-- Logs begin at Thu 2022-10-13 07:50:34 UTC, end at Thu 2022-10-13 10:24:36 UTC. -- Oct 13 08:23:18.665865 n-d-858384-11 systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 08:23:18.674441 n-d-858384-11 devstack@n-api.service[104572]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 08:23:18 2022] *** Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: nodename: n-d-858384-11 Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: machine: x86_64 Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: clock source: unix Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: pcre jit disabled Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: detected number of CPU cores: 4 Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: current working directory: / Oct 13 08:23:18.676412 n-d-858384-11 devstack@n-api.service[104572]: detected binary path: /usr/bin/uwsgi-core Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: your processes number limit is 47680 Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: your memory page size is 4096 bytes Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: detected max file descriptor number: 2048 Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: lock engine: pthread robust mutexes Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: thunder lock: enabled Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 08:23:18.677105 n-d-858384-11 devstack@n-api.service[104572]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 08:23:18.715915 n-d-858384-11 devstack@n-api.service[104572]: Python main interpreter initialized at 0x55900a24b9c0 Oct 13 08:23:18.715915 n-d-858384-11 devstack@n-api.service[104572]: python threads support enabled Oct 13 08:23:18.715915 n-d-858384-11 devstack@n-api.service[104572]: your server socket listen backlog is limited to 100 connections Oct 13 08:23:18.715915 n-d-858384-11 devstack@n-api.service[104572]: your mercy for graceful operations on workers is 90 seconds Oct 13 08:23:18.716325 n-d-858384-11 devstack@n-api.service[104572]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 08:23:18.716325 n-d-858384-11 devstack@n-api.service[104572]: *** Operational MODE: preforking *** Oct 13 08:23:18.716563 n-d-858384-11 devstack@n-api.service[104572]: *** uWSGI is running in multiple interpreter mode *** Oct 13 08:23:18.716563 n-d-858384-11 devstack@n-api.service[104572]: spawned uWSGI master process (pid: 104572) Oct 13 08:23:18.716734 n-d-858384-11 systemd[1]: Started Devstack devstack@n-api.service. Oct 13 08:23:18.717271 n-d-858384-11 devstack@n-api.service[104572]: spawned uWSGI worker 1 (pid: 104573, cores: 1) Oct 13 08:23:18.722452 n-d-858384-11 devstack@n-api.service[104572]: spawned uWSGI worker 2 (pid: 104574, cores: 1) Oct 13 08:23:18.722452 n-d-858384-11 devstack@n-api.service[104572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 08:23:19.374220 n-d-858384-11 devstack@n-api.service[104573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 08:23:19.376377 n-d-858384-11 devstack@n-api.service[104574]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 08:23:20.457432 n-d-858384-11 devstack@n-api.service[104573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:23:20.457432 n-d-858384-11 devstack@n-api.service[104573]: from cryptography.utils import int_from_bytes Oct 13 08:23:20.458036 n-d-858384-11 devstack@n-api.service[104574]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:23:20.458036 n-d-858384-11 devstack@n-api.service[104574]: from cryptography.utils import int_from_bytes Oct 13 08:23:20.458485 n-d-858384-11 devstack@n-api.service[104573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:23:20.458485 n-d-858384-11 devstack@n-api.service[104573]: from cryptography.utils import int_from_bytes Oct 13 08:23:20.458604 n-d-858384-11 devstack@n-api.service[104574]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:23:20.458604 n-d-858384-11 devstack@n-api.service[104574]: from cryptography.utils import int_from_bytes Oct 13 08:23:22.951833 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 08:23:22.952410 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 08:23:22.952581 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 08:23:22.952972 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 08:23:22.953067 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 08:23:22.953157 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 08:23:22.953157 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 08:23:22.953356 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 08:23:22.953537 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.953720 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 08:23:22.953874 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.953966 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 08:23:22.954163 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.954344 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.954482 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.954695 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.954813 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955015 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955110 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955334 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955428 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955661 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.955764 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.956486 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.956654 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.956802 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.956899 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957119 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957208 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957446 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957545 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-11 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957705 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.957814 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958024 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958112 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958347 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-11 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958464 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958690 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958778 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.958996 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959130 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959304 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959399 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959602 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959700 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.959906 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.960092 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.960228 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961242 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961383 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961383 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961575 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961676 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961757 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.961966 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962044 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962174 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962278 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962359 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962473 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962562 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962641 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962837 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.962933 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963152 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963239 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963458 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963609 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-11 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963802 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.963936 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964082 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964223 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964486 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-11 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964575 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964802 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.964887 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965112 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965199 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965421 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965514 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965775 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.965913 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966093 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966223 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966396 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966502 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966748 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.966836 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967063 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967160 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967367 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967462 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967678 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967765 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.967973 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968059 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968276 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968370 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968578 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968663 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968887 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.968973 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969188 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969287 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969486 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969579 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969733 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.969820 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970035 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970129 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970349 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970465 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970647 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970741 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.970957 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.971065 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.971229 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.971324 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.971553 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972197 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972342 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972522 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972659 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972775 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.972963 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973057 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973265 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973360 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973566 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973654 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973882 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.973987 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974166 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974253 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974489 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974580 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974792 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.974886 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975092 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975178 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975403 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975500 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975709 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.975797 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976015 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976102 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976317 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976402 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976629 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976717 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.976946 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977042 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977250 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977381 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977552 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977640 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.977979 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978189 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978276 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978518 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978608 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978833 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.978920 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979148 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979244 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979450 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979545 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979748 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.979845 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980047 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980143 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980359 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980452 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980660 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980745 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.980964 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981060 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981215 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981300 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981509 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981595 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981808 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.981907 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982118 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982204 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982469 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982561 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982732 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.982820 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983034 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983119 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983328 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983422 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983628 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983726 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.983942 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984038 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984223 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984310 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984524 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984617 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984823 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.984910 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985121 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985208 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985417 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985504 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985716 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.985813 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986012 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986145 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986308 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986420 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986633 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986727 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.986935 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987039 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987259 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987353 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987559 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987659 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987859 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.987955 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988159 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988247 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988464 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988558 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988762 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.988848 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989061 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989148 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989375 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989460 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989670 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989765 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.989966 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990053 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990276 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990363 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990597 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990700 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990895 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.990982 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991209 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991301 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991501 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991594 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991800 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.991889 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992110 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992197 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992405 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992504 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992699 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992793 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.992993 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993086 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993290 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993389 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993586 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993672 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993882 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.993975 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994174 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994261 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994491 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994580 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994786 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.994873 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995083 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995170 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995383 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995477 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995681 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995778 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.995979 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996066 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996277 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996363 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996588 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996673 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996891 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.996978 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.997191 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.997285 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.997505 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:23:22.997601 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.997836 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.997923 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998161 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998248 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998511 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998614 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998825 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.998911 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999131 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999218 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999439 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999539 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999759 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:22.999847 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000062 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000150 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000367 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000455 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000671 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000758 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.000980 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001065 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001289 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001385 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001598 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001700 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001906 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.001992 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.002213 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.002302 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.002544 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.002635 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.003388 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.003475 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.003702 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.003800 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004019 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004112 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004329 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004420 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004632 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004718 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.004956 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005053 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005274 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005369 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005583 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005671 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005896 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.005986 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006209 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006342 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006539 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006637 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006843 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.006938 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007146 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007242 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007479 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007566 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007784 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.007877 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008088 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008184 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008399 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008485 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008705 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.008799 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009020 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009116 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009326 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009412 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009628 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009717 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.009934 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010029 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010237 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010323 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010562 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010652 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010872 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.010959 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011179 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011266 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011485 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011572 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011799 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.011887 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012105 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012191 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012414 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012507 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012720 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.012808 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013024 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013123 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013328 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013415 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013626 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013715 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.013924 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014011 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014222 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014322 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014545 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014645 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014842 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.014973 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015144 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015242 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015451 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015538 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015751 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.015836 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016066 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016165 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016366 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016453 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016668 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016763 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.016971 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017067 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017275 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017362 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017574 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017660 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017881 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.017967 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018185 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018271 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018553 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018645 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018863 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.018951 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019166 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019253 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019466 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019559 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019781 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.019870 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020081 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020168 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020382 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020469 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020687 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020774 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.020991 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021089 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021295 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021394 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021606 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021700 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.021909 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022005 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022217 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022312 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022548 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022639 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022853 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.022939 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023171 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023274 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023480 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023612 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023846 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.023965 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024096 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024222 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024416 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024533 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024716 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.024833 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025018 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025128 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025300 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025423 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025596 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025712 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.025895 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026010 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026191 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026305 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026513 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026630 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026810 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.026925 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027106 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027221 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027401 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027524 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027695 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027810 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.027992 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028106 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028290 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028413 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028594 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028708 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028890 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.028981 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029190 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029286 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029484 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029572 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029784 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.029869 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030088 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030184 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030391 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030504 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030751 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.030841 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031055 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031151 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031369 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031462 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031683 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031769 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.031991 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032080 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032297 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032385 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032603 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032690 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032909 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.032996 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.033215 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.033303 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.033524 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.033609 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.033827 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.034399 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.034684 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.034774 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035001 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035087 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035312 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035400 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035615 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035712 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.035929 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036016 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036226 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036322 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036533 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036632 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036850 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.036945 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037154 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037248 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037466 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037553 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037781 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.037876 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038087 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038177 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038393 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038546 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038719 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.038806 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039029 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039106 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039334 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039410 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039641 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039725 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.039948 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040031 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040251 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040333 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040557 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040633 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040855 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.040930 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041168 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041242 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041468 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041544 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041777 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.041851 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.042080 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.042154 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.042385 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.042480 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043058 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043130 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043130 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043258 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043325 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043390 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043621 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043698 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.043935 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044020 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044242 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044331 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044544 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044690 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044847 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.044937 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045145 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045232 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045447 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045542 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045752 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.045841 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046053 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046139 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046356 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046483 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046684 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046778 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.046983 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047071 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047288 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047387 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047588 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047676 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047886 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.047974 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048183 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048279 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048489 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048575 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048792 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.048889 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.049095 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.049189 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.049401 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.049487 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050264 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050370 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050590 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050693 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050891 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.050986 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051206 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051293 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051509 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051610 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051806 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.051900 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052111 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052198 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052409 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052497 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052709 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.052835 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053013 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053104 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053316 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053413 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053623 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053709 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.053935 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054028 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054238 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054334 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054579 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054669 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.054973 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055186 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055274 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055497 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055597 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055802 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.055898 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056103 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056189 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056408 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056502 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056712 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.056809 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057017 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057104 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057320 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057472 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057630 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057725 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.057929 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058025 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058234 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058321 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058562 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058668 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058863 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.058951 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.059167 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.059253 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.059477 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.059564 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.059782 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060038 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060135 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060364 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060459 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060675 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.060941 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061028 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061276 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061363 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061595 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061696 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.061916 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062004 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062238 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062325 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062581 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062681 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.062883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063007 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063187 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063274 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063486 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063572 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063786 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.063874 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064088 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064180 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064386 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064474 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064684 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064773 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.064980 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065070 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065306 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065396 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065604 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065693 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065899 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.065985 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066194 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066295 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066512 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066605 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066818 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.066907 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067116 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067211 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067421 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067508 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067719 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.067805 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068026 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068125 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068325 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068412 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068621 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068707 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.068918 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069014 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069215 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069310 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069529 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069614 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069832 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.069920 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070135 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070222 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070496 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070597 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070803 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.070891 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071120 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071205 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071418 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071518 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071736 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.071831 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072040 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072127 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072339 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072425 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072636 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072724 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.072936 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073070 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073238 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073337 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073534 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073622 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073839 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.073924 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074140 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074273 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074461 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074563 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074766 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.074853 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.075315 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.075415 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.075617 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.075716 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.075916 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076003 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076218 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076318 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076518 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076613 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076814 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.076909 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077111 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077200 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077415 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077503 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077717 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.077804 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078013 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078102 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078313 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078417 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078632 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078719 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.078940 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079028 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079237 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079323 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079535 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079621 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079831 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.079920 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080131 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080218 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080432 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080527 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080727 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.080834 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081059 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081145 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081361 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081456 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081658 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081745 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.081958 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082045 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082257 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082353 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082578 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082668 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082875 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.082962 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083175 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083290 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083475 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083561 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083777 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.083866 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084074 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084162 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084376 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084463 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084676 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084762 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.084974 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085063 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085271 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085364 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085571 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085657 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085866 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.085953 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086162 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086262 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086479 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086570 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086779 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.086874 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087076 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087166 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087376 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087472 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087679 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087768 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.087973 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088065 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088272 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088369 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088568 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088662 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088877 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.088964 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089184 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089279 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089487 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089574 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089819 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.089905 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090122 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090217 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090447 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090536 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090754 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.090840 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091062 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091151 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091368 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091455 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091665 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091751 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.091977 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092073 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092282 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092376 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092586 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092673 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.092971 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093179 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093286 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093493 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093592 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093794 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.093882 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094093 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094187 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094432 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094530 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094742 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.094832 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095057 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095152 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095356 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095500 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095658 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095747 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.095961 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.096048 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.096261 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.096357 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097096 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097186 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097400 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097486 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097705 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.097800 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098008 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098095 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098312 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098398 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098640 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098740 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.098943 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099038 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099242 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099330 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099546 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099635 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099847 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.099936 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100145 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100234 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100453 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100558 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100753 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.100840 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101049 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101138 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101347 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101436 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101642 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101729 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.101945 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102043 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102243 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102339 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102565 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102687 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102877 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.102994 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.103182 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.103300 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.103598 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.103696 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.103900 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104001 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104204 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104302 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104504 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104604 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104807 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.104903 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105104 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105191 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105413 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105538 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105726 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.105822 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106026 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106114 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106383 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106529 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106691 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106784 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.106989 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107076 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107291 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107378 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107607 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107695 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107902 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.107989 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108200 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108288 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108497 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108592 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108809 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.108895 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109104 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109198 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109412 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109498 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109729 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.109817 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110031 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110130 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110350 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110488 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110785 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.110883 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111095 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111196 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111396 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111483 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111712 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.111799 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112038 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112161 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112390 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112488 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112690 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112778 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.112998 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113085 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113301 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113397 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113623 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113752 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.113941 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114050 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114247 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114344 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114578 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114667 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114879 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.114976 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115194 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115292 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115510 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115638 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115813 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.115899 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116125 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116214 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116445 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116531 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116757 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.116845 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117077 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117167 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117430 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117517 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117749 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.117843 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118049 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118137 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118346 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118452 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118742 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.118843 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119040 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119126 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119340 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119427 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119649 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119744 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.119947 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120034 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120251 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120345 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120555 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120655 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120857 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.120945 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121154 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121241 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121450 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121550 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121754 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.121848 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122049 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122135 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122349 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122462 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122686 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122772 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.122987 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123073 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123298 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123392 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123596 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123699 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.123912 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124012 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124212 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124300 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124508 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124595 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124807 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.124894 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125102 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125191 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125409 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125495 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125713 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.125809 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126014 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126110 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126334 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126439 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126671 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126775 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.126987 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.127074 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.127313 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.127401 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.127628 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.128247 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.128458 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.128545 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.128761 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.128848 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129072 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129161 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129388 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129475 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129686 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129785 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.129982 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130071 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130284 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130370 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130606 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130695 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130906 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.130996 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131204 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131291 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131504 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131591 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131798 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.131885 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132094 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132181 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132391 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132478 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132688 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132784 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.132991 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133079 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133294 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133390 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133594 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133727 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.133907 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134040 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134188 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134285 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134514 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134607 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134817 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.134914 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135121 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135218 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135423 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135511 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135737 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.135868 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136051 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136139 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136359 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136445 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136667 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136754 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.136977 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137066 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137286 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137384 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137595 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137693 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137907 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.137994 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138217 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138311 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138543 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138645 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138858 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.138953 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139169 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139256 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139477 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139563 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139801 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.139990 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.140119 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.140313 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.140436 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.140622 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.140930 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141017 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141238 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141332 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141548 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141643 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141857 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.141945 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142163 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142251 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142491 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142595 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142800 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.142889 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143108 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143195 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143500 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143596 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143815 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.143903 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144128 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144216 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144456 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144545 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144766 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.144852 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145077 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145165 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145388 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145484 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145701 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.145796 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146014 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146177 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146331 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146446 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146666 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146781 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.146975 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147074 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147284 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147378 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147593 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147680 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147902 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.147991 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148209 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148296 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148521 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148607 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148827 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.148922 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149132 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149220 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149437 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149532 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149745 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.149873 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150053 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150142 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150360 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150471 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150695 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.150790 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151009 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151097 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151314 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151409 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151622 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151709 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.151930 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152017 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152251 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152442 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152568 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152751 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.152882 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.153084 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.153399 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.153496 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.153714 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.153802 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154023 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154116 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154336 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154531 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154683 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154771 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.154984 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155071 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155284 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155380 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155590 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155684 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155893 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.155980 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156191 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156280 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156497 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156583 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156801 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.156896 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157100 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157197 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157413 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157555 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157715 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.157817 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.158016 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.158240 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.158328 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.158615 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.158716 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.159441 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.159689 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.159779 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160039 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160126 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160367 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160456 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160667 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160754 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.160985 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161072 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161287 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161376 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161588 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161676 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161898 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.161997 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162203 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162292 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162525 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162617 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162825 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.162912 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163129 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163219 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163432 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163522 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163728 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.163824 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164045 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164136 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164328 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164435 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164627 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164723 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.164930 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165017 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165228 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165314 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165525 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165625 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165830 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.165926 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166129 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166216 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166439 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166543 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166740 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.166829 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167038 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167126 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167340 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167435 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167636 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167724 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.167937 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168032 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168233 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168320 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168536 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168623 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168841 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.168927 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169146 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169236 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169451 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169538 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169766 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.169853 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170065 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170161 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170361 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170506 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170696 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170784 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.170998 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171087 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171299 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171393 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171603 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171698 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171908 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.171994 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.172227 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.172316 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.172534 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.172633 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.172842 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.173058 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.173183 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.173404 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.173491 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.173723 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174011 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174139 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174433 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174560 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174735 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.174825 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175040 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175136 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175341 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175438 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175658 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175749 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.175962 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176049 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176270 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176357 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176573 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176661 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176877 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.176968 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177180 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177277 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177484 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177581 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177787 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.177879 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178088 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178185 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178391 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178498 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178714 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.178801 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179015 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179116 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179316 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179406 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179618 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179705 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.179919 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180015 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180225 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180311 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180535 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180623 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180844 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.180933 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181156 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181243 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181464 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181552 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181775 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.181873 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182078 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182166 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182381 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182516 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182708 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.182798 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183013 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183102 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183319 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183414 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183629 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183718 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.183934 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184020 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184232 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184333 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184561 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184869 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.184957 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.185173 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.185261 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.185500 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.185822 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.185910 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186130 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186225 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186476 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186568 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186797 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.186885 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187107 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187197 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187423 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187511 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187727 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.187814 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188047 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188133 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188368 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188466 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188679 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188768 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.188995 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189090 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189297 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189392 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189597 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189692 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189895 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.189992 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.190748 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.190848 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191065 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191154 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191371 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191471 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191671 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191759 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.191971 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192060 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192275 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192373 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192575 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192662 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192873 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.192960 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193173 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193262 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193470 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193558 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193772 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.193865 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194075 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194163 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194374 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194528 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194736 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194825 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.194984 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195074 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195281 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195372 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195580 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195676 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195880 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.195968 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196176 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196264 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196475 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196571 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196771 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.196868 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197069 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197165 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197365 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197462 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197664 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197752 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.197967 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198054 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198267 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198364 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198618 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198708 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.198934 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.199021 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.199249 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.199345 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.199554 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.199641 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200125 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200219 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200451 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200539 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200763 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.200889 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201069 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201157 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201395 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201484 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201699 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.201786 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202052 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202146 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202314 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202480 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202644 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202733 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.202950 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203051 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203255 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203343 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203563 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203650 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203874 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.203972 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204177 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204309 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204496 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204585 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204811 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.204985 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205113 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205201 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205422 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205516 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205731 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.205875 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206096 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206184 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206422 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206523 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206731 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.206821 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207036 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207131 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207344 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207432 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207653 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207748 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.207961 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208049 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208267 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208354 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208575 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208663 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208886 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.208973 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209196 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209295 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209507 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209597 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209822 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.209912 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210126 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210222 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210466 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210558 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210790 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.210878 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211098 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211198 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211423 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211520 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211746 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.211834 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212066 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212155 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212376 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212464 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212684 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212779 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.212983 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.213081 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.213221 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 08:23:23.213310 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.213624 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.213926 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:23:23.214169 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 08:23:23.366241 n-d-858384-11 devstack@n-api.service[104573]: INFO dbcounter [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Registered counter for database nova_api Oct 13 08:23:23.367614 n-d-858384-11 devstack@n-api.service[104574]: INFO dbcounter [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Registered counter for database nova_api Oct 13 08:23:23.388598 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.390378 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.395981 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.397651 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.452465 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.context [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=104573) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 08:23:23.454173 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.context [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=104574) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 08:23:23.456811 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:23:23.457281 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:23:23.458572 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:23:23.458856 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:23:23.459048 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:23:23.459585 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:23:23.460030 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:23:23.460631 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:23:23.461368 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:23:23.461901 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:23:23.462040 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_concurrency.lockutils [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:23:23.463931 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:23:23.464036 n-d-858384-11 devstack@n-api.service[104573]: INFO dbcounter [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Registered counter for database nova_cell0 Oct 13 08:23:23.465949 n-d-858384-11 devstack@n-api.service[104574]: INFO dbcounter [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Registered counter for database nova_cell0 Oct 13 08:23:23.467997 n-d-858384-11 devstack@n-api.service[104573]: INFO dbcounter [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Registered counter for database nova_cell1 Oct 13 08:23:23.470061 n-d-858384-11 devstack@n-api.service[104574]: INFO dbcounter [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Registered counter for database nova_cell1 Oct 13 08:23:23.476520 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.478885 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.481496 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.482635 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.486681 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.488963 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.489080 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.491283 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.633961 n-d-858384-11 devstack@n-api.service[104573]: INFO dbcounter [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Registered counter for database nova_cell0 Oct 13 08:23:23.639271 n-d-858384-11 devstack@n-api.service[104574]: INFO dbcounter [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Registered counter for database nova_cell0 Oct 13 08:23:23.640963 n-d-858384-11 devstack@n-api.service[104573]: DEBUG oslo_db.sqlalchemy.engines [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.646203 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writer thread running {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.648318 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_db.sqlalchemy.engines [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:23:23.652943 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writer thread running {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:23:23.986834 n-d-858384-11 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:23:23.988479 n-d-858384-11 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:23:23.994200 n-d-858384-11 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:23:23.995861 n-d-858384-11 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:23:24.337233 n-d-858384-11 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:23:24.339850 n-d-858384-11 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:23:24.343245 n-d-858384-11 devstack@n-api.service[104573]: WARNING keystonemiddleware.auth_token [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:23:24.345824 n-d-858384-11 devstack@n-api.service[104574]: WARNING keystonemiddleware.auth_token [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:23:24.348620 n-d-858384-11 devstack@n-api.service[104573]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55900a24b9c0 pid: 104573 (default app) Oct 13 08:23:24.350720 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:23:24.351402 n-d-858384-11 devstack@n-api.service[104574]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55900a24b9c0 pid: 104574 (default app) Oct 13 08:23:24.351915 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-62616c87-f05d-4633-952c-abde2e48b54e None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Oct 13 08:23:24.352311 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Oct 13 08:23:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:45.278049 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:45.279329 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Oct 13 08:24:45.279741 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:45.290895 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:45.292029 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell0:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:45.292880 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell1:SELECT=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:45.295160 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:46.165773 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-86913d72-b53c-4ba8-b353-bb86ad607e99 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:46.198675 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-86913d72-b53c-4ba8-b353-bb86ad607e99 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912779 Oct 13 08:24:46.199492 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:24:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:24:48.793724 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:48.794787 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-1cb18456-bcdc-474c-a481-87e80cb4550e None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 13 08:24:48.795364 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:49.250926 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ccfc7506-d4ed-4623-96b1-74bd769c9f23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "ram": 256}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:49.298925 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-ccfc7506-d4ed-4623-96b1-74bd769c9f23 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496970 Oct 13 08:24:49.299673 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:24:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:24:49.312964 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:49.313754 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell1:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:49.316797 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell0:SELECT=3 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:49.317527 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:24:49.521428 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-604e67a5-7169-4de2-9d6b-aa625ec656f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:49.588221 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-604e67a5-7169-4de2-9d6b-aa625ec656f3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280405 Oct 13 08:24:49.589021 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 08:24:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:24:52.212650 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ccfc7506-d4ed-4623-96b1-74bd769c9f23 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:52.213661 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-ccfc7506-d4ed-4623-96b1-74bd769c9f23 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 13 08:24:52.214061 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:52.975657 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-8713e949-e75d-484c-a2fd-0d4d3cc1017f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:53.036272 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-8713e949-e75d-484c-a2fd-0d4d3cc1017f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.815463 Oct 13 08:24:53.037447 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:24:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:24:53.053015 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-917546d6-e1a5-46d1-badf-65297bea055d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:53.114924 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-917546d6-e1a5-46d1-badf-65297bea055d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067220 Oct 13 08:24:53.116208 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 08:24:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:24:55.999957 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-8713e949-e75d-484c-a2fd-0d4d3cc1017f admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:56.001023 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-8713e949-e75d-484c-a2fd-0d4d3cc1017f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Oct 13 08:24:56.001580 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:56.589739 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-e86df7a8-aaba-4cbe-af08-ee9702412c48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:56.611609 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-e86df7a8-aaba-4cbe-af08-ee9702412c48 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.603574 Oct 13 08:24:56.612595 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:24:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:24:56.624772 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-a8a0cea5-f442-4db4-b439-2f08456909cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:56.655134 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-a8a0cea5-f442-4db4-b439-2f08456909cf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033816 Oct 13 08:24:56.658893 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 08:24:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:24:59.251600 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-e86df7a8-aaba-4cbe-af08-ee9702412c48 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:24:59.252625 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-e86df7a8-aaba-4cbe-af08-ee9702412c48 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 13 08:24:59.253032 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:24:59.710057 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-1d566d25-2e9d-4fbf-af6e-26cc79eb3fc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:59.732988 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-1d566d25-2e9d-4fbf-af6e-26cc79eb3fc6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473909 Oct 13 08:24:59.733839 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:24:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:24:59.745887 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6bbd55cf-3f29-4504-b072-7e3c0f58c5e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:24:59.779796 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6bbd55cf-3f29-4504-b072-7e3c0f58c5e8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037497 Oct 13 08:24:59.780452 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 08:24:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:25:02.498068 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-1d566d25-2e9d-4fbf-af6e-26cc79eb3fc6 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:02.499045 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-1d566d25-2e9d-4fbf-af6e-26cc79eb3fc6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 13 08:25:02.500176 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:02.937355 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "disk": 20}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:02.962646 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455026 Oct 13 08:25:02.966454 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:02.976403 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-72dd3605-d128-47d8-aecd-30ecc41da486 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:03.010548 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-72dd3605-d128-47d8-aecd-30ecc41da486 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038242 Oct 13 08:25:03.011136 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Thu Oct 13 08:25:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:25:05.650814 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:05.653213 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 13 08:25:05.653213 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:06.094703 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-61439af6-0a6d-407e-ad5d-21280f075e46 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:06.119820 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-61439af6-0a6d-407e-ad5d-21280f075e46 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459924 Oct 13 08:25:06.120402 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:25:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:09.046028 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:09.047152 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-92fd403c-47e0-408f-9a68-ce29bcf06f89 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Oct 13 08:25:09.047589 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:09.486633 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-4c81e392-17b3-4a1e-9b2f-00c23cc0ce60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "1", "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:09.511299 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-4c81e392-17b3-4a1e-9b2f-00c23cc0ce60 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457380 Oct 13 08:25:09.511964 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:25:09.524528 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-457df24b-b5c3-4a0a-b7eb-e907ba3805ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:09.553172 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-457df24b-b5c3-4a0a-b7eb-e907ba3805ad admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032066 Oct 13 08:25:09.553906 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 08:25:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:25:12.214694 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-4c81e392-17b3-4a1e-9b2f-00c23cc0ce60 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:12.215705 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-4c81e392-17b3-4a1e-9b2f-00c23cc0ce60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 13 08:25:12.216110 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:12.612373 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a9bd90aa-6235-4c7f-9b94-54d1e95b271c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "disk": 20}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:12.631298 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-a9bd90aa-6235-4c7f-9b94-54d1e95b271c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408514 Oct 13 08:25:12.631786 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:12.644206 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c0a11689-a2b5-410f-ada1-368e3a27e8bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:12.667606 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c0a11689-a2b5-410f-ada1-368e3a27e8bb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027514 Oct 13 08:25:12.668174 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 08:25:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:25:15.256665 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a9bd90aa-6235-4c7f-9b94-54d1e95b271c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:15.257678 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-a9bd90aa-6235-4c7f-9b94-54d1e95b271c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Oct 13 08:25:15.258092 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:15.669363 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-33a46b78-e3c1-4409-b053-ef63b82ed5b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "vcpus": 2, "swap": 0, "disk": 40, "rxtx_factor": 1.0}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:15.689177 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-33a46b78-e3c1-4409-b053-ef63b82ed5b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.424816 Oct 13 08:25:15.689725 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:15.702013 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6d058c0c-9d1f-43ac-8184-04fccfff7ed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:15.707441 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:25:15.732264 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6d058c0c-9d1f-43ac-8184-04fccfff7ed1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034132 Oct 13 08:25:15.732850 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 08:25:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:25:18.391509 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-33a46b78-e3c1-4409-b053-ef63b82ed5b4 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:18.392426 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-33a46b78-e3c1-4409-b053-ef63b82ed5b4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Oct 13 08:25:18.392834 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:18.818746 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c133155e-72a9-42eb-8c7b-a7aef0b2ceb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:18.843745 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c133155e-72a9-42eb-8c7b-a7aef0b2ceb1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444844 Oct 13 08:25:18.844606 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:18.856986 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-3bd35723-d5fb-46ac-9f57-3a7357790e8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:18.882851 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-3bd35723-d5fb-46ac-9f57-3a7357790e8f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029779 Oct 13 08:25:18.883862 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 08:25:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:25:21.516925 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-c133155e-72a9-42eb-8c7b-a7aef0b2ceb1 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:21.518041 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-c133155e-72a9-42eb-8c7b-a7aef0b2ceb1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 13 08:25:21.518857 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:21.960416 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "id": "5"}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:21.967911 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:25:21.984221 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459388 Oct 13 08:25:21.986446 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Thu Oct 13 08:25:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:21.996824 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-48b925d6-8468-4bdd-91d8-54f4f7b91100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:22.021869 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-48b925d6-8468-4bdd-91d8-54f4f7b91100 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028676 Oct 13 08:25:22.022466 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Thu Oct 13 08:25:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:25:43.139043 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:43.140634 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Oct 13 08:25:43.141041 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:43.151555 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:25:43.521996 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-394905df-aab3-4ea7-b202-ca53c4dfeecb admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:43.540333 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-394905df-aab3-4ea7-b202-ca53c4dfeecb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393271 Oct 13 08:25:43.540871 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:25:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:44.827983 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:44.829037 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-7a6fa7a7-366f-4b55-8c84-3c6bc531b0fe admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 13 08:25:44.829429 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:45.347094 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ec69a853-2f61-469a-bafb-ccaf50489cdb admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:45.352343 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-ec69a853-2f61-469a-bafb-ccaf50489cdb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ec69a853-2f61-469a-bafb-ccaf50489cdb admin admin] Request method failure captured: Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Accept: application/json Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Connection: keep-alive Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Content-Length: 0 Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Host: 10.222.0.23 Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjR8uIS0wm-ekoMuAtzQEeHKRtiTam9Z3b8IEnlgN5nx-1SFxWY6HaxuiS9zuFCGZoxHc0KiMonKI84aiY1E5EImpog9QNa4UVcHsUFoVFZbhW27iIMqG987BiedPqCEaShAisHD3l2TGNQQiRQcnlVWv6Qf_P-RzJa9XUKvtoo_txgBQ Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Id: None Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Name: None Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Name: admin Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Role: member,admin,reader Oct 13 08:25:45.355628 n-d-858384-11 devstack@n-api.service[104573]: X-Roles: member,admin,reader Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant: admin Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-User: admin Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: X-User-Name: admin Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: method: > Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: exception: Flavor 42 could not be found. Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: action_args: {'id': '42'} Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:45.357301 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:45.359090 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.360493 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-ec69a853-2f61-469a-bafb-ccaf50489cdb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:45.361853 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-ec69a853-2f61-469a-bafb-ccaf50489cdb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387437 Oct 13 08:25:45.361853 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:25:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 13 08:25:45.366822 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-51ac2c61-b22c-4be2-8e86-3a018ceb216d admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:45.390913 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-51ac2c61-b22c-4be2-8e86-3a018ceb216d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027532 Oct 13 08:25:45.391456 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:45.415623 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6d95072b-439e-4838-8d7f-24ed8548b62d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:45.438025 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6d95072b-439e-4838-8d7f-24ed8548b62d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026860 Oct 13 08:25:45.438612 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:45.448314 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-649b8a07-0f52-48aa-a9aa-68869628fe2d admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:45.454340 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-649b8a07-0f52-48aa-a9aa-68869628fe2d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-649b8a07-0f52-48aa-a9aa-68869628fe2d admin admin] Request method failure captured: Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Accept: application/json Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Connection: keep-alive Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Content-Length: 0 Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Host: 10.222.0.23 Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjR8uIS0wm-ekoMuAtzQEeHKRtiTam9Z3b8IEnlgN5nx-1SFxWY6HaxuiS9zuFCGZoxHc0KiMonKI84aiY1E5EImpog9QNa4UVcHsUFoVFZbhW27iIMqG987BiedPqCEaShAisHD3l2TGNQQiRQcnlVWv6Qf_P-RzJa9XUKvtoo_txgBQ Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Id: None Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Name: None Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Name: admin Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Role: member,admin,reader Oct 13 08:25:45.457609 n-d-858384-11 devstack@n-api.service[104574]: X-Roles: member,admin,reader Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant: admin Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-User: admin Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: X-User-Name: admin Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: method: > Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: exception: Flavor 42 could not be found. Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: action_args: {'id': '42'} Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:45.459171 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:45.461408 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:45.462858 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-649b8a07-0f52-48aa-a9aa-68869628fe2d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:45.464044 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-649b8a07-0f52-48aa-a9aa-68869628fe2d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014496 Oct 13 08:25:45.464044 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:25:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 13 08:25:46.658526 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-6d95072b-439e-4838-8d7f-24ed8548b62d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:46.659577 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-6d95072b-439e-4838-8d7f-24ed8548b62d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 13 08:25:46.659999 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:47.172833 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-cd88fd9e-3301-486f-853c-837d44315fd3 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:47.177776 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-cd88fd9e-3301-486f-853c-837d44315fd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-cd88fd9e-3301-486f-853c-837d44315fd3 admin admin] Request method failure captured: Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Accept: application/json Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Connection: keep-alive Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Content-Length: 0 Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Host: 10.222.0.23 Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjR8uKCk-RpM27UPq76riIP_hzb5RjKU0sK40FKvRktVa4BBV3ODk2vg6gs9YZ_xc5ptq9CiX-9a_OrSlZydKyqObVoVYwH0Qr-BH2GrIjBgI9mD2qVDMcpBDkhKPD56ThxuwWllANfsOiFZi0eTqSrDkK5jHA071y39_xEvvqvoELWOs Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Id: None Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Name: None Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Name: admin Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Role: member,admin,reader Oct 13 08:25:47.179323 n-d-858384-11 devstack@n-api.service[104574]: X-Roles: member,admin,reader Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant: admin Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-User: admin Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: X-User-Name: admin Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: method: > Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: exception: Flavor 84 could not be found. Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: action_args: {'id': '84'} Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:47.180766 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:47.181679 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.183151 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-cd88fd9e-3301-486f-853c-837d44315fd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:47.184488 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-cd88fd9e-3301-486f-853c-837d44315fd3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.381498 Oct 13 08:25:47.184488 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:25:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:25:47.190494 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-a83b1112-432b-4eaa-87e2-f93392185d40 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:47.205735 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-a83b1112-432b-4eaa-87e2-f93392185d40 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018801 Oct 13 08:25:47.206248 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:25:47.215727 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-d7c78540-1d7f-4d45-bace-7b93b81bade0 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:47.230911 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-d7c78540-1d7f-4d45-bace-7b93b81bade0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018799 Oct 13 08:25:47.231449 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:25:47.240789 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-87489c72-2d17-45ac-87af-02a2c770d47d admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:47.245624 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-87489c72-2d17-45ac-87af-02a2c770d47d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-87489c72-2d17-45ac-87af-02a2c770d47d admin admin] Request method failure captured: Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Accept: application/json Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Connection: keep-alive Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Content-Length: 0 Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Host: 10.222.0.23 Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjR8uKCk-RpM27UPq76riIP_hzb5RjKU0sK40FKvRktVa4BBV3ODk2vg6gs9YZ_xc5ptq9CiX-9a_OrSlZydKyqObVoVYwH0Qr-BH2GrIjBgI9mD2qVDMcpBDkhKPD56ThxuwWllANfsOiFZi0eTqSrDkK5jHA071y39_xEvvqvoELWOs Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Id: None Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Name: None Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Name: admin Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Role: member,admin,reader Oct 13 08:25:47.247148 n-d-858384-11 devstack@n-api.service[104573]: X-Roles: member,admin,reader Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant: admin Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-User: admin Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: X-User-Name: admin Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: method: > Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: exception: Flavor 84 could not be found. Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: action_args: {'id': '84'} Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:47.249222 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:47.250012 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:47.251130 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-87489c72-2d17-45ac-87af-02a2c770d47d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:47.252155 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-87489c72-2d17-45ac-87af-02a2c770d47d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011107 Oct 13 08:25:47.252155 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:25:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:25:48.461428 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-d7c78540-1d7f-4d45-bace-7b93b81bade0 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:48.462449 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-d7c78540-1d7f-4d45-bace-7b93b81bade0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 13 08:25:48.462879 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:48.977050 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b5710168-674e-4e2a-b1e0-bad5b5858759 admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:48.983470 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.wsgi [None req-b5710168-674e-4e2a-b1e0-bad5b5858759 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b5710168-674e-4e2a-b1e0-bad5b5858759 admin admin] Request method failure captured: Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Accept: application/json Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Accept-Encoding: gzip, deflate Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Connection: keep-alive Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Content-Length: 0 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Host: 10.222.0.23 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: Openstack-System-Scope: None Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: User-Agent: python-novaclient Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Auth-Token: gAAAAABjR8uM8Qqc4UXIacE_60GP_0BSyCbzcLpv5Fr3BzZXfLKH4n2tb0Y9shvs0JpRAbikFJOaoKKHw1jxYL6t12vFJ3h2NtQXRe8D-wIdzErEDle5XcgIIps_ivaEhiu5vGimkfOwzsQelQygGoQK4AnYMaPoFaoM4OW-pQeL7bcicYp7p18 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Id: None Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Domain-Name: None Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Identity-Status: Confirmed Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Is-Admin-Project: True Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Id: default Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Domain-Name: Default Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Project-Name: admin Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Role: member,admin,reader Oct 13 08:25:48.984963 n-d-858384-11 devstack@n-api.service[104573]: X-Roles: member,admin,reader Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant: admin Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-Tenant-Name: admin Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-User: admin Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Id: default Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-User-Domain-Name: Default Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: X-User-Name: admin Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: method: > Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: exception: Flavor 451 could not be found. Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: action_args: {'id': '451'} Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:48.986513 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:48.987459 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: ERROR nova.api.openstack.wsgi Oct 13 08:25:48.988780 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-b5710168-674e-4e2a-b1e0-bad5b5858759 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:48.990001 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-b5710168-674e-4e2a-b1e0-bad5b5858759 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389151 Oct 13 08:25:48.990001 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:25:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:25:48.996198 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-53e6f9a6-9be0-4ca5-9c63-952a7cc0f234 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:49.011005 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-53e6f9a6-9be0-4ca5-9c63-952a7cc0f234 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018420 Oct 13 08:25:49.011532 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:49.020518 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:49.035735 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018588 Oct 13 08:25:49.036280 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Oct 13 08:25:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:25:49.046531 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-eb927a37-7cd6-4def-a317-c6a5dfe3c67b admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:49.051550 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.wsgi [None req-eb927a37-7cd6-4def-a317-c6a5dfe3c67b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-eb927a37-7cd6-4def-a317-c6a5dfe3c67b admin admin] Request method failure captured: Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Accept: application/json Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Accept-Encoding: gzip, deflate Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Connection: keep-alive Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Content-Length: 0 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Host: 10.222.0.23 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Openstack-Api-Version: compute 2.92 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: Openstack-System-Scope: None Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: User-Agent: python-novaclient Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Auth-Token: gAAAAABjR8uM8Qqc4UXIacE_60GP_0BSyCbzcLpv5Fr3BzZXfLKH4n2tb0Y9shvs0JpRAbikFJOaoKKHw1jxYL6t12vFJ3h2NtQXRe8D-wIdzErEDle5XcgIIps_ivaEhiu5vGimkfOwzsQelQygGoQK4AnYMaPoFaoM4OW-pQeL7bcicYp7p18 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Id: None Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Domain-Name: None Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Identity-Status: Confirmed Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Is-Admin-Project: True Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Openstack-Nova-Api-Version: 2.92 Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Id: default Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Domain-Name: Default Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Project-Name: admin Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Role: member,admin,reader Oct 13 08:25:49.053046 n-d-858384-11 devstack@n-api.service[104574]: X-Roles: member,admin,reader Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96a25f93a2f14229bf29384020d610fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96a25f93a2f14229bf29384020d610fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant: admin Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Id: 96a25f93a2f14229bf29384020d610fd Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-Tenant-Name: admin Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-User: admin Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Id: default Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-User-Domain-Name: Default Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-User-Id: 72aa736f967b4cf78b0a3c71a774e886 Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: X-User-Name: admin Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: method: > Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: exception: Flavor 451 could not be found. Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: action_args: {'id': '451'} Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:25:49.054629 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:49.055556 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: ERROR nova.api.openstack.wsgi Oct 13 08:25:49.056667 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-eb927a37-7cd6-4def-a317-c6a5dfe3c67b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:25:49.057665 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-eb927a37-7cd6-4def-a317-c6a5dfe3c67b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012177 Oct 13 08:25:49.057665 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:25:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:25:50.282830 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:50.283834 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 13 08:25:50.284224 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:50.795311 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-a7b457bc-2c5e-4cab-8e4b-2639b212b9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:50.814111 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-a7b457bc-2c5e-4cab-8e4b-2639b212b9f1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.393676 Oct 13 08:25:50.814685 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 08:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:25:52.023076 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:52.024082 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 13 08:25:52.024476 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:52.536366 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-ed9030f6-fd3b-4229-8aed-8cc753529d74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:52.554822 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-ed9030f6-fd3b-4229-8aed-8cc753529d74 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.394113 Oct 13 08:25:52.555363 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 08:25:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:25:53.760904 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:53.761916 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 13 08:25:53.762313 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:54.276695 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-1eea1bb4-183b-4fc8-ad25-123f1b95f3a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:54.295349 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-1eea1bb4-183b-4fc8-ad25-123f1b95f3a5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395524 Oct 13 08:25:54.295901 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 08:25:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:55.501573 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:55.502610 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 13 08:25:55.503005 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:56.019309 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-f156033b-0f25-4940-b5d6-4f1989bf8f8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:25:56.037340 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-f156033b-0f25-4940-b5d6-4f1989bf8f8a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398492 Oct 13 08:25:56.037889 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Oct 13 08:25:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:25:57.243945 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:57.244947 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 13 08:25:57.245337 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:25:57.756133 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-b02a9d04-4dc7-4890-89b8-c0f91d2f292f admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:25:57.776189 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-b02a9d04-4dc7-4890-89b8-c0f91d2f292f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396209 Oct 13 08:25:57.776728 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Oct 13 08:25:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:26:53.644139 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:53.645066 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-3908a494-ff12-4adb-8d54-3cf342ce644c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 13 08:26:53.645497 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Thu Oct 13 08:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:26:53.656107 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:26:54.034797 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-d01b2ac6-e04e-4cd5-8310-9c1e01a72457 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:54.055477 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-d01b2ac6-e04e-4cd5-8310-9c1e01a72457 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403901 Oct 13 08:26:54.056010 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:26:54.077537 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=14 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:26:54.081363 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-84cd7e5b-4f78-4999-93c0-26986ba4981f admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:54.088763 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-84cd7e5b-4f78-4999-93c0-26986ba4981f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013017 Oct 13 08:26:54.089287 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 13 08:26:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:26:54.100826 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-f93c0f48-b4e8-4809-b78c-aad59a0a7af2 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:54.108506 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-f93c0f48-b4e8-4809-b78c-aad59a0a7af2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011202 Oct 13 08:26:54.109011 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 13 08:26:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:26:54.119885 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:54.127491 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011015 Oct 13 08:26:54.128009 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Thu Oct 13 08:26:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:26:54.138768 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-c58de270-a4c7-4d96-a5bd-b92154ffd556 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:26:54.145719 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-c58de270-a4c7-4d96-a5bd-b92154ffd556 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010225 Oct 13 08:26:54.146222 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Thu Oct 13 08:26:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:32:19.767453 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:32:19.768466 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 13 08:32:19.768858 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:32:19.908815 n-d-858384-11 devstack@n-api.service[104574]: DEBUG dbcounter [-] [104574] Writing DB stats nova_api:SELECT=6 {{(pid=104574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:32:20.168119 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:32:20.173434 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:32:20.173912 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:32:20.174337 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:32:20.175075 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:32:20.175526 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:32:20.175939 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:32:20.213749 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-f939ce4f-d11f-4413-983e-602827672288 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.306287 Oct 13 08:32:20.214306 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:32:19 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:32:21.278906 n-d-858384-11 devstack@n-api.service[104573]: DEBUG nova.api.openstack.wsgi [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] Calling method '>' {{(pid=104573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:32:21.279915 n-d-858384-11 devstack@n-api.service[104573]: INFO nova.api.openstack.requestlog [None req-4f095647-2e6b-4e4e-93d4-49ea42c7419b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 13 08:32:21.280314 n-d-858384-11 devstack@n-api.service[104573]: [pid: 104573|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Oct 13 08:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:32:21.467615 n-d-858384-11 devstack@n-api.service[104574]: DEBUG nova.api.openstack.wsgi [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Calling method '>' {{(pid=104574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:32:21.471148 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:32:21.471624 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:32:21.472056 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:32:21.472777 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:32:21.473225 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:32:21.473642 n-d-858384-11 devstack@n-api.service[104574]: DEBUG oslo_concurrency.lockutils [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:32:21.497200 n-d-858384-11 devstack@n-api.service[104574]: INFO nova.api.openstack.requestlog [None req-61627393-b80a-464f-959d-af83465b2272 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.080945 Oct 13 08:32:21.497690 n-d-858384-11 devstack@n-api.service[104574]: [pid: 104574|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:32:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:33:05.627161 n-d-858384-11 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 13 08:33:05.627712 n-d-858384-11 devstack@n-api.service[104572]: Thu Oct 13 08:33:05 2022 - graceful shutdown triggered... Oct 13 08:33:05.628172 n-d-858384-11 devstack@n-api.service[104573]: Gracefully killing worker 1 (pid: 104573)... Oct 13 08:33:05.628601 n-d-858384-11 devstack@n-api.service[104574]: Gracefully killing worker 2 (pid: 104574)... Oct 13 08:33:05.753221 n-d-858384-11 devstack@n-api.service[104573]: DEBUG dbcounter [-] [104573] Writing DB stats nova_api:SELECT=4 {{(pid=104573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:06.628824 n-d-858384-11 devstack@n-api.service[104572]: worker 1 buried after 1 seconds Oct 13 08:33:06.628824 n-d-858384-11 devstack@n-api.service[104572]: worker 2 buried after 1 seconds Oct 13 08:33:06.628824 n-d-858384-11 devstack@n-api.service[104572]: goodbye to uWSGI. Oct 13 08:33:06.630373 n-d-858384-11 systemd[1]: devstack@n-api.service: Succeeded. Oct 13 08:33:06.630978 n-d-858384-11 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 13 08:33:06.633958 n-d-858384-11 systemd[1]: Starting Devstack devstack@n-api.service... Oct 13 08:33:06.651165 n-d-858384-11 devstack@n-api.service[127020]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 13 08:33:06 2022] *** Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: nodename: n-d-858384-11 Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: machine: x86_64 Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: clock source: unix Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: pcre jit disabled Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: detected number of CPU cores: 4 Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: current working directory: / Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: detected binary path: /usr/bin/uwsgi-core Oct 13 08:33:06.669903 n-d-858384-11 devstack@n-api.service[127020]: your processes number limit is 47680 Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: your memory page size is 4096 bytes Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: detected max file descriptor number: 2048 Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: lock engine: pthread robust mutexes Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: thunder lock: enabled Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 13 08:33:06.670787 n-d-858384-11 devstack@n-api.service[127020]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 13 08:33:06.712901 n-d-858384-11 devstack@n-api.service[127020]: Python main interpreter initialized at 0x55a503c709c0 Oct 13 08:33:06.712901 n-d-858384-11 devstack@n-api.service[127020]: python threads support enabled Oct 13 08:33:06.712901 n-d-858384-11 devstack@n-api.service[127020]: your server socket listen backlog is limited to 100 connections Oct 13 08:33:06.712901 n-d-858384-11 devstack@n-api.service[127020]: your mercy for graceful operations on workers is 90 seconds Oct 13 08:33:06.713402 n-d-858384-11 devstack@n-api.service[127020]: mapped 403077 bytes (393 KB) for 2 cores Oct 13 08:33:06.713402 n-d-858384-11 devstack@n-api.service[127020]: *** Operational MODE: preforking *** Oct 13 08:33:06.713606 n-d-858384-11 devstack@n-api.service[127020]: *** uWSGI is running in multiple interpreter mode *** Oct 13 08:33:06.713606 n-d-858384-11 devstack@n-api.service[127020]: spawned uWSGI master process (pid: 127020) Oct 13 08:33:06.713815 n-d-858384-11 systemd[1]: Started Devstack devstack@n-api.service. Oct 13 08:33:06.714484 n-d-858384-11 devstack@n-api.service[127020]: spawned uWSGI worker 1 (pid: 127030, cores: 1) Oct 13 08:33:06.715853 n-d-858384-11 devstack@n-api.service[127020]: spawned uWSGI worker 2 (pid: 127031, cores: 1) Oct 13 08:33:06.715969 n-d-858384-11 devstack@n-api.service[127020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 13 08:33:07.374261 n-d-858384-11 devstack@n-api.service[127030]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 08:33:07.374943 n-d-858384-11 devstack@n-api.service[127031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 13 08:33:08.555283 n-d-858384-11 devstack@n-api.service[127030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:33:08.555283 n-d-858384-11 devstack@n-api.service[127030]: from cryptography.utils import int_from_bytes Oct 13 08:33:08.556334 n-d-858384-11 devstack@n-api.service[127030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:33:08.556334 n-d-858384-11 devstack@n-api.service[127030]: from cryptography.utils import int_from_bytes Oct 13 08:33:08.557052 n-d-858384-11 devstack@n-api.service[127031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:33:08.557052 n-d-858384-11 devstack@n-api.service[127031]: from cryptography.utils import int_from_bytes Oct 13 08:33:08.557526 n-d-858384-11 devstack@n-api.service[127031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 13 08:33:08.557526 n-d-858384-11 devstack@n-api.service[127031]: from cryptography.utils import int_from_bytes Oct 13 08:33:10.967653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 08:33:10.968314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 08:33:10.968607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 08:33:10.968827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 08:33:10.969086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 08:33:10.969630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.969875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.970136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.970510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.970789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.971200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.971433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.971745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.972090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.972333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.972652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.973134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-11 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.973474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.973770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.974085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.974458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.974735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.975063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.975375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.975883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.976338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.976630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.976957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.977082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 13 08:33:10.977486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.977585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 13 08:33:10.977695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.977872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 13 08:33:10.977986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.978206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.978309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 13 08:33:10.978500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 13 08:33:10.978598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.978901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-11 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.979967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.980881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.981847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-11 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.982869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.983840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.984985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.985915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.986863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.987916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-11 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.988980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.989994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.990965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.991909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.992858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.993932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.994938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.995957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.996956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.997880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.998095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.998199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.998398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.998523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:10.999949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.000870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.001787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.002950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.003892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.004917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.005843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.006934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.007956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.008851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.009973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.010912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.011834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.012912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.013138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.013138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.013511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.013679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.013830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.013972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.014121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.014275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.015071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.015169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.015272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.015360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.015453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.015558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.015646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.015731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.015882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.015997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.016488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.016621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.016721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.016822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.016918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.017028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.017122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.017217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.017429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.017538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.017745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.017840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.018062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.018202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.018368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.018510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.018699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.018808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.019004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.019114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.019308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.019401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.019616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.019742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.019920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.020032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.020225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.020328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.020523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.020618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.020840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.020943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.021159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.021261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.021467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.021571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.021772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.021875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.022075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.022178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.022391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 13 08:33:11.022601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.022749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.022872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.023079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.023196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.023424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.023666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.023833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.027979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.028952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.029961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.030921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.031930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.032815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.033966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.034937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.035872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.036812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.037945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.038975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.039891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.040836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.042711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.042958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.042958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.043893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.044956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.045998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.046917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.047868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.048827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.049990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.050941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.051937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.052845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.053966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.054861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.055936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.056963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.057929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.058884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.059823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.060977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.061083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.061810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.061903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.062922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.063969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.064906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.065913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.066891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.067810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.068946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.069975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.070928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.071859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.072990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.073999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.074959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.075894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.076092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.076187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.076415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.076676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.076899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.077574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.077935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.078948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.079877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.080832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.081954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.082908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.083929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.084899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.085992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.086251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.086346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.086615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.086722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.086922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.087906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.088987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.089909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.090842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.091951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.092889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.093903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.094849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.095962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.096891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.097925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.098909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.099984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.100997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.101927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.102847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.103962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.104989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.105884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.106818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.107937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.108562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.108784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.108879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.109996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.110091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.110629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.110791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.110889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.110995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.111939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.112844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.113942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.114983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.115925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.116849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.117987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.118944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.119956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.120886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.121832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.122844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.123775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.124952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.125983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.126938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.127922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.128984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.129279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.129433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.129596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.129746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.129888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.130934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.131853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.132813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.133856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.134901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.135997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.136962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.137931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.138888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.139095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.139762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.139929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.140952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.141208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.141418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.141530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.141800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.141927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.142121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.142253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.142489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.142740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.142853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.143070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.143178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.143396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.143715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.144035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.144456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.144781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.145093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.145415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.145601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.145907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.146875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.147898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.148911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.149828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.150800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.151968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.152974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.153982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.154990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.155876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.156791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.157934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.158972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.159887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.160805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.161918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.162973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.163908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.164863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.165799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.166812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.167890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.168087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.168326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.168653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.168968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.169281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.169594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.169908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.170223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.170446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.171145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.171313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.171470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.171691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.171860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.172950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.173945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.174179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.174326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.174518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.176943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.177931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.178924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.179772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.180963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.181962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.182137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.182289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.182561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.182675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.182896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.183943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.184911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.185998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.186130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.186382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.186500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.186726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.186839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.187918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.188964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.189890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.190843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.191968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.192984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.193907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.194852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.195964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.196971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.197965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.198944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.199851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.200816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.201723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.202546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.202990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.203971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.204905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.205942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.206897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.207859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.208085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.208400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.208707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.208851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.209988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.210942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.211931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.212877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.213926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.214932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.215930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.216885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.217931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.218974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.219189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.219298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.219493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.219598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.219832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.220860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.221981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.222968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.223947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.224951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.225961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.226158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.226267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.226534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.226854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.226976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.227896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.228822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.229941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.230913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.231814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.232976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.233600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.233822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.233928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.234135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.234269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.234474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.234682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.234895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.235823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.236822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.237773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.238928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.239034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.239133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.239230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 08:33:11.239318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.239733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.240056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.240367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.240677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.240993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.241309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.241634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.241959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.242269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.242625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.242951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.243296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.243606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.243949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.244325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.244592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.244902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.245205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 13 08:33:11.245452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 13 08:33:11.302031 n-d-858384-11 devstack@n-api.service[127030]: INFO dbcounter [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Registered counter for database nova_api Oct 13 08:33:11.308442 n-d-858384-11 devstack@n-api.service[127031]: INFO dbcounter [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Registered counter for database nova_api Oct 13 08:33:11.322944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_db.sqlalchemy.engines [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.329233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.331481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writer thread running {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.336199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writer thread running {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.390635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.context [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127030) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 08:33:11.393496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.context [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127031) load_cells /opt/stack/nova/nova/context.py:464}} Oct 13 08:33:11.394722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:11.395203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:11.396815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:11.397522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:11.397649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:11.397985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:11.398097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:11.399583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:11.400007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:11.400321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:11.400767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:11.402029 n-d-858384-11 devstack@n-api.service[127030]: INFO dbcounter [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Registered counter for database nova_cell0 Oct 13 08:33:11.402791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:11.404972 n-d-858384-11 devstack@n-api.service[127031]: INFO dbcounter [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Registered counter for database nova_cell0 Oct 13 08:33:11.407957 n-d-858384-11 devstack@n-api.service[127030]: INFO dbcounter [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Registered counter for database nova_cell1 Oct 13 08:33:11.409281 n-d-858384-11 devstack@n-api.service[127031]: INFO dbcounter [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Registered counter for database nova_cell1 Oct 13 08:33:11.415986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_db.sqlalchemy.engines [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.417750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.421913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_db.sqlalchemy.engines [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.422058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.424756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writer thread running {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.430480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writer thread running {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.430822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writer thread running {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.568662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writer thread running {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.578938 n-d-858384-11 devstack@n-api.service[127031]: INFO dbcounter [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Registered counter for database nova_cell0 Oct 13 08:33:11.581285 n-d-858384-11 devstack@n-api.service[127030]: INFO dbcounter [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Registered counter for database nova_cell0 Oct 13 08:33:11.586019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.590580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writer thread running {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.594364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_db.sqlalchemy.engines [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 13 08:33:11.599096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writer thread running {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 13 08:33:11.910658 n-d-858384-11 devstack@n-api.service[127031]: WARNING keystonemiddleware.auth_token [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:33:11.917945 n-d-858384-11 devstack@n-api.service[127031]: WARNING keystonemiddleware.auth_token [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:33:11.919457 n-d-858384-11 devstack@n-api.service[127030]: WARNING keystonemiddleware.auth_token [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:33:11.927209 n-d-858384-11 devstack@n-api.service[127030]: WARNING keystonemiddleware.auth_token [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:33:12.258912 n-d-858384-11 devstack@n-api.service[127031]: WARNING keystonemiddleware.auth_token [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:33:12.265085 n-d-858384-11 devstack@n-api.service[127031]: WARNING keystonemiddleware.auth_token [None req-1bb0a531-7d83-47b7-9e76-d7332f5060af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:33:12.268782 n-d-858384-11 devstack@n-api.service[127030]: WARNING keystonemiddleware.auth_token [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 13 08:33:12.270376 n-d-858384-11 devstack@n-api.service[127031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a503c709c0 pid: 127031 (default app) Oct 13 08:33:12.274783 n-d-858384-11 devstack@n-api.service[127030]: WARNING keystonemiddleware.auth_token [None req-a9011cbe-f0f3-4044-acb3-047f6a78c2d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 13 08:33:12.280537 n-d-858384-11 devstack@n-api.service[127030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a503c709c0 pid: 127030 (default app) Oct 13 08:33:52.101114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:52.103397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:52.105146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:52.106108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:53.595460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '.version_select at 0x7f53782d4550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:53.603239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127031) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 13 08:33:53.604102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:53.604501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:53.604992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:53.635932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:53.636345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:53.636782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:53.651534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:53.652257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:53.652856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:53.660317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc02b836-3e91-4dca-a5cc-72e5bc251a84 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.570030 Oct 13 08:33:53.675068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:33:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:53.686252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:53.687453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:53.691059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:53.692074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:53.954016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3bc986b9-587a-4c9e-ac4b-ea1a7262f1f2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-978208059", "name": "tempest-test_aggregate-169128778"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:53.993161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-3bc986b9-587a-4c9e-ac4b-ea1a7262f1f2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid ad6beaf8-ebd7-4a3e-bfa6-4a89a8d4fea1 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:33:54.104793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3bc986b9-587a-4c9e-ac4b-ea1a7262f1f2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.426351 Oct 13 08:33:54.106102 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Oct 13 08:33:53 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:54.210322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Calling method '.version_select at 0x7f5378290790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:54.218147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:54.220831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:54.221460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:54.298692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:54.298692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:54.298692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:54.313154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:54.315052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:54.315612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:54.337668 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-777be699-1883-44cd-8085-6bec76a2411c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.647928 Oct 13 08:33:54.342437 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1208 bytes} [Thu Oct 13 08:33:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:33:54.702253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e052db1-90e4-4ee9-ab46-1cf14c7d2888 tempest-AZAdminNegativeTestJSON-697696166 tempest-AZAdminNegativeTestJSON-697696166-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:54.704498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e052db1-90e4-4ee9-ab46-1cf14c7d2888 tempest-AZAdminNegativeTestJSON-697696166 tempest-AZAdminNegativeTestJSON-697696166-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '385e2509918140959bbf127da4745ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01f59157dc4976a7c8e16d74ec2846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e052db1-90e4-4ee9-ab46-1cf14c7d2888 tempest-AZAdminNegativeTestJSON-697696166 tempest-AZAdminNegativeTestJSON-697696166-project] Request method failure captured: Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR81u6kZvQxYKvxoOY77R-YKfVW74qORJAIM5uBnjYZXFLg8Tf2wYMJhPuwAO9P5Ghet4PSr2_2Mc4IhuNnuee3iwUk1bmSI1J3ak7ERS_9C5ExtJ-SlNnZQ62qEPw-SgqRT1RotfZPYpfRlX8TdZMv8VUXAymQ6ihbvandceGGMeyOM Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ec01f59157dc4976a7c8e16d74ec2846 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AZAdminNegativeTestJSON-697696166 Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:33:54.715362 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec01f59157dc4976a7c8e16d74ec2846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec01f59157dc4976a7c8e16d74ec2846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec01f59157dc4976a7c8e16d74ec2846"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec01f59157dc4976a7c8e16d74ec2846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AZAdminNegativeTestJSON-697696166 Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ec01f59157dc4976a7c8e16d74ec2846 Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-697696166 Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AZAdminNegativeTestJSON-697696166-project Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 385e2509918140959bbf127da4745ef2 Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AZAdminNegativeTestJSON-697696166-project Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 13 08:33:54.716493 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:33:54.717057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 13 08:33:54.717900 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:54.722967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e052db1-90e4-4ee9-ab46-1cf14c7d2888 tempest-AZAdminNegativeTestJSON-697696166 tempest-AZAdminNegativeTestJSON-697696166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:54.724162 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e052db1-90e4-4ee9-ab46-1cf14c7d2888 tempest-AZAdminNegativeTestJSON-697696166 tempest-AZAdminNegativeTestJSON-697696166-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.615976 Oct 13 08:33:54.727751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:33:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 621 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:54.768439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1290e62e-04df-4c29-8ca8-fd14766c2da6 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:54.791179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d40377cd-9e40-44ab-b2a6-3d6d5bac86b7 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-642813926", "id": 1817197819, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:54.804412 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1290e62e-04df-4c29-8ca8-fd14766c2da6 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.073586 Oct 13 08:33:54.807323 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:33:54 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:54.918377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d40377cd-9e40-44ab-b2a6-3d6d5bac86b7 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.573340 Oct 13 08:33:54.927074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3/6] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:54 2022] POST /compute/v2.1/flavors => generated 429 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:55.199100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc123d00-de2e-4895-930a-00cd844ffff2 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2111923719", "ram": 512, "vcpus": 1, "disk": 10, "id": 80949167, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:55.269729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc123d00-de2e-4895-930a-00cd844ffff2 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.460794 Oct 13 08:33:55.276301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4/7] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:54 2022] POST /compute/v2.1/flavors => generated 410 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:55.292346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-623efb97-b963-4d45-b98b-8deca68e50bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:55.313150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623efb97-b963-4d45-b98b-8deca68e50bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:55.314198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623efb97-b963-4d45-b98b-8deca68e50bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:55.314879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623efb97-b963-4d45-b98b-8deca68e50bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:55.499105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-759347799", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:56.187036 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-623efb97-b963-4d45-b98b-8deca68e50bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 0.898916 Oct 13 08:33:56.192624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 5/8] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:33:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:56.208734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbd43951-f38d-46d6-9a5f-3c5a6f9b69ae tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:56.276130 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbd43951-f38d-46d6-9a5f-3c5a6f9b69ae tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1817197819" status: 202 len: 0 microversion: 2.1 time: 0.082139 Oct 13 08:33:56.277221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 6/9] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:33:56 2022] DELETE /compute/v2.1/flavors/1817197819 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:56.400660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:33:56.746820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8f1c99b-b173-4d56-b7ad-987aae6c8110 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:56.798912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d8f1c99b-b173-4d56-b7ad-987aae6c8110 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] HTTP exception thrown: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8f1c99b-b173-4d56-b7ad-987aae6c8110 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Request method failure captured: Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR81v1Agh4HyLzIuc4EXw7NFRjh12bpXI5ZP1lNGenzvdS6Ty_YCs7ePWQuRuEw4eNeGoZd4YuJ-w7O-xVx6xqoWaQijiIDzAwRiHDkGZ5vfwz1okDcdehWKxuCSPr3vpL3AjDiX2MskNCwL8bOX9WR8m0UPLPq3jtfOd06VXeEVC82E Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:33:56.801773 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4f10fbfd10874b01a8dbcbea9c5f6b4c Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:33:56.803053 n-d-858384-11 devstack@n-api.service[127030]: exception: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'flavor_id': '80949167', 'id': 'hw:cpu_thread_policy'} Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:56.803715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:56.804932 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:33:56.810023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8f1c99b-b173-4d56-b7ad-987aae6c8110 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Returning 404 to user: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:56.811099 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8f1c99b-b173-4d56-b7ad-987aae6c8110 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] 10.222.0.23 "GET /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.532785 Oct 13 08:33:56.812118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 7/10] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:33:56 2022] GET /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:56.819205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0aea9571-e926-48de-baa7-d44f535505d1 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:56.844220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:33:56.846516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:33:56.847182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:33:56.847782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:33:56.848493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:33:56.871019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:56.871664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:56.872421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:56.873297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:56.874459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:56.875037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:56.884530 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0aea9571-e926-48de-baa7-d44f535505d1 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.071129 Oct 13 08:33:56.887746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 8/11] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:56 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:56.928921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Getting quotas for project 3f43c474989d4fa4aecc7f524de41a78. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:33:56.938641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Getting quotas for user 1e001d79774e48119ebce4497388f84f and project 3f43c474989d4fa4aecc7f524de41a78. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:33:56.955186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:33:56.958973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:33:57.066677 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-204f9e46-a405-4532-9f1f-c812d2ed07df tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138223 Oct 13 08:33:57.067574 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 4/12] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:33:57.077765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29a22793-e992-437b-be59-d72ca80bb6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.087428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29a22793-e992-437b-be59-d72ca80bb6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '4f10fbfd10874b01a8dbcbea9c5f6b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39436693f14446a8a0dca1ff717d8aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29a22793-e992-437b-be59-d72ca80bb6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Request method failure captured: Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/flavors/80949167/os-extra_specs HTTP/1.1 Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 66 Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81v1Agh4HyLzIuc4EXw7NFRjh12bpXI5ZP1lNGenzvdS6Ty_YCs7ePWQuRuEw4eNeGoZd4YuJ-w7O-xVx6xqoWaQijiIDzAwRiHDkGZ5vfwz1okDcdehWKxuCSPr3vpL3AjDiX2MskNCwL8bOX9WR8m0UPLPq3jtfOd06VXeEVC82E Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:33:57.092247 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4f10fbfd10874b01a8dbcbea9c5f6b4c Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 13 08:33:57.093257 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:33:57.093826 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 13 08:33:57.094764 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.097082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29a22793-e992-437b-be59-d72ca80bb6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:57.098799 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29a22793-e992-437b-be59-d72ca80bb6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] 10.222.0.23 "POST /compute/v2.1/flavors/80949167/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.029702 Oct 13 08:33:57.099987 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 5/13] 10.222.0.23 () {60 vars in 1218 bytes} [Thu Oct 13 08:33:57 2022] POST /compute/v2.1/flavors/80949167/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:57.106921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4683a1fc-aa53-423b-9195-264eb8ee1a35 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-84239672", "id": 1348380437, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.163044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4683a1fc-aa53-423b-9195-264eb8ee1a35 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.061620 Oct 13 08:33:57.164074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 6/14] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:57.170213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d12f11f-7d02-4462-b919-d283b6f01f2d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.170974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d12f11f-7d02-4462-b919-d283b6f01f2d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:33:57.249490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-678010968", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "availability_zone": "tempest-test_az-978208059"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.273512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:57.274001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:57.274461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:57.275185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:57.283018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:57.283552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:57.324680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d12f11f-7d02-4462-b919-d283b6f01f2d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:57.350923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d12f11f-7d02-4462-b919-d283b6f01f2d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1219 microversion: 2.1 time: 0.182834 Oct 13 08:33:57.352373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:33:57 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:57.365610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47e941d1-2c0f-4801-a614-69303817076d tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.447709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47e941d1-2c0f-4801-a614-69303817076d tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/80949167/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093682 Oct 13 08:33:57.448708 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1218 bytes} [Thu Oct 13 08:33:57 2022] POST /compute/v2.1/flavors/80949167/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:33:57.455537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-005b5a86-73fd-4564-8428-6e075a588c21 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.543276 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-005b5a86-73fd-4564-8428-6e075a588c21 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5796 microversion: 2.1 time: 0.092549 Oct 13 08:33:57.544078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:57 2022] GET /compute/v2.1/flavors/detail => generated 5796 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:57.552842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-624d1f11-4b3f-49b5-9283-a3bdec6fa7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.554463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-624d1f11-4b3f-49b5-9283-a3bdec6fa7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '4f10fbfd10874b01a8dbcbea9c5f6b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39436693f14446a8a0dca1ff717d8aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-624d1f11-4b3f-49b5-9283-a3bdec6fa7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Request method failure captured: Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81v1Agh4HyLzIuc4EXw7NFRjh12bpXI5ZP1lNGenzvdS6Ty_YCs7ePWQuRuEw4eNeGoZd4YuJ-w7O-xVx6xqoWaQijiIDzAwRiHDkGZ5vfwz1okDcdehWKxuCSPr3vpL3AjDiX2MskNCwL8bOX9WR8m0UPLPq3jtfOd06VXeEVC82E Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:33:57.558995 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4f10fbfd10874b01a8dbcbea9c5f6b4c Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:57.560637 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'id': 'hw:numa_nodes'} Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:33:57.561176 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 13 08:33:57.562626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.569734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-624d1f11-4b3f-49b5-9283-a3bdec6fa7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:57.571161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-624d1f11-4b3f-49b5-9283-a3bdec6fa7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.025562 Oct 13 08:33:57.571722 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:33:57 2022] DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:57.587335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a68a3584-cafe-4eaf-b65a-95ef7d90c71d tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.656498 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a68a3584-cafe-4eaf-b65a-95ef7d90c71d tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1348380437" status: 202 len: 0 microversion: 2.1 time: 0.083671 Oct 13 08:33:57.657233 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 11/19] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:33:57 2022] DELETE /compute/v2.1/flavors/1348380437 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:57.667882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f2e3a32-252e-408e-a2a4-40101b12602e tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.726662 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f2e3a32-252e-408e-a2a4-40101b12602e tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/80949167/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068476 Oct 13 08:33:57.727709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 12/20] 10.222.0.23 () {60 vars in 1218 bytes} [Thu Oct 13 08:33:57 2022] POST /compute/v2.1/flavors/80949167/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:33:57.734568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9febef6-7df4-4769-9fb2-eab527fb50ca tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.746320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:33:57.767531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9febef6-7df4-4769-9fb2-eab527fb50ca tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.038506 Oct 13 08:33:57.769232 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 13/21] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:57 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:57.774585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2da692ad-70f1-4a96-bea5-99e9a357407e tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.778227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2da692ad-70f1-4a96-bea5-99e9a357407e tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '4f10fbfd10874b01a8dbcbea9c5f6b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39436693f14446a8a0dca1ff717d8aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2da692ad-70f1-4a96-bea5-99e9a357407e tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Request method failure captured: Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 22 Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81v1Agh4HyLzIuc4EXw7NFRjh12bpXI5ZP1lNGenzvdS6Ty_YCs7ePWQuRuEw4eNeGoZd4YuJ-w7O-xVx6xqoWaQijiIDzAwRiHDkGZ5vfwz1okDcdehWKxuCSPr3vpL3AjDiX2MskNCwL8bOX9WR8m0UPLPq3jtfOd06VXeEVC82E Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:33:57.780815 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/39436693f14446a8a0dca1ff717d8aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 39436693f14446a8a0dca1ff717d8aad Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4f10fbfd10874b01a8dbcbea9c5f6b4c Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: {"hw:numa_nodes": "1"} Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:57.781844 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:33:57.782509 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 13 08:33:57.783410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.787739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2da692ad-70f1-4a96-bea5-99e9a357407e tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:57.793271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2da692ad-70f1-4a96-bea5-99e9a357407e tempest-FlavorsExtraSpecsNegativeTestJSON-312790533 tempest-FlavorsExtraSpecsNegativeTestJSON-312790533-project] 10.222.0.23 "PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022680 Oct 13 08:33:57.795151 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 14/22] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Oct 13 08:33:57 2022] PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:57.812592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14ded7ca-729c-4a40-947e-07c64552dd59 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-99252853", "id": 1398919289, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.843379 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14ded7ca-729c-4a40-947e-07c64552dd59 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.046724 Oct 13 08:33:57.844642 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 15/23] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:57.850005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a1fedb-5f7d-427b-ad1a-41a6419a92c9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.861945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-75a1fedb-5f7d-427b-ad1a-41a6419a92c9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] HTTP exception thrown: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a1fedb-5f7d-427b-ad1a-41a6419a92c9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Request method failure captured: Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81xO36P3BxabfLYI5c7Y-BJ8OmWjxKzwpMa6Igk5_lp_d3H2SsvuJoSlOtQY01Ow1VcqdYRakeMmlL81ebdkbcEuMTNhpDSdeTZ8A3hTPz2cvRvUSI6cJO4n7BqxJR_5C5LILURYwGfg2gRIX2O5QkEZ9Ycv5e77egfEmErLwGeMY8 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:33:57.864359 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a04979a9d7cc46d0aad492c0b6093d0c Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:57.865389 n-d-858384-11 devstack@n-api.service[127031]: exception: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'id': 'hw:cpu_thread_policy'} Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.865929 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. Oct 13 08:33:57.866971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.868693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a1fedb-5f7d-427b-ad1a-41a6419a92c9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Returning 404 to user: Flavor 80949167 has no extra specs with key hw:cpu_thread_policy. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:57.869914 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75a1fedb-5f7d-427b-ad1a-41a6419a92c9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.023958 Oct 13 08:33:57.871018 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 16/24] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:33:57 2022] DELETE /compute/v2.1/flavors/80949167/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:33:57.881419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04f88128-19f6-42ec-959f-64c4faa6ed7a tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.917388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04f88128-19f6-42ec-959f-64c4faa6ed7a tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1398919289" status: 202 len: 0 microversion: 2.1 time: 0.045062 Oct 13 08:33:57.921043 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 17/25] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:33:57 2022] DELETE /compute/v2.1/flavors/1398919289 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:57.929960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6302efc-7c10-405e-a91b-0d384b8c43d9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:57.936022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c6302efc-7c10-405e-a91b-0d384b8c43d9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6302efc-7c10-405e-a91b-0d384b8c43d9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Request method failure captured: Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 27 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81xO36P3BxabfLYI5c7Y-BJ8OmWjxKzwpMa6Igk5_lp_d3H2SsvuJoSlOtQY01Ow1VcqdYRakeMmlL81ebdkbcEuMTNhpDSdeTZ8A3hTPz2cvRvUSI6cJO4n7BqxJR_5C5LILURYwGfg2gRIX2O5QkEZ9Ycv5e77egfEmErLwGeMY8 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:33:57.940225 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a04979a9d7cc46d0aad492c0b6093d0c Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: {"hw:cpu_policy": "shared"} Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:57.941476 n-d-858384-11 devstack@n-api.service[127031]: exception: Request body and URI mismatch Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:57.942182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:57.943355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:33:57.943355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:33:57.943355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 13 08:33:57.943355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:57.945210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6302efc-7c10-405e-a91b-0d384b8c43d9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:57.946927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6302efc-7c10-405e-a91b-0d384b8c43d9 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024479 Oct 13 08:33:57.952571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 18/26] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Oct 13 08:33:57 2022] PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:33:57.953528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b671e893-3e41-48bd-b031-0291f77653f3 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:57.989902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b671e893-3e41-48bd-b031-0291f77653f3 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.040449 Oct 13 08:33:58.000605 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 19/27] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:57 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:58.009087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce856cbc-8973-4ae6-bc17-58bc310997d4 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce856cbc-8973-4ae6-bc17-58bc310997d4 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Request method failure captured: Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 49 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81xO36P3BxabfLYI5c7Y-BJ8OmWjxKzwpMa6Igk5_lp_d3H2SsvuJoSlOtQY01Ow1VcqdYRakeMmlL81ebdkbcEuMTNhpDSdeTZ8A3hTPz2cvRvUSI6cJO4n7BqxJR_5C5LILURYwGfg2gRIX2O5QkEZ9Ycv5e77egfEmErLwGeMY8 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:33:58.018139 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9746e78c72394220ad8b2be2b2d21700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9746e78c72394220ad8b2be2b2d21700 Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a04979a9d7cc46d0aad492c0b6093d0c Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 13 08:33:58.019421 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'flavor_id': '80949167', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance: Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 13 08:33:58.019992 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.021010 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 13 08:33:58.021935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:33:58.023732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce856cbc-8973-4ae6-bc17-58bc310997d4 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:33:58.024809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ce856cbc-8973-4ae6-bc17-58bc310997d4 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022547 Oct 13 08:33:58.026062 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 20/28] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Oct 13 08:33:58 2022] PUT /compute/v2.1/flavors/80949167/os-extra_specs/hw:numa_nodes => generated 117 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:33:58.035995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4242dde-1fc7-4ff2-8092-f413da1e6a72 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1429841547", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:58.074894 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4242dde-1fc7-4ff2-8092-f413da1e6a72 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.046892 Oct 13 08:33:58.076596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 21/29] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:58 2022] POST /compute/v2.1/flavors => generated 507 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:58.081730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3095e355-cf4a-4efb-9500-72e928cf6bcb tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.107746 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3095e355-cf4a-4efb-9500-72e928cf6bcb tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/80949167" status: 202 len: 0 microversion: 2.1 time: 0.029882 Oct 13 08:33:58.108703 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 22/30] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:33:58 2022] DELETE /compute/v2.1/flavors/80949167 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:58.115626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08ad354d-b9ef-4019-8fb7-18c4c5c1e4cf tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.141053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:33:58.149739 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08ad354d-b9ef-4019-8fb7-18c4c5c1e4cf tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/590afc69-8306-4768-a643-1a0c68e8d916" status: 202 len: 0 microversion: 2.1 time: 0.039616 Oct 13 08:33:58.150890 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 23/31] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:33:58 2022] DELETE /compute/v2.1/flavors/590afc69-8306-4768-a643-1a0c68e8d916 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:58.162714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6feeb767-822d-4622-96a6-9d90162b6f65 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.240047 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6feeb767-822d-4622-96a6-9d90162b6f65 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300 tempest-FlavorsExtraSpecsNegativeTestJSON-943476300-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084237 Oct 13 08:33:58.242006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 24/32] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:58.251558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f07b86db-1133-4185-9ad6-99e11fff98eb tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.340223 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f07b86db-1133-4185-9ad6-99e11fff98eb tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094125 Oct 13 08:33:58.345487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 25/33] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:58.368437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7504792-6f4f-4f87-97df-4efcfc3c6c0b tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-259625196", "id": "83cff256-fd39-4e0c-963e-c0780e3f391f", "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:58.433746 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7504792-6f4f-4f87-97df-4efcfc3c6c0b tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.065906 Oct 13 08:33:58.437252 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 26/34] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:58 2022] POST /compute/v2.1/flavors => generated 506 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:58.449176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ff4f293-d684-477c-8153-1524f54781d5 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.455273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ff4f293-d684-477c-8153-1524f54781d5 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:33:58.588015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:33:58.588496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:33:58.589132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:33:58.589629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:33:58.590050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:33:58.613035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:58.613721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:58.615144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:58.616519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:33:58.617173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:33:58.617738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:33:58.659070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Getting quotas for project 0ab09230959646e5b99e75077d3371a9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:33:58.668865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Getting quotas for user 88db837d4caf4c5695a7d224168460fb and project 0ab09230959646e5b99e75077d3371a9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:33:58.691535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:33:58.701438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:33:58.851641 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95510337-aedb-4691-b87a-0243aa393a56 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.962011 Oct 13 08:33:58.855959 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 9/35] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:33:58.870554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-918340ca-12e0-40ba-b7e5-a1346d4f4edf tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.922305 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-918340ca-12e0-40ba-b7e5-a1346d4f4edf tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/83cff256-fd39-4e0c-963e-c0780e3f391f" status: 202 len: 0 microversion: 2.1 time: 0.063490 Oct 13 08:33:58.923002 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 10/36] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:33:58 2022] DELETE /compute/v2.1/flavors/83cff256-fd39-4e0c-963e-c0780e3f391f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:33:58.934556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a885d06d-1a42-411d-84fb-a24ee689dd74 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:58.935902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a885d06d-1a42-411d-84fb-a24ee689dd74 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:33:59.068544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a885d06d-1a42-411d-84fb-a24ee689dd74 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:59.097188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a885d06d-1a42-411d-84fb-a24ee689dd74 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1241 microversion: 2.1 time: 0.171835 Oct 13 08:33:59.100585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 11/37] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:33:58 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:59.114216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0baea66-e07f-47f6-a5ea-8d03829a1aef tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:59.150289 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0baea66-e07f-47f6-a5ea-8d03829a1aef tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048402 Oct 13 08:33:59.151228 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 12/38] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:59.181062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17f82474-859e-4d67-859d-e067e67589c4 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1441242322", "id": 1981320194, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:33:59.219546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ff4f293-d684-477c-8153-1524f54781d5 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:33:59.228659 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17f82474-859e-4d67-859d-e067e67589c4 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053007 Oct 13 08:33:59.230312 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 13/39] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:33:59 2022] POST /compute/v2.1/flavors => generated 414 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:33:59.238267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ff4f293-d684-477c-8153-1524f54781d5 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1219 microversion: 2.1 time: 0.799677 Oct 13 08:33:59.245806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 27/40] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:33:58 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1219 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:33:59.248292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b9574a0-5cf8-47ea-bb15-a075f0ca31d3 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:59.287518 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b9574a0-5cf8-47ea-bb15-a075f0ca31d3 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1981320194" status: 200 len: 414 microversion: 2.1 time: 0.045556 Oct 13 08:33:59.288399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 14/41] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:33:59 2022] GET /compute/v2.1/flavors/1981320194 => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:33:59.898828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ee570dd-7542-423c-a782-e62b3362e892 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:33:59.999330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ee570dd-7542-423c-a782-e62b3362e892 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.701308 Oct 13 08:34:00.009530 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 28/42] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:33:59 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.033264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eab76d1d-77ab-45e4-9064-ceb4bee1fdff tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.065927 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eab76d1d-77ab-45e4-9064-ceb4bee1fdff tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1981320194" status: 202 len: 0 microversion: 2.1 time: 0.041211 Oct 13 08:34:00.066741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 15/43] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:00 2022] DELETE /compute/v2.1/flavors/1981320194 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:00.077155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bdf8152d-c9b9-44e0-aa02-1bdba953b6b7 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.127136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49a07681-3d64-4872-b1f2-c46c5b2f3649 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.128078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49a07681-3d64-4872-b1f2-c46c5b2f3649 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:00.131198 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bdf8152d-c9b9-44e0-aa02-1bdba953b6b7 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043167 Oct 13 08:34:00.133292 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 29/44] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.157818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3102ac8-f3bf-4061-8a3e-221a215b2940 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1870200245", "id": 984467313, "os-flavor-access:is_public": "False"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:00.220167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b3102ac8-f3bf-4061-8a3e-221a215b2940 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.066441 Oct 13 08:34:00.227736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 30/45] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:00 2022] POST /compute/v2.1/flavors => generated 427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.249484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a837b6ef-0370-4872-9ce8-5486bfc6dca5 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "984467313"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:00.285609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a837b6ef-0370-4872-9ce8-5486bfc6dca5 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] HTTP exception thrown: Flavor 984467313 could not be found. Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a837b6ef-0370-4872-9ce8-5486bfc6dca5 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Request method failure captured: Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 106 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vK7IwFNjsvl1cYYDXXsFzKone832yoXu_AywK-W5qlRkBgd0BuI2AGILM-b3R6wbjRrFefkXP7g-FOKAIW4kafvmNbUwTCeBa-NM3Tc7MJVqubuI8BYA9Vo0aW9z_u-IzwzY0Cq_d1wP8MfwE71ZtFDASpxG00PhZqakrCqHLA0o Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: f497013781b04da19d43a50e02817662 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsAdminTestJSON-1456204579 Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:00.295741 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f497013781b04da19d43a50e02817662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f497013781b04da19d43a50e02817662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f497013781b04da19d43a50e02817662"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f497013781b04da19d43a50e02817662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsAdminTestJSON-1456204579 Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: f497013781b04da19d43a50e02817662 Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1456204579 Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsAdminTestJSON-1456204579-project Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 55b07a76048b47329276a0600cc1232b Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsAdminTestJSON-1456204579-project Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "test", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "984467313"}} Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:00.296820 n-d-858384-11 devstack@n-api.service[127031]: exception: Flavor 984467313 could not be found. Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '984467313'}}} Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 984467313 could not be found. Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:00.298017 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 984467313 could not be found. Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:00.299160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:00.301985 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:00.301985 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:00.301985 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:00.301985 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 984467313 could not be found. Oct 13 08:34:00.301985 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:00.303080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49a07681-3d64-4872-b1f2-c46c5b2f3649 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:00.305662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a837b6ef-0370-4872-9ce8-5486bfc6dca5 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Returning 400 to user: Flavor 984467313 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:00.306129 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49a07681-3d64-4872-b1f2-c46c5b2f3649 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1241 microversion: 2.1 time: 0.183812 Oct 13 08:34:00.307383 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 16/46] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.309394 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a837b6ef-0370-4872-9ce8-5486bfc6dca5 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.076203 Oct 13 08:34:00.310827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 31/47] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:00 2022] POST /compute/v2.1/servers => generated 80 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:34:00.313433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.314144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:00.333592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:00.334087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:00.334640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:00.335396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:00.335856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:00.336282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:00.356001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78ac9b46-464b-4658-8f76-3b06da578c4f tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.423195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78ac9b46-464b-4658-8f76-3b06da578c4f tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/984467313" status: 202 len: 0 microversion: 2.1 time: 0.094745 Oct 13 08:34:00.428040 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 32/48] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:34:00 2022] DELETE /compute/v2.1/flavors/984467313 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:00.444341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4e99722-5b96-4899-8da4-6b0b3ab1b077 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.502432 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4e99722-5b96-4899-8da4-6b0b3ab1b077 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068825 Oct 13 08:34:00.503604 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 33/49] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.534681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-117f8d2e-c402-413a-a408-5d3f9f36d314 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-23406392", "id": 2139812347, "os-flavor-access:is_public": "False"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:00.536458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:00.552636 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e329c289-f3b3-4ce4-a88f-f555db8de331 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1292 microversion: 2.1 time: 0.244091 Oct 13 08:34:00.567160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 17/50] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1292 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.586016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-117f8d2e-c402-413a-a408-5d3f9f36d314 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.061174 Oct 13 08:34:00.601624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a8c6257-937c-4aa7-98b5-3bcd5df61eab tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-158564392", "id": 1292520389, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:00.607081 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 34/51] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:00 2022] POST /compute/v2.1/flavors => generated 413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.627875 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a8c6257-937c-4aa7-98b5-3bcd5df61eab tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031079 Oct 13 08:34:00.638201 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 18/52] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:00 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.641657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-800965ab-8b00-4f1b-8ae1-8357d583e3c1 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.672377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-800965ab-8b00-4f1b-8ae1-8357d583e3c1 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 416 microversion: 2.1 time: 0.035189 Oct 13 08:34:00.673276 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 35/53] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 416 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.687249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da1c96d3-9c30-4f03-8883-83044bfaba43 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.716666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da1c96d3-9c30-4f03-8883-83044bfaba43 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 416 microversion: 2.1 time: 0.034125 Oct 13 08:34:00.731265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f3ce1c9-78f5-4f3c-926d-036fb853379e tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.738325 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 19/54] 10.222.0.23 () {58 vars in 1177 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 416 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.749447 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f3ce1c9-78f5-4f3c-926d-036fb853379e tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 416 microversion: 2.1 time: 0.022257 Oct 13 08:34:00.750034 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 36/55] 10.222.0.23 () {58 vars in 1171 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 416 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:00.764336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-668b41da-1a54-416c-aabf-ed179c043c85 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.812344 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-668b41da-1a54-416c-aabf-ed179c043c85 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 416 microversion: 2.1 time: 0.052806 Oct 13 08:34:00.817722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 20/56] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 416 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:00.826565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f07e4d6a-b9ba-42ef-bbf0-edd7c54b5e17 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.880477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f07e4d6a-b9ba-42ef-bbf0-edd7c54b5e17 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.057160 Oct 13 08:34:00.885129 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 37/57] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.910013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ccd014ed-8dc5-4249-ab34-0ea3c6930689 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:00.969210 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ccd014ed-8dc5-4249-ab34-0ea3c6930689 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.066293 Oct 13 08:34:00.970085 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 21/58] 10.222.0.23 () {58 vars in 1175 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:00.996511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73283b43-e596-4382-8331-5347d739dacc tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.078814 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73283b43-e596-4382-8331-5347d739dacc tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.086608 Oct 13 08:34:01.087907 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 38/59] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:34:00 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.100867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c906348-96cb-435c-b70c-cdd4f3c81b8c tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.121102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:01.132101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c906348-96cb-435c-b70c-cdd4f3c81b8c tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.036282 Oct 13 08:34:01.133524 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 22/60] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.158044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ecc0052-0033-450b-9e5b-d695499cff78 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.197997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ecc0052-0033-450b-9e5b-d695499cff78 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1292520389" status: 202 len: 0 microversion: 2.1 time: 0.047297 Oct 13 08:34:01.203245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 39/61] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:01 2022] DELETE /compute/v2.1/flavors/1292520389 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:01.207567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20908bc4-f606-4bd3-8540-83532c5d3301 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.266235 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20908bc4-f606-4bd3-8540-83532c5d3301 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062832 Oct 13 08:34:01.281611 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 23/62] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.286115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0228f161-f941-44a2-a32e-496b89235217 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.320139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0228f161-f941-44a2-a32e-496b89235217 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2139812347" status: 202 len: 0 microversion: 2.1 time: 0.038343 Oct 13 08:34:01.324317 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 40/63] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:01 2022] DELETE /compute/v2.1/flavors/2139812347 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:01.333645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00a7d5a7-5d10-4ab1-ac37-be4257ca0af6 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.336504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.351067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:01.360980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00a7d5a7-5d10-4ab1-ac37-be4257ca0af6 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032872 Oct 13 08:34:01.362553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 24/64] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.367086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:01.367586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:01.377072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:01.380242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:01.380887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:01.381721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:01.386888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a20fd785-1f33-4f93-b4ca-ec3a33e19421 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1771965063", "id": 500569427, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:01.455037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a20fd785-1f33-4f93-b4ca-ec3a33e19421 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.070370 Oct 13 08:34:01.465507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 25/65] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:01.479033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99c93988-d3af-46f7-84b2-e6166f403051 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.510396 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99c93988-d3af-46f7-84b2-e6166f403051 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040842 Oct 13 08:34:01.523810 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 26/66] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.530611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d03a0b8a-eae6-4c4a-85bb-0db2c67d380a tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.567010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d03a0b8a-eae6-4c4a-85bb-0db2c67d380a tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040241 Oct 13 08:34:01.580242 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 27/67] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.588749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.590500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:01.597629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:01.598287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:01.598862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:01.600514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:01.601086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:01.601643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:01.705976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:01.749146 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd99aa1b-7904-4253-9efd-f7e9133578cf tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1289 microversion: 2.1 time: 0.420857 Oct 13 08:34:01.757311 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 41/68] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1289 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.769098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c8fc964-ac3b-4148-bd32-050e3e123f35 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.857275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:01.862298 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c8fc964-ac3b-4148-bd32-050e3e123f35 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/500569427" status: 202 len: 0 microversion: 2.1 time: 0.103323 Oct 13 08:34:01.863190 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 42/69] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:34:01 2022] DELETE /compute/v2.1/flavors/500569427 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:01.875550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9aea170e-e063-4db8-bb9e-7e0164a1b3e9 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:01.884313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbebb213-f1f4-41c0-8f07-880a9e496c4e tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1298 microversion: 2.1 time: 0.301422 Oct 13 08:34:01.886965 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 28/70] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1298 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.932652 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9aea170e-e063-4db8-bb9e-7e0164a1b3e9 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063178 Oct 13 08:34:01.933462 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 43/71] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:01.956148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfc23ba3-02c5-42dd-8a78-143d750cf615 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1171911237", "id": 1228976986, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:01.988944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfc23ba3-02c5-42dd-8a78-143d750cf615 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036889 Oct 13 08:34:01.989595 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 29/72] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:02.003157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25b97219-79dc-4fd0-a3ba-acff897d0989 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:02.073458 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25b97219-79dc-4fd0-a3ba-acff897d0989 tempest-FlavorsAdminTestJSON-1456204579 tempest-FlavorsAdminTestJSON-1456204579-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.073411 Oct 13 08:34:02.077419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 44/73] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:01 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:02.095879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7641e151-f18b-4337-9d61-8735c2049f0f tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:02.154250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7641e151-f18b-4337-9d61-8735c2049f0f tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1228976986" status: 202 len: 0 microversion: 2.1 time: 0.063075 Oct 13 08:34:02.155151 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 30/74] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:02 2022] DELETE /compute/v2.1/flavors/1228976986 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:02.171960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f406dec2-4d34-47bc-977a-6a9d90dc5fc5 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:02.207236 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f406dec2-4d34-47bc-977a-6a9d90dc5fc5 tempest-FlavorsAdminTestJSON-584613777 tempest-FlavorsAdminTestJSON-584613777-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047159 Oct 13 08:34:02.208703 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 45/75] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:02.782444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:02.783169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:02.797579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:02.798613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:02.799201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:02.800219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:02.800679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:02.801110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:02.916698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:02.917488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:02.933040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:02.935815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:02.937233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:02.940008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:02.941414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:02.942208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:03.458109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:03.477037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d65cf4b1-20e6-4dbf-b9f9-91baa4f4ec58 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1298 microversion: 2.1 time: 0.569442 Oct 13 08:34:03.478107 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 46/76] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:02 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1298 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:04.205194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:04.221518 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1911486a-d657-47bf-82d2-d6eef7588e84 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1295 microversion: 2.1 time: 1.441430 Oct 13 08:34:04.225286 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 31/77] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:02 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1295 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:04.449611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae63c0ae-247d-452e-80b5-37fd1f11d7f3 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Calling method '.version_select at 0x7f537766d820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:04.454538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae63c0ae-247d-452e-80b5-37fd1f11d7f3 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '9bd97610150245d18786821d260614f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09916afbd2aa47f3a3b32cf30292b61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae63c0ae-247d-452e-80b5-37fd1f11d7f3 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Request method failure captured: Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR815ekExhpQ1HxgbQW7IM5ZIXvdewRKjdfMOGpdnZXQO8y09_Wf6HVB01hGIMVns9WvSTydBQJaFExz2xLBbWV4W9wWiQgxy3AiuQ6CcVjh9Wrwl8khTRI-C4j_gY5flGs6qeehdDcZRdOMfrldbf3siorADuEYrzFfJAFQCGVZ0y2E Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:04.456798 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9bd97610150245d18786821d260614f4 Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: action_args: {} Oct 13 08:34:04.458730 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:04.459647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 13 08:34:04.460871 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.467424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae63c0ae-247d-452e-80b5-37fd1f11d7f3 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:04.469536 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae63c0ae-247d-452e-80b5-37fd1f11d7f3 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.780737 Oct 13 08:34:04.477658 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 47/78] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:34:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 789 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:04.483965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80ff9f06-f5d0-4f9f-a398-c191a19d7231 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Calling method '.version_select at 0x7f5377682d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:04.486805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80ff9f06-f5d0-4f9f-a398-c191a19d7231 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '9bd97610150245d18786821d260614f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09916afbd2aa47f3a3b32cf30292b61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80ff9f06-f5d0-4f9f-a398-c191a19d7231 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Request method failure captured: Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR815ekExhpQ1HxgbQW7IM5ZIXvdewRKjdfMOGpdnZXQO8y09_Wf6HVB01hGIMVns9WvSTydBQJaFExz2xLBbWV4W9wWiQgxy3AiuQ6CcVjh9Wrwl8khTRI-C4j_gY5flGs6qeehdDcZRdOMfrldbf3siorADuEYrzFfJAFQCGVZ0y2E Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:04.490243 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9bd97610150245d18786821d260614f4 Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:34:04.491608 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:04.492509 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 13 08:34:04.493680 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.509505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:04.509953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80ff9f06-f5d0-4f9f-a398-c191a19d7231 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:04.512272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80ff9f06-f5d0-4f9f-a398-c191a19d7231 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034754 Oct 13 08:34:04.513379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:04.515070 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 32/79] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:04.551190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2ce87cf-b9e6-4273-a4c4-8f77f3d5be54 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Calling method '.version_select at 0x7f5377662700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:04.559002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2ce87cf-b9e6-4273-a4c4-8f77f3d5be54 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '9bd97610150245d18786821d260614f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09916afbd2aa47f3a3b32cf30292b61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:04.560273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:04.560893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:04.562791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:04.568435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:04.572569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2ce87cf-b9e6-4273-a4c4-8f77f3d5be54 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Request method failure captured: Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR815ekExhpQ1HxgbQW7IM5ZIXvdewRKjdfMOGpdnZXQO8y09_Wf6HVB01hGIMVns9WvSTydBQJaFExz2xLBbWV4W9wWiQgxy3AiuQ6CcVjh9Wrwl8khTRI-C4j_gY5flGs6qeehdDcZRdOMfrldbf3siorADuEYrzFfJAFQCGVZ0y2E Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:04.573295 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9bd97610150245d18786821d260614f4 Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:34:04.574615 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:04.575968 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 13 08:34:04.577044 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:04.578960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2ce87cf-b9e6-4273-a4c4-8f77f3d5be54 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:04.580124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:04.581654 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2ce87cf-b9e6-4273-a4c4-8f77f3d5be54 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.060905 Oct 13 08:34:04.592510 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 33/80] 10.222.0.23 () {58 vars in 1179 bytes} [Thu Oct 13 08:34:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:05.265308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Calling method '.version_select at 0x7f5377662280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:05.289063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127030) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 13 08:34:05.295529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.297219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.298949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:05.354945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.355738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.359742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:05.375213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.376063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.376720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:05.387123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f088a714-1d3c-42e5-8bd0-1e233e67df70 tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.791799 Oct 13 08:34:05.388152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 34/81] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:05.394213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:05.395293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:05.406831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.407715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.408389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:05.410631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.412586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.428133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:05.817867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:05.829923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d9c14f4-36e1-43c2-a1c3-087a8f9083bc tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1295 microversion: 2.1 time: 0.436474 Oct 13 08:34:05.832022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 35/82] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:05 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1295 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:05.866132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-368c42aa-9a16-4f4e-88b1-e4d6aaaa734a tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Calling method '.version_select at 0x7f5377697d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:05.869779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-368c42aa-9a16-4f4e-88b1-e4d6aaaa734a tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '9bd97610150245d18786821d260614f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09916afbd2aa47f3a3b32cf30292b61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-368c42aa-9a16-4f4e-88b1-e4d6aaaa734a tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Request method failure captured: Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR815ekExhpQ1HxgbQW7IM5ZIXvdewRKjdfMOGpdnZXQO8y09_Wf6HVB01hGIMVns9WvSTydBQJaFExz2xLBbWV4W9wWiQgxy3AiuQ6CcVjh9Wrwl8khTRI-C4j_gY5flGs6qeehdDcZRdOMfrldbf3siorADuEYrzFfJAFQCGVZ0y2E Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:05.876132 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9bd97610150245d18786821d260614f4 Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '1'} Oct 13 08:34:05.877399 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:05.878176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 13 08:34:05.879316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.882769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-368c42aa-9a16-4f4e-88b1-e4d6aaaa734a tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:05.885190 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-368c42aa-9a16-4f4e-88b1-e4d6aaaa734a tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.049272 Oct 13 08:34:05.888749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 36/83] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:34:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:05.897568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-002b7b3d-7bc7-4402-bd8a-56f28b16ea9d tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Calling method '.version_select at 0x7f537764daf0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:05.902535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-002b7b3d-7bc7-4402-bd8a-56f28b16ea9d tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] HTTP exception thrown: Hypervisor with ID 'dfd424a0-6975-4554-b3af-116e91584817' could not be found. Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-002b7b3d-7bc7-4402-bd8a-56f28b16ea9d tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Request method failure captured: Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/dfd424a0-6975-4554-b3af-116e91584817/uptime HTTP/1.1 Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR817XqwhXQIKVt4XCPpqtvSTE9UxdcXb0bDOPc7l7Z8E_CceSdzoMXu1GUOHX4IRuAaKm4ufIzXtv-O3x-p6mfBsKKZi8vlfWVKMpbb3aFLLTP9bFMbOmXR0FSjqBSm9lW9RwuBA3qdgn6zvcxzh7VUb34PdGdcdudYKMd8JgPk0FLA Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 906b884b6f3a48dd94cae5da37aac9db Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:05.928182 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 906b884b6f3a48dd94cae5da37aac9db Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ef7b24662dac4fb2b497642d4968fd74 Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: exception: Hypervisor with ID 'dfd424a0-6975-4554-b3af-116e91584817' could not be found. Oct 13 08:34:05.929380 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'dfd424a0-6975-4554-b3af-116e91584817'} Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dfd424a0-6975-4554-b3af-116e91584817' Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 13 08:34:05.930055 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dfd424a0-6975-4554-b3af-116e91584817' could not be found. Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:05.932225 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dfd424a0-6975-4554-b3af-116e91584817' could not be found. Oct 13 08:34:05.933383 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:05.936600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-002b7b3d-7bc7-4402-bd8a-56f28b16ea9d tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Returning 404 to user: Hypervisor with ID 'dfd424a0-6975-4554-b3af-116e91584817' could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:05.939309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-002b7b3d-7bc7-4402-bd8a-56f28b16ea9d tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/dfd424a0-6975-4554-b3af-116e91584817/uptime" status: 404 len: 123 microversion: 2.1 time: 0.045444 Oct 13 08:34:05.942124 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 37/84] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Oct 13 08:34:05 2022] GET /compute/v2.1/os-hypervisors/dfd424a0-6975-4554-b3af-116e91584817/uptime => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:05.954209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Calling method '.version_select at 0x7f53776625e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:05.964016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:05.968756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:05.970822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:06.023712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:06.026126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:06.026738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:06.047225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:06.047854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:06.048471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:06.055497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12a381ea-ac9d-473f-86d9-43dfe696badc tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105827 Oct 13 08:34:06.056194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 38/85] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:06.068856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c4d107a-d64b-49d2-b3fe-33b3a66cbca2 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Calling method '.version_select at 0x7f5377697790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:06.071773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c4d107a-d64b-49d2-b3fe-33b3a66cbca2 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '9bd97610150245d18786821d260614f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09916afbd2aa47f3a3b32cf30292b61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c4d107a-d64b-49d2-b3fe-33b3a66cbca2 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Request method failure captured: Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR815ekExhpQ1HxgbQW7IM5ZIXvdewRKjdfMOGpdnZXQO8y09_Wf6HVB01hGIMVns9WvSTydBQJaFExz2xLBbWV4W9wWiQgxy3AiuQ6CcVjh9Wrwl8khTRI-C4j_gY5flGs6qeehdDcZRdOMfrldbf3siorADuEYrzFfJAFQCGVZ0y2E Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:06.073993 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09916afbd2aa47f3a3b32cf30292b61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 09916afbd2aa47f3a3b32cf30292b61a Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933 Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9bd97610150245d18786821d260614f4 Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1487898933-project Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '1'} Oct 13 08:34:06.075434 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:06.076129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 13 08:34:06.077188 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.080269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c4d107a-d64b-49d2-b3fe-33b3a66cbca2 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:06.081313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c4d107a-d64b-49d2-b3fe-33b3a66cbca2 tempest-HypervisorAdminNegativeTestJSON-1487898933 tempest-HypervisorAdminNegativeTestJSON-1487898933-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016984 Oct 13 08:34:06.082167 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 39/86] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:06.093849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cec5291-4136-4a49-b10e-e52468db432b tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Calling method '.version_select at 0x7f5377813310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:06.095903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5cec5291-4136-4a49-b10e-e52468db432b tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] HTTP exception thrown: Hypervisor with ID '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' could not be found. Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cec5291-4136-4a49-b10e-e52468db432b tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Request method failure captured: Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/9fc81d4d-b880-4d0a-acb1-19e8cb4cb064 HTTP/1.1 Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR817XqwhXQIKVt4XCPpqtvSTE9UxdcXb0bDOPc7l7Z8E_CceSdzoMXu1GUOHX4IRuAaKm4ufIzXtv-O3x-p6mfBsKKZi8vlfWVKMpbb3aFLLTP9bFMbOmXR0FSjqBSm9lW9RwuBA3qdgn6zvcxzh7VUb34PdGdcdudYKMd8JgPk0FLA Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 906b884b6f3a48dd94cae5da37aac9db Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:06.098502 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/906b884b6f3a48dd94cae5da37aac9db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 906b884b6f3a48dd94cae5da37aac9db Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-347745180 Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ef7b24662dac4fb2b497642d4968fd74 Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: exception: Hypervisor with ID '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' could not be found. Oct 13 08:34:06.099652 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064'} Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 13 08:34:06.100285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:34:06.101439 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' could not be found. Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' could not be found. Oct 13 08:34:06.103359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:06.105447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cec5291-4136-4a49-b10e-e52468db432b tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] Returning 404 to user: Hypervisor with ID '9fc81d4d-b880-4d0a-acb1-19e8cb4cb064' could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:06.107095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cec5291-4136-4a49-b10e-e52468db432b tempest-HypervisorAdminNegativeTestJSON-347745180 tempest-HypervisorAdminNegativeTestJSON-347745180-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/9fc81d4d-b880-4d0a-acb1-19e8cb4cb064" status: 404 len: 123 microversion: 2.1 time: 0.017051 Oct 13 08:34:06.114649 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 40/87] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Oct 13 08:34:06 2022] GET /compute/v2.1/os-hypervisors/9fc81d4d-b880-4d0a-acb1-19e8cb4cb064 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:06.265098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:06.281949 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d848bde-de38-4333-b7e9-e8ae44f42f9a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 1.779726 Oct 13 08:34:06.282593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 48/88] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:04 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:06.891113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:06.894672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:06.901810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:06.915931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:06.916478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:06.916991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:06.921636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:06.922115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:06.922581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:07.349508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Calling method '.version_select at 0x7f53777c03a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:07.349508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:07.350050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:07.350541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:07.376478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:07.377803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:07.379259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:07.399920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:07.400694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:07.403001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:07.416090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-043ce00e-3987-432c-8729-6d3bd4c36875 tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.799321 Oct 13 08:34:07.417411 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 41/89] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:34:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:07.430131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:07.433355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:07.452052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:07.452866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:07.454744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:07.457247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:07.458870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:07.461255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:08.321639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:08.344960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-768275dc-fcc1-4905-92c0-614380239e09 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.925784 Oct 13 08:34:08.346824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 42/90] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:07 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:08.357248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Calling method '.version_select at 0x7f5377860f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:08.366497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:08.367812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:08.368975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:08.396184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:08.397038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:08.398188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:08.412110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9d9522d-f282-436a-962b-b4b1e3bb232f tempest-HypervisorAdminV228Test-943350575 tempest-HypervisorAdminV228Test-943350575-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.063884 Oct 13 08:34:08.420111 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 43/91] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:34:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:09.227173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:09.369663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:09.370532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:09.374806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:09.398598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:09.399135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:09.399567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:09.410809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:09.411577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:09.412087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:10.301929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:10.322328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:10.346529 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d66c5ec-369c-44c4-aa34-65fdaa9c307e tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 3.491512 Oct 13 08:34:10.347160 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 49/92] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:06 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 3496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:10.538834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e24feec-448f-4ed8-a243-090c0594392d", "tag": "d35bb426-a67a-4614-87ac-07437c22eaa5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:10.570277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:10.570812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:10.571252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:10.644586 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Creating event network-changed:d35bb426-a67a-4614-87ac-07437c22eaa5 for instance 3e24feec-448f-4ed8-a243-090c0594392d on n-h1-858384-11 Oct 13 08:34:10.645166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:34:10.645573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2730fd3f-db03-4747-a3b1-4cf6c397779d req-12602f8b-ceba-4862-84f7-ee62f8de00a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:34:10.669771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:10.673029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:10.673884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:10.677766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:10.694183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:10.694836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:10.728832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.rpcapi [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 13 08:34:10.734395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] Releasing lock "compute-rpcapi-router" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:34:10.788328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2de6b1b6-c188-4512-b6c6-e039dbb34bb6 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435928 Oct 13 08:34:10.788970 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 50/93] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:11.113569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:11.121995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-049c041e-154e-4de4-a20e-aecf4c17ac80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 1.756154 Oct 13 08:34:11.127589 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 44/94] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:09 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:11.378458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:11.379299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:11.390648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:11.394666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:11.395779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:11.396537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:11.397011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:11.397445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:11.909659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:11.931629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa1e3102-8b43-4184-aba5-f5333b475b52 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.557379 Oct 13 08:34:11.933049 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 51/95] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:11 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:12.158955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:12.160330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:12.181672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:12.182391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:12.183057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:12.184003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:12.184703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:12.185366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:12.810299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:12.819354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5eb93d90-ce4e-4822-a9d6-10ca7e39a304 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.664227 Oct 13 08:34:12.825481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 45/96] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:12 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:12.962683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:12.964009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:12.973036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:12.974973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:12.979002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:12.979944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:12.980586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:12.981219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:13.182331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b273cf8-ee47-485b-bc2a-79bf12171bf3", "tag": "019f472d-c84a-49d1-8ec1-86e6a0b5d1b7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:13.211500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:13.221819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:13.224931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:13.281458 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Creating event network-changed:019f472d-c84a-49d1-8ec1-86e6a0b5d1b7 for instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 on n-h1-858384-11 Oct 13 08:34:13.287149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:34:13.287849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0856f829-b486-458f-9068-ec163b1262d1 req-2e45f7b0-9c18-4e04-ab3a-90eb2b4c3b99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:34:13.289159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:13.289851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:13.303127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:13.304276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:13.305000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:13.305631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:13.321020 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.rpcapi [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 13 08:34:13.322293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] Releasing lock "compute-rpcapi-router" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:34:13.349103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-499504e2-9b7b-4bd9-9468-b0781764a1ec None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170422 Oct 13 08:34:13.350357 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 46/97] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:13.456714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:13.467217 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd615beb-192e-4717-ad7e-de3c6781dc75 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.508457 Oct 13 08:34:13.475311 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 52/98] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:12 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:13.849942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:13.850818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:13.860675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:13.865806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:13.866451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:13.867315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:13.868015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:13.868655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:14.506906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:14.508265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:14.523826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:14.524663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:14.525344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:14.526261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:14.530724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:14.531477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:15.145673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:15.157849 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-201cdc88-98b7-4dae-b61a-aa518b6763bb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.654716 Oct 13 08:34:15.169955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:15.177942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8681b2ca-49b0-49a6-bdac-a7cf5385f871 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 1.332377 Oct 13 08:34:15.178482 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 53/99] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:14 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:15.192622 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 47/100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:13 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:16.190939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:16.191557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:16.198010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:16.204935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:16.206159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:16.218306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:16.221880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:16.223567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:16.224055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:16.224486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:16.225198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:16.225648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:16.226064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:16.229626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:16.230121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:16.230585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:16.695439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:16.706228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f1b4093-a304-4c84-8ed9-2fca147f04dc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.505273 Oct 13 08:34:16.723479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:16.725285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 48/101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:16 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:16.736280 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9cfc899f-cd1e-475f-8a04-6f0ad0f4b836 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.549092 Oct 13 08:34:16.738017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:16 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:17.732122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:17.733626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:17.749702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:17.761167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:17.762591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:17.771458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:17.772374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:17.776110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:17.776622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:17.777323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:17.778956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:17.781219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:17.785234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:17.786564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:17.791962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:17.795061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:18.100816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:18.122594 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76b561e2-7d7a-4fc6-b8c7-c95312ea4256 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.364590 Oct 13 08:34:18.142206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 55/103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:17 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:18.172590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:18.183635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7017946-30b8-4355-862a-455c3d687bad tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.455499 Oct 13 08:34:18.187524 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 49/104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:17 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:18.783024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2afedef9-f297-438f-9bc3-9ce067285c78 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:18.796104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2afedef9-f297-438f-9bc3-9ce067285c78 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.397969 Oct 13 08:34:18.796689 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:34:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:19.123047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-832e29bc-fb48-41d8-8110-405ff2e271d2 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1104593220", "id": 1863734187, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:19.155574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-832e29bc-fb48-41d8-8110-405ff2e271d2 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.347796 Oct 13 08:34:19.156051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:19.158840 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 50/106] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:18 2022] POST /compute/v2.1/flavors => generated 425 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:19.161329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:19.173986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3cdb3c9a-4b2c-4bbb-b84d-cf6a99612e1c tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:19.174366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:19.175709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:19.176475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:19.177367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:19.178725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:19.179491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:19.193766 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3cdb3c9a-4b2c-4bbb-b84d-cf6a99612e1c tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025302 Oct 13 08:34:19.193766 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 51/107] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Oct 13 08:34:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:19.219171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db1d1ec3-505b-4a54-851d-c1fc12ab267a tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-813489526", "id": 928434669, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:19.268583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db1d1ec3-505b-4a54-851d-c1fc12ab267a tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.068295 Oct 13 08:34:19.269561 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 52/108] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:19 2022] POST /compute/v2.1/flavors => generated 421 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:19.274560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:19.275853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:19.286631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:19.289586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:19.290208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:19.291116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:19.291800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:19.292375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:19.447456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:19.456638 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9924774f-a704-4c6e-8d5d-dbad66b4a2ba tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.311259 Oct 13 08:34:19.457548 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 57/109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:19 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:19.479950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-31d0ca6a-ead1-4c83-a96a-7b9f7661bca8 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:19.486384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:19.490262 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-31d0ca6a-ead1-4c83-a96a-7b9f7661bca8 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021808 Oct 13 08:34:19.491454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 58/110] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Oct 13 08:34:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:19.507829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ccbd1ead-0fd0-48c0-a6f3-f336cc285819 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Action: 'create', calling method: .version_select at 0x7f5377603ee0>, body: {"keypair": {"name": "tempest-keypair-571656106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhDkgTC/2bmBikUCWA38PgXyGRG7dVhtAD+AwJmfPWDTvhLAWN0/nGUgZItF7CW9QQnqghrbPGz82WfQtuR0fWg8OboTPtggNKRvl3K9Zs28K0EWD6hKIxCYfj+nGQ2hA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:19.534229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:19.539357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:19.546718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4ba3dcb3-c0ab-4457-9192-1b6dbda95fa7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.276100 Oct 13 08:34:19.551554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 53/111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:19 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:19.561284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ccbd1ead-0fd0-48c0-a6f3-f336cc285819 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for project a695033da9494b63aa3f1b4e6927efd1. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:19.587978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ccbd1ead-0fd0-48c0-a6f3-f336cc285819 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for user a8d17f582a274ea9b07f376fcfdcb19e and project a695033da9494b63aa3f1b4e6927efd1. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:19.697671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ccbd1ead-0fd0-48c0-a6f3-f336cc285819 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195479 Oct 13 08:34:19.698885 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 59/112] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:34:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:20.127319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d759af9c-006b-4e10-a2eb-3bef6187bfa9 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:20.131959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d759af9c-006b-4e10-a2eb-3bef6187bfa9 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d759af9c-006b-4e10-a2eb-3bef6187bfa9 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin] Request method failure captured: Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82L39jfg4eLpQhbVmssVXliMAhzw-73zoNUXISZc6IwXijRUSdIuYxCt-znTqMjBwfI31fh8uHvbXBp2pXBQuoiKiz2ZXoiBEM9eDtbhqB2k8_Kp30tivdckbeOVZWPdZAz2GUNkmqR8D2uANk557i1H0RxsZvKz_OVZTjtiXjALyk Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3749f70da3eb4bbe8ffaf8bd0f6cba8f Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:20.142516 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3749f70da3eb4bbe8ffaf8bd0f6cba8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3749f70da3eb4bbe8ffaf8bd0f6cba8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3749f70da3eb4bbe8ffaf8bd0f6cba8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3749f70da3eb4bbe8ffaf8bd0f6cba8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3749f70da3eb4bbe8ffaf8bd0f6cba8f Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c95f2dc7445449048f173caf6036969c Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:20.144061 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid timestamp for date invalid_time Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'invalid_time'} Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:20.144793 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 13 08:34:20.146148 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.149139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d759af9c-006b-4e10-a2eb-3bef6187bfa9 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:20.150741 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d759af9c-006b-4e10-a2eb-3bef6187bfa9 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940 tempest-InstanceUsageAuditLogNegativeTestJSON-2060932940-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.465139 Oct 13 08:34:20.152620 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 54/113] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Oct 13 08:34:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 13 08:34:20.474283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fcaed29-7ad1-4b48-bc15-a3f837920c6a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:20.476920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fcaed29-7ad1-4b48-bc15-a3f837920c6a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5df3aff1651a468097788e7dcbb2d770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e47db697044411aaa9a1c62e20653e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fcaed29-7ad1-4b48-bc15-a3f837920c6a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Request method failure captured: Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82JSLhpis77kaD86Ej6Ot0GHPEE6uVRxJTdRdC2YBtuPnZ-Mis9ENzJr_NWww-SDI-YjVfkyWULwVyX1bBK0P3FUtPQIq4Cmm4KksgT2MHICHzZFncRzvk6ACtoxeHj69Zxh-1ldg9qMF-aoola4b-UgXz3w5BBBkyJBhP67NE3t8s Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 82e47db697044411aaa9a1c62e20653e Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:20.484981 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82e47db697044411aaa9a1c62e20653e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 82e47db697044411aaa9a1c62e20653e Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5df3aff1651a468097788e7dcbb2d770 Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project Oct 13 08:34:20.486424 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: action_args: {} Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:20.487107 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 13 08:34:20.488389 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.489429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:20.489429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:20.492060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fcaed29-7ad1-4b48-bc15-a3f837920c6a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:20.496213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fcaed29-7ad1-4b48-bc15-a3f837920c6a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.335662 Oct 13 08:34:20.500541 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 60/114] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:34:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:20.516459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ae58ea8-e250-4d18-a543-931a224d5f2a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:20.526229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ae58ea8-e250-4d18-a543-931a224d5f2a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5df3aff1651a468097788e7dcbb2d770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e47db697044411aaa9a1c62e20653e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ae58ea8-e250-4d18-a543-931a224d5f2a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Request method failure captured: Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-13%2008:34:20 HTTP/1.1 Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82JSLhpis77kaD86Ej6Ot0GHPEE6uVRxJTdRdC2YBtuPnZ-Mis9ENzJr_NWww-SDI-YjVfkyWULwVyX1bBK0P3FUtPQIq4Cmm4KksgT2MHICHzZFncRzvk6ACtoxeHj69Zxh-1ldg9qMF-aoola4b-UgXz3w5BBBkyJBhP67NE3t8s Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 82e47db697044411aaa9a1c62e20653e Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:20.528785 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82e47db697044411aaa9a1c62e20653e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82e47db697044411aaa9a1c62e20653e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 82e47db697044411aaa9a1c62e20653e Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5df3aff1651a468097788e7dcbb2d770 Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project Oct 13 08:34:20.530138 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '2022-10-13 08:34:20'} Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:20.530857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 13 08:34:20.532077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:20.536345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:20.537296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:20.537749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:20.538144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ae58ea8-e250-4d18-a543-931a224d5f2a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:20.539292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ae58ea8-e250-4d18-a543-931a224d5f2a tempest-InstanceUsageAuditLogNegativeTestJSON-849403294 tempest-InstanceUsageAuditLogNegativeTestJSON-849403294-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-13 08:34:20" status: 403 len: 128 microversion: 2.1 time: 0.034671 Oct 13 08:34:20.541208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:20.541700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:20.542148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:20.544415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 61/115] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 08:34:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-13%2008%3A34%3A20 => generated 128 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:20.579284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:20.580155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:20.594737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:20.595868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:20.596864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:20.599542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:20.601692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:20.603351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:20.722567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:20.891737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:20.916894 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-362a26e5-9a4f-4c75-b922-640eb466d985 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.435365 Oct 13 08:34:20.918949 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 55/116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:20 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:21.120919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:21.154732 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3ebbaa0-7f1b-471b-a8f7-4cbee5d2536b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.579641 Oct 13 08:34:21.156157 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 62/117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:20 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:21.405697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10d86480-0989-4882-8162-6a69e8391b1e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1443704703", "id": 2070986902, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:21.439169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10d86480-0989-4882-8162-6a69e8391b1e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.518923 Oct 13 08:34:21.440809 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 56/118] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:20 2022] POST /compute/v2.1/flavors => generated 439 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:21.456567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d426434-b4ea-4296-a8ff-235696ebe245 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:21.937090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1948760453", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:21.979960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d426434-b4ea-4296-a8ff-235696ebe245 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2070986902/action" status: 200 len: 97 microversion: 2.1 time: 0.530425 Oct 13 08:34:21.985716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 63/119] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:21 2022] POST /compute/v2.1/flavors/2070986902/action => generated 97 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:21.999127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:22.011648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:22.018658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.019401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.020058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.020952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.022135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.022723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.036379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:34:22.365666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:22.367935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=89 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:22.384014 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdbd1900-3ec5-4e1a-80fa-bdcd0770090b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.390303 Oct 13 08:34:22.388608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 64/120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:21 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:22.406137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9070b485-df77-4934-9b34-4755a9702b0f tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:22.544299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9070b485-df77-4934-9b34-4755a9702b0f tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9070b485-df77-4934-9b34-4755a9702b0f tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Request method failure captured: Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/flavors/2070986902/action HTTP/1.1 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 67 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82Kv8YrhE1k2srbKep_b663GYe4fvSWE9qcQE1lsmhaRomRzqoxRlgvV20wbC84Jw5IMS1edo0G9mI6h-AqlJ1wRj4OMcSGms5CicOj36mk9QP94Fh8O3dYU82MjF3_TB7ut2y3grPyEM_Dt_alfNcvZXPnOfzlhPd1FwZ6xeuWE00 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:22.580007 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4061376f6741a88dcf262633a9429e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 235c3ce4a2c94c6293061c6df0a739f7 Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} Oct 13 08:34:22.581257 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: exception: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '2070986902', 'body': {'addTenantAccess': {'tenant': '8741b46d0dad47c59cfc44ed4beb8179'}}} Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:34:22.581939 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-8741b46d0dad47c59cfc44ed4beb8179' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi session.flush() Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 08:34:22.582944 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 08:34:22.585696 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:34:22.586978 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-8741b46d0dad47c59cfc44ed4beb8179' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 13, 8, 34, 22, 534140), 'updated_at': None, 'flavor_id': 29, 'project_id': '8741b46d0dad47c59cfc44ed4beb8179'}] Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:22.589184 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:22.590539 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:22.591780 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:22.592994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. Oct 13 08:34:22.592994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:22.603142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9070b485-df77-4934-9b34-4755a9702b0f tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 8741b46d0dad47c59cfc44ed4beb8179 combination. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:22.606740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9070b485-df77-4934-9b34-4755a9702b0f tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2070986902/action" status: 409 len: 152 microversion: 2.1 time: 0.216212 Oct 13 08:34:22.612411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 65/121] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:22 2022] POST /compute/v2.1/flavors/2070986902/action => generated 152 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:22.626099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:34:22.628759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:34:22.628759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:34:22.628759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:34:22.628759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:34:22.645862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:22.647253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:22.671579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.673429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.674145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.674859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.675323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.676105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.676218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.676590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.680272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:22.680965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.681418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:22.681858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:22.714177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Getting quotas for project a6ba7d819f68495182c9cd6d79ac1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:22.736733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Getting quotas for user 9d00a3a275b54978b4380b971c91d659 and project a6ba7d819f68495182c9cd6d79ac1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:22.759015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:34:22.779351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:34:22.845232 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f80f869-2ab5-4533-bf1d-1aabe2e984cf tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028070 Oct 13 08:34:22.846885 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 57/122] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:34:22.859933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9e4c204-8c5b-4a6f-a235-7645720760ac tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:23.097911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:23.107927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a6fb4e5-9007-4cda-b7ac-62b723260318 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.492058 Oct 13 08:34:23.108510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 66/123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:22 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:23.133313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1e20450-401a-4d41-9bf2-c6f56ee6cd23 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:23.134010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1e20450-401a-4d41-9bf2-c6f56ee6cd23 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:23.247535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1e20450-401a-4d41-9bf2-c6f56ee6cd23 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:23.256542 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1e20450-401a-4d41-9bf2-c6f56ee6cd23 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1219 microversion: 2.1 time: 0.129514 Oct 13 08:34:23.257117 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 67/124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:23 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:23.276083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2015229807", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "928434669", "adminPass": "***", "networks": [{"uuid": "d08e537b-1238-4354-9155-b6cf1b700138"}], "security_groups": [{"name": "tempest-securitygroup--743865233"}], "key_name": "tempest-keypair-571656106", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:23.359984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9e4c204-8c5b-4a6f-a235-7645720760ac tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2070986902/action" status: 200 len: 21 microversion: 2.1 time: 0.511688 Oct 13 08:34:23.363584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 58/125] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:22 2022] POST /compute/v2.1/flavors/2070986902/action => generated 21 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:23.375668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73ca76cd-47b8-4034-bba0-dc564a924945 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:23.385992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:23.474109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73ca76cd-47b8-4034-bba0-dc564a924945 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2070986902" status: 202 len: 0 microversion: 2.1 time: 0.104456 Oct 13 08:34:23.475240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 59/126] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:23 2022] DELETE /compute/v2.1/flavors/2070986902 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:23.483452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:23.484430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:23.494139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:23.495094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:23.497972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:23.499322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:23.500180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:23.500985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:23.762249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] validate_networks() for [('d08e537b-1238-4354-9155-b6cf1b700138', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:34:24.192140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:24.200577 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfe8eb01-8fa1-499b-a81f-feb5c6651823 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.723342 Oct 13 08:34:24.203973 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 60/127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:23 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:24.221459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a269e060-1f15-4f89-8bc1-1104d976f02b tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:24.280924 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a269e060-1f15-4f89-8bc1-1104d976f02b tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.075375 Oct 13 08:34:24.281528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 61/128] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:24.286493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:24.297485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:24.305832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:24.307647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:24.312097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:24.313178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:24.316226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:24.316931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:24.775837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:24.802275 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9def2c8c-3df1-497c-8972-6fcc817a08e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.519252 Oct 13 08:34:24.821178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 62/129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:24 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:24.838923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:24.839539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:24.882783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:24.884146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:24.886455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:24.889770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:24.890776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:24.892025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:25.195463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:25.215626 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2def60ec-fa17-4b57-b07b-91eb728cea94 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1279 microversion: 2.1 time: 0.387303 Oct 13 08:34:25.216115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 63/130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:24 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1279 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:25.229168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8cc2605-754e-4cda-a8cf-7f0deea11233 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1184144473", "id": 177721694, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:25.291670 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8cc2605-754e-4cda-a8cf-7f0deea11233 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.072046 Oct 13 08:34:25.294432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 64/131] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:25 2022] POST /compute/v2.1/flavors => generated 435 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:25.301014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:25.303657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:25.313883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:25.314790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:25.315490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:25.316477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:25.317138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:25.320642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.042141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:26.061505 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-670d58f6-12db-4ac3-b2e9-ce49931edd5b tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.765659 Oct 13 08:34:26.062097 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 65/132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:25 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:26.075589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-357a1bdd-983e-410f-a863-573c977c652e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:26.086886 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-357a1bdd-983e-410f-a863-573c977c652e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-357a1bdd-983e-410f-a863-573c977c652e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Request method failure captured: Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/flavors/177721694/os-flavor-access HTTP/1.1 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82Kv8YrhE1k2srbKep_b663GYe4fvSWE9qcQE1lsmhaRomRzqoxRlgvV20wbC84Jw5IMS1edo0G9mI6h-AqlJ1wRj4OMcSGms5CicOj36mk9QP94Fh8O3dYU82MjF3_TB7ut2y3grPyEM_Dt_alfNcvZXPnOfzlhPd1FwZ6xeuWE00 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:26.089448 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4061376f6741a88dcf262633a9429e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 235c3ce4a2c94c6293061c6df0a739f7 Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: exception: Access list not available for public flavors. Oct 13 08:34:26.091353 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'flavor_id': '177721694'} Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 13 08:34:26.091984 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:26.094737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-357a1bdd-983e-410f-a863-573c977c652e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:26.095789 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-357a1bdd-983e-410f-a863-573c977c652e tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/177721694/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.032754 Oct 13 08:34:26.099884 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Oct 13 08:34:26 2022] GET /compute/v2.1/flavors/177721694/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:26.108248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:26.111647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:26.137920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.139974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.145905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.146956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.149291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.151006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:34:26.151515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.151619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:34:26.151925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:34:26.157795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:34:26.159700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:34:26.232801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.237455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.238516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.241116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.241755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.242374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.327644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for project a695033da9494b63aa3f1b4e6927efd1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:26.338034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for user a8d17f582a274ea9b07f376fcfdcb19e and project a695033da9494b63aa3f1b4e6927efd1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:26.386753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:34:26.393285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:34:26.529361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-949b271c-5626-426b-99d1-16938c64bf95 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.269763 Oct 13 08:34:26.547014 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 68/134] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:34:26.575295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e82a103-6077-4c49-bd06-de6d3bc4ce26 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:26.649000 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e82a103-6077-4c49-bd06-de6d3bc4ce26 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/177721694" status: 202 len: 0 microversion: 2.1 time: 0.099428 Oct 13 08:34:26.661885 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 69/135] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:34:26 2022] DELETE /compute/v2.1/flavors/177721694 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:26.679370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:26.679909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:26.701683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.707995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.708465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.709214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:26.709676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:26.710106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:26.995968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:27.008094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00973c46-9213-4d3f-8bf1-127385a39a94 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.904420 Oct 13 08:34:27.009593 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:26 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:27.016195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d7817be-eec2-45c3-8679-2426c875f884 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:27.023310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d7817be-eec2-45c3-8679-2426c875f884 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:27.038385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:27.052167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89a653eb-7e27-45f6-b39e-74e64e4d596e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1277 microversion: 2.1 time: 0.389009 Oct 13 08:34:27.062607 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:26 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1277 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:27.083473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2add00e1-464e-4d8c-a6e7-79abcd333942 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:27.157071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2add00e1-464e-4d8c-a6e7-79abcd333942 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.092582 Oct 13 08:34:27.158450 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 71/138] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:27.171204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:27.172086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:27.184418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:27.186333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:27.186994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:27.192691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:27.199189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:27.200171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:27.254280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d7817be-eec2-45c3-8679-2426c875f884 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:27.267110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d7817be-eec2-45c3-8679-2426c875f884 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1262 microversion: 2.1 time: 0.256159 Oct 13 08:34:27.268402 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:27 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1262 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:27.286300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71f80931-70e5-421d-a340-f01ce49d9edc tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2100708338", "id": 1236290059, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:27.343895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71f80931-70e5-421d-a340-f01ce49d9edc tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.073980 Oct 13 08:34:27.346093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 69/140] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:27 2022] POST /compute/v2.1/flavors => generated 439 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:27.722792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:27.771463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64416cb0-de58-4c73-882d-13436c8bf68a tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.610301 Oct 13 08:34:27.778324 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 72/141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:27 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:28.083854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18c0f6f5-6692-4ed9-9fe7-65446b6db16d tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:28.088148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18c0f6f5-6692-4ed9-9fe7-65446b6db16d tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '4f55d92bb98f4080893a4d0c56db4816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8741b46d0dad47c59cfc44ed4beb8179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18c0f6f5-6692-4ed9-9fe7-65446b6db16d tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Request method failure captured: Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/flavors/1236290059/action HTTP/1.1 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 67 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82IUt8VOdU0Fs7RLovM7BSms4nb24Es1h84DWepF9BlPUWF4sNpKX5zuDcneXW0YRPMDbm-yiEZCOyBvDpmFZNVU6DoT2Tj5TWG7a3ESPg6oX670zGfz2BC0fFfOapsZ12nabL6tsubxUde78k8GIxAVz5TK0sT94iPvbylWGu1zuA Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 8741b46d0dad47c59cfc44ed4beb8179 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:28.093318 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 8741b46d0dad47c59cfc44ed4beb8179 Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FlavorsAccessNegativeTestJSON-945787465-project Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4f55d92bb98f4080893a4d0c56db4816 Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-945787465-project Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} Oct 13 08:34:28.094815 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '1236290059', 'body': {'addTenantAccess': {'tenant': '8741b46d0dad47c59cfc44ed4beb8179'}}} Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:28.095570 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 13 08:34:28.096611 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:28.099656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18c0f6f5-6692-4ed9-9fe7-65446b6db16d tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:28.102906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18c0f6f5-6692-4ed9-9fe7-65446b6db16d tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] 10.222.0.23 "POST /compute/v2.1/flavors/1236290059/action" status: 403 len: 130 microversion: 2.1 time: 0.748887 Oct 13 08:34:28.112777 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 70/142] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:27 2022] POST /compute/v2.1/flavors/1236290059/action => generated 130 bytes in 759 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:28.121157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:28.122566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:28.131485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.132210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.132826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.133695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.134300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.134909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.379955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b273cf8-ee47-485b-bc2a-79bf12171bf3", "name": "network-vif-plugged", "status": "completed", "tag": "019f472d-c84a-49d1-8ec1-86e6a0b5d1b7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:28.401379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.404765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.406335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.444254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] Creating event network-vif-plugged:019f472d-c84a-49d1-8ec1-86e6a0b5d1b7 for instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 on n-h1-858384-11 Oct 13 08:34:28.460018 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ace2fa2b-eb55-41fd-8fb7-ef8f815b3630 req-f909ea7a-77e1-4cd4-91fd-a252e5bb2874 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.502842 Oct 13 08:34:28.463038 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 73/143] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:28.482162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:28.483746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:28.484347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:28.500366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82bd2928-14a7-4886-9f61-b0adcab0c56c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.379586 Oct 13 08:34:28.501013 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 71/144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:28 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:28.507487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.508967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.509569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.510283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.528505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.529480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.540827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-565cf80b-3eb1-4899-a426-668e9cc19aee tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:28.583796 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-565cf80b-3eb1-4899-a426-668e9cc19aee tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1236290059" status: 202 len: 0 microversion: 2.1 time: 0.053544 Oct 13 08:34:28.586141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 72/145] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:28 2022] DELETE /compute/v2.1/flavors/1236290059 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:28.601745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:28.603192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:28.611444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.611970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.612668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.613374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:28.614600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:28.615171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:28.724680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:28.736741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a347901c-03e7-4e06-ad0c-c498d2b99b52 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.271594 Oct 13 08:34:28.739953 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 74/146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:28 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:28.740614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:28.749815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e0eb759b-0caa-4594-9cde-41fa965fe941 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1266 microversion: 2.1 time: 0.162106 Oct 13 08:34:28.750569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 73/147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:28 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:28.765776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b870667-91f4-4810-a829-6fa8da61a969 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:28.803899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b870667-91f4-4810-a829-6fa8da61a969 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.052110 Oct 13 08:34:28.804739 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:28 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:28.822337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-583303619", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "31ab6cfd-c0f3-4111-b8a2-4e38788505cb"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:28.895532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] validate_networks() for [('31ab6cfd-c0f3-4111-b8a2-4e38788505cb', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:34:28.916416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a676362-4f63-4e54-8c36-c823b24cdb12 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Action: 'create', calling method: .version_select at 0x7f5377662a60>, body: {"keypair": {"name": "tempest-keypair-1325659499", "type": "ssh", "user_id": "a252f3b2b7c2456b81eeb6af75eb5570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMF5eh5C5IiE7rdq96JIqSgzWTjXHiTqYcFJkumXWzzrm5EfyiHxJ+zstEc2XyxjgP0tI9vcd+JS8XtqC8bdS0gMf6oxO6cnUbAT1qFIizlUNgQfgyQ8966abmtGpfTeg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:28.950855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a676362-4f63-4e54-8c36-c823b24cdb12 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:28.957134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a676362-4f63-4e54-8c36-c823b24cdb12 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for user 2a9e8651e428448ca35ce51f04e90333 and project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:28.993150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a676362-4f63-4e54-8c36-c823b24cdb12 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.186554 Oct 13 08:34:28.994778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 75/149] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:34:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:34:29.002226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.003725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:29.015288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.030303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.030956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.031856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.032458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.033199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.221130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.230448 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e8de4d3-a969-440c-b752-f51b0f833674 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.234271 Oct 13 08:34:29.234455 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 76/150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:28 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:29.239122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4da1c5d3-326f-490a-8510-056a8bda66f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1420538931", "id": 1451155109, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.271663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4da1c5d3-326f-490a-8510-056a8bda66f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.035929 Oct 13 08:34:29.272556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 77/151] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:29.277416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50c9c624-08ac-44cc-95d3-b57e3d95cb19 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Action: 'create', calling method: .version_select at 0x7f53777053a0>, body: {"keypair": {"name": "tempest-keypair-569734578", "type": "ssh", "user_id": "a252f3b2b7c2456b81eeb6af75eb5570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjVstvt1HIlHE9JgUvDCwtNtLmkrDJGiyNGdmJCzQ8g5hXAkZiTqcYA+OXQ4DyF89yTH6kHfi73EkwFOUqhUXTFgXhgx9qH7bmkPoznC2ZjMmZzeKaNQzTbwYV5wCC7CQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.295134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-50c9c624-08ac-44cc-95d3-b57e3d95cb19 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:29.305599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-50c9c624-08ac-44cc-95d3-b57e3d95cb19 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for user 2a9e8651e428448ca35ce51f04e90333 and project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:29.336733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50c9c624-08ac-44cc-95d3-b57e3d95cb19 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.062752 Oct 13 08:34:29.337335 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 78/152] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:34:29.342848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6ae0dbc-1707-42bf-a108-d87d2846cbf3 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.486049 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6ae0dbc-1707-42bf-a108-d87d2846cbf3 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1451155109/action" status: 200 len: 97 microversion: 2.1 time: 0.147453 Oct 13 08:34:29.486722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 79/153] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/flavors/1451155109/action => generated 97 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:29.491018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f190d34-5c90-43d8-9581-9ea8ffd86fcb tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Calling method '.version_select at 0x7f53775e89d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.501287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f190d34-5c90-43d8-9581-9ea8ffd86fcb tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1325659499?user_id=a252f3b2b7c2456b81eeb6af75eb5570" status: 200 len: 512 microversion: 2.10 time: 0.013580 Oct 13 08:34:29.501834 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 80/154] 10.222.0.23 () {60 vars in 1340 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1325659499?user_id=a252f3b2b7c2456b81eeb6af75eb5570 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1270fc4-413a-42bb-8973-944655c6f348 tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b1270fc4-413a-42bb-8973-944655c6f348 tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '4f55d92bb98f4080893a4d0c56db4816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8741b46d0dad47c59cfc44ed4beb8179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1270fc4-413a-42bb-8973-944655c6f348 tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Request method failure captured: Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/flavors/1451155109/action HTTP/1.1 Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 70 Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:29.511630 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82IUt8VOdU0Fs7RLovM7BSms4nb24Es1h84DWepF9BlPUWF4sNpKX5zuDcneXW0YRPMDbm-yiEZCOyBvDpmFZNVU6DoT2Tj5TWG7a3ESPg6oX670zGfz2BC0fFfOapsZ12nabL6tsubxUde78k8GIxAVz5TK0sT94iPvbylWGu1zuA Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 8741b46d0dad47c59cfc44ed4beb8179 Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8741b46d0dad47c59cfc44ed4beb8179"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 8741b46d0dad47c59cfc44ed4beb8179 Oct 13 08:34:29.513194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-945787465 Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FlavorsAccessNegativeTestJSON-945787465-project Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4f55d92bb98f4080893a4d0c56db4816 Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-945787465-project Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: {"removeTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '1451155109', 'body': {'removeTenantAccess': {'tenant': '8741b46d0dad47c59cfc44ed4beb8179'}}} Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can( Oct 13 08:34:29.513995 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:29.515416 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1270fc4-413a-42bb-8973-944655c6f348 tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b1270fc4-413a-42bb-8973-944655c6f348 tempest-FlavorsAccessNegativeTestJSON-945787465 tempest-FlavorsAccessNegativeTestJSON-945787465-project] 10.222.0.23 "POST /compute/v2.1/flavors/1451155109/action" status: 403 len: 133 microversion: 2.1 time: 0.010339 Oct 13 08:34:29.516686 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 81/155] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/flavors/1451155109/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:29.524273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:34:29.524806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:34:29.525392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:34:29.525639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-439364eb-20d4-4ea2-a737-995f3383144e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Action: 'create', calling method: .version_select at 0x7f53777053a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-937755773", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmR4pxwbQiVGCj6WmCm0QnQNF9w0O8VAaLFCxTMHCm0VcAeivlLKJBC3h/+DM0hR8MH8P+d56JkLcljPXx8aVkotItdOXBC1zrz2Ic4RvxcgWeWiBGENpMfFyfk512aSQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.525977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:34:29.526544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:34:29.535845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.536445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.536953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.537922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.538388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.538839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.540372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-439364eb-20d4-4ea2-a737-995f3383144e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:29.544139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-439364eb-20d4-4ea2-a737-995f3383144e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Getting quotas for user 2a9e8651e428448ca35ce51f04e90333 and project 8d95961f4cc34c2e9b898ffe742cec31. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:29.557621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:29.563608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for user c09ea2313b3343579cb75d16d8f220ee and project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:29.569769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-439364eb-20d4-4ea2-a737-995f3383144e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.047839 Oct 13 08:34:29.570562 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 82/156] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:34:29.576229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7013ce2-ba91-4400-a2d6-649d103e9772 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8741b46d0dad47c59cfc44ed4beb8179"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:29.585369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:34:29.588902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:34:29.648545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40b4c1e3-4894-403b-a244-f81b55cc1839 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.906840 Oct 13 08:34:29.649250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 75/157] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:34:29.654208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.655103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:29.660528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:29.663062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.664251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.665000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.665329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7013ce2-ba91-4400-a2d6-649d103e9772 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1451155109/action" status: 200 len: 21 microversion: 2.1 time: 0.093759 Oct 13 08:34:29.665937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.671527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 83/158] 10.222.0.23 () {60 vars in 1200 bytes} [Thu Oct 13 08:34:29 2022] POST /compute/v2.1/flavors/1451155109/action => generated 21 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:29.671771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.671771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.676277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51684c8e-cdde-4b7e-a9e8-2bc86867638e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Calling method '.version_select at 0x7f537762cf70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.680289 n-d-858384-11 devstack@n-api.service[127030]: WARNING oslo_db.sqlalchemy.utils [None req-51684c8e-cdde-4b7e-a9e8-2bc86867638e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:34:29.688037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51684c8e-cdde-4b7e-a9e8-2bc86867638e tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=a252f3b2b7c2456b81eeb6af75eb5570" status: 200 len: 725 microversion: 2.10 time: 0.020582 Oct 13 08:34:29.695314 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 84/159] 10.222.0.23 () {60 vars in 1259 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/os-keypairs?user_id=a252f3b2b7c2456b81eeb6af75eb5570 => generated 725 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:29.695314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.695314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:29.765724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.775509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.777470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.778941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c6c50d6-3541-4542-af30-5f5af83a0ee9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1261 microversion: 2.25 time: 0.089133 Oct 13 08:34:29.779975 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 85/160] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:29.785688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11a61347-4679-411a-ac03-f304cbc01e57 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.811255 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11a61347-4679-411a-ac03-f304cbc01e57 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1451155109" status: 202 len: 0 microversion: 2.1 time: 0.030140 Oct 13 08:34:29.811904 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 86/161] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:34:29 2022] DELETE /compute/v2.1/flavors/1451155109 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:29.816969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbb76d8f-d3be-440a-9362-1a139fa17d81 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Calling method '.version_select at 0x7f53775e8d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.855079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbb76d8f-d3be-440a-9362-1a139fa17d81 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-937755773" status: 204 len: 0 microversion: 2.10 time: 0.041609 Oct 13 08:34:29.865283 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 87/162] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Oct 13 08:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-937755773 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:34:29.870537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.871321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:29.872392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:29.880660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0427afc-41b0-4e1b-a15a-4c993f2065ff tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.230342 Oct 13 08:34:29.881223 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 76/163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:29.894785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:29.895525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.896147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.896593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.897465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:29.899525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.900003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.900437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.908289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.908788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.909280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.910869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:29.911477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:29.912056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:29.992512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.003169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc29110c-1103-4e8e-9553-e6dfd2a50e89 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1266 microversion: 2.1 time: 0.120707 Oct 13 08:34:30.004392 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 77/164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:30.023770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85b10b43-ba6c-479e-a9a2-17fec8ca435b tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.063437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85b10b43-ba6c-479e-a9a2-17fec8ca435b tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.043260 Oct 13 08:34:30.064438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 78/165] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:30 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:30.069675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f56636a-a5dc-49d5-88d1-0aa934890c01 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Calling method '.version_select at 0x7f5377362040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.099408 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9f56636a-a5dc-49d5-88d1-0aa934890c01 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569734578?user_id=a252f3b2b7c2456b81eeb6af75eb5570" status: 204 len: 0 microversion: 2.10 time: 0.033200 Oct 13 08:34:30.100684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 79/166] 10.222.0.23 () {60 vars in 1340 bytes} [Thu Oct 13 08:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569734578?user_id=a252f3b2b7c2456b81eeb6af75eb5570 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:34:30.106466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99b12b23-bdca-4525-b767-9975d0e80f87 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-465693673", "id": 137208760, "os-flavor-access:is_public": "False"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:30.130376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.133832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99b12b23-bdca-4525-b767-9975d0e80f87 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.031871 Oct 13 08:34:30.134872 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 80/167] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:30 2022] POST /compute/v2.1/flavors => generated 435 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:30.139954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-349fba8c-4227-4b46-89c5-a670ef5497c9 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] Calling method '.version_select at 0x7f53773a0af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.156222 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da3aad48-f4d0-4d0c-9264-3783c2fb4128 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.289428 Oct 13 08:34:30.161024 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 88/168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:29 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:30.162388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:DELETE=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:30.170359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70728522-8d74-4a39-b13d-ee09025680f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ad87d57aa2374aae84248c8554ea5212"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:30.191114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-349fba8c-4227-4b46-89c5-a670ef5497c9 tempest-KeyPairsV210TestJSON-719202011 tempest-KeyPairsV210TestJSON-719202011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325659499?user_id=a252f3b2b7c2456b81eeb6af75eb5570" status: 204 len: 0 microversion: 2.10 time: 0.054915 Oct 13 08:34:30.191880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 81/169] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325659499?user_id=a252f3b2b7c2456b81eeb6af75eb5570 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:34:30.269402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.270117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:30.278947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.279693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.280310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.281168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.281797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.282373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.315545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-70728522-8d74-4a39-b13d-ee09025680f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] HTTP exception thrown: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70728522-8d74-4a39-b13d-ee09025680f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Request method failure captured: Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/flavors/137208760/action HTTP/1.1 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 70 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82Kv8YrhE1k2srbKep_b663GYe4fvSWE9qcQE1lsmhaRomRzqoxRlgvV20wbC84Jw5IMS1edo0G9mI6h-AqlJ1wRj4OMcSGms5CicOj36mk9QP94Fh8O3dYU82MjF3_TB7ut2y3grPyEM_Dt_alfNcvZXPnOfzlhPd1FwZ6xeuWE00 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:30.319946 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa4061376f6741a88dcf262633a9429e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa4061376f6741a88dcf262633a9429e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa4061376f6741a88dcf262633a9429e Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791 Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 235c3ce4a2c94c6293061c6df0a739f7 Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: {"removeTenantAccess": {"tenant": "ad87d57aa2374aae84248c8554ea5212"}} Oct 13 08:34:30.321209 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: exception: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '137208760', 'body': {'removeTenantAccess': {'tenant': 'ad87d57aa2374aae84248c8554ea5212'}}} Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 13 08:34:30.322230 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:30.327083 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70728522-8d74-4a39-b13d-ee09025680f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Returning 404 to user: Flavor access not found for 33 / ad87d57aa2374aae84248c8554ea5212 combination. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70728522-8d74-4a39-b13d-ee09025680f1 tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/137208760/action" status: 404 len: 124 microversion: 2.1 time: 0.160263 Oct 13 08:34:30.328855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 89/170] 10.222.0.23 () {60 vars in 1197 bytes} [Thu Oct 13 08:34:30 2022] POST /compute/v2.1/flavors/137208760/action => generated 124 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:30.345978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6c1fc1f-6d25-4f78-bcc2-a22bbf941fda tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.371706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6c1fc1f-6d25-4f78-bcc2-a22bbf941fda tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/137208760" status: 202 len: 0 microversion: 2.1 time: 0.036417 Oct 13 08:34:30.372403 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 90/171] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:34:30 2022] DELETE /compute/v2.1/flavors/137208760 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:30.380816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71242d4f-f746-4f5b-86e8-e2c9187c545a tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.405490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71242d4f-f746-4f5b-86e8-e2c9187c545a tempest-FlavorsAccessNegativeTestJSON-2091537791 tempest-FlavorsAccessNegativeTestJSON-2091537791-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028246 Oct 13 08:34:30.406466 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 91/172] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:30 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:30.504426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.516044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de134df2-c10c-42b7-aca3-0e540f4e1ac7 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1337 microversion: 2.1 time: 0.258333 Oct 13 08:34:30.516627 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 82/173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:30 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1337 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:30.562341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e24feec-448f-4ed8-a243-090c0594392d", "name": "network-vif-plugged", "status": "completed", "tag": "d35bb426-a67a-4614-87ac-07437c22eaa5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:30.575854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.575854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.575854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.592481 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] Creating event network-vif-plugged:d35bb426-a67a-4614-87ac-07437c22eaa5 for instance 3e24feec-448f-4ed8-a243-090c0594392d on n-h1-858384-11 Oct 13 08:34:30.598354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0277ef79-9390-4bec-b2e2-16ef52424f1a req-771bd729-94d7-425e-97c0-6794ed59da57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Oct 13 08:34:30.599427 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 92/174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:30.809920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.811386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:30.817940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.818850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.819503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.820421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.821090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.821725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.909032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:30.910258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:30.925416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.928849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.929263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.929461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.931399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:30.934397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:30.937064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:30.948966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.950797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:30.955299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bfbf24d1-52c2-41ed-bd17-3b78309e104d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1265 microversion: 2.25 time: 0.150298 Oct 13 08:34:30.961933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 83/175] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:30 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:31.029583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:31.032576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:31.040174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.040999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.041691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.042727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.044437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.045084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.153564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:31.157433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:31.165227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8bb91f55-24e2-46dd-9797-a8798aeaf246 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1266 microversion: 2.1 time: 0.141599 Oct 13 08:34:31.165604 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b344fd61-289c-42b0-80c4-7c7ca9764db9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1340 microversion: 2.1 time: 0.264359 Oct 13 08:34:31.166423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 93/176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:30 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1340 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:31.167043 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 84/177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:31 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:31.202518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:31.203145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:31.214753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.216013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.217760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.219039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.219651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.220966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.419183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:31.433195 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-be835d2b-df88-40b3-a7ee-839d4c3c0c0d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.253624 Oct 13 08:34:31.433634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 94/178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:31 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:31.544659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:31.545284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:31.560375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.560861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.561314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.562029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.565091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.565979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.763554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:31.775150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0341e3c-7340-417f-a5c5-7503f65afc4d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1486 microversion: 2.1 time: 0.235368 Oct 13 08:34:31.782860 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 85/179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:31 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1486 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:31.803326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:31.803853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:31.812478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.813035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.813545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.814609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:31.815364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:31.815875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:31.990854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:31.992555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.011100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.011607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.012612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.013335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.013798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.014226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.146776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.160507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.172260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.173426 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-31c8fe4a-e921-456e-a0db-9aae88353740 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1265 microversion: 2.25 time: 0.196060 Oct 13 08:34:32.178553 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 86/180] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:31 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:34:32.208642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:32.209494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.216597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.217311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.217929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.218811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.219761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.220407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.403164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.423812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-686e3085-8324-4716-8631-3a4f90f8582a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1639 microversion: 2.1 time: 0.626436 Oct 13 08:34:32.425342 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 95/181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:31 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1639 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:32.425659 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-12568948-f534-48da-b03c-8ee8d708973b tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1490 microversion: 2.1 time: 0.221217 Oct 13 08:34:32.426776 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:32 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1490 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:32.450506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:32.451399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.459434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.460146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.460675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:32.460979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.461302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.461949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.462705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.463280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.477218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.477719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.488560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.489347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.489837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.490250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.492220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:34:32.596754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.607059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-02e09c80-556e-4de6-b119-121e989bce7d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1266 microversion: 2.1 time: 0.177055 Oct 13 08:34:32.608332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:32 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:32.619512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:32.620402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.627477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.628041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.628551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.629326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.629852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.630583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.694491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:32.712366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2cd3224b-9971-4f55-8bfe-7eff3fe8e9cd tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 204 len: 0 microversion: 2.1 time: 0.266536 Oct 13 08:34:32.713450 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 96/184] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:34:32 2022] DELETE /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:34:32.823678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:32.834107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-555e1d89-775d-470f-ae46-27ea2c1c6f15 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.224491 Oct 13 08:34:32.834910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 89/185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:32 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:32.843781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:32.844690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:32.851716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.852205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.852675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:32.853387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:32.853864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:32.854361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.049958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:33.061348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95a2961f-d2c1-448c-9e65-2a7b49b13130 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1492 microversion: 2.1 time: 0.225342 Oct 13 08:34:33.062968 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 90/186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:32 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1492 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:33.169518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:33.170612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:33.192049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.193436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.194097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.200007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:33.201015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:33.205479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.207849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.208456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.210341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.214168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.214932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.216305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.217960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.218443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.219915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:33.269404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:33.372698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:33.388525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:33.392103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:33.394700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0840d2be-413c-4b6b-abc9-2aca3e9dc7c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1257 microversion: 2.25 time: 0.198302 Oct 13 08:34:33.412911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 91/187] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:33 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1257 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:33.563542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:34:33.632808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:33.633495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:33.644513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.648250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.648833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.649679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.650250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.651891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.727639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e413916-bbba-41cd-af72-dd78f0b4c220 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 204 len: 0 microversion: 2.1 time: 1.012380 Oct 13 08:34:33.729856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 97/188] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:34:32 2022] DELETE /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:34:33.745139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:33.745909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:33.753902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.754681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.755241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.755819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.756269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.756692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.807160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:33.818174 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5eff0fc1-68a3-4c7b-ab91-479aa3e3e737 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1314 microversion: 2.1 time: 0.189877 Oct 13 08:34:33.829784 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 92/189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:33 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:33.865545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:33.866230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:33.875362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.877032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.877743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:33.878900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:33.879530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:33.880126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.087689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.097127 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8cf09bd5-f398-467a-a703-87a5bcefba10 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1496 microversion: 2.1 time: 0.361217 Oct 13 08:34:34.103066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 98/190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:33 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1496 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:34.110655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:34.114041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:34.125835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.126326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.126796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.132521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.133184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.144435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.489229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.501119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-861d1d7f-4951-40e9-833b-d49fce63c9f7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.646996 Oct 13 08:34:34.515217 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 93/191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:33 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:34.523207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:34.524058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:34.531126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.531833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.532503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.541029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.542433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.543420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.621903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.631679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.633359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.635065 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-548afde1-e27d-4873-86c1-0363211c71e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1313 microversion: 2.25 time: 0.118167 Oct 13 08:34:34.636290 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 94/192] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:34 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1313 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:34.850759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:34.851657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:34.862483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.863323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.864021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.864993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:34.865711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:34.866358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:34.898597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.908799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8789f7d-e73e-47b4-a528-5fa30b25fefb tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1492 microversion: 2.1 time: 0.804414 Oct 13 08:34:34.930739 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 99/193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:34 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1492 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:34.970220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:34.987612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4b790dd-83de-43b9-b084-b93f0cc25e9d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1320 microversion: 2.1 time: 0.139182 Oct 13 08:34:34.989287 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 95/194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:34 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1320 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:35.120444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:35.121699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:35.128962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.129823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.130612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.131695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.132342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.132987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.529583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:35.530196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:35.538011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.538717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.539314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.540176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.540863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.541365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.766654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:35.780749 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7eb9d2b8-4bc4-42e8-8c8c-22f99670fc15 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1496 microversion: 2.1 time: 0.664054 Oct 13 08:34:35.783310 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 100/195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:35 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1496 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:35.790380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:35.792302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:35.800342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.801422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.802153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.803729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:35.804518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:35.805247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:35.921309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:35.934463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a5bb917-c606-47b8-aa75-d60fb1305b19 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.409727 Oct 13 08:34:35.935801 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 96/196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:35 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:36.134338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361e65a9-6da4-4630-af5a-9473d6193db0", "tag": "c45dcd65-8795-4a54-a776-83e9ab6a7db9"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:36.145401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.145999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.146675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.159642 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] Creating event network-changed:c45dcd65-8795-4a54-a776-83e9ab6a7db9 for instance 361e65a9-6da4-4630-af5a-9473d6193db0 on n-h2-858384-11 Oct 13 08:34:36.169133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d62f9c02-31e8-4a02-bd4a-6063bbaa66c1 req-d2a9c7f4-03b4-4bb3-9dc4-0ca78f4321a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228586 Oct 13 08:34:36.170062 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 97/197] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:36.175432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.177625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.178608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:36.185332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.185762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.186348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.186911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.187560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.187944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.188497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.189031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.189330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa7cb113-3d3c-4da8-8436-fcfd4c1b01a5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1319 microversion: 2.25 time: 0.404740 Oct 13 08:34:36.200745 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 101/198] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:35 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:36.295400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ff0fbf0-647a-4805-8ea5-cf6b97cd665f tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1741244601", "ram": 512, "vcpus": 1, "disk": 10, "id": 150810520, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:36.342020 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ff0fbf0-647a-4805-8ea5-cf6b97cd665f tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.138425 Oct 13 08:34:36.354066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 102/199] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:36 2022] POST /compute/v2.1/flavors => generated 413 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:36.367425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.368883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:36.392638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.393936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.394720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.399138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.399969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.400768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.569716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.580343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19695148-dfe4-4170-b26f-1b0574a91017 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1320 microversion: 2.1 time: 0.223078 Oct 13 08:34:36.595186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 103/200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:36.602209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8dab87c-5eaf-4795-8ab3-e99abfeb9ea3 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:36.658144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.664760 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8dab87c-5eaf-4795-8ab3-e99abfeb9ea3 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068316 Oct 13 08:34:36.665368 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 104/201] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Oct 13 08:34:36 2022] POST /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:36.676712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c04aae13-804a-4640-bbdd-9a92996ba75f tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1492 microversion: 2.1 time: 0.504818 Oct 13 08:34:36.677821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 98/202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1492 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:36.811491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.812601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:36.819522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.821003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.821888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.823130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.824861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.825497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.874730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-036e253a-39f1-4514-a483-2d7bc37b6470 tempest-FlavorsExtraSpecsTestJSON-1847966865 tempest-FlavorsExtraSpecsTestJSON-1847966865-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.891615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-036e253a-39f1-4514-a483-2d7bc37b6470 tempest-FlavorsExtraSpecsTestJSON-1847966865 tempest-FlavorsExtraSpecsTestJSON-1847966865-project] 10.222.0.23 "GET /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.219888 Oct 13 08:34:36.895793 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:36.906671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26db10dd-753e-49f9-949f-4b42c051c870 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:36.938815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26db10dd-753e-49f9-949f-4b42c051c870 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036401 Oct 13 08:34:36.940129 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 106/204] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Oct 13 08:34:36 2022] POST /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:34:36.949698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ff817ba-7003-461e-b19f-6d8bd26a41b9 tempest-FlavorsExtraSpecsTestJSON-1847966865 tempest-FlavorsExtraSpecsTestJSON-1847966865-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.959832 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ff817ba-7003-461e-b19f-6d8bd26a41b9 tempest-FlavorsExtraSpecsTestJSON-1847966865 tempest-FlavorsExtraSpecsTestJSON-1847966865-project] 10.222.0.23 "GET /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014247 Oct 13 08:34:36.961463 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 107/205] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:34:36.973147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:36.973975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:36.979636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:36.991099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:36.991883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:36.993912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:36.999313 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc2138b8-4c8e-44ac-87d9-15a6281f427c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 200 len: 1454 microversion: 2.1 time: 0.190967 Oct 13 08:34:36.999816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.000436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.001874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.007709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 1454 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:37.032017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d895074f-c113-4ea3-b8f8-10aa489cae5a tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:37.105102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d895074f-c113-4ea3-b8f8-10aa489cae5a tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095848 Oct 13 08:34:37.123729 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 100/207] 10.222.0.23 () {60 vars in 1221 bytes} [Thu Oct 13 08:34:37 2022] POST /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:37.128946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e24feec-448f-4ed8-a243-090c0594392d", "name": "network-vif-deleted", "tag": "d35bb426-a67a-4614-87ac-07437c22eaa5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:37.163218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.163736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.164185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.192435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] Creating event network-vif-deleted:d35bb426-a67a-4614-87ac-07437c22eaa5 for instance 3e24feec-448f-4ed8-a243-090c0594392d on n-h1-858384-11 Oct 13 08:34:37.208364 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4ddee3f0-eb2f-4b74-b84c-c0841e48108d req-374a3e75-9912-406a-b9ac-38e14f402df9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082570 Oct 13 08:34:37.209125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 101/208] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:37.219406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f263892-5eb8-4b3f-8f87-85ecc6453d55 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.236182 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f263892-5eb8-4b3f-8f87-85ecc6453d55 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025652 Oct 13 08:34:37.236760 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 102/209] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:37.244809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.245704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:37.276698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.277276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.277729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.278609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.279075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.281951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.496747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:37.509125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-98109f71-b196-4875-94ba-d55ec5b19530 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.545770 Oct 13 08:34:37.514758 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 108/210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:36 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:37.521041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1fe602b4-7cbe-4bb9-9e3e-efe8ac508649 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:37.532941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=8,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:37.570964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:37.581918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:37.583440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:37.584581 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-348d1a84-c909-47ae-9396-771320cde247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.343732 Oct 13 08:34:37.586927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 103/211] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:37.587806 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1fe602b4-7cbe-4bb9-9e3e-efe8ac508649 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.071597 Oct 13 08:34:37.595417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 109/212] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:34:37 2022] PUT /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:37.607189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43e69d8d-ff35-4652-9822-e935faa47eae tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.615837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.616691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:37.626693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.627523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.628106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.629124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.629730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.630256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.650428 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43e69d8d-ff35-4652-9822-e935faa47eae tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053942 Oct 13 08:34:37.651207 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 104/213] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/flavors/150810520/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:37.672146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b9cd39c-173c-4a4f-8d8d-dc748eae51ad tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.781671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b9cd39c-173c-4a4f-8d8d-dc748eae51ad tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.113637 Oct 13 08:34:37.784362 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 105/214] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:34:37 2022] DELETE /compute/v2.1/flavors/150810520/os-extra_specs/hw:numa_nodes => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:37.797549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.802436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:37.809552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.810035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.810484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.811188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.811633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.816608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:37.819958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.827354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e831ea56-a45f-4838-a11c-bcce6890277a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.222224 Oct 13 08:34:37.829477 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 110/215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:37.834745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d59aa94-eca0-4a6c-bb16-f2ab2d5adf05 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.860005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d59aa94-eca0-4a6c-bb16-f2ab2d5adf05 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/150810520/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.029057 Oct 13 08:34:37.866267 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 111/216] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:34:37 2022] DELETE /compute/v2.1/flavors/150810520/os-extra_specs/hw:cpu_policy => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:37.874381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc7d896c-ff19-4f43-a9a1-2cbc84e4d58f tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.884804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc7d896c-ff19-4f43-a9a1-2cbc84e4d58f tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/150810520/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016602 Oct 13 08:34:37.892115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 112/217] 10.222.0.23 () {58 vars in 1200 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/flavors/150810520/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:37.897602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62643bd2-286a-4456-9e7c-8769559b341e tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.902964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:37.903600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:37.904721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:37.906076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lazy-loading 'fault' on Instance uuid 6b273cf8-ee47-485b-bc2a-79bf12171bf3 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:34:37.919818 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62643bd2-286a-4456-9e7c-8769559b341e tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/150810520" status: 202 len: 0 microversion: 2.1 time: 0.026192 Oct 13 08:34:37.921692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 113/218] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:34:37 2022] DELETE /compute/v2.1/flavors/150810520 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:37.931582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61fe7675-0858-4dd7-b84f-b156073307c0 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:37.956149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61fe7675-0858-4dd7-b84f-b156073307c0 tempest-FlavorsExtraSpecsTestJSON-1525106011 tempest-FlavorsExtraSpecsTestJSON-1525106011-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030340 Oct 13 08:34:37.956927 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 114/219] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:38.025424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:38.026045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:38.038992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.039830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.040466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.041341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.041946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.043411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.067400 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d HTTP/1.1 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:38.088662 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:34:38.090253 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '3e24feec-448f-4ed8-a243-090c0594392d'} Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:38.091067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:34:38.092109 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:38.093071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:38.093071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0844135a-89b9-41e8-a094-7104057753e9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 404 len: 111 microversion: 2.1 time: 0.068950 Oct 13 08:34:38.102788 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 115/220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:38 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:38.219866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88db837d4caf4c5695a7d224168460fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab09230959646e5b99e75077d3371a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:38.234264 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-245d5b4b-84ac-4aa2-bd11-66df66b9eec5 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 200 len: 1327 microversion: 2.1 time: 0.446306 Oct 13 08:34:38.234888 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 106/221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:37 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 1327 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:38.282840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-572951257", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:38.351813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:34:38.546756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:38.547819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:38.557046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.557394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.557830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.559273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.561228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.562460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.617859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:34:38.619360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:34:38.619870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:34:38.621597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:34:38.621954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:34:38.632965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.633449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.633891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.634647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.635103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.635526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.654372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Getting quotas for project 3f43c474989d4fa4aecc7f524de41a78. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:38.658523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Getting quotas for user 1e001d79774e48119ebce4497388f84f and project 3f43c474989d4fa4aecc7f524de41a78. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:38.670748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:34:38.673085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:34:38.754383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a0c78218-e449-4af7-afc0-e620d8677ad0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478060 Oct 13 08:34:38.764358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 116/222] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:34:38.769374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:38.770324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:38.815242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.815754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.816182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.816894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:38.817348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:38.817781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:38.887822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:38.897203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a737d4c0-016e-4fc2-a2f6-1a47fb8fbc51 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.362517 Oct 13 08:34:38.914164 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 107/223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:38 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:38.914164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17164101-0ca1-4964-9935-2679105db409 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:38.914164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17164101-0ca1-4964-9935-2679105db409 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:38.986097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17164101-0ca1-4964-9935-2679105db409 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:38.999119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17164101-0ca1-4964-9935-2679105db409 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1219 microversion: 2.1 time: 0.096979 Oct 13 08:34:39.003301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:39.011105 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 108/224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:38 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:39.014124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:39.016102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:39.017435 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0778a2e-89b2-4502-b84b-cde5e40ac783 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.252088 Oct 13 08:34:39.018213 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 117/225] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:38 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:39.021125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:39.021790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:39.040384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.040890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.041332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.042061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.043680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.044120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.242908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b273cf8-ee47-485b-bc2a-79bf12171bf3", "name": "network-vif-deleted", "tag": "019f472d-c84a-49d1-8ec1-86e6a0b5d1b7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:39.261105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.264798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.265599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.280137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] Creating event network-vif-deleted:019f472d-c84a-49d1-8ec1-86e6a0b5d1b7 for instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 on n-h1-858384-11 Oct 13 08:34:39.287032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ea9b9c12-c55b-45d1-8d1c-5f1c2c2b1600 req-969a215b-5b01-4052-b528-71a302acd12e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059093 Oct 13 08:34:39.289221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 118/226] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:39.295924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:39.296651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:39.309494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.310134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.311108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.313785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.314481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.315065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.333122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] HTTP exception thrown: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Request method failure captured: Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 HTTP/1.1 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR81tph1RoGLXdBzELcwvLknOk0smgsrC61TlHg4WRZajWjxsRN678eGRweaDQp-XMMyVQLukcPtEaa_Wd9fQyPLkLq4tYDjycRPtraBiXZKLPEgj_Bgen40vN56a-0fHqztCvuYs2JWnBDAWOzMg3l7WFMgA_isba1P5z_aiyFw8Jeo Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:39.336144 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ab09230959646e5b99e75077d3371a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 88db837d4caf4c5695a7d224168460fb Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:39.337588 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6b273cf8-ee47-485b-bc2a-79bf12171bf3'} Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:39.338491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:39.340301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:39.343466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Returning 404 to user: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:39.344583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2d77cec-109d-4bbf-ad41-729d51c897b1 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 404 len: 111 microversion: 2.1 time: 0.054221 Oct 13 08:34:39.345592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 119/227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:39 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:39.355527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc653952-32c6-43c5-b24d-5bab3a4270c2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:39.370124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:39.373332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc653952-32c6-43c5-b24d-5bab3a4270c2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.374308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc653952-32c6-43c5-b24d-5bab3a4270c2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.376630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc653952-32c6-43c5-b24d-5bab3a4270c2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.388730 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-996ce352-605e-4b7e-90d6-06f5d9d02cdb tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.375896 Oct 13 08:34:39.391688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 109/228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:39 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:39.546997 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc653952-32c6-43c5-b24d-5bab3a4270c2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.196362 Oct 13 08:34:39.551179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 120/229] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:39.563923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f2eaa1e-9ca2-4a69-85d8-da1beb7361aa tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:39.587878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:39.639813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f2eaa1e-9ca2-4a69-85d8-da1beb7361aa tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.080647 Oct 13 08:34:39.648922 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 110/230] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:39 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:39.663379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a7869c7-34cd-4510-88ce-5826c0211446 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-492420557"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:39.667692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-4a7869c7-34cd-4510-88ce-5826c0211446 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid dc4f978a-69de-4f93-b82c-371ad5f2427a for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:39.707131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a7869c7-34cd-4510-88ce-5826c0211446 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047592 Oct 13 08:34:39.707765 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 121/231] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:39.719883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6d2d513b-83d9-4999-95a0-2019e4402ec1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:39.741927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d2d513b-83d9-4999-95a0-2019e4402ec1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.743025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d2d513b-83d9-4999-95a0-2019e4402ec1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.744107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d2d513b-83d9-4999-95a0-2019e4402ec1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.924885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:39.926170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:39.937636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.938462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.939916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:39.942342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:39.943755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:39.944404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.369181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6d2d513b-83d9-4999-95a0-2019e4402ec1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.650180 Oct 13 08:34:40.375242 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 111/232] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:40.390512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:40.392158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:40.417104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.419819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.420770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.421690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.422778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.423890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.693144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:40.716431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:40.727436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d24585b0-e1ca-464e-893c-1f8e6e9a50ac tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.805662 Oct 13 08:34:40.742430 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-022726dc-7b62-4bff-9ca6-073ee1cf5d93 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1277 microversion: 2.1 time: 0.350536 Oct 13 08:34:40.742430 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 112/233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:40 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:40.743508 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 122/234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:39 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:40.749818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-853a03c9-1956-4748-a869-8ec9a5db894b tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:40.751114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:40.751726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:40.759349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-853a03c9-1956-4748-a869-8ec9a5db894b tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.014054 Oct 13 08:34:40.760138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 123/235] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:34:40 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:40.765289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:40.766141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:40.772466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.773254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.773922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.774870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.775530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.776206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.776341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.776825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.777487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:40.778202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:40.778682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:40.779101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.095650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:41.103742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cff3cf94-299f-4566-90b7-325dea68286f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.342303 Oct 13 08:34:41.104850 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 124/236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:40 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:41.110371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-100abf1c-5e3f-42b3-a2eb-cd7583779934 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:41.129718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-100abf1c-5e3f-42b3-a2eb-cd7583779934 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.134639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-100abf1c-5e3f-42b3-a2eb-cd7583779934 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.135297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-100abf1c-5e3f-42b3-a2eb-cd7583779934 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.280754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:41.298286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:41.300099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:41.301493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c65004b6-1f81-4f70-9758-ec77114453a3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.554176 Oct 13 08:34:41.315324 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 113/237] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:40 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:41.319799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-100abf1c-5e3f-42b3-a2eb-cd7583779934 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.209122 Oct 13 08:34:41.319799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 125/238] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:41.327871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d3830d34-1383-48e0-9567-52f228b208ae tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:41.341243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=87,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:41.351803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0da86d-73c7-4b2f-a3f3-7f5096310a01", "tag": "609ef1bd-ddea-4c9c-84cc-f4be3290e108"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:41.361290 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d3830d34-1383-48e0-9567-52f228b208ae tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.037426 Oct 13 08:34:41.363256 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 114/239] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:41 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 13 08:34:41.369595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.370080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.370539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.375487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0422b1b8-5c0f-49b6-bf90-cb477ae6855e tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087645172"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:41.380215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.aggregate [None req-0422b1b8-5c0f-49b6-bf90-cb477ae6855e tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid 9b8c82bd-fb87-4ea6-840c-b2f8ce4d4bf7 for aggregate {{(pid=127031) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:41.393246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] Creating event network-changed:609ef1bd-ddea-4c9c-84cc-f4be3290e108 for instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 on n-h2-858384-11 Oct 13 08:34:41.408565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-308c4c3d-d520-4f09-950c-e60c6a9fc21a req-bfc9187a-18be-432a-a7c9-8ea10d24ed8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057755 Oct 13 08:34:41.409743 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 126/240] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:41.419842 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0422b1b8-5c0f-49b6-bf90-cb477ae6855e tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049016 Oct 13 08:34:41.421579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 115/241] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:41.434135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9e668c6-27fa-4a27-96fa-ec630a2cab7c tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:41.447268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e668c6-27fa-4a27-96fa-ec630a2cab7c tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.447941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e668c6-27fa-4a27-96fa-ec630a2cab7c tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.448372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e668c6-27fa-4a27-96fa-ec630a2cab7c tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.725647 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9e668c6-27fa-4a27-96fa-ec630a2cab7c tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.296113 Oct 13 08:34:41.726513 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 127/242] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:41 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:41.738356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5df7773-05dd-4a96-90fc-6e7f95049c0e tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:41.754989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:41.755690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:41.755834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5df7773-05dd-4a96-90fc-6e7f95049c0e tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.020891 Oct 13 08:34:41.758814 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 116/243] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:34:41 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:41.765689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.766173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.766808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.767761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.770449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:41.770808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.771582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.772271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:41.793977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.794629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.795122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.795987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:41.796505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:41.796994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:41.821588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:41.975379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:41.987433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f79ae92-3b47-4766-aa6c-6713b1bbce29 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1277 microversion: 2.1 time: 0.237834 Oct 13 08:34:41.989195 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 128/244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:41 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:42.002529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa665aee-7d73-4ff2-b986-e31b0201e213 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:42.024465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa665aee-7d73-4ff2-b986-e31b0201e213 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.031932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa665aee-7d73-4ff2-b986-e31b0201e213 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.036478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa665aee-7d73-4ff2-b986-e31b0201e213 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:42.228120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:42.235999 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ad92783-7fcf-4db2-a4ed-234ce8a6e08c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.471321 Oct 13 08:34:42.258614 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 117/245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:41 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:42.271520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:42.272436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:42.281706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.284138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.284794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:42.285744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.291052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.291750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:42.305378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:42.317927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:42.336705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa665aee-7d73-4ff2-b986-e31b0201e213 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.341062 Oct 13 08:34:42.337366 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 129/246] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:41 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:42.350678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:42.361214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:42.380529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.381363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.386884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:42.387874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.389381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.390003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:42.767528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:42.779369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:42.781055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:42.784768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0921470-4942-4921-aa7b-d539f0136e2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.440548 Oct 13 08:34:42.795200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 130/247] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:42 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:42.800027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4d5dced-bfa0-4d27-a61d-783448fe17e3 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:42.849283 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4d5dced-bfa0-4d27-a61d-783448fe17e3 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.052858 Oct 13 08:34:42.850019 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 131/248] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:42 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:42.861493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8aa97289-c414-4cce-a2c1-cb77b68335b5 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1780001055"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:42.866063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-8aa97289-c414-4cce-a2c1-cb77b68335b5 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid ec77de97-a5c1-4750-88ff-bcfab99ce8cf for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:42.912833 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8aa97289-c414-4cce-a2c1-cb77b68335b5 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055301 Oct 13 08:34:42.913638 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 132/249] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:42.926066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45e5c929-641d-45a3-b360-66d43783b6e2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:42.943951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45e5c929-641d-45a3-b360-66d43783b6e2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:42.944834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45e5c929-641d-45a3-b360-66d43783b6e2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:42.946133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45e5c929-641d-45a3-b360-66d43783b6e2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.023093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:43.043813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f26f5f98-4544-482c-a45d-f5af95777ed8 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.781440 Oct 13 08:34:43.050780 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 118/250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:42 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:43.062898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:43.067043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:43.087026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.087538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.094474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.098290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.101802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.102287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.175847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45e5c929-641d-45a3-b360-66d43783b6e2 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.253718 Oct 13 08:34:43.176602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 133/251] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:42 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:43.182868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79408968-f79c-4af8-815c-c338d2d5cea9", "tag": "14bf18b9-923e-44b5-89f0-f63aeb02af35"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:43.208173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.209024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.210650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.257336 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] Creating event network-changed:14bf18b9-923e-44b5-89f0-f63aeb02af35 for instance 79408968-f79c-4af8-815c-c338d2d5cea9 on n-h2-858384-11 Oct 13 08:34:43.272853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cddd721c-406c-412e-bb98-e6a2926aeb55 req-fb30612e-cd54-4555-8cbb-f4a79f28262c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094016 Oct 13 08:34:43.275417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 134/252] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:43.288678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe7bb903-0d7e-42f7-bd00-038e8281a7f4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:43.317903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7bb903-0d7e-42f7-bd00-038e8281a7f4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.319182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7bb903-0d7e-42f7-bd00-038e8281a7f4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.319791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7bb903-0d7e-42f7-bd00-038e8281a7f4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.632734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:43.644348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4dab8ece-db2d-4f66-b1da-633335d8ad5c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.589916 Oct 13 08:34:43.653638 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 119/253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:43 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:43.654937 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe7bb903-0d7e-42f7-bd00-038e8281a7f4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.375715 Oct 13 08:34:43.657649 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 135/254] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:43 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:43.665662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:43.666379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:43.675392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.680970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17ddde19-b0aa-4de1-a475-4c50812841d0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:43.690037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.691587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.696510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.698340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.700022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.707649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17ddde19-b0aa-4de1-a475-4c50812841d0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.030376 Oct 13 08:34:43.710359 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 136/255] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:43 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:43.721910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c42360bf-5a2c-4430-9589-df82329e7442 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2056292883"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:43.731358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-c42360bf-5a2c-4430-9589-df82329e7442 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid 5e955515-6e20-4504-b9fa-6d24fa791849 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:43.789239 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c42360bf-5a2c-4430-9589-df82329e7442 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073013 Oct 13 08:34:43.790205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 137/256] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:43.797523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a29c15aa-89b2-4856-bcfa-942e61b1664c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-620214904"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:43.803494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-a29c15aa-89b2-4856-bcfa-942e61b1664c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Generated uuid 86b14088-da2f-4e8c-b2ed-870b3d65ecf0 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:43.830895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a29c15aa-89b2-4856-bcfa-942e61b1664c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.038020 Oct 13 08:34:43.831659 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 138/257] 10.222.0.23 () {62 vars in 1205 bytes} [Thu Oct 13 08:34:43 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:43.842606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22ca5745-e4b9-46b0-85c6-f61878b72cd3 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:43.890496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22ca5745-e4b9-46b0-85c6-f61878b72cd3 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055971 Oct 13 08:34:43.894694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 139/258] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:43.904433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:43.905208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:43.919878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.920443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.920882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.922814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:43.923277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:43.926687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:43.954012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:43.961913 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dae2568-15df-4449-bbdd-22fa47fb307c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.307006 Oct 13 08:34:43.976947 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 120/259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:43 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:43.976947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47912a03-ef06-4bf7-95df-3feb8b312e2d tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-570098963"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:44.160017 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47912a03-ef06-4bf7-95df-3feb8b312e2d tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.191253 Oct 13 08:34:44.169200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 121/260] 10.222.0.23 () {62 vars in 1210 bytes} [Thu Oct 13 08:34:43 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:44.174512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2fa438e-15bb-4784-aad6-eec7728e5179 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:44.192935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f2fa438e-15bb-4784-aad6-eec7728e5179 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2fa438e-15bb-4784-aad6-eec7728e5179 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Request method failure captured: Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vMH4ErjQFLOhZq9KXVOEObZfs8rCWUdrYsl-Qm9Lu81FR_tM9xxUrGF_UlE0jL7nyL2PJYyw1tDFXaKtcfCDyLWZo4h95ELYgw0g_vnx-r9uR7BZ8Wbej2tN7zCH8sVEvjGpwFHxL2jGArfXNHKIonL3HIw-mlXpDM92BuczVZjg Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:44.201947 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5fe0a387f4ac494d826d9946558e07b6 Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: exception: Aggregate 5 could not be found. Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '5'} Oct 13 08:34:44.203695 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.204555 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 13 08:34:44.205865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.208046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2fa438e-15bb-4784-aad6-eec7728e5179 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:44.210748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2fa438e-15bb-4784-aad6-eec7728e5179 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.038420 Oct 13 08:34:44.216169 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 122/261] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:34:44 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:44.223166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:44.224012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:44.429349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:44.430164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:44.430859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:44.432317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:44.432920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:44.433633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:44.654639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:44.671511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:44.674640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:44.678575 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8efb7083-6857-4975-8bdc-81a4752af330 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.782932 Oct 13 08:34:44.693282 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 140/262] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:43 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:44.713450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c032e1-044b-41ee-af08-0ee6fd83ee7a", "tag": "71f52006-c9aa-4693-bb4c-c411fbfdab09"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:44.728152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:44.728627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:44.729042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:44.749949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] Creating event network-changed:71f52006-c9aa-4693-bb4c-c411fbfdab09 for instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a on n-h1-858384-11 Oct 13 08:34:44.764503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bc43a5b9-24bc-4a3b-bad9-b3726b1595e2 req-9c650834-87a9-4772-91f0-690e8d1b760d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059993 Oct 13 08:34:44.768628 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 141/263] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:44.784585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d5df003-11fd-4a8f-9c68-5539d4f369aa tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:44.810715 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d5df003-11fd-4a8f-9c68-5539d4f369aa tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.030087 Oct 13 08:34:44.818496 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 142/264] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:34:44 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:44.823338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-868cbd99-625b-45ad-9f86-5ee9f5dd54e9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:44.856012 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-868cbd99-625b-45ad-9f86-5ee9f5dd54e9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-868cbd99-625b-45ad-9f86-5ee9f5dd54e9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Request method failure captured: Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR81vMH4ErjQFLOhZq9KXVOEObZfs8rCWUdrYsl-Qm9Lu81FR_tM9xxUrGF_UlE0jL7nyL2PJYyw1tDFXaKtcfCDyLWZo4h95ELYgw0g_vnx-r9uR7BZ8Wbej2tN7zCH8sVEvjGpwFHxL2jGArfXNHKIonL3HIw-mlXpDM92BuczVZjg Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:44.860603 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 5fe0a387f4ac494d826d9946558e07b6 Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: exception: Aggregate 5 could not be found. Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '5'} Oct 13 08:34:44.862053 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:44.862959 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:44.864181 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:44.865510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:44.865510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:44.865510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:44.865510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 13 08:34:44.865510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:44.866737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-868cbd99-625b-45ad-9f86-5ee9f5dd54e9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:44.867742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-868cbd99-625b-45ad-9f86-5ee9f5dd54e9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.048181 Oct 13 08:34:44.868609 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 143/265] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:44 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:45.108644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f5377449b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.112137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.116035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.117413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.118383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.119049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.119627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.123377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:45.131348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0eb88f2d-6f03-4573-88dd-ced36c31674f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.913851 Oct 13 08:34:45.135349 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 123/266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:44 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:45.141988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.146993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:45.160811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.161984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.162644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.163509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.171177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.171852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.183144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e8a83f2-cd05-4619-b996-9ba09b41181b tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.312861 Oct 13 08:34:45.184380 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 144/267] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:34:44 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:45.190701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afae6fb3-a45e-424b-8b36-4771be83b1df tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:45.211555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afae6fb3-a45e-424b-8b36-4771be83b1df tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.213156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afae6fb3-a45e-424b-8b36-4771be83b1df tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.215274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afae6fb3-a45e-424b-8b36-4771be83b1df tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.387111 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afae6fb3-a45e-424b-8b36-4771be83b1df tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.200853 Oct 13 08:34:45.388055 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 145/268] 10.222.0.23 () {62 vars in 1232 bytes} [Thu Oct 13 08:34:45 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:45.392870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3497ec0-e6d9-4bf0-9bce-94581d385b11 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-193566410", "name": "tempest-test_aggregate-1223886307"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:45.397561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-b3497ec0-e6d9-4bf0-9bce-94581d385b11 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid 1b7d55b0-9978-4921-880d-e0c29a3711d2 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:45.427880 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3497ec0-e6d9-4bf0-9bce-94581d385b11 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.038393 Oct 13 08:34:45.435204 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 146/269] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Oct 13 08:34:45 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:45.436178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e65a9-6da4-4630-af5a-9473d6193db0", "name": "network-vif-plugged", "status": "completed", "tag": "c45dcd65-8795-4a54-a776-83e9ab6a7db9"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:45.447253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.447733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.448160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.468275 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] Creating event network-vif-plugged:c45dcd65-8795-4a54-a776-83e9ab6a7db9 for instance 361e65a9-6da4-4630-af5a-9473d6193db0 on n-h2-858384-11 Oct 13 08:34:45.476657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2bf1d29e-0220-4978-bed5-d86ef58a7fc4 req-11634e73-6cea-4058-a246-5797c41fd189 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044593 Oct 13 08:34:45.477722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 147/270] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:45.487446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.488348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:45.498040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.498595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.498989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.500002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.500468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.501342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.646129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:45.654139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e05c794-c193-49aa-9349-6f2f985997e0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.517499 Oct 13 08:34:45.654821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 124/271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:45 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:45.659421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f5377362040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.665738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.665738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.665738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.666794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.667442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.668808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.704735 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f40e993-b9d1-4c94-891c-a34a2adb56b7 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.048694 Oct 13 08:34:45.706245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 125/272] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Oct 13 08:34:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:45.711362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a957be85-791a-4609-ab3a-2bb1802286d9 tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:45.726279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a957be85-791a-4609-ab3a-2bb1802286d9 tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.727082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a957be85-791a-4609-ab3a-2bb1802286d9 tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.727739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a957be85-791a-4609-ab3a-2bb1802286d9 tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.745525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:45.758593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1226c824-4606-4a01-a3bb-68af6135fe9d tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.279626 Oct 13 08:34:45.770577 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 148/273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:45 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:45.779261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5621e84b-1151-42a0-a8bb-7a4c6865e319 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.843882 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5621e84b-1151-42a0-a8bb-7a4c6865e319 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.071810 Oct 13 08:34:45.851157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 149/274] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:45.857833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.857833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:45.874263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.874792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.875224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.875933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.876379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.876814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.935004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a957be85-791a-4609-ab3a-2bb1802286d9 tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.227183 Oct 13 08:34:45.935508 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 126/275] 10.222.0.23 () {62 vars in 1232 bytes} [Thu Oct 13 08:34:45 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:45.947191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f53773623a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:45.963751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.964635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.965341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:45.966245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:45.967201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:45.967772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.010423 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d32080ad-7513-4dc6-bd33-e28657ffbc77 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.073281 Oct 13 08:34:46.012032 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 127/276] 10.222.0.23 () {58 vars in 1145 bytes} [Thu Oct 13 08:34:45 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:34:46.017517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-373f6e38-03d4-4ce5-919c-6923719c4595 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.030966 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-373f6e38-03d4-4ce5-919c-6923719c4595 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-373f6e38-03d4-4ce5-919c-6923719c4595 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Request method failure captured: Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vMH4ErjQFLOhZq9KXVOEObZfs8rCWUdrYsl-Qm9Lu81FR_tM9xxUrGF_UlE0jL7nyL2PJYyw1tDFXaKtcfCDyLWZo4h95ELYgw0g_vnx-r9uR7BZ8Wbej2tN7zCH8sVEvjGpwFHxL2jGArfXNHKIonL3HIw-mlXpDM92BuczVZjg Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:46.033279 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5fe0a387f4ac494d826d9946558e07b6 Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: exception: Aggregate 7 could not be found. Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '7'} Oct 13 08:34:46.034704 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.035571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 13 08:34:46.036812 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.041487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-373f6e38-03d4-4ce5-919c-6923719c4595 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:46.043391 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-373f6e38-03d4-4ce5-919c-6923719c4595 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.029372 Oct 13 08:34:46.044437 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 128/277] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:46.054028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f4e505c-de77-4a4f-aeb8-efa9bd674d2c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.092553 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f4e505c-de77-4a4f-aeb8-efa9bd674d2c tempest-AggregatesAdminTestV241-169495736 tempest-AggregatesAdminTestV241-169495736-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.046819 Oct 13 08:34:46.095205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 129/278] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 08:34:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.133646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44c2a6b4-e164-4e57-9901-46ba71351c6d tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.174804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-44c2a6b4-e164-4e57-9901-46ba71351c6d tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44c2a6b4-e164-4e57-9901-46ba71351c6d tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Request method failure captured: Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vMH4ErjQFLOhZq9KXVOEObZfs8rCWUdrYsl-Qm9Lu81FR_tM9xxUrGF_UlE0jL7nyL2PJYyw1tDFXaKtcfCDyLWZo4h95ELYgw0g_vnx-r9uR7BZ8Wbej2tN7zCH8sVEvjGpwFHxL2jGArfXNHKIonL3HIw-mlXpDM92BuczVZjg Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:46.182876 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cece6991a6cf4da1ba4926884376e36b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cece6991a6cf4da1ba4926884376e36b Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-220490295 Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5fe0a387f4ac494d826d9946558e07b6 Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminTestJSON-220490295-project-admin Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: exception: Aggregate 7 could not be found. Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '7'} Oct 13 08:34:46.184902 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:46.185768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:46.186994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:46.188251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44c2a6b4-e164-4e57-9901-46ba71351c6d tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:46.188909 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-44c2a6b4-e164-4e57-9901-46ba71351c6d tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.092565 Oct 13 08:34:46.195219 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 130/279] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:46 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:46.201722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f537729bf70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.211599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:46.215084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.215566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.218191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.218969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.222687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.223164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.234593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:46.237801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:46.239201 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c0346f78-0afd-4601-8130-97be9cf126be tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.387002 Oct 13 08:34:46.240240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 150/280] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:45 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:46.251068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.252742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:46.260040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1728d90d-7ecb-4356-8043-d3b0b457d5fe tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.062441 Oct 13 08:34:46.261469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 131/281] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.267551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6463ae62-5439-4666-a2de-e63209ac926a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-409926761"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:46.269058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.270866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.271557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.274457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.aggregate [None req-6463ae62-5439-4666-a2de-e63209ac926a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid 814c8fa8-53d1-4cbf-bde8-b9d53fbad842 for aggregate {{(pid=127031) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:46.275324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.277567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.278929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.310173 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6463ae62-5439-4666-a2de-e63209ac926a tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047083 Oct 13 08:34:46.311944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 132/282] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.318170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f537729b670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.332331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.332906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.333359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.334078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.340875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.341324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.387128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c5f4686-1ffd-4bba-bfef-d5998d474e4d tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.073249 Oct 13 08:34:46.395069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 133/283] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.403112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcfd76cf-0844-438c-b0b0-6a6c09d5a7c0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.414504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcfd76cf-0844-438c-b0b0-6a6c09d5a7c0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.018060 Oct 13 08:34:46.416949 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 134/284] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.431610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f537760aca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.439482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.439979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.440409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.441141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.441587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.443604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.484040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2eb5c416-dfb7-4c62-82d4-aecadb81ad66 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.065835 Oct 13 08:34:46.491450 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 135/285] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.497036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19f8a518-5d11-4229-959c-7fa9060ee998 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:46.537385 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19f8a518-5d11-4229-959c-7fa9060ee998 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.044247 Oct 13 08:34:46.538518 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 136/286] 10.222.0.23 () {60 vars in 1191 bytes} [Thu Oct 13 08:34:46 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.544221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f53771e5ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.552994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.553715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.554305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.569053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.569686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.570123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.606009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-199ece22-d661-4503-8b75-842540b0abe4 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-858384-11" status: 200 len: 471 microversion: 2.1 time: 0.066374 Oct 13 08:34:46.612039 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 137/287] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-hosts/n-h1-858384-11 => generated 471 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.616821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5dae424-75b1-4070-adde-f6661854a4bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.625070 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5dae424-75b1-4070-adde-f6661854a4bc tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.011742 Oct 13 08:34:46.626178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 138/288] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.630703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Calling method '.version_select at 0x7f53771e5ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.638521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.639242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.639825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.655328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.656086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.656674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.680902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-70972e08-1c9e-4757-98d8-abe1ac6ab014 tempest-HostsAdminTestJSON-1774142837 tempest-HostsAdminTestJSON-1774142837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-858384-11" status: 200 len: 735 microversion: 2.1 time: 0.053503 Oct 13 08:34:46.687124 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 139/289] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/os-hosts/n-h2-858384-11 => generated 735 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.694270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0f9b683-a05e-450a-9047-a95509d04dc1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.727778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0f9b683-a05e-450a-9047-a95509d04dc1 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039862 Oct 13 08:34:46.728555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 140/290] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:46.738058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.738708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:46.751515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.752002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.752543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.753137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.759115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.759565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.820621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:46.829941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6bf18ec-ada5-48ef-b32f-2accb4ef1142 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.588502 Oct 13 08:34:46.831196 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 151/291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:46.837093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1eee15ea-3850-417e-b82b-b26163370c37 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-220152449", "availability_zone": "tempest-test_az-1466542372"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:46.842199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-1eee15ea-3850-417e-b82b-b26163370c37 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid 591fda52-4639-4f2d-8485-7c7ef19b3144 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:46.878877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1eee15ea-3850-417e-b82b-b26163370c37 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.044593 Oct 13 08:34:46.880326 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 152/292] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Oct 13 08:34:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:46.895177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:46.897703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:46.915443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.916238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.918012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:46.923250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:46.924226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:46.925147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.029810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:47.044049 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a05274e9-baa7-4897-be58-03f442fb84bf tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.309225 Oct 13 08:34:47.044845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 141/293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:47.055572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-210de9b3-6782-49bb-a29e-f01a805073e4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-220152449_new", "availability_zone": "tempest-test_az-1466542372_new"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:47.131401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:47.220410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-210de9b3-6782-49bb-a29e-f01a805073e4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.222554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-210de9b3-6782-49bb-a29e-f01a805073e4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.226590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-210de9b3-6782-49bb-a29e-f01a805073e4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.270947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:47.287814 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5535cc5a-aa46-448f-8ecb-e99e778bd6c7 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.402960 Oct 13 08:34:47.289168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 153/294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:46 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:47.296940 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-210de9b3-6782-49bb-a29e-f01a805073e4 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.247748 Oct 13 08:34:47.297722 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 142/295] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:34:47 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:47.308494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9db4850a-b87c-4c4b-afd4-42955f58aa69 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.319907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.322375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:47.322795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9db4850a-b87c-4c4b-afd4-42955f58aa69 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.017839 Oct 13 08:34:47.323694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 143/296] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:34:47 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:47.335606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25774180-e357-4b15-8bb6-d0c7d9b5d685 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.337210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:47.359445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.362182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.364336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.369268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.370942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.374072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.384914 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25774180-e357-4b15-8bb6-d0c7d9b5d685 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.052703 Oct 13 08:34:47.388181 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 144/297] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:47.402838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9baf8a2c-1dd3-4970-95d6-3f36e403f373 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-130164819"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:47.407785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.aggregate [None req-9baf8a2c-1dd3-4970-95d6-3f36e403f373 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Generated uuid f25ab55a-2efc-4471-b05d-f947ebfc1328 for aggregate {{(pid=127031) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:47.488862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9baf8a2c-1dd3-4970-95d6-3f36e403f373 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092762 Oct 13 08:34:47.489487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 145/298] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:47.503450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99a859be-67dc-4ca8-a9fa-02c535a3eaf9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.519813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99a859be-67dc-4ca8-a9fa-02c535a3eaf9 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.020919 Oct 13 08:34:47.522329 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 146/299] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:34:47 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:47.540025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a8ba7e9-d7ab-4fc6-a7f4-3a5b4d1a57e0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.584598 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a8ba7e9-d7ab-4fc6-a7f4-3a5b4d1a57e0 tempest-AggregatesAdminTestJSON-220490295 tempest-AggregatesAdminTestJSON-220490295-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053255 Oct 13 08:34:47.590288 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 147/300] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:47 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:47.600910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.601410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:47.617504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.618007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.618471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.619180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.621697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.622136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.638163 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] HTTP exception thrown: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Request method failure captured: Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 HTTP/1.1 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81tph1RoGLXdBzELcwvLknOk0smgsrC61TlHg4WRZajWjxsRN678eGRweaDQp-XMMyVQLukcPtEaa_Wd9fQyPLkLq4tYDjycRPtraBiXZKLPEgj_Bgen40vN56a-0fHqztCvuYs2JWnBDAWOzMg3l7WFMgA_isba1P5z_aiyFw8Jeo Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:47.640630 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ab09230959646e5b99e75077d3371a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 88db837d4caf4c5695a7d224168460fb Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.641978 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6b273cf8-ee47-485b-bc2a-79bf12171bf3'} Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:47.642927 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.644093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.648123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Returning 404 to user: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:47.649757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b3cabc81-3369-458d-a04b-a2bea544370d tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 404 len: 111 microversion: 2.1 time: 0.054214 Oct 13 08:34:47.650843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 148/301] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:34:47 2022] DELETE /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:47.661109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.662259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] [instance: 6b273cf8-ee47-485b-bc2a-79bf12171bf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:47.670326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.671065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.671703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.672603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.673238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.673840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.691853 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] HTTP exception thrown: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Request method failure captured: Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 HTTP/1.1 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81tph1RoGLXdBzELcwvLknOk0smgsrC61TlHg4WRZajWjxsRN678eGRweaDQp-XMMyVQLukcPtEaa_Wd9fQyPLkLq4tYDjycRPtraBiXZKLPEgj_Bgen40vN56a-0fHqztCvuYs2JWnBDAWOzMg3l7WFMgA_isba1P5z_aiyFw8Jeo Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:47.693599 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ab09230959646e5b99e75077d3371a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ab09230959646e5b99e75077d3371a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0ab09230959646e5b99e75077d3371a9 Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1332062583 Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 88db837d4caf4c5695a7d224168460fb Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminTestJSON-1332062583-project Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.695124 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6b273cf8-ee47-485b-bc2a-79bf12171bf3'} Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:47.695817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. Oct 13 08:34:47.697300 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:47.698718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] Returning 404 to user: Instance 6b273cf8-ee47-485b-bc2a-79bf12171bf3 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:47.698718 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19166ef6-3d7d-41a6-8811-337a81669405 tempest-AggregatesAdminTestJSON-1332062583 tempest-AggregatesAdminTestJSON-1332062583-project] 10.222.0.23 "GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3" status: 404 len: 111 microversion: 2.1 time: 0.039916 Oct 13 08:34:47.699582 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 149/302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:47 2022] GET /compute/v2.1/servers/6b273cf8-ee47-485b-bc2a-79bf12171bf3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:47.857544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:47.858166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:47.869178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.869688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.871847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.872583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:47.873050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:47.874900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:47.962274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:47.970675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:47.972127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:47.973243 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42cdf324-5572-4685-80ec-aedae6b566b8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.682834 Oct 13 08:34:47.979833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 154/303] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:47 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:48.073387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:48.074702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:48.085618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:48.090474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:48.090967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:48.093052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:48.093534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:48.093960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:48.248062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:48.263154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-792aa333-6413-4a68-9c5f-6a9323f25116 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.410101 Oct 13 08:34:48.275159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 150/304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:47 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:48.312168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:48.312986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:48.321117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:48.326920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:48.327244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:48.328276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:48.329408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:48.333439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:48.388498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:48.400109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c76ba32f-ec94-4278-a3d9-5160380a9904 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.331692 Oct 13 08:34:48.401255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 155/305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:48 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:48.832183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:48.843149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c6abbb7-245d-4898-926c-bba6a76e8866 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1319 microversion: 2.1 time: 0.534560 Oct 13 08:34:48.844867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 151/306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:48 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:49.005211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:49.005895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:49.008564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=28 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:49.018319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.018837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.019272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.019965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.020513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.031134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.290505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:49.291686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:49.293769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=20 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:49.302617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.303354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.304781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.309529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.313562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.314786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.570780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:49.586600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:49.589951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:49.593424 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0958c22f-6a43-477c-a567-1e3fba492dc4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.593982 Oct 13 08:34:49.595579 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 156/307] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:48 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:49.610720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:49.610720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:49.619061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.619591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.619936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.621187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.621680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.622098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.698764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:49.744400 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43a73e0c-4da5-4058-94bc-fef0554a99da tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.460044 Oct 13 08:34:49.764333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:49 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:49.867216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:49.868449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:49.885202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.890967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.893346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:49.894497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:49.898924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:49.899572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:50.135134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:50.144683 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c64da27-3bdf-46ae-a33c-2686e1636c75 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.542934 Oct 13 08:34:50.150471 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 157/309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:49 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:50.184355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:50.197821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80f3b105-e1d2-45c2-9ffd-4eb9cb5e8425 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1469 microversion: 2.1 time: 0.334923 Oct 13 08:34:50.198429 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 153/310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:49 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:50.623626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:50.624841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:50.634612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:50.637133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:50.639264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:50.640975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:50.644476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:50.645112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:50.760083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2123882670", "block_migration": true, "disk_over_commit": false}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:50.762967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:50.787143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:50.788021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:50.789735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:50.793656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:50.794328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:50.795131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.115604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:51.128262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:51.132883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:51.144800 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa8ff83a-ce48-42d3-965f-d0ac4ef69962 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.517462 Oct 13 08:34:51.145826 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 154/311] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:50 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:51.154823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:51.155659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:51.163578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.164338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.165107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.166024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.166721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.167332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.456435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:51.458922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:51.470100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c0621cd-3c5b-4170-9bc0-db7d02e8c5bd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.322942 Oct 13 08:34:51.471259 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 155/312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:51 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:51.484166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:51.484788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:51.503398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.504111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.504745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.505503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.506226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.506688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.746784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:51.755410 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f0997cc-b1fc-4b8c-8e1d-9d56dbf9e0c2 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.283107 Oct 13 08:34:51.771026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 156/313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:51 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:51.778937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0da86d-73c7-4b2f-a3f3-7f5096310a01", "name": "network-vif-plugged", "status": "completed", "tag": "609ef1bd-ddea-4c9c-84cc-f4be3290e108"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:51.791961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.793304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.793937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.815136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] Creating event network-vif-plugged:609ef1bd-ddea-4c9c-84cc-f4be3290e108 for instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 on n-h2-858384-11 Oct 13 08:34:51.822351 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5f1a8b22-753e-43d1-9289-e38295f775b3 req-be8934fc-9b1f-4d39-9b86-361ade145ab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049452 Oct 13 08:34:51.824760 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 157/314] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:51.846221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lazy-loading 'flavor' on Instance uuid 361e65a9-6da4-4630-af5a-9473d6193db0 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:34:51.942756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Going to try to live migrate instance to tempest-host-2123882670 {{(pid=127030) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:34:51.951511 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] HTTP exception thrown: Compute host tempest-host-2123882670 could not be found. Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Request method failure captured: Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0/action HTTP/1.1 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 107 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82N1_JbPOu9OHOX55T-uYRMQm6zsiEeP4xwlllyo77snxun-KfmrI1RUOtWB-7OjhOOKC6FqhmX5oIEzJ6wHgFB2JLIRZMc9BgDR_J6Xf5roSGsj-vTRmcGvs6NMSzbdcCf8bkh4AF3zp3NjZoWTQT96PKU08J_nF3vyEAJUeXvyEM Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 045b882d65844641a548e0cea067deb9 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:51.956265 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/045b882d65844641a548e0cea067deb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_045b882d65844641a548e0cea067deb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/045b882d65844641a548e0cea067deb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/045b882d65844641a548e0cea067deb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 045b882d65844641a548e0cea067deb9 Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveMigrationNegativeTest-243648801-project-admin Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0bfe2c1bd7e044bfa5e9d592dacaf77b Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveMigrationNegativeTest-243648801-project-admin Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: {"os-migrateLive": {"host": "tempest-host-2123882670", "block_migration": true, "disk_over_commit": false}} Oct 13 08:34:51.957499 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: exception: Compute host tempest-host-2123882670 could not be found. Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '361e65a9-6da4-4630-af5a-9473d6193db0', 'body': {'os-migrateLive': {'host': 'tempest-host-2123882670', 'block_migration': True, 'disk_over_commit': False}}} Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:34:51.958262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2123882670 could not be found. Oct 13 08:34:51.959404 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2123882670 could not be found. Oct 13 08:34:51.960479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2123882670 could not be found. Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Returning 400 to user: Compute host tempest-host-2123882670 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:51.961544 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d58a5fc2-d4ac-4d1b-89f4-62d3a130d0e2 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0/action" status: 400 len: 100 microversion: 2.1 time: 1.739475 Oct 13 08:34:51.962149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 158/315] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Oct 13 08:34:50 2022] POST /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0/action => generated 100 bytes in 1742 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:34:51.971867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:51.972785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:51.981366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.982665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.983458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:51.984391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:51.985048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:51.985673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.173106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:52.174205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:52.198081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.199045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.202285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.203335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.204338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.205006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.322709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:52.333964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a28313c8-9017-4e43-af5d-ce881a27153e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1469 microversion: 2.1 time: 0.367517 Oct 13 08:34:52.335671 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 158/316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:51 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:52.495397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:52.496870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:52.509261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.512450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:52.516498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:52.516660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.517794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.519219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.521665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.522262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.529291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:52.543901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:52.546934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d87d08f-d0aa-482a-828f-4c407de3247d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.378377 Oct 13 08:34:52.554803 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 159/317] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:52 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:34:52.652897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-229067064", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:52.766449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:34:52.889971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:52.905392 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e214207-81ed-4267-9965-d364535cf893 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1387 microversion: 2.1 time: 0.413674 Oct 13 08:34:52.906264 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 159/318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:52 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1387 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:34:52.912558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:52.913558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:52.920478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.921180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.921784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:52.922677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:52.923453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:52.924032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:53.134005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:53.144051 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38135533-79db-411d-b8ff-be5c907e6f8c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.236387 Oct 13 08:34:53.145444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 160/319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:52 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:53.361335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:34:53.362524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:34:53.363032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:34:53.363449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:34:53.363868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:34:53.388064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:53.388557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:53.388993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:53.389797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:53.395807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:53.396175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:53.468946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Getting quotas for project a6ba7d819f68495182c9cd6d79ac1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:34:53.473691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Getting quotas for user 9d00a3a275b54978b4380b971c91d659 and project a6ba7d819f68495182c9cd6d79ac1e20. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:34:53.497170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:34:53.502617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:34:53.576413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:53.577658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:53.588536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:53.589623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:53.591608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:53.592652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:53.595559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:53.598308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:53.724241 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6eca01a-b1a5-4d69-a990-7ddd73f824e4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076583 Oct 13 08:34:53.741318 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 160/320] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:34:53.762753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e1d8486-cab9-46fc-a47c-3d9cd54b7ea9 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:53.763388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e1d8486-cab9-46fc-a47c-3d9cd54b7ea9 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:54.113975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:54.131457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:54.133094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:54.134335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c09d6781-5efa-4ee6-b50b-b85132d7dbb9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.564434 Oct 13 08:34:54.134820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 161/321] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:53 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:34:54.300370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e1d8486-cab9-46fc-a47c-3d9cd54b7ea9 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:54.315070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e1d8486-cab9-46fc-a47c-3d9cd54b7ea9 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1218 microversion: 2.1 time: 0.572241 Oct 13 08:34:54.325171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 161/322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:53 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1218 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:54.358720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:54.363739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:54.374342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:54.380879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.381396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.381903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.383149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.384242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.388284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.389284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.391565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.391724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.392274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.393218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.393444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.501300 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed461b64-0a27-4788-9224-2e16bd954cb3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.365232 Oct 13 08:34:54.502151 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 162/323] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:34:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:54.515434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:54.517008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:54.533947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.535108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.536653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.538689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:54.539821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:54.541491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:54.949233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:54.963315 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19bd6456-6abf-4739-8c6c-5b4e16e772fc tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.457015 Oct 13 08:34:54.963951 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 163/324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:54 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:55.025591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:55.039115 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdef9628-ac5c-491d-8e6f-a3688f800fb7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1584 microversion: 2.1 time: 0.696856 Oct 13 08:34:55.040103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 162/325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:54 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1584 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:55.058582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10aa32d4-4359-44c7-ae90-6297a720b62c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1408186564"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:55.062522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-10aa32d4-4359-44c7-ae90-6297a720b62c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid d28e4d95-d8ee-4e19-87e5-7f36c5fcea34 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:55.102394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10aa32d4-4359-44c7-ae90-6297a720b62c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060936 Oct 13 08:34:55.103209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 163/326] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:55.108074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c032e1-044b-41ee-af08-0ee6fd83ee7a", "name": "network-vif-plugged", "status": "completed", "tag": "71f52006-c9aa-4693-bb4c-c411fbfdab09"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:55.134230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.135146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.135796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.156450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f6dcf55-e851-4c36-9a12-08f6a9cc4151 tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-406018279", "id": 734033164, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:55.175361 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] Creating event network-vif-plugged:71f52006-c9aa-4693-bb4c-c411fbfdab09 for instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a on n-h1-858384-11 Oct 13 08:34:55.191779 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f6dcf55-e851-4c36-9a12-08f6a9cc4151 tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.213342 Oct 13 08:34:55.198616 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-22583c85-9809-4dd6-b6e5-fa479d14b795 req-abca07f7-6def-496e-8f54-1ca7bb98cfef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094095 Oct 13 08:34:55.213594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 164/327] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:55.219616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:55.221776 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 164/328] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:34:54 2022] POST /compute/v2.1/flavors => generated 467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:34:55.231944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16c60729-96bc-4306-b2b0-8eb439c769d1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:55.234434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:55.249859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.252615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.254962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.257639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.258124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.258581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.283336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c60729-96bc-4306-b2b0-8eb439c769d1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.284212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c60729-96bc-4306-b2b0-8eb439c769d1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.284945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c60729-96bc-4306-b2b0-8eb439c769d1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.561819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16c60729-96bc-4306-b2b0-8eb439c769d1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.338372 Oct 13 08:34:55.563139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 165/329] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:55 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:55.570663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:55.572709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:55.588074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.591198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.591931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.592978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:55.593649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:55.594909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:55.757852 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-651b9e95-2d25-471c-8ed1-85d447f6851d tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.542468 Oct 13 08:34:55.773481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 165/330] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:34:55 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01/os-interface => generated 284 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:55.788515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bb91097-f166-4e2b-9bcc-e49eb88c7ff6 tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:56.135251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6bb91097-f166-4e2b-9bcc-e49eb88c7ff6 tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/734033164/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.357352 Oct 13 08:34:56.138911 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 166/331] 10.222.0.23 () {62 vars in 1262 bytes} [Thu Oct 13 08:34:55 2022] POST /compute/v2.1/flavors/734033164/os-extra_specs => generated 62 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:56.145795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:56.152086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:56.154900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:56.157707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:56.160216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:56.161650 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa02beb0-d494-4427-bb3e-eb32316791bb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 0.597286 Oct 13 08:34:56.163005 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 166/332] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:55 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:56.164151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.164633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.166130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.167971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.168592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.169219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.191886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:56.239184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.243620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.249227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.300569 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-858384-11. Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 40 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:56.306291 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: {"add_host": {"host": "n-h1-858384-11"}} Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:56.309263 n-d-858384-11 devstack@n-api.service[127031]: exception: Aggregate 11 already has host n-h1-858384-11. Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-858384-11'}}} Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:34:56.310116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858384-11-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi session.flush() Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 08:34:56.311903 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 08:34:56.312999 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:34:56.315160 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858384-11-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 13, 8, 34, 56, 284777), 'updated_at': None, 'host': 'n-h1-858384-11', 'aggregate_id': 11}] Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:56.317688 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-858384-11. Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.319979 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-858384-11. Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:56.325102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:56.328039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-858384-11. Oct 13 08:34:56.328039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:56.329477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-858384-11. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:56.331529 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4b4c4dd-8634-4743-ba27-5ecef3e0512e tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.166484 Oct 13 08:34:56.339803 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 167/333] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 13 08:34:56.346388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:56.350251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:56.372879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.373572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.374054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.378821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.379615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.380263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.475012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:56.489129 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b4408ea-008f-4663-8bf9-e50a4fbad69b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1288 microversion: 2.1 time: 0.347755 Oct 13 08:34:56.490632 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 167/334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:56 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1288 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:56.509664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4405c1f9-d460-4d10-8b1d-93c58bb8edfe tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:56.542755 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4405c1f9-d460-4d10-8b1d-93c58bb8edfe tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/734033164" status: 202 len: 0 microversion: 2.86 time: 0.050718 Oct 13 08:34:56.543989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 168/335] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Oct 13 08:34:56 2022] DELETE /compute/v2.1/flavors/734033164 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:34:56.549264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa80e06f-2732-4eb9-a22b-95cda3ca75b4 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:56.580662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa80e06f-2732-4eb9-a22b-95cda3ca75b4 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:56.581558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa80e06f-2732-4eb9-a22b-95cda3ca75b4 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:56.582242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa80e06f-2732-4eb9-a22b-95cda3ca75b4 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:56.792720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa80e06f-2732-4eb9-a22b-95cda3ca75b4 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.247247 Oct 13 08:34:56.799224 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 169/336] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:56.804440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ef18069-dad3-4041-979b-c03f42e232aa tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:56.825379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:56.840395 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c83abc82-e2b2-40b1-8872-ca783f3f9315 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1319 microversion: 2.1 time: 0.498989 Oct 13 08:34:56.857659 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 168/337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:56 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:56.857659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b1f7d0f-7a99-4443-a54d-7b14365ee6b1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:56.888106 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ef18069-dad3-4041-979b-c03f42e232aa tempest-FlavorMetadataValidation-830704069 tempest-FlavorMetadataValidation-830704069-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.077748 Oct 13 08:34:56.898431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 170/338] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:34:56 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:34:56.919716 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b1f7d0f-7a99-4443-a54d-7b14365ee6b1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.074854 Oct 13 08:34:56.920662 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 169/339] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:56 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:56.929776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ab89cbd-5882-478d-92a1-8c8b52dca2f1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1494655318"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:56.952837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-6ab89cbd-5882-478d-92a1-8c8b52dca2f1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 0b6ea98b-b59e-454a-8907-7830c8825e6a for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:56.997824 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ab89cbd-5882-478d-92a1-8c8b52dca2f1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071489 Oct 13 08:34:57.000128 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 171/340] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:57.192139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:57.192946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:57.204127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.207042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.207750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.208701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.211611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.212278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.221955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45a85cb8-5785-4712-a1f3-de6b66202439 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.231739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45a85cb8-5785-4712-a1f3-de6b66202439 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45a85cb8-5785-4712-a1f3-de6b66202439 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 40 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:57.237834 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: {"add_host": {"host": "n-h1-858384-11"}} Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:57.239227 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858384-11'}}} Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:57.240009 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 13 08:34:57.241139 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.247096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45a85cb8-5785-4712-a1f3-de6b66202439 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:57.249690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45a85cb8-5785-4712-a1f3-de6b66202439 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.241483 Oct 13 08:34:57.252500 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 170/341] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:57.273407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9302dd20-e2af-4877-b8a8-c545ecaf1035 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:57.296806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:57.321400 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9302dd20-e2af-4877-b8a8-c545ecaf1035 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.062700 Oct 13 08:34:57.327206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 171/342] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:57.333732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d77112c-a455-439a-a18f-3c2c72fb7a7f tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-272435813"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.337905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.aggregate [None req-4d77112c-a455-439a-a18f-3c2c72fb7a7f tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 656c1b37-ae13-4844-89a2-63f5940caab7 for aggregate {{(pid=127031) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:57.374326 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d77112c-a455-439a-a18f-3c2c72fb7a7f tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045637 Oct 13 08:34:57.383725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 172/343] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:57.395451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79408968-f79c-4af8-815c-c338d2d5cea9", "name": "network-vif-plugged", "status": "completed", "tag": "14bf18b9-923e-44b5-89f0-f63aeb02af35"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.423700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.424537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.425497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.449943 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] Creating event network-vif-plugged:14bf18b9-923e-44b5-89f0-f63aeb02af35 for instance 79408968-f79c-4af8-815c-c338d2d5cea9 on n-h2-858384-11 Oct 13 08:34:57.464969 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3728d83c-ce8b-47a4-b10d-09c116107f15 req-4babe04b-3439-441b-bfbb-1050afd4c214 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075940 Oct 13 08:34:57.468629 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 173/344] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:57.483537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1677166346"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.507887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.510082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.515839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.529555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.533997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.535266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.557340 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1677166346 could not be found. Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 58 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:57.563095 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: {"add_host": {"host": "tempest-nonexist_host-1677166346"}} Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:57.564362 n-d-858384-11 devstack@n-api.service[127031]: exception: Compute host tempest-nonexist_host-1677166346 could not be found. Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1677166346'}}} Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1677166346' is not mapped to any cell Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.565074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 13 08:34:57.566146 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1677166346 could not be found. Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1677166346 could not be found. Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.567296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1677166346 could not be found. Oct 13 08:34:57.568450 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.570720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1677166346 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:57.575339 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b947780a-e331-4399-be21-92ad0a9dd1ca tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.104587 Oct 13 08:34:57.576194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 174/345] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:57.586182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:57.587450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:57.595725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.596649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.598260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.599525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.600187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.600961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.708244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:57.725643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f91c916-7245-4bff-8137-334e4ef69dc2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1276 microversion: 2.1 time: 0.145431 Oct 13 08:34:57.731004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 175/346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:57 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:57.737803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8366b85-6a7f-4f55-b286-ecd0fa909526 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:57.784547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8366b85-6a7f-4f55-b286-ecd0fa909526 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.050244 Oct 13 08:34:57.790507 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 176/347] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:57 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:57.796737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acd2e737-b0db-47c1-a7f2-5d5b4926a01b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acd2e737-b0db-47c1-a7f2-5d5b4926a01b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 283 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:57.800698 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.801976 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:34:57.803092 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:57.804094 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.805681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.807698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:34:57.807698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:34:57.807698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:34:57.807698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.807698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acd2e737-b0db-47c1-a7f2-5d5b4926a01b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:57.808694 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-acd2e737-b0db-47c1-a7f2-5d5b4926a01b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010868 Oct 13 08:34:57.808694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 177/348] 10.222.0.23 () {60 vars in 1165 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:34:57.815409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-411979e4-9dbe-4361-a81e-312c74debc43 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-411979e4-9dbe-4361-a81e-312c74debc43 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 27 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:57.824520 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: {"aggregate": {"name": ""}} Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:57.825742 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '' Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:57.828966 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:34:57.830334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.831870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-411979e4-9dbe-4361-a81e-312c74debc43 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:57.831870 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-411979e4-9dbe-4361-a81e-312c74debc43 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015432 Oct 13 08:34:57.831870 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 178/349] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:34:57.847815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d96e7d34-61dc-447f-8992-63bec1e02ea3 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1804044970"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:57.852205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d96e7d34-61dc-447f-8992-63bec1e02ea3 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d96e7d34-61dc-447f-8992-63bec1e02ea3 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 60 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:57.854329 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: {"aggregate": {"name": "tempest-test_aggregate-1804044970"}} Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:57.856340 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1804044970'}}} Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:57.857207 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:57.860177 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 13 08:34:57.861715 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:57.862932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d96e7d34-61dc-447f-8992-63bec1e02ea3 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:57.864152 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d96e7d34-61dc-447f-8992-63bec1e02ea3 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026007 Oct 13 08:34:57.869122 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 179/350] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:57 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:57.879668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:57.885463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:57.893075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.893643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.894313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:57.895074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:57.895631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:57.896063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:58.396287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:58.412376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:58.414262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:58.430896 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b85619fd-474a-4515-9870-411016be2f30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1361 microversion: 2.25 time: 1.242530 Oct 13 08:34:58.432896 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 172/351] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:57 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1361 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:34:58.455333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5d92946-e355-44f9-bf39-4dbef33a18d2 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2016518314"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:58.463255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-c5d92946-e355-44f9-bf39-4dbef33a18d2 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 89182635-d686-4382-80fd-2d2ee6890b43 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:58.505567 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5d92946-e355-44f9-bf39-4dbef33a18d2 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061324 Oct 13 08:34:58.509019 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 173/352] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:58.526117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2016518314"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:58.529590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid e6eda142-acf5-4800-a5d6-c0eff38333f9 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:58.551482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2016518314 already exists. Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 60 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:58.553391 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: {"aggregate": {"name": "tempest-test_aggregate-2016518314"}} Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:58.555161 n-d-858384-11 devstack@n-api.service[127030]: exception: Aggregate tempest-test_aggregate-2016518314 already exists. Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2016518314'}}} Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 13 08:34:58.556162 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2016518314 already exists. Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:58.557489 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2016518314 already exists. Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2016518314 already exists. Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.559497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2016518314 already exists. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:58.560378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd2c6499-704e-4671-aee0-e8f54e109877 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.044254 Oct 13 08:34:58.562092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 174/353] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:58 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:34:58.574944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57e973ba-6c79-43fa-906b-6d5fc527941d tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:58.602335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:58.619347 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bba81944-43aa-41f4-98e2-7d6beb2662a9 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1469 microversion: 2.1 time: 0.749079 Oct 13 08:34:58.624718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 180/354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:57 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1469 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:58.651139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:58.657565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57e973ba-6c79-43fa-906b-6d5fc527941d tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.091391 Oct 13 08:34:58.657745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:58.659288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 175/355] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:58 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 13 08:34:58.669380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a6ef415f-c5f7-439b-a2d4-13f4b9052d82 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-537785363"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:58.675293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:58.675884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-a6ef415f-c5f7-439b-a2d4-13f4b9052d82 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 9eef0a99-75b1-4d8f-b26a-f08ecc7215be for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:58.677122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:58.678737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:58.679520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:58.680891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:58.681337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:58.715816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a6ef415f-c5f7-439b-a2d4-13f4b9052d82 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050899 Oct 13 08:34:58.721680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 176/356] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:58.728845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37b53ad9-8006-48cf-bc31-db553ff45ede tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:58.731073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37b53ad9-8006-48cf-bc31-db553ff45ede tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37b53ad9-8006-48cf-bc31-db553ff45ede tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:58.734256 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 13 08:34:58.735919 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '15'} Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:58.736740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 13 08:34:58.737986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:58.739970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37b53ad9-8006-48cf-bc31-db553ff45ede tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:58.740981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37b53ad9-8006-48cf-bc31-db553ff45ede tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016606 Oct 13 08:34:58.746366 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 177/357] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:58 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:58.763655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2495007a-c6e3-4d35-b85a-c4ca86d214d5 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:58.769686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:58.807672 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2495007a-c6e3-4d35-b85a-c4ca86d214d5 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.060913 Oct 13 08:34:58.813978 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 178/358] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:58 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:58.824353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:58.825119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:58.847366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:58.849912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:58.850510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:58.851504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:58.863284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:58.864141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:58.980701 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-41dd8d74-fdc5-4dce-8f36-4d5beb307d76 tempest-DeleteServersAdminTestJSON-1687065136 tempest-DeleteServersAdminTestJSON-1687065136-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a/action" status: 202 len: 0 microversion: 2.1 time: 0.339127 Oct 13 08:34:58.981758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 181/359] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:34:58 2022] POST /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:34:58.992644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a90e69-92de-47e5-9367-684fb372497b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.008514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:59.016899 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-75a90e69-92de-47e5-9367-684fb372497b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 13 08:34:59.019611 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-539ee856-3c73-4e2e-a96c-99ae96ab7c22 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1276 microversion: 2.1 time: 0.205185 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a90e69-92de-47e5-9367-684fb372497b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:34:59.020557 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: exception: Aggregate -1 could not be found. Oct 13 08:34:59.022077 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '-1'} Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:59.022911 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.023935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 13 08:34:59.026203 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.026824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75a90e69-92de-47e5-9367-684fb372497b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:59.027812 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75a90e69-92de-47e5-9367-684fb372497b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043655 Oct 13 08:34:59.029394 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 182/360] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:58 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:34:59.035166 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 179/361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:58 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:59.037457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.038281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:59.046806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.047531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.048117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.048983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.049596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.050340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.051545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d46fa7dd-816c-4a6e-81f0-cd188b96de1c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-877694645"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:59.066792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-d46fa7dd-816c-4a6e-81f0-cd188b96de1c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid c87e1a8d-ff21-4ed5-a4fb-f8f2d6214bc5 for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:59.087391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.088154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.088780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.089709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:34:59.096502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d46fa7dd-816c-4a6e-81f0-cd188b96de1c tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057871 Oct 13 08:34:59.097808 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 180/362] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:59.110567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc962b5a-05e4-4b30-85a9-d7bda69d35c0 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.112435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc962b5a-05e4-4b30-85a9-d7bda69d35c0 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc962b5a-05e4-4b30-85a9-d7bda69d35c0 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:59.114355 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 13 08:34:59.115998 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '16'} Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:59.116775 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 13 08:34:59.118007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.120173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc962b5a-05e4-4b30-85a9-d7bda69d35c0 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:59.121271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc962b5a-05e4-4b30-85a9-d7bda69d35c0 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.014899 Oct 13 08:34:59.122470 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 181/363] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:34:59.130925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a034c79-406c-4a08-b3f9-d48d849ddf99 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.155611 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a034c79-406c-4a08-b3f9-d48d849ddf99 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.029094 Oct 13 08:34:59.156884 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 182/364] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:34:59 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:34:59.165992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e73fe022-8f74-4c0a-8473-5c59ec148207 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.175405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e73fe022-8f74-4c0a-8473-5c59ec148207 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e73fe022-8f74-4c0a-8473-5c59ec148207 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:34:59.177923 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: exception: Aggregate -1 could not be found. Oct 13 08:34:59.179381 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '-1'} Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.180164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 13 08:34:59.181547 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.183981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e73fe022-8f74-4c0a-8473-5c59ec148207 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:59.184990 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e73fe022-8f74-4c0a-8473-5c59ec148207 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023166 Oct 13 08:34:59.186797 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 183/365] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:34:59.195297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a794735-9b7e-4522-a745-55593ce3e014 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.197132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7a794735-9b7e-4522-a745-55593ce3e014 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a794735-9b7e-4522-a745-55593ce3e014 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:34:59.199492 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 13 08:34:59.200922 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:59.201745 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 13 08:34:59.203024 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.205451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a794735-9b7e-4522-a745-55593ce3e014 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:59.206283 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a794735-9b7e-4522-a745-55593ce3e014 tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015569 Oct 13 08:34:59.207361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 184/366] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:59.221275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9801ec78-7fef-4876-9992-e8fafa3922e6 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-650463538"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:59.228086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-9801ec78-7fef-4876-9992-e8fafa3922e6 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 1b9cb8d5-20b8-4589-ba45-0cddc32e489b for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:34:59.282727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9801ec78-7fef-4876-9992-e8fafa3922e6 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068659 Oct 13 08:34:59.287665 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 185/367] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:34:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:34:59.298374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06162613-49b3-4bcf-ae86-6eabc7c5571b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:59.318284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06162613-49b3-4bcf-ae86-6eabc7c5571b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.319163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06162613-49b3-4bcf-ae86-6eabc7c5571b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.319928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06162613-49b3-4bcf-ae86-6eabc7c5571b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.368881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:59.384290 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1389d12-0d04-411d-bde5-3d3e4ac71e6d tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1452 microversion: 2.1 time: 0.353497 Oct 13 08:34:59.385424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 183/368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1452 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:34:59.411612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.412154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:59.425166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.434747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.435203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.435942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.436394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.438742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.449895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:34:59.507997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:34:59.535068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06162613-49b3-4bcf-ae86-6eabc7c5571b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.240837 Oct 13 08:34:59.544621 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 186/369] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:34:59.556757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.560415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:59.578695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.579376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.580907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.583429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.586604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.587389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.874716 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-345411f2-1f36-48fb-a66d-94155326ade7 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 204 len: 0 microversion: 2.1 time: 0.468768 Oct 13 08:34:59.876651 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 184/370] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:34:59 2022] DELETE /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:34:59.898272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f1aa612-889a-4066-b353-5830c260e5fa tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:34:59.913695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f1aa612-889a-4066-b353-5830c260e5fa tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ba445ddfd3f74ed8be0d67c4a7c87334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b8e4c6eff498d9d519b69c38b3f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f1aa612-889a-4066-b353-5830c260e5fa tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Request method failure captured: Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 43 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82sBKOgD8Lrki7q51jX6rrY3u8KbbOlOMiT7NQEc8x2_3aoNNpxD4CgoqhjPQktFTH2ysKiixsZP819gDNNIUAjxTykanbP873aOzPiim2GIUuOkTTOFIHQhIs5WohktHzmjFLPfDHogh4ZgRaQPWtDUx7PPeP8NTFwRH4Y_8WHdgc Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:34:59.915897 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b8e4c6eff498d9d519b69c38b3f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ef8b8e4c6eff498d9d519b69c38b3f67 Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-177479667 Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ba445ddfd3f74ed8be0d67c4a7c87334 Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-177479667-project Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: {"remove_host": {"host": "n-h1-858384-11"}} Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:34:59.917891 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858384-11'}}} Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:34:59.920386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 13 08:34:59.921391 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:34:59.928461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f1aa612-889a-4066-b353-5830c260e5fa tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:34:59.929835 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f1aa612-889a-4066-b353-5830c260e5fa tempest-AggregatesAdminNegativeTestJSON-177479667 tempest-AggregatesAdminNegativeTestJSON-177479667-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.051937 Oct 13 08:34:59.931246 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 185/371] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:34:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:34:59.937883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:34:59.939253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:34:59.948917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.950114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.950971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:34:59.952309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:34:59.953663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:34:59.954537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:00.019310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:00.019913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:00.020458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:00.021671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:00.310767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:00.326939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6372ca48-32c6-42bb-9a9b-9002e312f9ba tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1458 microversion: 2.1 time: 0.393068 Oct 13 08:35:00.328372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 186/372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1458 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:00.335571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8619585e-ba1b-4bb0-b236-9f38c074b4f3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:00.349323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8619585e-ba1b-4bb0-b236-9f38c074b4f3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:00.349814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8619585e-ba1b-4bb0-b236-9f38c074b4f3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:00.350253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8619585e-ba1b-4bb0-b236-9f38c074b4f3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:00.536924 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8619585e-ba1b-4bb0-b236-9f38c074b4f3 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.204411 Oct 13 08:35:00.541161 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 187/373] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:35:00 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:00.552715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:00.553995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:00.562907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:00.564329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:00.564986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:00.565905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:00.566702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:00.567352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:00.595740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:00.610074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:00.613184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:00.618678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-054214ca-da2b-4d0c-be23-75cef7eda7e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1557 microversion: 2.25 time: 1.072810 Oct 13 08:35:00.635474 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 187/374] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:34:59 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1557 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:00.645274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-98fcaeb6-c6da-49f4-bc0f-074d609ee43b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:00.677535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-98fcaeb6-c6da-49f4-bc0f-074d609ee43b tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.040622 Oct 13 08:35:00.684583 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 188/375] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:35:00 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:35:00.848078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:00.859469 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-750c66d2-bb67-4ea5-9b36-a02dcf07c097 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.316646 Oct 13 08:35:00.878561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 188/376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:00 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:00.884251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbb7d3a3-4ae7-4879-a506-8e03be26c75d tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-878664183"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:00.897144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.aggregate [None req-dbb7d3a3-4ae7-4879-a506-8e03be26c75d tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Generated uuid 15e0371e-fdee-4d2b-ace4-301c9c07ebfd for aggregate {{(pid=127031) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 08:35:00.946216 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dbb7d3a3-4ae7-4879-a506-8e03be26c75d tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066405 Oct 13 08:35:00.953199 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 189/377] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 08:35:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:00.967592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:01.000105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.000545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.005812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.029643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.030135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.030616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.062387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.compute.aggregates [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 13 08:35:01.062918 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Request method failure captured: Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 42 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82t0JiUKFEG3lZhZsnchWq2FVeEqF2owcqm745RWJM4e8ZWlQ8jZJ5rZeSYH_L7_7PsXLdX86YbMKVVG336tK5Jq6g_h7iO6bxqif0xLXKB7ohd_uoa3ChozoPxSmb7VUkPYergDaTPt_rZ-iYwbA8EI_KTdIkAVNnK6oJt74PJbFY Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:01.071161 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_42253160994a48b1878df124b56f4b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/42253160994a48b1878df124b56f4b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 42253160994a48b1878df124b56f4b20 Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-274850833 Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f2fda659198c450aa402f46b34ddedf5 Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: {"remove_host": {"host": "nonexist_host"}} Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:01.072468 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 13 08:35:01.073193 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 13 08:35:01.074914 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.076004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:01.079329 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b32ccee-b44c-4841-81e2-0a440e0f8850 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.118047 Oct 13 08:35:01.083237 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 190/378] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:35:00 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:01.095971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-758de722-4087-4037-bc9e-c2eab1c635b1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:01.143731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-758de722-4087-4037-bc9e-c2eab1c635b1 tempest-AggregatesAdminNegativeTestJSON-274850833 tempest-AggregatesAdminNegativeTestJSON-274850833-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.059710 Oct 13 08:35:01.148278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 191/379] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:35:01 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 13 08:35:01.164164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:01.165503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:01.180108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.183875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.184543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.186393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.189273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.191165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.355602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:01.356213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:01.371116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.371668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.372192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.373099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.373708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.374306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.481600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.483632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.484898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.487091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:01.811370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:01.819397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76f4977e-dda6-4cd9-855d-d83eb5b62729 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1458 microversion: 2.1 time: 0.468069 Oct 13 08:35:01.841243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 192/380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:01 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1458 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:01.886705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:01.887312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:01.899007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.899756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.900807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:01.901631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:01.902107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:01.902566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.067283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 79408968-f79c-4af8-815c-c338d2d5cea9 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:02.192733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97a2d8e0-bd1f-4721-aaa6-62c781320322 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 2051 microversion: 2.25 time: 1.506720 Oct 13 08:35:02.194004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 189/381] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:00 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 2051 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:02.211098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:02.211730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:02.220975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.221710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.222562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.223470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.224132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.224789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.753499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:02.764780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91a29468-c4b6-4112-8a95-a336f58a1c4f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.883610 Oct 13 08:35:02.767146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 193/382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:01 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:02.778491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0da86d-73c7-4b2f-a3f3-7f5096310a01", "tag": "609ef1bd-ddea-4c9c-84cc-f4be3290e108"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:02.807600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:02.814343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.825401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.826656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.832329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ba2eaae-9e88-4681-b784-d950a39a2965 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 200 len: 1584 microversion: 2.1 time: 0.633181 Oct 13 08:35:02.833623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 190/383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:02 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 1584 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:02.846743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:02.848656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:02.861995 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] Creating event network-changed:609ef1bd-ddea-4c9c-84cc-f4be3290e108 for instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 on n-h2-858384-11 Oct 13 08:35:02.863905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.867446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.868245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.869533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.870293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.871657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.875094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d4500da4-a930-4913-9dec-01c9b73eb78f req-f9f8bdf1-133a-477a-a82a-65bea3e26b79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106234 Oct 13 08:35:02.877860 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 194/384] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:02.891259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:02.895366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:02.917797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.918298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.918829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:02.919545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:02.926634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:02.926990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:03.015978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:03.016487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:03.017021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:03.017480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:03.376775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:03.386468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85ea5062-2519-4008-b3da-682f4a9d11d0 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1458 microversion: 2.1 time: 0.507068 Oct 13 08:35:03.389411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 195/385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:02 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1458 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:03.419926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:03.790570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:03.791552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:03.801035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:03.801568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:03.805590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:03.806330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:03.808453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:03.810662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.119526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:04.129481 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-395f9cd8-321f-4b0e-8999-84145dc27fe6 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.344013 Oct 13 08:35:04.136700 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 196/386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:03 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:04.311046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:04.401285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 79408968-f79c-4af8-815c-c338d2d5cea9 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:04.420625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:04.422376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:04.432226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c53dc86-7cea-40e7-ab6c-c12e539522cd tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 2051 microversion: 2.25 time: 1.597164 Oct 13 08:35:04.434170 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 191/387] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:02 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 2051 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:04.437168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.437669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.438101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.439072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.439767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.440468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.472391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:04.484431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.485803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.486985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.490388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.492238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.493429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.517212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.517713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.518154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.525837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:04.580065 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0638fc46-2335-452b-ab04-d0304ebb1cb6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.118845 Oct 13 08:35:04.583724 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 192/388] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Oct 13 08:35:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:04.603608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-11", "block_migration": "auto"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:04.611685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:04.642532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.643584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.646240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.649741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:04.651474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:04.654417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:04.733924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'flavor' on Instance uuid 79408968-f79c-4af8-815c-c338d2d5cea9 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:04.782829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Going to try to live migrate instance to n-h1-858384-11 {{(pid=127030) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:35:04.843941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:04.853787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c0e8535-01ba-487a-9f58-46c5db15245a tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1458 microversion: 2.1 time: 0.440571 Oct 13 08:35:04.854380 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 197/389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:04 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1458 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:05.155702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:05.156478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:05.170694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:05.171262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:05.173458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:05.174701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:05.179118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:05.180442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:05.633972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:05.646672 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4231765-39ae-48ec-8676-8782faa543a1 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.493143 Oct 13 08:35:05.664843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 198/390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:05 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:06.019945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89845847-63d7-4052-9aae-001fd158168a tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-446371283", "id": 1441297201, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:06.133242 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89845847-63d7-4052-9aae-001fd158168a tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.437292 Oct 13 08:35:06.138362 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 199/391] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:35:05 2022] POST /compute/v2.1/flavors => generated 448 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:06.169619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:06.175132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:06.204703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:06.205194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:06.205957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:06.229011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:06.231965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:06.232427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:06.331444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:06.361245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:06.362370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:06.365981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:06.367192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lazy-loading 'fault' on Instance uuid c8c032e1-044b-41ee-af08-0ee6fd83ee7a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:06.560509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e001d79774e48119ebce4497388f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f43c474989d4fa4aecc7f524de41a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:06.571979 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0b2aad6-aaae-4de7-b69e-aff561fd7c23 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 200 len: 1309 microversion: 2.1 time: 0.432172 Oct 13 08:35:06.572896 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 200/392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:06 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:06.602236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c032e1-044b-41ee-af08-0ee6fd83ee7a", "name": "network-vif-deleted", "tag": "71f52006-c9aa-4693-bb4c-c411fbfdab09"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:06.619570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:06.621468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:06.622109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:06.643107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] Creating event network-vif-deleted:71f52006-c9aa-4693-bb4c-c411fbfdab09 for instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a on n-h1-858384-11 Oct 13 08:35:06.672253 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cad1c65c-caf9-4fc7-b398-ae4521d8f539 req-fec9af6b-7212-4bd1-bc8b-24b4339f7500 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088118 Oct 13 08:35:06.672253 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 201/393] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:07.207983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-545edfeb-6b6b-4768-b87b-8a491d45da2f tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:07.226630 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-545edfeb-6b6b-4768-b87b-8a491d45da2f tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] 10.222.0.23 "GET /compute/v2.1/flavors/1441297201" status: 200 len: 448 microversion: 2.55 time: 0.558153 Oct 13 08:35:07.229004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 202/394] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Oct 13 08:35:06 2022] GET /compute/v2.1/flavors/1441297201 => generated 448 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:07.246356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:07.247251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:07.290398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:07.290921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:07.291367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:07.292169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:07.292628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:07.293056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:07.700140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:07.710353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-727555d7-2b48-4cb6-bf50-bb0d7458ffed tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.479455 Oct 13 08:35:07.715469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 203/395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:07 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:07.721028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7c3de92-7863-4f8f-b5a6-820b73294953 tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] Action: 'update', calling method: .version_select at 0x7f537868bb80>, body: {"flavor": {"description": "new"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:07.813463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7c3de92-7863-4f8f-b5a6-820b73294953 tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1441297201" status: 200 len: 449 microversion: 2.55 time: 0.093734 Oct 13 08:35:07.815548 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 204/396] 10.222.0.23 () {62 vars in 1219 bytes} [Thu Oct 13 08:35:07 2022] PUT /compute/v2.1/flavors/1441297201 => generated 449 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:07.836556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:07.838311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:07.879760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:07.882793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:07.885011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:07.903029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:07.906162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:07.908495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:07.952718 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a HTTP/1.1 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:07.957900 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:07.959541 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c8c032e1-044b-41ee-af08-0ee6fd83ee7a'} Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:07.960461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:07.961800 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:07.963038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:07.963038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4cd08786-a00a-4c7b-abda-a7e2f33fdeca tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 404 len: 111 microversion: 2.1 time: 0.142335 Oct 13 08:35:07.970294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 205/397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:07 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:07.985400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f987aedb-7ec0-4f43-982c-8940c4a6943c tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.048108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f987aedb-7ec0-4f43-982c-8940c4a6943c tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.072324 Oct 13 08:35:08.049402 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 206/398] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:35:07 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:08.054932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.072166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:08.091991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.097650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.098450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.099625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.100138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.100689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.137254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a HTTP/1.1 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:08.140116 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.141536 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c8c032e1-044b-41ee-af08-0ee6fd83ee7a'} Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:08.142326 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.143605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.145370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:08.145370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7f36f50-9ef0-465d-a1c6-36ec391ffb80 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 404 len: 111 microversion: 2.1 time: 0.091251 Oct 13 08:35:08.148646 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 207/399] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:35:08 2022] DELETE /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:08.160310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2909ced3-7a68-4df8-b9b1-1b025cccc2b8 tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.211488 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2909ced3-7a68-4df8-b9b1-1b025cccc2b8 tempest-FlavorsV255TestJSON-1475372050 tempest-FlavorsV255TestJSON-1475372050-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.060711 Oct 13 08:35:08.214389 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 208/400] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Oct 13 08:35:08 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:08.221915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.223044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: c8c032e1-044b-41ee-af08-0ee6fd83ee7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:08.235694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.236481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.237083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.237988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.239017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.239613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.260170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:08.262844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a HTTP/1.1 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:08.264974 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.266362 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c8c032e1-044b-41ee-af08-0ee6fd83ee7a'} Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:08.267410 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. Oct 13 08:35:08.268789 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.269918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance c8c032e1-044b-41ee-af08-0ee6fd83ee7a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:08.270670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f62e6f9e-ad7c-4dbf-a1df-50c2924c0fe6 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a" status: 404 len: 111 microversion: 2.1 time: 0.054533 Oct 13 08:35:08.274307 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 209/401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:08 2022] GET /compute/v2.1/servers/c8c032e1-044b-41ee-af08-0ee6fd83ee7a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:08.277663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa8f1b31-4247-4049-b342-534d1b37a33c tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.325178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa8f1b31-4247-4049-b342-534d1b37a33c tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1441297201" status: 202 len: 0 microversion: 2.55 time: 0.053374 Oct 13 08:35:08.329285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 210/402] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Oct 13 08:35:08 2022] DELETE /compute/v2.1/flavors/1441297201 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:08.334173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.334717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:08.345969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.346392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.346856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.347574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.348034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.348461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.385046 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d HTTP/1.1 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:08.387207 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.388417 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3e24feec-448f-4ed8-a243-090c0594392d'} Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:08.389074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.392489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.394507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:08.394507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8df464a0-1c4f-4982-bbaa-100d0e097720 tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 404 len: 111 microversion: 2.1 time: 0.058341 Oct 13 08:35:08.394507 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 211/403] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:35:08 2022] DELETE /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:08.399837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fa1889b-0e5a-4aef-8f2e-3eacca297e54 tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.468043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fa1889b-0e5a-4aef-8f2e-3eacca297e54 tempest-FlavorsV255TestJSON-1461536242 tempest-FlavorsV255TestJSON-1461536242-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.077444 Oct 13 08:35:08.468644 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 212/404] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:35:08 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:08.501327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.501952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] [instance: 3e24feec-448f-4ed8-a243-090c0594392d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:08.537542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.538255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.538875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.545430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.546147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.546773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.573767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] HTTP exception thrown: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Request method failure captured: Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d HTTP/1.1 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR81vAudmIyPOXh2NEUgV-F1tYLjv3eYn549qo_vZIlXKFyh9MmxahkBE1TTuC3lu_agrqvcoDcxG62MJNVFc5uX6NXC8tQiLuGtdPcpk2jVazickt2S59pI1EiyYdZxl5BajwEHkpjkrl31O0aSLewUNAYIGDLuNt9UZhCTfSsb3Okk Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:08.584919 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f43c474989d4fa4aecc7f524de41a78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3f43c474989d4fa4aecc7f524de41a78 Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-47295532 Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1e001d79774e48119ebce4497388f84f Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersAdminTestJSON-47295532-project Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.586386 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3e24feec-448f-4ed8-a243-090c0594392d'} Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:08.587266 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. Oct 13 08:35:08.588641 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:08.591808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] Returning 404 to user: Instance 3e24feec-448f-4ed8-a243-090c0594392d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:08.592818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48e61b0b-0e11-433e-bd58-8eabcb7ec59c tempest-DeleteServersAdminTestJSON-47295532 tempest-DeleteServersAdminTestJSON-47295532-project] 10.222.0.23 "GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d" status: 404 len: 111 microversion: 2.1 time: 0.096816 Oct 13 08:35:08.593841 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 213/405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:08 2022] GET /compute/v2.1/servers/3e24feec-448f-4ed8-a243-090c0594392d => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:08.740417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:08.741349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:08.754449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.755308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.756003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:08.761805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:08.762664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:08.763331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:09.164545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:09.173795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e43b085-2437-49ce-b3e1-5181d914d556 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.437214 Oct 13 08:35:09.202802 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 214/406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:08 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:09.209049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e58b19f-7dd8-4581-8b61-b8058b2a0061", "tag": "7755517e-fc4c-45f2-ad78-b0fa69e8c558"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:09.250394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:09.251069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:09.251313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:09.287317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] Creating event network-changed:7755517e-fc4c-45f2-ad78-b0fa69e8c558 for instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 on n-h1-858384-11 Oct 13 08:35:09.329487 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d2dcdb72-41d0-47f0-b93e-2968d9f2f0fe req-f5c2decd-4de9-4ce4-95a3-f05036935164 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123698 Oct 13 08:35:09.331827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 215/407] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:10.207818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:10.208551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:10.248682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:10.249264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:10.251356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:10.255107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:10.255632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:10.256080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:10.728725 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4df96050-f258-4e98-83ed-1e79b7f451be tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9/action" status: 202 len: 0 microversion: 2.25 time: 6.136196 Oct 13 08:35:10.730729 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 193/408] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:35:04 2022] POST /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9/action => generated 0 bytes in 6140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:10.751774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:10.752397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:10.789758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:10.790264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:10.801939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:10.803196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:10.805759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:10.806342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:11.021760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:11.062453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:11.077358 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef5a33ea-a937-486f-93db-1b342603b463 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.877337 Oct 13 08:35:11.078348 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 216/409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:10 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:12.167445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:12.194919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:12.201415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:12.205352 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e9d7804-b366-4bad-b26a-6526e42811f1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 1.465600 Oct 13 08:35:12.205934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 194/410] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:10 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:12.243065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:12.243683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:12.274069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.274914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.275626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.276903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.277703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.278547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.385538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:12.390355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.391279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.391996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.394088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.395067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.395804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.472459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-353b1f61-88ac-4746-b54f-b5d9c4366047 tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.710245 Oct 13 08:35:12.473078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 217/411] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Oct 13 08:35:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:35:12.488849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:12.491466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.492254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.493048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.494282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:12.494944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:12.495588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:12.564418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73d080d9-b9ee-48be-ade3-410d16bf854d tempest-AZAdminV2TestJSON-536227184 tempest-AZAdminV2TestJSON-536227184-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.082086 Oct 13 08:35:12.567883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 218/412] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:35:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:35:13.104336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:13.111641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:13.117491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc1db3b9-9318-453a-82a0-4483a35bcca2 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.894965 Oct 13 08:35:13.137090 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 195/413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:12 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:13.236534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:13.238013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:13.248908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:13.252082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:13.252769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:13.253677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:13.256316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:13.258322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:13.856910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:13.875055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:13.876639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:13.878038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d3aedf4-d733-441e-af52-6fa01a628140 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.647063 Oct 13 08:35:13.878979 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 219/414] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:13 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:14.157804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:14.161934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:14.191978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:14.192691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:14.194133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:14.195552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:14.197008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:14.198213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:14.520423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:14.834553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:14.853531 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.701002 Oct 13 08:35:14.862551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 196/415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:14 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:14.908905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:14.911049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:14.932228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:14.932797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:14.933237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:14.934785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:14.935834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:14.941591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:15.117128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:15.118754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53e21034-52a0-4a92-bd02-b5c9f74b0e3e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001763 Oct 13 08:35:15.119647 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 197/416] 10.222.0.23 () {56 vars in 886 bytes} [Thu Oct 13 08:35:15 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 13 08:35:15.879834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:15.880488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:15.892380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:15.894681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:15.895473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:15.900384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:15.901706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:15.903726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:15.923123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:15.941397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:15.942901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:15.945224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-235d2e60-7a96-466b-95f8-6e72cac8af07 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 1.043802 Oct 13 08:35:15.970158 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 220/417] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:14 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:16.442366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79408968-f79c-4af8-815c-c338d2d5cea9", "name": "network-vif-unplugged", "status": "completed", "tag": "14bf18b9-923e-44b5-89f0-f63aeb02af35"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:16.468630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:16.468857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:16.470607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:16.503419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] Creating event network-vif-unplugged:14bf18b9-923e-44b5-89f0-f63aeb02af35 for instance 79408968-f79c-4af8-815c-c338d2d5cea9 on n-h2-858384-11 Oct 13 08:35:16.515712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-14448bdd-d9dc-4ccb-80b3-df6437da742a req-9f44b0f2-343b-4aa4-9291-35d1b054049a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077965 Oct 13 08:35:16.516622 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 221/418] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:35:16.779835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:16.792289 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb931b43-5112-4a21-b5ce-8b2165957e10 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.916542 Oct 13 08:35:16.792812 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 198/419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:15 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:16.978043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:16.980870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:16.992188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:16.993401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:16.995456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:16.996994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:16.998736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:17.000317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:17.291522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:17.309351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e58b19f-7dd8-4581-8b61-b8058b2a0061", "name": "network-vif-plugged", "status": "completed", "tag": "7755517e-fc4c-45f2-ad78-b0fa69e8c558"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:17.314582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:17.320630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:17.326742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:17.327202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:17.327643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:17.329350 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d9891d4-ccc0-43aa-a989-c26260dcd392 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.352633 Oct 13 08:35:17.330063 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 222/420] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:16 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:17.465137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] Creating event network-vif-plugged:7755517e-fc4c-45f2-ad78-b0fa69e8c558 for instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 on n-h1-858384-11 Oct 13 08:35:17.485622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a7434156-e6a9-403b-99d5-0555cd44b98b req-692560e1-61ea-43b6-9ca4-7d98290a90d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182289 Oct 13 08:35:17.487651 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 199/421] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 13 08:35:17.824649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:17.825121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:17.838151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:17.841341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:17.841791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:17.842542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:17.842998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:17.843421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:17.972081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-768979312", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "855f3368-1207-411b-b46e-0f9d164fb505"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:18.079743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] validate_networks() for [('855f3368-1207-411b-b46e-0f9d164fb505', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:18.144541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:18.155941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b73907c-921a-423d-8bd2-a4a74724212c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1318 microversion: 2.1 time: 0.339385 Oct 13 08:35:18.156521 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 200/422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:17 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:18.359268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:18.359843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:18.371626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:18.372113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:18.373870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:18.376352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:18.378183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:18.379900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.044227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:19.058238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:19.061855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:19.066920 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cb647ce-58c5-4de5-8a39-18e0c0e32872 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.712002 Oct 13 08:35:19.069777 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 201/423] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:18 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:19.083841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79408968-f79c-4af8-815c-c338d2d5cea9", "tag": "14bf18b9-923e-44b5-89f0-f63aeb02af35"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:19.125969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:19.129252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:19.129873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.162557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] Creating event network-changed:14bf18b9-923e-44b5-89f0-f63aeb02af35 for instance 79408968-f79c-4af8-815c-c338d2d5cea9 on n-h2-858384-11 Oct 13 08:35:19.170152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1c8929f7-7f34-474e-a3ff-5c252f7fb1d1 req-2e4fee06-4a69-427b-baf3-87ec15b69976 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098913 Oct 13 08:35:19.171098 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 202/424] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:19.232665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:19.235264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:19.235876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:19.236403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:19.236997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:19.265710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:19.266212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:19.272840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.273949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:19.274658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:19.275368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.312700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:19.317687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for user c6b6dd069e4f4c57a9f41197a2cc25d5 and project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:19.331656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:19.334330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:19.421159 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73c349d7-21ed-4c1c-85f3-3a8222b7d3e3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012966 Oct 13 08:35:19.426560 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 223/425] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:19.460073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:19.460722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:19.484050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:19.484541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:19.484985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.485678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:19.486132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:19.501702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:19.711993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fcd96173-ff12-4387-921c-e369e6db5ae9 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2065836457", "id": 2040951126, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:19.776281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fcd96173-ff12-4387-921c-e369e6db5ae9 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.591065 Oct 13 08:35:19.777308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 203/426] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:35:19 2022] POST /compute/v2.1/flavors => generated 468 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:19.791557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37099178-3150-4105-b402-3e5a8a46bc15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:19.792471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37099178-3150-4105-b402-3e5a8a46bc15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:19.913541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37099178-3150-4105-b402-3e5a8a46bc15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:19.921893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37099178-3150-4105-b402-3e5a8a46bc15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1210 microversion: 2.1 time: 0.143496 Oct 13 08:35:19.926547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 204/427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:19 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:20.390354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0581dee8-c9ec-4e22-8a66-3e0ca4a602fe tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:20.428217 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0581dee8-c9ec-4e22-8a66-3e0ca4a602fe tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] 10.222.0.23 "GET /compute/v2.1/flavors/2040951126" status: 200 len: 468 microversion: 2.61 time: 0.499190 Oct 13 08:35:20.432866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 205/428] 10.222.0.23 () {60 vars in 1199 bytes} [Thu Oct 13 08:35:19 2022] GET /compute/v2.1/flavors/2040951126 => generated 468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:20.458235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:20.460116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:20.477962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:20.480544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:20.481095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:20.483716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:20.484979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:20.486690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:20.824007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:20.845074 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9cea3b21-dbab-4e31-bc98-1fd51f516ae4 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1467 microversion: 2.1 time: 1.413312 Oct 13 08:35:20.845652 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 224/429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:19 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1467 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:20.868192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a857877-92e1-4c8e-b93f-1b9854471112 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:21.012660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a857877-92e1-4c8e-b93f-1b9854471112 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/2040951126" status: 200 len: 469 microversion: 2.61 time: 0.157660 Oct 13 08:35:21.032606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 225/430] 10.222.0.23 () {62 vars in 1219 bytes} [Thu Oct 13 08:35:20 2022] PUT /compute/v2.1/flavors/2040951126 => generated 469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:21.051153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:21.052448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:21.074435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.075324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.078465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.079744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.080428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.081100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.127237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lazy-loading 'flavor' on Instance uuid 5e58b19f-7dd8-4581-8b61-b8058b2a0061 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:21.299168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3e52e8b0-12ab-4e95-98e9-69c3ab73ed82 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061/action" status: 202 len: 0 microversion: 2.1 time: 0.264712 Oct 13 08:35:21.300821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 226/431] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:35:21 2022] POST /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:35:21.308910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.309810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:21.321510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.322226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.322967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.324454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.325873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.326312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.390991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:21.416796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:21.418961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:21.420605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d41f086b-e966-456b-bcf0-aadbe7cfabc0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.986425 Oct 13 08:35:21.443773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:21.444402 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 206/432] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:20 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:21.449761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86517a63-a536-48b9-ade0-7437a6df370b tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.462878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c9ccb97-ee32-4cf1-9dbf-0377a79b591e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1262 microversion: 2.1 time: 0.160297 Oct 13 08:35:21.464020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 227/433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:21 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:21.481598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.482212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:21.487823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86517a63-a536-48b9-ade0-7437a6df370b tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.041297 Oct 13 08:35:21.488724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.489101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 207/434] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:35:21 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:21.489686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.490161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.491098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:21.491690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:21.492248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:21.657188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:21.669953 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-976d98aa-5756-47ff-9244-a1f552580ed8 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1475 microversion: 2.1 time: 0.195891 Oct 13 08:35:21.678725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 228/435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:21 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1475 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:21.691815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d57992e5-48df-4071-aca6-ead8a884ac0f tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.719142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d57992e5-48df-4071-aca6-ead8a884ac0f tempest-FlavorsV261TestJSON-973098631 tempest-FlavorsV261TestJSON-973098631-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.040771 Oct 13 08:35:21.719725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 229/436] 10.222.0.23 () {60 vars in 1166 bytes} [Thu Oct 13 08:35:21 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:21.739286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1b6aa02-a19c-4863-99d1-1f51d5c0d00a tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.771229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:21.779247 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1b6aa02-a19c-4863-99d1-1f51d5c0d00a tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2040951126" status: 202 len: 0 microversion: 2.61 time: 0.043497 Oct 13 08:35:21.780267 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 230/437] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Oct 13 08:35:21 2022] DELETE /compute/v2.1/flavors/2040951126 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:35:21.791026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47942e5a-e76d-47fd-b1d8-6b0a5fbd6df2 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:21.850787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47942e5a-e76d-47fd-b1d8-6b0a5fbd6df2 tempest-FlavorsV261TestJSON-2141204584 tempest-FlavorsV261TestJSON-2141204584-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.064918 Oct 13 08:35:21.852814 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 231/438] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 08:35:21 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:21.981318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57c498ef-0f56-4efc-a754-268c1b57857a tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1252935704", "id": 48091577, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:22.030321 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57c498ef-0f56-4efc-a754-268c1b57857a tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.539701 Oct 13 08:35:22.033694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 208/439] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:21 2022] POST /compute/v2.1/flavors => generated 425 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:22.044364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8156fc4-8ef1-48ec-ab8c-11db93dc633e tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "34c7a1b9ba3c4487b17daf8f3c8fe86b"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:22.451405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:22.452750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:22.467749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.468520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.469917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.471492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.474371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.474945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.709392 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8156fc4-8ef1-48ec-ab8c-11db93dc633e tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/48091577/action" status: 200 len: 95 microversion: 2.1 time: 0.669314 Oct 13 08:35:22.712875 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 232/440] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:35:22 2022] POST /compute/v2.1/flavors/48091577/action => generated 95 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:35:22.722266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:22.723226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:22.749025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.749576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.750087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.750858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.751369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.751845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.911275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:22.929126 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fd5a6f3-fa9c-4b17-a39a-6dcb8e3b0b5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1268 microversion: 2.1 time: 0.211636 Oct 13 08:35:22.929748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 233/441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:22 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1268 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:22.941642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:22.953110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:22.954340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:22.959473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:22.961709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.962818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.963493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.964714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:22.965397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:22.966288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:22.973915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:22.975279 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-525f80d1-0fe0-4c5a-a2b4-32dc75183377 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.528417 Oct 13 08:35:22.975866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 209/442] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:22 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:23.210934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:23.223089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3571009d-e341-429a-8531-36447ac34b74 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1458 microversion: 2.1 time: 0.279299 Oct 13 08:35:23.225192 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 234/443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:22 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1458 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:23.257103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:23.258678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:23.283144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:23.285968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:23.289361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:23.290428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:23.291906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:23.294436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:23.480583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1fe40bd-5e1e-43e7-80cb-abc7f3d4b1f8 tempest-FlavorsAccessTestJSON-2143825936 tempest-FlavorsAccessTestJSON-2143825936-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:23.533868 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a1fe40bd-5e1e-43e7-80cb-abc7f3d4b1f8 tempest-FlavorsAccessTestJSON-2143825936 tempest-FlavorsAccessTestJSON-2143825936-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.556912 Oct 13 08:35:23.534621 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 210/444] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:22 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:23.880306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Calling method '.version_select at 0x7f53771cab80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:23.884105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:23.885385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:23.886098 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4de63cf2-1825-4002-8d97-6f508a8dce79 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1611 microversion: 2.1 time: 0.637773 Oct 13 08:35:23.886756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:23.889863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 235/445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:23 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1611 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:23.907632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bcb2a45-70e1-4781-9019-1a462414476b tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34c7a1b9ba3c4487b17daf8f3c8fe86b"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:23.908915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:23.909410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:23.909841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:23.977875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:23.978363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:23.985333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.010255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.011769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.012626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.067556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.068697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.069331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.083362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1fb6890-7dc8-49c6-acbd-a627a3000a26 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1998 microversion: 2.53 time: 0.543867 Oct 13 08:35:24.084420 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 211/446] 10.222.0.23 () {60 vars in 1243 bytes} [Thu Oct 13 08:35:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1998 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:24.099391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.108104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.108971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.109606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.111026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.111934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.112564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.143399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:24.158297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4901de2-5d6b-466c-ae7c-188bdcac7d90 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.072625 Oct 13 08:35:24.168444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 212/447] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:24.176557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.176687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:24.183638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.184130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.184575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.185280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.185732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.186813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.235329 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bcb2a45-70e1-4781-9019-1a462414476b tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/48091577/action" status: 200 len: 21 microversion: 2.1 time: 0.331654 Oct 13 08:35:24.236494 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 236/448] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 08:35:23 2022] POST /compute/v2.1/flavors/48091577/action => generated 21 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:35:24.243174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.246306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:24.256999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.257677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.258270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.259013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.259463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.260062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.286416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:24.475336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:24.502912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:24.504509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:24.505736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-72f35363-aba6-4025-aefb-e918177d9581 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.268070 Oct 13 08:35:24.522582 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 237/449] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:24.537142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Calling method '.version_select at 0x7f53770721f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.545390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.549924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.551462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.554741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:24.563056 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43557c80-b13e-47ef-9606-41ea30cd44a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.392774 Oct 13 08:35:24.583141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 213/450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:24.587976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": true, "disk_over_commit": false}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:24.595301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.596137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.596793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.606772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:24.613704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.614471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.615074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.615944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.616563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.617145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.647999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.650088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.650670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.669476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Lazy-loading 'flavor' on Instance uuid 5e58b19f-7dd8-4581-8b61-b8058b2a0061 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:24.684235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.685415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.687873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.709443 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 while it is in vm_state suspended Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Request method failure captured: Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061/action HTTP/1.1 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 98 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82N1_JbPOu9OHOX55T-uYRMQm6zsiEeP4xwlllyo77snxun-KfmrI1RUOtWB-7OjhOOKC6FqhmX5oIEzJ6wHgFB2JLIRZMc9BgDR_J6Xf5roSGsj-vTRmcGvs6NMSzbdcCf8bkh4AF3zp3NjZoWTQT96PKU08J_nF3vyEAJUeXvyEM Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 045b882d65844641a548e0cea067deb9 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:35:24.726013 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/045b882d65844641a548e0cea067deb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_045b882d65844641a548e0cea067deb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/045b882d65844641a548e0cea067deb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/045b882d65844641a548e0cea067deb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 045b882d65844641a548e0cea067deb9 Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-243648801 Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveMigrationNegativeTest-243648801-project-admin Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0bfe2c1bd7e044bfa5e9d592dacaf77b Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveMigrationNegativeTest-243648801-project-admin Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": true, "disk_over_commit": false}} Oct 13 08:35:24.727359 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'os-migrateLive' instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 while it is in vm_state suspended Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '5e58b19f-7dd8-4581-8b61-b8058b2a0061', 'body': {'os-migrateLive': {'host': 'n-h2-858384-11', 'block_migration': True, 'disk_over_commit': False}}} Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 13 08:35:24.728050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:24.729591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 while it is in vm_state suspended Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 while it is in vm_state suspended Oct 13 08:35:24.734634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:24.741367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 while it is in vm_state suspended {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:24.742554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7768cdb9-19b7-49e3-a232-1f43ef5d81c1 tempest-LiveMigrationNegativeTest-243648801 tempest-LiveMigrationNegativeTest-243648801-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061/action" status: 409 len: 155 microversion: 2.1 time: 0.158334 Oct 13 08:35:24.750637 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 214/451] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:35:24 2022] POST /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061/action => generated 155 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:24.758818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.762642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c79ac45-e79b-45e3-8949-4b9fedd3da88 tempest-FlavorsAccessTestJSON-2143825936 tempest-FlavorsAccessTestJSON-2143825936-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.763431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.763953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.783909 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-608bbd33-1661-4366-9af3-7c591a9b7e68 tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 688 microversion: 2.53 time: 0.256442 Oct 13 08:35:24.792725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 238/452] 10.222.0.23 () {60 vars in 1222 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:24.796923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.797419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:24.802841 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c79ac45-e79b-45e3-8949-4b9fedd3da88 tempest-FlavorsAccessTestJSON-2143825936 tempest-FlavorsAccessTestJSON-2143825936-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.050476 Oct 13 08:35:24.803442 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 215/453] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:24.812019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Calling method '.version_select at 0x7f5377036670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.817601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.818099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.821292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.821942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.822514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.822874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.823655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.824126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.824729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.843850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:24.844661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:24.845281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:24.859385 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e335d932-7d7c-4f3d-99d2-2c9d73ac3b4e tempest-HypervisorAdminV253TestBase-1236456349 tempest-HypervisorAdminV253TestBase-1236456349-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/3d631b15-ed99-428b-82a6-d5b14a193bf5" status: 200 len: 794 microversion: 2.53 time: 0.054701 Oct 13 08:35:24.860270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 216/454] 10.222.0.23 () {60 vars in 1298 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/os-hypervisors/3d631b15-ed99-428b-82a6-d5b14a193bf5 => generated 794 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:24.864780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc21af82-46f7-4b6f-bea5-b3a238023891 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.888535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:35:24.889555 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc21af82-46f7-4b6f-bea5-b3a238023891 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/48091577" status: 202 len: 0 microversion: 2.1 time: 0.027800 Oct 13 08:35:24.890669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 217/455] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:35:24 2022] DELETE /compute/v2.1/flavors/48091577 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:35:24.898537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3077f5e8-3f67-4636-bcfc-58146181b4ce tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:24.957955 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3077f5e8-3f67-4636-bcfc-58146181b4ce tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.062884 Oct 13 08:35:24.958980 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 218/456] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:24.981575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19f362d5-6a8e-4882-ad59-0bb41f6cdb31 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1123569326", "id": 1667618486, "os-flavor-access:is_public": "False"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:25.010089 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19f362d5-6a8e-4882-ad59-0bb41f6cdb31 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.032623 Oct 13 08:35:25.012787 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 219/457] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:24 2022] POST /compute/v2.1/flavors => generated 431 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:25.024777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-34cdc01c-d6ac-4f6f-8c0e-5b22de87b597 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.053099 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-34cdc01c-d6ac-4f6f-8c0e-5b22de87b597 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1667618486/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031983 Oct 13 08:35:25.055514 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 220/458] 10.222.0.23 () {58 vars in 1209 bytes} [Thu Oct 13 08:35:25 2022] GET /compute/v2.1/flavors/1667618486/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:35:25.067529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b271b309-43a3-42ea-880e-94f3e208654e tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.099317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3a91609c-6b67-4ee1-b133-8462d3a29b3f tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 204 len: 0 microversion: 2.1 time: 0.310656 Oct 13 08:35:25.102146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 239/459] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:35:24 2022] DELETE /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:25.104805 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b271b309-43a3-42ea-880e-94f3e208654e tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1667618486" status: 202 len: 0 microversion: 2.1 time: 0.042342 Oct 13 08:35:25.106456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 221/460] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:35:25 2022] DELETE /compute/v2.1/flavors/1667618486 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:35:25.118484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58f4b7f8-b48e-43f6-beaa-83895abdfce3 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.119348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.120132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:25.144341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.147445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.148055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.148937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.150120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.155018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.171941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58f4b7f8-b48e-43f6-beaa-83895abdfce3 tempest-FlavorsAccessTestJSON-2057949746 tempest-FlavorsAccessTestJSON-2057949746-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.060437 Oct 13 08:35:25.174445 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 222/461] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:25 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:25.424153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff95b85-68c9-4c74-af7d-47419a17bc58", "tag": "1d9d1970-7383-4244-b262-0fe1d569801a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:25.430214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:25.442628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.455097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.455789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.469661 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77b9fa96-f3f4-4042-8274-840e424cfb3c tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1464 microversion: 2.1 time: 0.335708 Oct 13 08:35:25.473457 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 240/462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:25 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:25.495163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] Creating event network-changed:1d9d1970-7383-4244-b262-0fe1d569801a for instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 on n-h2-858384-11 Oct 13 08:35:25.510373 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-be78db8d-0a0e-4449-bc80-f7df506d39ca req-879cdadd-d1ee-430b-9b23-48ce118c47a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089536 Oct 13 08:35:25.511674 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 223/463] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:35:25.533742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.534349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:25.544856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.545339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.545768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.547037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.547037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.547328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.591988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:25.593316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:25.606108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.606932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.607562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.608446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:25.610319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:25.611310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:25.967255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:25.978314 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c7fa7061-aeba-4869-a434-a83d9bd21b15 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.391378 Oct 13 08:35:25.979500 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 224/464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:25 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:26.037082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:26.057930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:26.060291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:26.062239 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3bc76764-6a1c-4dc6-ab02-ae918d5f80ea tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.532992 Oct 13 08:35:26.076423 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 241/465] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:25 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:26.498005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:26.498788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:26.523466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:26.528521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:26.530984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:26.531935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:26.536692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:26.537440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:27.001767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:27.002434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:27.019834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:27.023052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:27.023539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:27.024272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:27.031484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:27.031966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:27.351154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:27.392235 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c51ea907-c51a-4428-a1cb-b0d17990d81e tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1464 microversion: 2.1 time: 0.900389 Oct 13 08:35:27.395045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 225/466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:26 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1464 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:27.414018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:27.415316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:27.423333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:27.424351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:27.426616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:27.432843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:27.433663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:27.434310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:27.564387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:27.578964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f44cb3ec-ec53-4aee-906a-406e7d548da2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.579552 Oct 13 08:35:27.582760 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 242/467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:26 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:27.836797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:27.868699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:27.883282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:27.887010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32ab9b1d-7cad-4739-a7c2-4a4b2e1242bc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.488406 Oct 13 08:35:27.888301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 226/468] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:27 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:28.130716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Calling method '.version_select at 0x7f5377072d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.135529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.139587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.141197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.143600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.146819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.148787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.192644 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-58b2a89d-22a4-42b5-a1c0-7cf56dd59cb6 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.608267 Oct 13 08:35:28.193838 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 243/469] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:35:27 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:28.314151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e58b19f-7dd8-4581-8b61-b8058b2a0061", "name": "network-vif-deleted", "tag": "7755517e-fc4c-45f2-ad78-b0fa69e8c558"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:28.340375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.342315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.345359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.378849 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] Creating event network-vif-deleted:7755517e-fc4c-45f2-ad78-b0fa69e8c558 for instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 on n-h1-858384-11 Oct 13 08:35:28.391756 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6999aa13-45da-4012-9179-45494d7689e0 req-e47c8e11-4767-4185-b652-11c00c8c99cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084490 Oct 13 08:35:28.393564 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 244/470] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:28.426037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.428385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:28.482165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.488223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.489928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.491599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.492379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.493731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.576626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.577443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.583831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.584537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lazy-loading 'fault' on Instance uuid 5e58b19f-7dd8-4581-8b61-b8058b2a0061 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:28.636289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:28.644856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de3afbff-72a9-4e54-9a9d-34a532355212 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 200 len: 1308 microversion: 2.1 time: 0.225578 Oct 13 08:35:28.646389 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 245/471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:28.670590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7442eb83-7241-4375-b8a6-9497298189ae tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Calling method '.version_select at 0x7f5377037ee0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.679041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7442eb83-7241-4375-b8a6-9497298189ae tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7442eb83-7241-4375-b8a6-9497298189ae tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:35:28.681136 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:35:28.683341 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.684583 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 13 08:35:28.685907 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.687258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7442eb83-7241-4375-b8a6-9497298189ae tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.688148 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7442eb83-7241-4375-b8a6-9497298189ae tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.485593 Oct 13 08:35:28.688262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.688721 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 227/472] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:28.697061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:28.701154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6a76f24-f8fc-4ff4-88da-ae9fb3d3942d tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Calling method '.version_select at 0x7f5376fad670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.712310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.715749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e6a76f24-f8fc-4ff4-88da-ae9fb3d3942d tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:28.716201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.716907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.717909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.719371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.719919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6a76f24-f8fc-4ff4-88da-ae9fb3d3942d tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/n-d-858384-11/reboot HTTP/1.1 Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:35:28.724545 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'n-d-858384-11'} Oct 13 08:35:28.725970 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.726866 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 13 08:35:28.727873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.729448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6a76f24-f8fc-4ff4-88da-ae9fb3d3942d tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.729448 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6a76f24-f8fc-4ff4-88da-ae9fb3d3942d tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-858384-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.030602 Oct 13 08:35:28.732322 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 228/473] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/n-d-858384-11/reboot => generated 111 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:28.737039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4283a371-5114-4615-a92e-e637efd4d028 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Calling method '.version_select at 0x7f5376f9a820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.759875 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4283a371-5114-4615-a92e-e637efd4d028 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4283a371-5114-4615-a92e-e637efd4d028 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:35:28.762114 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'nonexistent_hostname'} Oct 13 08:35:28.763650 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:28.764605 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 13 08:35:28.766300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.767889 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.770227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4283a371-5114-4615-a92e-e637efd4d028 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.771309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4283a371-5114-4615-a92e-e637efd4d028 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.037999 Oct 13 08:35:28.772068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 229/474] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:28.785605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8007a976-9089-48e7-87f4-558bfb8d0b1f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Calling method '.version_select at 0x7f5377036e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.787419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8007a976-9089-48e7-87f4-558bfb8d0b1f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8007a976-9089-48e7-87f4-558bfb8d0b1f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/n-d-858384-11 HTTP/1.1 Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:35:28.788972 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'n-d-858384-11'} Oct 13 08:35:28.790438 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.791261 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 13 08:35:28.793475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.799804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8007a976-9089-48e7-87f4-558bfb8d0b1f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.799804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8007a976-9089-48e7-87f4-558bfb8d0b1f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-858384-11" status: 403 len: 109 microversion: 2.1 time: 0.012880 Oct 13 08:35:28.799804 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 230/475] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/n-d-858384-11 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:28.809196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0667704e-3b3e-4bc0-a267-9b704709ef7c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Calling method '.version_select at 0x7f5377036790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.825985 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0667704e-3b3e-4bc0-a267-9b704709ef7c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0667704e-3b3e-4bc0-a267-9b704709ef7c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:35:28.827638 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'nonexistent_hostname'} Oct 13 08:35:28.829571 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.830436 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.831741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.832799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0667704e-3b3e-4bc0-a267-9b704709ef7c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.832799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0667704e-3b3e-4bc0-a267-9b704709ef7c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027090 Oct 13 08:35:28.833302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 231/476] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:28.849555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-072c5b9c-32f4-47e4-aa81-53c0255cdf2f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Calling method '.version_select at 0x7f5376f9a8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.857745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072c5b9c-32f4-47e4-aa81-53c0255cdf2f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-072c5b9c-32f4-47e4-aa81-53c0255cdf2f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/n-d-858384-11/shutdown HTTP/1.1 Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:35:28.863060 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'n-d-858384-11'} Oct 13 08:35:28.864250 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.865202 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 13 08:35:28.866360 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.867332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-072c5b9c-32f4-47e4-aa81-53c0255cdf2f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.867332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-072c5b9c-32f4-47e4-aa81-53c0255cdf2f tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-858384-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.025465 Oct 13 08:35:28.871021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 232/477] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/n-d-858384-11/shutdown => generated 113 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:28.881551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa550b31-b273-4983-b26e-ca2964b8a8aa tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Calling method '.version_select at 0x7f5376ff3dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.913873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-aa550b31-b273-4983-b26e-ca2964b8a8aa tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa550b31-b273-4983-b26e-ca2964b8a8aa tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:35:28.921742 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'nonexistent_hostname'} Oct 13 08:35:28.923135 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:28.923860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 13 08:35:28.925300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:28.928208 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:28.930005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa550b31-b273-4983-b26e-ca2964b8a8aa tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:28.930684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa550b31-b273-4983-b26e-ca2964b8a8aa tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.056444 Oct 13 08:35:28.932330 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 233/478] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:28.940027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:28.941338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:28.949448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.950314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.951020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.951793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:28.952820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:28.953329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:28.997917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.007935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61eb1468-5b64-4870-8c2d-5ecd176de433 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.360291 Oct 13 08:35:29.030366 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 246/479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:29.052131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6bd48d65-0b62-40c5-8e39-57f1abf1566b tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Calling method '.version_select at 0x7f53770dcee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:29.055237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6bd48d65-0b62-40c5-8e39-57f1abf1566b tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6bd48d65-0b62-40c5-8e39-57f1abf1566b tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hosts/n-d-858384-11/startup HTTP/1.1 Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:29.061077 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-d-858384-11'} Oct 13 08:35:29.062395 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:29.063196 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 13 08:35:29.064238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.065156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6bd48d65-0b62-40c5-8e39-57f1abf1566b tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.065156 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6bd48d65-0b62-40c5-8e39-57f1abf1566b tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-858384-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.046916 Oct 13 08:35:29.065156 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 247/480] 10.222.0.23 () {58 vars in 1194 bytes} [Thu Oct 13 08:35:29 2022] GET /compute/v2.1/os-hosts/n-d-858384-11/startup => generated 110 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:29.082622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35383c90-287d-4306-bdaa-27815e8cc5f1 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Calling method '.version_select at 0x7f53771679d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:29.107330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-35383c90-287d-4306-bdaa-27815e8cc5f1 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35383c90-287d-4306-bdaa-27815e8cc5f1 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:29.109302 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'nonexistent_hostname'} Oct 13 08:35:29.110605 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:29.111344 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 13 08:35:29.112366 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.113477 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.114886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35383c90-287d-4306-bdaa-27815e8cc5f1 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.115331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35383c90-287d-4306-bdaa-27815e8cc5f1 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.045963 Oct 13 08:35:29.117288 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 248/481] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 08:35:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:35:29.126156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da9ab62f-1839-4dc0-b8a4-36fc99f3344c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Action: 'update', calling method: .version_select at 0x7f53773a89d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da9ab62f-1839-4dc0-b8a4-36fc99f3344c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-hosts/n-d-858384-11 HTTP/1.1 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 51 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:29.129918 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: {"status": "enable", "maintenance_mode": "invalid"} Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.131619 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-d-858384-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'disable', Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Enable', Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Disable', Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance: Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'invalid' Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.132340 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.133796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.136933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da9ab62f-1839-4dc0-b8a4-36fc99f3344c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.139872 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da9ab62f-1839-4dc0-b8a4-36fc99f3344c tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-858384-11" status: 400 len: 199 microversion: 2.1 time: 0.008870 Oct 13 08:35:29.143280 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 249/482] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:35:29 2022] PUT /compute/v2.1/os-hosts/n-d-858384-11 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:35:29.149089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edcad129-a183-47e4-9ad5-fd640e7cc687 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Action: 'update', calling method: .version_select at 0x7f53770dc550>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edcad129-a183-47e4-9ad5-fd640e7cc687 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-hosts/n-d-858384-11 HTTP/1.1 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 51 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:29.153822 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: {"status": "invalid", "maintenance_mode": "enable"} Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.155268 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-d-858384-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'disable', Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Enable', Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Disable', Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance: Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'invalid' Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.156041 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.157438 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.158563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edcad129-a183-47e4-9ad5-fd640e7cc687 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.167125 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-edcad129-a183-47e4-9ad5-fd640e7cc687 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-858384-11" status: 400 len: 189 microversion: 2.1 time: 0.019238 Oct 13 08:35:29.168391 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 250/483] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:35:29 2022] PUT /compute/v2.1/os-hosts/n-d-858384-11 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:35:29.178176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f977d234-0dfa-4131-a356-372c3c62e2ef tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Action: 'update', calling method: .version_select at 0x7f5376fae0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:29.188375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f977d234-0dfa-4131-a356-372c3c62e2ef tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '30ad7f7a102f4c98bf820a90efc992d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df3335ba67b411d881c5b3601e5c2fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f977d234-0dfa-4131-a356-372c3c62e2ef tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Request method failure captured: Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-hosts/n-d-858384-11 HTTP/1.1 Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 50 Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83OiASTD_5NDE0DAHm-5mb37pWlmw09T-cEIV90OshPin04Evr0Kh5la0gm8hGLrpeiYXrMSIalbjFizFwSRCOYrMedkub9P0RZyNGmYvwIOlYURsik-Lj6RWdrNe5yE-MakDIGJAHXR95x1EQI-GXudXb6JTmTTxyF3bDZRkaPwYY Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:29.192133 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2df3335ba67b411d881c5b3601e5c2fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2df3335ba67b411d881c5b3601e5c2fb Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-713226681 Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 30ad7f7a102f4c98bf820a90efc992d3 Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-713226681-project Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: {"status": "enable", "maintenance_mode": "enable"} Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 13 08:35:29.193332 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-d-858384-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:29.194172 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 13 08:35:29.195299 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.196717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f977d234-0dfa-4131-a356-372c3c62e2ef tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.198169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f977d234-0dfa-4131-a356-372c3c62e2ef tempest-HostsAdminNegativeTestJSON-713226681 tempest-HostsAdminNegativeTestJSON-713226681-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-858384-11" status: 403 len: 111 microversion: 2.1 time: 0.024683 Oct 13 08:35:29.203233 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 251/484] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:35:29 2022] PUT /compute/v2.1/os-hosts/n-d-858384-11 => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:29.216407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-268aad94-e939-4c28-ae07-97a369555bd7 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Action: 'update', calling method: .version_select at 0x7f5377072b80>, body: {"status": null, "maintenance_mode": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-268aad94-e939-4c28-ae07-97a369555bd7 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-hosts/n-d-858384-11 HTTP/1.1 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 42 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:29.223555 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: {"status": null, "maintenance_mode": null} Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 13 08:35:29.224875 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-d-858384-11', 'body': {'status': None, 'maintenance_mode': None}} Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'disable', Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Enable', Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'Disable', Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance: Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi None Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.225671 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.227099 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.228158 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:35:29.228158 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:35:29.228158 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 13 08:35:29.228158 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.231062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-268aad94-e939-4c28-ae07-97a369555bd7 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.232094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-268aad94-e939-4c28-ae07-97a369555bd7 tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-858384-11" status: 400 len: 127 microversion: 2.1 time: 0.021790 Oct 13 08:35:29.232969 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 252/485] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Oct 13 08:35:29 2022] PUT /compute/v2.1/os-hosts/n-d-858384-11 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:35:29.248912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Action: 'update', calling method: .version_select at 0x7f5377072f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:29.256778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.hosts [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Enabling host nonexistent_hostname. Oct 13 08:35:29.276404 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Request method failure captured: Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 50 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83PHE0cj_alyhR4JM2zgmNgQ6aiT-7ZN3NSPj2swrSWgZvT5ryqa4k1JES4Zf_y4yMoJkYj9dSQXCstbBQXVzwZCgaaKIo6B-qK5I132nuAbLBkbQUYRxVjLoyX72-BZO4hPLe8cbavso6l5ZWWII0tvoL_yM630XEI5ziq5Kon2cA Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:29.282034 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5a35f48444014f2cbdcfbd057b72e566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5a35f48444014f2cbdcfbd057b72e566 Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1231149888 Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 090ac9521cbf470fb85f9bc78b4feb75 Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1231149888-project-admin Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: {"status": "enable", "maintenance_mode": "enable"} Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.283505 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 13 08:35:29.284319 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:35:29.285313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 13 08:35:29.286387 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.288726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.289780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be2447fe-c5da-4581-b700-5b9558ca128b tempest-HostsAdminNegativeTestJSON-1231149888 tempest-HostsAdminNegativeTestJSON-1231149888-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051770 Oct 13 08:35:29.290521 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 253/486] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Oct 13 08:35:29 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:35:29.453503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.464598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.466368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:29.467810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86580695-0a59-4ffd-a6f1-a6410095b709 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1567 microversion: 2.25 time: 0.534226 Oct 13 08:35:29.483271 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 234/487] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:28 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1567 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:29.668998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:29.673093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:29.673706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 5e58b19f-7dd8-4581-8b61-b8058b2a0061] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:29.687973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.688469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.688904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:29.689818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.690273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.690724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:29.706257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] HTTP exception thrown: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Request method failure captured: Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 HTTP/1.1 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82LX9ZtlmV351tyApKVpylxBnDpnz43dRySGqhFf4bt2iE7nSAM0hsi-Hl9SN3dvcCs4MMz95koESdLzrluWc2GdsvjJQEVz-CcdLuOilsr7fMCzvYyW4SBBqPdCuBldMizOOBF8U72EJvkFHKZ2NyNYnZwweOKi1QAeY78iIx9evw Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a6ba7d819f68495182c9cd6d79ac1e20 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:29.708887 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a6ba7d819f68495182c9cd6d79ac1e20 Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-LiveMigrationNegativeTest-1898217760-project Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9d00a3a275b54978b4380b971c91d659 Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-LiveMigrationNegativeTest-1898217760-project Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. Oct 13 08:35:29.710354 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '5e58b19f-7dd8-4581-8b61-b8058b2a0061'} Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:29.711138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. Oct 13 08:35:29.712296 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:29.715449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Returning 404 to user: Instance 5e58b19f-7dd8-4581-8b61-b8058b2a0061 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:29.716510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55c34e21-0763-4202-9e7f-0dd6db4c7095 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061" status: 404 len: 111 microversion: 2.1 time: 0.048451 Oct 13 08:35:29.717255 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 254/488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:29 2022] GET /compute/v2.1/servers/5e58b19f-7dd8-4581-8b61-b8058b2a0061 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:29.725838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:29.732464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:29.740224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.740719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.741165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:29.742024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.742563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.742994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:29.748389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:29.772123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:35:29.861614 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d981026c-03c9-459d-b161-295ab2697f0b tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 204 len: 0 microversion: 2.1 time: 0.139780 Oct 13 08:35:29.865387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 235/489] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:35:29 2022] DELETE /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:29.871598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:29.872750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:29.878544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.879022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.879455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:29.880147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:29.880591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:29.881173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.038159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:30.039134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:30.047826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:30.049608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.050121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.050643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.051384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.051839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.052265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.067482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:30.078213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e43c1595-1575-4bd8-9cf8-fd03af4fe753 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1475 microversion: 2.1 time: 0.211190 Oct 13 08:35:30.080373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 255/490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:29 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1475 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:30.310715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:30.320460 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d73804b-f31c-4730-b9df-345af29a5644 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.286618 Oct 13 08:35:30.323001 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 236/491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:30 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:30.496114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:30.497446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:30.505784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.506469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.507125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.507965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.508425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.509424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.663937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:30.674289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:30.684857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:30.686627 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f5ae959d-586b-4df0-bc4b-c249d96a28ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1557 microversion: 2.25 time: 0.195689 Oct 13 08:35:30.687188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 256/492] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:30 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:30.710727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6a786d6-42c5-4311-863f-b54590003fbc tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '.version_select at 0x7f5377134670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:30.714394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a786d6-42c5-4311-863f-b54590003fbc tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.714898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a786d6-42c5-4311-863f-b54590003fbc tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.715939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a786d6-42c5-4311-863f-b54590003fbc tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.732019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6a786d6-42c5-4311-863f-b54590003fbc tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.024572 Oct 13 08:35:30.733484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 237/493] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Oct 13 08:35:30 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:30.748086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:30.749030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:30.755752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.756529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.757171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.757949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:30.758499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:30.759146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:30.915669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 79408968-f79c-4af8-815c-c338d2d5cea9 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:30.979245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-213e8fef-c282-463d-956c-9df69970319f tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 2051 microversion: 2.25 time: 0.235541 Oct 13 08:35:30.986546 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 257/494] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:30 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 2051 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:31.113121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:31.113741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:31.121650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:31.121994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:31.122781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:31.123640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:31.124247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:31.124914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:31.320969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:31.330548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c3c3be9-c8a9-4884-b585-e8f1639ec45a tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1475 microversion: 2.1 time: 0.232209 Oct 13 08:35:31.331752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 238/495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:31 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:31.346221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:31.347086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:31.354661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:31.355153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:31.356411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:31.357315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:31.358086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:31.358696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:31.370249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-386627124", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "31ab6cfd-c0f3-4111-b8a2-4e38788505cb"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:31.489370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] validate_networks() for [('31ab6cfd-c0f3-4111-b8a2-4e38788505cb', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:31.568623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:31.579629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-753ef737-09ea-4179-99c8-0571bfe94fb8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.236320 Oct 13 08:35:31.580950 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 258/496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:31 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:32.021618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4fa203c-61a3-4a60-a490-00bc05c7ba4a tempest-InstanceUsageAuditLogTestJSON-429092474 tempest-InstanceUsageAuditLogTestJSON-429092474-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:32.053345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4fa203c-61a3-4a60-a490-00bc05c7ba4a tempest-InstanceUsageAuditLogTestJSON-429092474 tempest-InstanceUsageAuditLogTestJSON-429092474-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-13 08:35:31" status: 200 len: 318 microversion: 2.1 time: 0.390290 Oct 13 08:35:32.060587 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 259/497] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 08:35:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-13%2008%3A35%3A31 => generated 318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:35:32.070510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c50cd783-02f2-4db1-ac38-95a8a41803e8 tempest-InstanceUsageAuditLogTestJSON-429092474 tempest-InstanceUsageAuditLogTestJSON-429092474-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:32.085690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c50cd783-02f2-4db1-ac38-95a8a41803e8 tempest-InstanceUsageAuditLogTestJSON-429092474 tempest-InstanceUsageAuditLogTestJSON-429092474-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.020302 Oct 13 08:35:32.086982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 260/498] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:35:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:32.295259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:32.297776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:32.298433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:32.298890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:32.299757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:32.316279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.317153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.318061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.318855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.319315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.319741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.345337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:32.350049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for user c09ea2313b3343579cb75d16d8f220ee and project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:32.356578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:32.357186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:32.364546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:32.367052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.367765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:32.368743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.369192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.376326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.377117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.377959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.411203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:32.499045 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e75bd191-a2c8-441f-9adf-ff1466113780 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.129998 Oct 13 08:35:32.508491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 239/499] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:35:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:35:32.516645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d00a3a275b54978b4380b971c91d659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ba7d819f68495182c9cd6d79ac1e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:32.527283 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37f722de-a546-4ad4-ab24-f28c953c4676 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 200 len: 1433 microversion: 2.1 time: 0.174921 Oct 13 08:35:32.530095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:32.530776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:32.532051 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 261/500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:32 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 1433 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:32.607299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e65a9-6da4-4630-af5a-9473d6193db0", "name": "network-vif-deleted", "tag": "c45dcd65-8795-4a54-a776-83e9ab6a7db9"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:32.619935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.621428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.622205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.652491 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] Creating event network-vif-deleted:c45dcd65-8795-4a54-a776-83e9ab6a7db9 for instance 361e65a9-6da4-4630-af5a-9473d6193db0 on n-h2-858384-11 Oct 13 08:35:32.663520 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5fece3fe-ab01-466d-a8a4-f8310f2083d8 req-da9eabe7-c62e-44e8-b852-3e23f73992f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058467 Oct 13 08:35:32.666958 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 262/501] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:32.677982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:32.683394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:32.701983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.702769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.704255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.707362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:32.709287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:32.709841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:32.713861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:32.743421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:32.747808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:32.749245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41e0b4ff-a833-41b7-970a-183a9a0b6a3d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1261 microversion: 2.25 time: 0.237564 Oct 13 08:35:32.751100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 240/502] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:32 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:33.049528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:33.066228 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-858a65d2-d276-47df-98d2-3c6eb911a08e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.395521 Oct 13 08:35:33.066883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 263/503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:32 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:33.100150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff95b85-68c9-4c74-af7d-47419a17bc58", "name": "network-vif-plugged", "status": "completed", "tag": "1d9d1970-7383-4244-b262-0fe1d569801a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:33.114446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:33.115760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:33.116690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:33.136794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] Creating event network-vif-plugged:1d9d1970-7383-4244-b262-0fe1d569801a for instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 on n-h2-858384-11 Oct 13 08:35:33.145708 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-92fb5fe9-41bd-406f-b7ee-18bf111cda7a req-a2d9846a-7da8-4ba8-b827-3ee14967cb5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048805 Oct 13 08:35:33.147387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 241/504] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:33.558551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:33.559192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] [instance: 361e65a9-6da4-4630-af5a-9473d6193db0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:33.573847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:33.576247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:33.578273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:33.580274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:33.584149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:33.584785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:33.639610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] HTTP exception thrown: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Request method failure captured: Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 HTTP/1.1 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR82LX9ZtlmV351tyApKVpylxBnDpnz43dRySGqhFf4bt2iE7nSAM0hsi-Hl9SN3dvcCs4MMz95koESdLzrluWc2GdsvjJQEVz-CcdLuOilsr7fMCzvYyW4SBBqPdCuBldMizOOBF8U72EJvkFHKZ2NyNYnZwweOKi1QAeY78iIx9evw Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a6ba7d819f68495182c9cd6d79ac1e20 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:33.645328 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a6ba7d819f68495182c9cd6d79ac1e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a6ba7d819f68495182c9cd6d79ac1e20 Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1898217760 Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-LiveMigrationNegativeTest-1898217760-project Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9d00a3a275b54978b4380b971c91d659 Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-LiveMigrationNegativeTest-1898217760-project Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. Oct 13 08:35:33.646838 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '361e65a9-6da4-4630-af5a-9473d6193db0'} Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:33.647529 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. Oct 13 08:35:33.648860 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:33.651589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] Returning 404 to user: Instance 361e65a9-6da4-4630-af5a-9473d6193db0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:33.654220 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-345b5b4e-3b4f-4401-8976-a424b4acdf66 tempest-LiveMigrationNegativeTest-1898217760 tempest-LiveMigrationNegativeTest-1898217760-project] 10.222.0.23 "GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0" status: 404 len: 111 microversion: 2.1 time: 0.100216 Oct 13 08:35:33.656220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 264/505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:33 2022] GET /compute/v2.1/servers/361e65a9-6da4-4630-af5a-9473d6193db0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:33.781207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:33.783546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:33.800484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:33.800992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:33.801792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:33.805982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:33.806673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:33.807911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:33.943728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:33.952434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:33.954144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:33.955278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56196d39-784f-4515-818b-2fa5f9b0c35d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1313 microversion: 2.25 time: 0.181577 Oct 13 08:35:33.955859 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 242/506] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:33 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:34.095309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:34.096382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:34.106706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:34.108396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:34.109264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:34.110377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:34.111096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:34.112018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:34.303791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:34.316606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f5b252d1-2460-4644-b80d-960761d22c26 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1310 microversion: 2.1 time: 0.230703 Oct 13 08:35:34.317384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 265/507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:34 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:34.985738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:34.987089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:34.995391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:35.006855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:35.007661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:35.008590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:35.009216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:35.009837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:35.341750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:35.342941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:35.355851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:35.356493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:35.357089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:35.357951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:35.358588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:35.359152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:35.368751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:35.386897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:35.395982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:35.399467 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e844387-5aee-4c0a-9e86-06a65d6d2728 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1319 microversion: 2.25 time: 0.416901 Oct 13 08:35:35.402620 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 243/508] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:34 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:35.856536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:35.874547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e28848e-88e3-467c-acf7-ce4c093fd195 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1493 microversion: 2.1 time: 0.535276 Oct 13 08:35:35.877063 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 266/509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:35 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1493 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:36.011576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Action: 'update', calling method: .version_select at 0x7f5377037e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:36.510931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:36.511689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:36.536204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.537329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.537791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.540356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.540845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.541634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.738609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-12e2b281-133c-433b-a8c6-7462e27fe455 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1646 microversion: 2.1 time: 0.839328 Oct 13 08:35:36.750728 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 267/510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:35 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1646 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:36.764195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:36.765062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:36.772595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.773739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.774445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.775766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.776645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.777640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.905675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.906247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.908120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.909122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:36.911036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:36.911593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:36.979231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:36.992723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-78e11174-a40b-48c9-8765-253761adba4d tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3" status: 200 len: 240 microversion: 2.36 time: 1.340232 Oct 13 08:35:37.004669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 244/511] 10.222.0.23 () {62 vars in 1303 bytes} [Thu Oct 13 08:35:35 2022] PUT /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3 => generated 240 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:37.009833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5dea53-e2ce-46bd-9b5f-a1c92c84de59", "tag": "10e40049-79d3-4179-b381-ed58724b5472"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:37.040771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.042602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.043403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.063013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] Creating event network-changed:10e40049-79d3-4179-b381-ed58724b5472 for instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 on n-h1-858384-11 Oct 13 08:35:37.068586 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3c066b4a-a48b-43d6-83ac-2bf916a59d33 req-a94d9d81-57f7-4dd0-a097-46bc6b2f118f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062565 Oct 13 08:35:37.070284 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 245/512] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:37.076619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.077532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:37.085570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.086135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.086819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.087623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.088717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.089264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.141605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:37.153189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:37.154744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:37.156590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e61fa15c-92be-40b4-b386-ecf2583d6ecd tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.397126 Oct 13 08:35:37.157490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 268/513] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:36 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:37.280662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cf0b00f3-09f6-4260-9166-f5a0c00f3295 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1646 microversion: 2.1 time: 0.208764 Oct 13 08:35:37.281593 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 246/514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1646 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:37.302155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Calling method '.version_select at 0x7f5377036790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.376414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Calling method '.version_select at 0x7f5376fae0d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.378581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.379282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.379650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.395610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.396190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.396682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.408643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.409212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.409768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.419454 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f028bf25-79d1-47b7-9be4-0e6467a4f10e tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.260695 Oct 13 08:35:37.425827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 269/515] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:37.431175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.435524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.436043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.436488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.437218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.437672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.438099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.462741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91998813-0165-4710-99a8-e2411560674e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035563 Oct 13 08:35:37.463906 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 270/516] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:37.468547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Calling method '.version_select at 0x7f53770dc670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.470267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.470753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.471188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.489969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.490516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.491001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.512478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.513069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.513391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.519395 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fd0ad39-7216-4e71-8505-b09836b1aeb1 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-858384-11/servers" status: 200 len: 276 microversion: 2.1 time: 0.054346 Oct 13 08:35:37.527643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 271/517] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-11/servers => generated 276 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:37.536623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-11", "block_migration": true, "disk_over_commit": false}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:37.538948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:37.541853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:37.548389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.548885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.549327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.550034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.550551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.550983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.631624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lazy-loading 'flavor' on Instance uuid 7ff95b85-68c9-4c74-af7d-47419a17bc58 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:37.646900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Going to try to live migrate instance to n-h1-858384-11 {{(pid=127031) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:35:37.928974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.929388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.930034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.931080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.931989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.933009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.957510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-477a456d-1140-4d2d-a342-60eabb666ce4 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3/detail" status: 200 len: 672 microversion: 2.36 time: 0.658159 Oct 13 08:35:37.957510 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 247/518] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3/detail => generated 672 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:37.959001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Calling method '.version_select at 0x7f5376f19b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:37.961130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.961850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.962559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.979790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:37.980451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:37.981046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:37.999346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:38.000200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:38.001277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:38.008164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17e8a8fa-a427-4303-afd9-a66b6a0a9449 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.052727 Oct 13 08:35:38.009324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 248/519] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:38.021356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Calling method '.version_select at 0x7f5376f19c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:38.023098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:38.023690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:38.024841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:38.069752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:38.070511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:38.071791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:38.082562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f879cc3-ab96-479e-b218-115f58b35971 tempest-HypervisorAdminUnderV252Test-329392968 tempest-HypervisorAdminUnderV252Test-329392968-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-858384-11/search" status: 200 len: 105 microversion: 2.1 time: 0.065764 Oct 13 08:35:38.089992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 249/520] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Oct 13 08:35:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-11/search => generated 105 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:38.189693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:38.195814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:38.205670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:38.206224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:38.206912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:38.208368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:38.208986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:38.209831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:38.471785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:38.483766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:38.485423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:38.488695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c942fed-4c90-413a-8476-2eeb12f101a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.305598 Oct 13 08:35:38.491808 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 250/521] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:38 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:38.765035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Action: 'update', calling method: .version_select at 0x7f5376ff3280>, body: {"quota_set": {"ram": "2048"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:39.193990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.195512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.198468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:39.199440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.199909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.201608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:39.240464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.241122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.241719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:39.242742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.243418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.244549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:39.312770 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29d5fd48-641c-4c9a-b28e-a4f5df8703ea tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3?user_id=ee71499838694e24885513b007256822" status: 200 len: 240 microversion: 2.36 time: 0.551336 Oct 13 08:35:39.313408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 251/522] 10.222.0.23 () {62 vars in 1384 bytes} [Thu Oct 13 08:35:38 2022] PUT /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3?user_id=ee71499838694e24885513b007256822 => generated 240 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:35:39.324808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad4b95a7-2594-4877-84d8-9076b05eddb3 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] Calling method '.version_select at 0x7f5376fad280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:39.863620 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad4b95a7-2594-4877-84d8-9076b05eddb3 tempest-QuotasAdminTestV236-272628989 tempest-QuotasAdminTestV236-272628989-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3?user_id=ee71499838694e24885513b007256822" status: 200 len: 282 microversion: 2.36 time: 0.542575 Oct 13 08:35:39.865064 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 252/523] 10.222.0.23 () {60 vars in 1364 bytes} [Thu Oct 13 08:35:39 2022] GET /compute/v2.1/os-quota-sets/4836155c22a24e928850e41d46bf79c3?user_id=ee71499838694e24885513b007256822 => generated 282 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:35:39.871949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:39.872762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:39.878950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.879828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.880424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:39.881574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:39.882579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:39.885926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:40.209617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:40.222433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:40.224047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:40.225957 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d59d994-b2e1-4336-8650-0a240a3d6993 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.358114 Oct 13 08:35:40.226939 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 253/524] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:39 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:40.332112 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e20ead1-6eab-4b26-915e-6974d0f69b04 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58/action" status: 202 len: 0 microversion: 2.1 time: 2.803113 Oct 13 08:35:40.333646 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 272/525] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:35:37 2022] POST /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58/action => generated 0 bytes in 2805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:35:40.342705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:40.343808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:40.359169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:40.360192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:40.360732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:40.364260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:40.365004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:40.365675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:40.581759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:40.590802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-baf14361-9d22-4f6c-a189-31bb3b8c9936 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.252799 Oct 13 08:35:40.594263 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 273/526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:40 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:40.730749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0dd0369f-9206-4b8d-a49c-0007690a0f77 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] Calling method '.version_select at 0x7f5377037f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:40.946756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0dd0369f-9206-4b8d-a49c-0007690a0f77 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 6063 microversion: 2.1 time: 0.718292 Oct 13 08:35:40.947490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 254/527] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:35:40 2022] GET /compute/v2.1/os-networks => generated 6063 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:40.956365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59ebd1af-ea53-4802-969f-e0f718688de8 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] Calling method '.version_select at 0x7f5376eb3430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:41.090203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59ebd1af-ea53-4802-969f-e0f718688de8 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/e0c42a02-80b3-424e-a571-99b0953fb6b4" status: 200 len: 652 microversion: 2.1 time: 0.137717 Oct 13 08:35:41.090815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 274/528] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:35:40 2022] GET /compute/v2.1/os-networks/e0c42a02-80b3-424e-a571-99b0953fb6b4 => generated 652 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:41.100804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2cfc722-8def-468a-b473-3074c589a9f6 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] Calling method '.version_select at 0x7f5376f199d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:41.253521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:41.255112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:41.264436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.265824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.266471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.267399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.268004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.268723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.280783 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2cfc722-8def-468a-b473-3074c589a9f6 tempest-NetworksTest-1717525595 tempest-NetworksTest-1717525595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 6063 microversion: 2.1 time: 0.184478 Oct 13 08:35:41.281971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 255/529] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:35:41 2022] GET /compute/v2.1/os-networks => generated 6063 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:41.455828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:41.466285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:41.470696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:41.473032 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b3d4fef-ed83-4270-85f0-252830010507 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.223500 Oct 13 08:35:41.475395 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 275/530] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:41 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:41.620905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:41.621573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:41.630182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.630723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.631160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.633589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.634220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.635403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.669942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-866416629", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:41.773231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:41.773464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:41.774258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:41.775038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:41.775851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:41.791660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.793127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.793873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.795124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.795772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.796877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.822863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Getting quotas for project bb5e7548316844ffb543c4a0393e49ea. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:41.829437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Getting quotas for user f1680cbcb1d94e5b8989789a5d37acec and project bb5e7548316844ffb543c4a0393e49ea. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:41.850674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:41.854924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:41.893479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:41.906043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4463cb31-c3b1-40b9-af71-693d4129915d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.289031 Oct 13 08:35:41.908774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 276/531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:41 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:41.925676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff95b85-68c9-4c74-af7d-47419a17bc58", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9d1970-7383-4244-b262-0fe1d569801a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:41.927100 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3db47cdf-72c8-416e-a263-b9fa5cd35575 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.548501 Oct 13 08:35:41.927928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 256/532] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 13 08:35:41.939774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:41.942953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:41.963330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:41.963838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:41.964276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:41.998869 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] Creating event network-vif-unplugged:1d9d1970-7383-4244-b262-0fe1d569801a for instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 on n-h2-858384-11 Oct 13 08:35:42.004485 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ce8cdad6-3833-448b-ac15-ef5c58c66365 req-d3274467-6d82-46c3-ae35-e3b6c771cc7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094299 Oct 13 08:35:42.009331 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 277/533] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:42.108268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:42.152838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.171442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.177208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.195707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8d7623e-ff98-43e6-a5d2-ae6fc7145bed tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "PUT /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1358 microversion: 2.75 time: 0.258764 Oct 13 08:35:42.196681 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 257/534] 10.222.0.23 () {62 vars in 1297 bytes} [Thu Oct 13 08:35:41 2022] PUT /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:42.231224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:42.231847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:42.385745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.419212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.423061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.442560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b524afba-8d52-43ed-a450-c7ce8d9bf83f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1358 microversion: 2.75 time: 0.215934 Oct 13 08:35:42.443147 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 258/535] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:42 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:42.501691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:42.502363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:42.513032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:42.517770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:42.518481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:42.519287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:42.525856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:42.526446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:42.792834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.803502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1898372604", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:42.805170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.808368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:42.811730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bdb26183-a028-4807-a2ea-3ad4a5e4383c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.314121 Oct 13 08:35:42.812791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 259/536] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:42 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:42.899065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:42.932372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:42.933067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:42.944900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:42.947204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:42.948869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:42.950618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:42.957200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:42.959883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.340717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:43.341135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:43.341784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:43.342337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:43.343081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:43.359168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.359658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.360092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.360825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.361276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.361698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.361821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:43.368809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=11 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:43.374634 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1532cb63-9e7d-422c-975a-a1342258aa1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.446307 Oct 13 08:35:43.376143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 260/537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:42 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:43.382758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5dea53-e2ce-46bd-9b5f-a1c92c84de59", "name": "network-vif-plugged", "status": "completed", "tag": "10e40049-79d3-4179-b381-ed58724b5472"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:43.391423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Getting quotas for project 8e4e09c7157949bca928e509abfef71d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:43.396843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Getting quotas for user 7716895497df4077ac7967afb033c26f and project 8e4e09c7157949bca928e509abfef71d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:43.401291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.401788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.402187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.410207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:43.412830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:43.414887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] Creating event network-vif-plugged:10e40049-79d3-4179-b381-ed58724b5472 for instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 on n-h1-858384-11 Oct 13 08:35:43.422633 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a2d4f773-ef66-4119-af30-7076b2e166f1 req-8c6b81c1-65fc-455a-9628-595f8934f67f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042068 Oct 13 08:35:43.424657 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 261/538] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:43.478144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:43.479191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:43.490274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.490826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.491263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.492894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.493710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.494204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.515994 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14e52b0d-e40a-4d84-9c01-10613cbb92aa tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409372 Oct 13 08:35:43.520277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:43.523131 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 278/539] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:43.532689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f90989-b8ea-4b9b-82b1-0540d5e267e8 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:43.533303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57f90989-b8ea-4b9b-82b1-0540d5e267e8 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:43.613129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57f90989-b8ea-4b9b-82b1-0540d5e267e8 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:43.624040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57f90989-b8ea-4b9b-82b1-0540d5e267e8 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1223 microversion: 2.1 time: 0.099696 Oct 13 08:35:43.625231 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 279/540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:43 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:43.771625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:43.784650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:43.790039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:43.803471 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-106ef8ba-f1b0-418b-a06f-1e7d9ac4666c tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1410 microversion: 2.75 time: 0.332008 Oct 13 08:35:43.817114 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 262/541] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:43 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1410 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:43.844311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:43.844919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:43.853332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.853831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.857649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:43.858397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:43.858882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:43.859527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.066828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff95b85-68c9-4c74-af7d-47419a17bc58", "tag": "1d9d1970-7383-4244-b262-0fe1d569801a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:44.069675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:44.080856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:44.082329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:44.083220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.083477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9387143b-037b-487d-bee3-e67470299682 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.242923 Oct 13 08:35:44.084061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.084608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 280/542] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:43 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:44.087033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.099802 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] Creating event network-changed:1d9d1970-7383-4244-b262-0fe1d569801a for instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 on n-h2-858384-11 Oct 13 08:35:44.106109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bc89d781-1a2d-48f4-86cf-6fab575ec08e req-fc53f265-5c7b-4348-ba01-cdbab8d2b11f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043781 Oct 13 08:35:44.107633 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 263/543] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:44.400624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:44.401186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:44.411919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.413031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.421841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.425844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.428089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.428737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.439740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:44.641057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:44.651362 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9fb45e8-c500-40d2-a102-493f6d13d0c8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.255594 Oct 13 08:35:44.652111 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 281/544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:44 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:44.658567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:44.659582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:44.666687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.667438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.668103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.672090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.672803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.673437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.806903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:44.820965 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f810727e-7f37-44e4-a305-0bdce6d35c18 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1219 microversion: 2.1 time: 0.167035 Oct 13 08:35:44.839834 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 282/545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:44 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:44.845714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:44.847332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:44.854639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.855367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.855971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.856754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.857441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.858148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.929855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Calling method '.version_select at 0x7f5376f2ae50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:44.932940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.933608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.933939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:44.985022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:44.985513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:44.990714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.021055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:45.021515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.028311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.036960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.037416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.043983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.045444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.061279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b523c15-3b47-4c60-b314-f3a0c15db053 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1428 microversion: 2.75 time: 0.220001 Oct 13 08:35:45.061863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 283/546] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:44 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:45.072226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09c5d21e-97e8-4aad-876a-3c26a3f4704a tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.647688 Oct 13 08:35:45.080669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 264/547] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:45.111232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.111977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:45.126900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.127613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.128210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.128932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.129406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.132407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.487104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd511712-606e-404b-b640-92faa2fe6181 tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Calling method '.version_select at 0x7f5376eb7f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.488895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd511712-606e-404b-b640-92faa2fe6181 tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '64db53ef4327424e84d1a0759f7086b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eabb79b39fd487fab470c3338a31de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd511712-606e-404b-b640-92faa2fe6181 tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Request method failure captured: Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hypervisors/n-h1-858384-11/search HTTP/1.1 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83eSd26jQb-zGGxgGQrHEgBTe3EAY-cxEmHMNwph4qtDtYbhs85uwKS_kBQttaVPKU_JU1w7JnWGHGMqWKP8ChAaTwDNXDZ0XwWMQzIdEQBLPZsjofePWItBsJWeTDucJD0u8fBpoO7W0ZtfrDV0OxZpoHesl4NfsA7Cq9skODJLmE Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3eabb79b39fd487fab470c3338a31de3 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:45.490610 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3eabb79b39fd487fab470c3338a31de3 Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-73266235-project Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 64db53ef4327424e84d1a0759f7086b5 Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235-project Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 13 08:35:45.492211 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'n-h1-858384-11'} Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:45.493106 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 13 08:35:45.494564 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.497051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd511712-606e-404b-b640-92faa2fe6181 tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:45.498094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd511712-606e-404b-b640-92faa2fe6181 tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-858384-11/search" status: 403 len: 117 microversion: 2.1 time: 0.416176 Oct 13 08:35:45.498977 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 284/548] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-11/search => generated 117 bytes in 418 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:45.509772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Calling method '.version_select at 0x7f5376e7d040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.512429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.513493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.514133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.523133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Request method failure captured: Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83gorzKhuNFfm8F6awnjTRs83CpuGEmoEY5gfposg2HxhKSPKLErvrKf1-qDc4oRW8l28k2boVklDqYwYSZ-raDTFfG--3mwek76rKXQBPN47yt3UI9TRK0hZf1h4J8HmB82B7GkuaCzwuE1aDUCW29AeIRsFaGxhZsfq6hYm76Q1s Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: abd17dca456f4c61a0c0bba2a2fd1d88 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:35:45.525657 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: abd17dca456f4c61a0c0bba2a2fd1d88 Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: af7cb94ef0f345cbba79af3021af454b Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 13 08:35:45.527047 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.527767 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.528909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.528909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:45.528909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:45.528909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 13 08:35:45.528909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.530502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:45.531767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-23985457-567a-4e24-a263-cbc6693443d4 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027653 Oct 13 08:35:45.532638 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 285/549] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:45.545265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Calling method '.version_select at 0x7f537760aaf0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.552098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.553366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.553809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.601094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.601795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.602284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.625968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.626487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.626933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.635402 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fd56977-666c-4052-86c9-a5f0503b1dc3 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.094684 Oct 13 08:35:45.636668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 286/550] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:45.647693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88049f33-676f-4e82-957e-9a5e3493c01f tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Calling method '.version_select at 0x7f5376eb5670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.652788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88049f33-676f-4e82-957e-9a5e3493c01f tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '64db53ef4327424e84d1a0759f7086b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eabb79b39fd487fab470c3338a31de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88049f33-676f-4e82-957e-9a5e3493c01f tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Request method failure captured: Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83eSd26jQb-zGGxgGQrHEgBTe3EAY-cxEmHMNwph4qtDtYbhs85uwKS_kBQttaVPKU_JU1w7JnWGHGMqWKP8ChAaTwDNXDZ0XwWMQzIdEQBLPZsjofePWItBsJWeTDucJD0u8fBpoO7W0ZtfrDV0OxZpoHesl4NfsA7Cq9skODJLmE Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3eabb79b39fd487fab470c3338a31de3 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:45.659299 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eabb79b39fd487fab470c3338a31de3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3eabb79b39fd487fab470c3338a31de3 Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235 Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-73266235-project Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 64db53ef4327424e84d1a0759f7086b5 Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-73266235-project Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 13 08:35:45.660622 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '1'} Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:45.661342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 13 08:35:45.663114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.666533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88049f33-676f-4e82-957e-9a5e3493c01f tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:45.667541 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88049f33-676f-4e82-957e-9a5e3493c01f tempest-HypervisorAdminNegativeUnderV252Test-73266235 tempest-HypervisorAdminNegativeUnderV252Test-73266235-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.024593 Oct 13 08:35:45.668531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 287/551] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:35:45.676915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.677227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.681079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:45.686802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.695399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.695580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.695923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.698431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.699055 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87fc86ef-eebb-4880-b6bb-1b141f75d247 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1361 microversion: 2.25 time: 0.592792 Oct 13 08:35:45.699345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.699817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.700255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.700545 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 265/552] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1361 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:45.710567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Calling method '.version_select at 0x7f5376ec2e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.714591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.717040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.720275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.733707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] HTTP exception thrown: No hypervisor matching '6239eb2e-00de-4c25-9d71-a07e7bd577c8' could be found. Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Request method failure captured: Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-hypervisors/6239eb2e-00de-4c25-9d71-a07e7bd577c8/servers HTTP/1.1 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83gorzKhuNFfm8F6awnjTRs83CpuGEmoEY5gfposg2HxhKSPKLErvrKf1-qDc4oRW8l28k2boVklDqYwYSZ-raDTFfG--3mwek76rKXQBPN47yt3UI9TRK0hZf1h4J8HmB82B7GkuaCzwuE1aDUCW29AeIRsFaGxhZsfq6hYm76Q1s Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: abd17dca456f4c61a0c0bba2a2fd1d88 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:35:45.739371 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/abd17dca456f4c61a0c0bba2a2fd1d88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: abd17dca456f4c61a0c0bba2a2fd1d88 Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377 Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: af7cb94ef0f345cbba79af3021af454b Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: exception: No hypervisor matching '6239eb2e-00de-4c25-9d71-a07e7bd577c8' could be found. Oct 13 08:35:45.740787 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6239eb2e-00de-4c25-9d71-a07e7bd577c8'} Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6239eb2e-00de-4c25-9d71-a07e7bd577c8' could be found. Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.741496 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6239eb2e-00de-4c25-9d71-a07e7bd577c8' could be found. Oct 13 08:35:45.742894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:35:45.744432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] Returning 404 to user: No hypervisor matching '6239eb2e-00de-4c25-9d71-a07e7bd577c8' could be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:45.745470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03f22d95-70d1-4fa5-a38a-4e850f644323 tempest-HypervisorAdminNegativeUnderV252Test-312535377 tempest-HypervisorAdminNegativeUnderV252Test-312535377-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/6239eb2e-00de-4c25-9d71-a07e7bd577c8/servers" status: 404 len: 123 microversion: 2.1 time: 0.042611 Oct 13 08:35:45.754248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 266/553] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/os-hypervisors/6239eb2e-00de-4c25-9d71-a07e7bd577c8/servers => generated 123 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:45.845851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:45.846573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:45.854255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.855916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.856360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.857063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:45.857516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:45.857942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:45.904880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.915271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f294de80-0fd0-4703-8c5c-ed8be8fa5d8a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.244110 Oct 13 08:35:45.915887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 288/554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:45.922637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:45.930265 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e5f4e36-2c2e-41f0-bbdf-c24ca3b60d53 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1281 microversion: 2.1 time: 0.088222 Oct 13 08:35:45.931897 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 267/555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:45 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:46.097024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:46.097787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:46.105546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.106304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.106954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:46.107873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.108498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.109137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:46.236707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:46.251381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:46.254080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:46.264424 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00a6256b-67f0-416a-a12f-aed4f4797719 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1416 microversion: 2.75 time: 0.172952 Oct 13 08:35:46.265006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 289/556] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:46 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1416 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:46.731693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:46.732618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:46.741897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.742801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.743434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:46.744654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.746746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.747414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:46.945121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:46.947024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:46.959528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.964084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.965916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:46.966963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:46.968906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:46.971626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.222327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:47.231372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:47.233140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:47.234533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-55f4120f-1c29-4cdd-b7dc-e73b4550d224 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1557 microversion: 2.25 time: 0.507879 Oct 13 08:35:47.247581 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 268/557] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:46 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1557 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:47.439483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:47.452571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9c18537-22c4-4262-b072-4e298ba73b66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.513232 Oct 13 08:35:47.460087 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 290/558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:46 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:47.472933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:47.473563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:47.482260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.482789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.483223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.485084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.486057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.487118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.595606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1324467034", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:47.691388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:47.691964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:47.692538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:47.692983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:47.693768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:47.701944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:47.711002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.712149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6646ee2d-44d1-4771-b7e1-66dfc23de146 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.250899 Oct 13 08:35:47.713492 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 291/559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:47 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:47.726726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.726726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.726726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.726726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.727095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.732423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=16 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:47.749830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Getting quotas for project 6a19941eca624bb5b3640528e7aa6615. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:47.754510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Getting quotas for user 97e7be5f5c4c475bbeb5f5574017608b and project 6a19941eca624bb5b3640528e7aa6615. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:47.771033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:47.773697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:47.859909 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-505f7d54-96dd-434b-bbc2-6a4374c4d491 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.606862 Oct 13 08:35:47.866571 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 269/560] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:35:47.881576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:47.883621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:47.899047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.900608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.902230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:47.903287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:47.903939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:47.904576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.043661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1853544297", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:48.118624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:48.353843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:48.371206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-802ab5b9-c600-4325-9c4e-747c68b4904b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 2051 microversion: 2.25 time: 0.500364 Oct 13 08:35:48.372434 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 270/561] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:47 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 2051 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:48.377304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:48.379036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:48.402346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.403287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.404039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.404956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.405673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.406316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.534378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:48.534833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:48.535368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:48.535721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:48.536133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:48.543418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.552980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.553453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.553886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.554650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.555106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.555534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.559945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.562011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.577237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:48.582497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2e57db4-0345-4b1f-9b64-1a09b496ec90 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1437 microversion: 2.75 time: 0.208699 Oct 13 08:35:48.583323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for user e1765243aa04484fb46f41db48beac54 and project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:48.583775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 271/562] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:48 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1437 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:48.598548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:48.600211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:48.609576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:48.610197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.610822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.612241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:48.612447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.627234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.627837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.628352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.701895 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-830438d7-630d-46e4-a913-9772e5dbd0bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972778 Oct 13 08:35:48.702593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 292/563] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:48.709812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e8b9bd-e6c9-4661-a967-a36c26e98b31", "tag": "e97c2a29-be58-4d94-be68-6e7ab62e96c1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:48.759680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.760177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.760613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.773964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.797684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] Creating event network-changed:e97c2a29-be58-4d94-be68-6e7ab62e96c1 for instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 on n-h2-858384-11 Oct 13 08:35:48.799867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.803174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:48.813721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-21acc4d0-c7b3-4a9c-b632-8220bbce4f16 req-f10ccdd7-e724-4298-b0b6-d35df948a10f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109481 Oct 13 08:35:48.817379 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-66c5c465-32ab-4562-82ed-1eff3efb27e8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1458 microversion: 2.91 time: 0.231951 Oct 13 08:35:48.818375 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 272/565] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:48 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1458 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:48.823295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:48.824096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:48.825792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 293/565] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:48.832632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.833491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.834105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.835183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.835792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.836413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.836917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:48.851063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:48.863767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.864259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.864693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:48.865399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:48.865860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:48.866264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.120737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.124664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:49.134500 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7eb63524-7494-44f5-be09-ec50b829c2b5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.305264 Oct 13 08:35:49.146793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0e34a0b-ab38-4c9f-ac81-830148e5562b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 2051 microversion: 2.25 time: 0.321145 Oct 13 08:35:49.146793 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 273/566] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:48 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 2051 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:49.147758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 294/567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:48 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:49.153317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:49.156633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:49.157033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.160158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.170001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.171144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.171271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.172113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.173271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.173950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.174574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.178658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.179212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.179997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.180525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.181302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.280708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:49.281593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:49.282632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:49.283257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:49.284537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:49.364610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.373036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.374226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.374736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.375445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.375953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.376375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.440054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.454353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dfe7f27f-4007-4872-8b47-e60fc85ab946 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.304927 Oct 13 08:35:49.457794 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 295/568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:49 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:49.469654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1509270357", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:49.515219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.529593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.531456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.541807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38d7a005-2f6f-4395-ad4c-1db9fd9a5dce tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "POST /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5/action" status: 202 len: 1494 microversion: 2.75 time: 0.389682 Oct 13 08:35:49.542786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 274/569] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:35:49 2022] POST /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5/action => generated 1494 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 13 08:35:49.547318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:49.553114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.553643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.554082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.555092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.555523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.555946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.581285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1153df0c-bd08-4172-8a90-8d1e825464df tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037281 Oct 13 08:35:49.582012 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 275/570] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Oct 13 08:35:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:49.588770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:49.589621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.591719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:49.595925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.596345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.597211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.597917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.598561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.598928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.700114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.713486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.715722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:49.721574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c17daac9-24a4-449b-bdfe-336284b77be6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.138041 Oct 13 08:35:49.722155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 276/571] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:49 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:49.727454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:49.727986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.741544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.743114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.743595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.744353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.744807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.745232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.796722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:49.824984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb69e9d8-bb0e-4317-9694-5b9e10cccc49 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59/action" status: 202 len: 0 microversion: 2.25 time: 0.101501 Oct 13 08:35:49.825999 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 277/572] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:35:49 2022] POST /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:49.835628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:49.838390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:49.848668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.849697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.850980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.852290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.853143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.854438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.918716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:49.919134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:49.919751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:49.920162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:49.920569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:49.933729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.934208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.934873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.935743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:49.936359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:49.936923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:49.956449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:49.961067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for user e1765243aa04484fb46f41db48beac54 and project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:49.973683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:49.975995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:50.018930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:50.032533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-727f9df6-f566-411d-afb2-b0fd8a6cff7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573404 Oct 13 08:35:50.033663 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 296/573] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:50.038637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:50.042574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75eb52b7-bcc2-468a-83fe-275d8dc0f4e3 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 2056 microversion: 2.25 time: 0.211437 Oct 13 08:35:50.045778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:50.052644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.053316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.053915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.054885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.055096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 278/574] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:49 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 2056 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:50.055694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.056348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.065533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4eede09d-7dbb-43cf-b245-5f3b761dfe11 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:50.070960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4eede09d-7dbb-43cf-b245-5f3b761dfe11 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:50.139439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4eede09d-7dbb-43cf-b245-5f3b761dfe11 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.147084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4eede09d-7dbb-43cf-b245-5f3b761dfe11 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1214 microversion: 2.1 time: 0.090867 Oct 13 08:35:50.147654 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 279/575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:50 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:50.168541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:50.169683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:50.180719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.181142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.181777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.182727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.184163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.185145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.187351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.196666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.199145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.205048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2c3e294-3def-47f6-ba4b-62b631469edb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1506 microversion: 2.91 time: 0.170209 Oct 13 08:35:50.205875 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 297/576] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:50 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:50.455304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.469244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28f08fce-93b6-4ed0-be69-1822e9db9d5e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1503 microversion: 2.1 time: 0.305791 Oct 13 08:35:50.470158 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 280/577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:50 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:50.481660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:50.482638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:50.489507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.491868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.492560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.494959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.495464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.498724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.664689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.672584 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da3ab0f5-74a2-4afd-8b34-501782a95e81 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.195139 Oct 13 08:35:50.673174 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 298/578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:50 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:50.750439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:50.751047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:50.752971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:50.758472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.758954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.759390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.760702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:50.761186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:50.761620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:50.813093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1525631553", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:50.825001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.833645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.834886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:50.839833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3df1146b-c2d1-4586-9ee5-3d682dad7be0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.093212 Oct 13 08:35:50.840393 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 299/579] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:50 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:50.866229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:51.053172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:51.053595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:51.054106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:51.054580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:51.055000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:51.064795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.065276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.065734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.066483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.066955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.067372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.071751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.072385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.079069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.079566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.080007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.080693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.081171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.081771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.084571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:51.089239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:51.100596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:51.102981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:51.157019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a44776bf-c090-44ea-869c-6f541e2f82ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456709 Oct 13 08:35:51.158111 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 281/580] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:51.171730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-625d838e-2a74-46a4-b37b-bf32fb719f7e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.172408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-625d838e-2a74-46a4-b37b-bf32fb719f7e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.278629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-625d838e-2a74-46a4-b37b-bf32fb719f7e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.291445 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-625d838e-2a74-46a4-b37b-bf32fb719f7e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1213 microversion: 2.1 time: 0.123914 Oct 13 08:35:51.292242 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 282/581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:51.305641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.308121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.320574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.327140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.327611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.328349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.329069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.329499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.351074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:51.379695 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e0b517e-170b-4d2c-857b-6c14608c3a14 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 2036 microversion: 2.25 time: 0.310957 Oct 13 08:35:51.391837 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 300/582] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 2036 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:51.403010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.403010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.403010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.403445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.403876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.413791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.414282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.414755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.447672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.456247 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8c008b9-38ec-486b-b6e9-afee1c38f6c4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1210 microversion: 2.1 time: 0.159395 Oct 13 08:35:51.457159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 283/583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:51.466121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": "auto"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:51.468915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.475312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.475919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.476464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.477621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.478328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.479701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.512006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'flavor' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:51.512343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.526515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127030) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:35:51.526746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.527984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.535279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6462f74-1333-4135-8951-942bb59cb021 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1506 microversion: 2.91 time: 0.145853 Oct 13 08:35:51.536400 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 301/584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:51.541760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.542572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.548989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.549469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.549986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.550757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.551321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.551849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.556731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:51.694078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.718097 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3328a124-c001-41ca-be3a-8f2e39b2ba66 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1493 microversion: 2.1 time: 0.178503 Oct 13 08:35:51.719413 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 302/585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1493 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:51.724895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.725776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.738827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.741852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.742487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.743329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.744644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.747083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.913773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:51.922944 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c2b8a3d-b228-4e4a-bd78-7e69ce6d903a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.202262 Oct 13 08:35:51.923528 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 303/586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:51.927979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed82823b-d238-4e42-b67b-c3d9b6ad6d8d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '.version_select at 0x7f5376f5f4c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.931581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed82823b-d238-4e42-b67b-c3d9b6ad6d8d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.932062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed82823b-d238-4e42-b67b-c3d9b6ad6d8d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.932501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed82823b-d238-4e42-b67b-c3d9b6ad6d8d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.948957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed82823b-d238-4e42-b67b-c3d9b6ad6d8d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1129 microversion: 2.1 time: 0.024314 Oct 13 08:35:51.949543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 304/587] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/os-migrations => generated 1129 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:51.954767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:51.955555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:51.961994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.963041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.963647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:51.964500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:51.965294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:51.965864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.065257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:52.076026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:52.078221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:52.085633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-047d318d-fbef-4340-a67c-cfa5508d01e4 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.134966 Oct 13 08:35:52.086660 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 305/588] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:51 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:52.113707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:52.115333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:52.127311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.127964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.129457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.130256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.130799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.131459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.373161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20bf1692-6c0b-4e30-ae4c-a5420b64de93 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1646 microversion: 2.1 time: 0.271851 Oct 13 08:35:52.386989 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 306/589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:52 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1646 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:52.403391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:52.404343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:52.409996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.410507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.410946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.411650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.412080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.412500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.490912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:52.500203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53e42ef3-c11b-4580-aabd-5b55ba767fbc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1265 microversion: 2.1 time: 0.112013 Oct 13 08:35:52.500969 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 307/590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:52 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:52.506641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:52.507252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:52.513394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.514111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.514733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.515593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:52.516333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:52.516760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:52.583317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:52.592495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a70aec6-e203-475d-8e3f-a772eca14618 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1210 microversion: 2.1 time: 0.090607 Oct 13 08:35:52.593072 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 308/591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:52 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:52.598045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1053466092", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "855f3368-1207-411b-b46e-0f9d164fb505"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:52.655322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] validate_networks() for [('855f3368-1207-411b-b46e-0f9d164fb505', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:35:53.106535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:35:53.106958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:35:53.107634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:35:53.108204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:35:53.108774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:35:53.120038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.120712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.121308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.122300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.122934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.123522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.157732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:35:53.161567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for user c6b6dd069e4f4c57a9f41197a2cc25d5 and project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:35:53.173192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:35:53.175414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:35:53.223005 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80889a14-39dd-44bf-a9d6-fd6304deafe1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628647 Oct 13 08:35:53.229503 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 309/592] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:35:53.229503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.229503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.238323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.239288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.239288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.240000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.240457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.240886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.309682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.319545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.320891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.327562 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6de265f-6e07-43a5-9039-92349bbd02a9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1512 microversion: 2.91 time: 0.102799 Oct 13 08:35:53.328588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 310/593] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:53.341815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.342468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.355066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.355579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.356185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.357157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.357579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.358046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.428461 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de5af9b2-d70d-4079-baee-e681f47ef061 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59/action" status: 202 len: 0 microversion: 2.25 time: 1.969876 Oct 13 08:35:53.429821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 284/594] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:35:51 2022] POST /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59/action => generated 0 bytes in 1972 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:53.438004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.440676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.450089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.450842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.451485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.452526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.453230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.454140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.574254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.583907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.585349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.591089 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1fbbf0ff-2d28-4d3e-8308-ef278516be09 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.159819 Oct 13 08:35:53.591659 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 285/595] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:53.594630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.596027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a472b166-5566-4d88-a3a0-340d87686c20 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.597260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a472b166-5566-4d88-a3a0-340d87686c20 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.605801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0596334a-c5f5-4378-bff0-ed9552104d7c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.275720 Oct 13 08:35:53.615220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 311/596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:53.621089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.621813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.628812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.629304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.629741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.630570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.631193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.631625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.670675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a472b166-5566-4d88-a3a0-340d87686c20 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.679962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a472b166-5566-4d88-a3a0-340d87686c20 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1211 microversion: 2.1 time: 0.087159 Oct 13 08:35:53.680919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 286/597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:53.686197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.687323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.693652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.694329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.694996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.695867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.696644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.697293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.784572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.797060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4773296-35d2-45a3-a6f7-0696b1f815fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1271 microversion: 2.1 time: 0.114564 Oct 13 08:35:53.799462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 287/598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:53.819519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:53.820205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:53.824786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.832918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.833418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.833858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.836140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.836980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:53.837512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:53.837952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:53.838765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.840137 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd590987-64bf-490a-9af5-dbedfc63a3a2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.223774 Oct 13 08:35:53.858291 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 312/599] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:53.933813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:53.942622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fea05e0d-fd1a-446f-b1d5-245c6c31d37b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1266 microversion: 2.1 time: 0.141395 Oct 13 08:35:53.943459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 288/600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:53 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:54.356097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:54.356704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:54.363194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.363668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.364096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.364776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.365225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.365645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.427601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:54.436334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:54.437857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:54.442818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08a167f5-de20-419e-87fb-48993e538808 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1512 microversion: 2.91 time: 0.090599 Oct 13 08:35:54.443385 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 313/601] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:54 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:54.619548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:54.620161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:54.623951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:54.631205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:54.631811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:54.640640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.642097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.642786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.643391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.644045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.644476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.645232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.645685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.646107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.653859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.654658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.655265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.801499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:54.809443 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77b98a80-d2e5-4a6f-a40d-39fd58dea717 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.181942 Oct 13 08:35:54.810051 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 314/602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:54 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:54.815787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:54.816582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:54.823546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.824044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.824480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.825222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.825785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.826238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.892251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:54.901068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d6120e3-7993-4e84-ae60-e63b59fb03ff tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1269 microversion: 2.1 time: 0.089002 Oct 13 08:35:54.902092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 315/603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:54 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:54.907060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:54.907744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:54.913949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.914558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.915112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.916477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:54.917050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:54.917571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:54.989854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.000964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.002318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.018528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df9f53c9-d034-4690-b262-822a7c740142 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.402939 Oct 13 08:35:55.019444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 289/604] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:54 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:55.023967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:55.026503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:55.037078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.037582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.038017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.039518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.040174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.041359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.104641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.124125 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09b266f8-85ab-4ce8-b0ca-109dcf5ef3dc tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.220703 Oct 13 08:35:55.150268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 316/605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:54 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:55.158734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:55.169615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:55.182577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.183535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.187451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.188391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.189036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.189807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.509880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.519405 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-01c368aa-a32a-4771-baa8-03bf807cffa6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1266 microversion: 2.1 time: 0.367917 Oct 13 08:35:55.520320 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 317/606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:55 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:55.540084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.542821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e8b9bd-e6c9-4661-a967-a36c26e98b31", "name": "network-vif-plugged", "status": "completed", "tag": "e97c2a29-be58-4d94-be68-6e7ab62e96c1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:55.553328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.554064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.554638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.556051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.561245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.563322 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-176cb759-3cbb-46b5-b496-87229ac1c80b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.542743 Oct 13 08:35:55.574780 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 290/607] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:55 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:55.574892 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] Creating event network-vif-plugged:e97c2a29-be58-4d94-be68-6e7ab62e96c1 for instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 on n-h2-858384-11 Oct 13 08:35:55.578371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:55.585192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a365c9fe-b3fc-4498-9dce-c0d0f40dba61 req-199c3e03-2732-4e5e-8ec2-dc8f052a39e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051968 Oct 13 08:35:55.586120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 318/608] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:55.589126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.589903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.590198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.593386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:55.594644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:55.600418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.601040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.601480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.602484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.602618 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] Creating event network-changed:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h1-858384-11 Oct 13 08:35:55.603460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.603924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.608607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9c496ac3-7777-43aa-9856-bb79874ff676 req-b2b327a1-e453-406c-9bf5-e019601bb86d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034985 Oct 13 08:35:55.609381 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 291/609] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:55.671741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.680040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.681498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:55.686309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdce32c5-d641-4b8c-8ea3-146c1c62c03f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1512 microversion: 2.91 time: 0.098900 Oct 13 08:35:55.687230 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 319/610] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:55 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:55.835054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:55.835974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:55.843841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.844458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.845108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.846060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.846764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.847541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.925987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:55.926739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:55.934844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.935324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.935751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:55.936449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:55.936896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:55.937316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.017554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.023921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:56.035395 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9057a00a-df1e-44db-a427-e9af007e3178 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1269 microversion: 2.1 time: 0.113636 Oct 13 08:35:56.036275 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 320/611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:55 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:56.047726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:56.048855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:56.057505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.058516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.059197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.060281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.062131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.063016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.143966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.153819 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88de0a83-facf-4228-98bd-a8804e57920f tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.323956 Oct 13 08:35:56.154736 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 292/612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:55 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:56.160285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:56.160971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:56.168063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.168818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.169464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.170376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.170944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.171445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.192887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.241613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.242961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.251138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f0a92a1-b747-4fcc-8933-272eff6c7202 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.207707 Oct 13 08:35:56.268017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 321/613] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:56.391991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.402145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56e3f755-1100-42ea-8b53-e8658768e603 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.245529 Oct 13 08:35:56.403092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 293/614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:56.545640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:56.546354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:56.553175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.553663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.554095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.554839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.555340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.555764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.595122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:56.596301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:56.607103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.608174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.610221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.610585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.611117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.611607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.650311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.658525 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c201088c-30ab-4289-9480-4a96a1f3e7e6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1266 microversion: 2.1 time: 0.117606 Oct 13 08:35:56.659396 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 322/615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:56.718143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:56.719330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:56.725576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.726590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.727199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.728842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:56.729341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:56.729769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:56.815413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.825831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.827683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.829413 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4d543cc-3507-4266-a5bf-e6b39076e138 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.243026 Oct 13 08:35:56.830341 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 294/616] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:56.855264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.864844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.866712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:56.872741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18cb0ae9-5357-4b4f-a4aa-0d53e18e9b5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1533 microversion: 2.91 time: 0.161635 Oct 13 08:35:56.873526 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 323/617] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1533 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:35:57.030621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.035464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.052827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.053575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.054213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.055821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.056715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.057430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.060167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.061130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.072688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.073588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.074243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.075196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.078162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.079165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.319476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lazy-loading 'services' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:57.332740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:57.343340 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56ee01df-6907-43b6-9fb1-276c1f5dc8a9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1940 microversion: 2.91 time: 0.445589 Oct 13 08:35:57.344228 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 295/618] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:56 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1940 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:57.349064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.349932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.359210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.359960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.361232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.362154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.362953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.363594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.422398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.431767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9cfbdb9-5db3-45c6-be6b-3e7c53cc3ebf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.375161 Oct 13 08:35:57.432519 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 324/619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:35:57.437421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.438165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.443990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.444837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.445488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.446400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.447188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.447895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.527168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.537292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.541175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.546355 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0488e5b8-bfa8-4a56-8353-bb7e46c1dc88 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.112613 Oct 13 08:35:57.560247 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 325/620] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:57.560247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.560247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.560247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.560686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.560686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.561218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.561436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.561869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.689851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lazy-loading 'services' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:57.708925 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6fd6512f-22f8-4265-9a60-8a5698696348 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1940 microversion: 2.91 time: 0.160748 Oct 13 08:35:57.709615 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 326/621] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1940 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:57.727206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.729370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.740995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.741723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.742939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.743718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.744566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.745845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.746605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.764490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45ed14be-0199-4061-89c4-df33cd873d1c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1323 microversion: 2.1 time: 0.417637 Oct 13 08:35:57.774962 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 296/622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:57.784655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.785272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.792218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.792703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.793132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.793830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.794279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.794977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.925301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:57.936510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fab9e4a4-361f-47e9-9a1e-22360527bdad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1272 microversion: 2.1 time: 0.160326 Oct 13 08:35:57.937335 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 297/623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:57.942561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.946498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.947263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.947943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.949296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.950003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.950818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.978680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0249cf5f-8c55-4258-90a3-31778936fc20 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.039294 Oct 13 08:35:57.980060 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 298/624] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:35:57.984855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:57.985650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:57.992719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.993512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.994007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:57.995262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:57.996667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:57.996807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.121826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.129560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ecbe010-2a77-4f0d-85ef-554d2955afb8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.418674 Oct 13 08:35:58.130361 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 327/625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:58.135267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:58.135985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:58.141959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.142677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.143289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.144156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.144762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.145354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.168887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lazy-loading 'flavor' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:35:58.445266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-641e8dda-1c11-4f99-9055-a600274567ad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action" status: 202 len: 0 microversion: 2.91 time: 0.313183 Oct 13 08:35:58.445962 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 328/626] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:35:58 2022] POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:58.454299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:58.467798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.468048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.468570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.480743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] Creating event network-changed:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:35:58.486300 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-323b76e9-3643-4d3d-90ba-f4223de429c3 req-58678893-03e1-414c-8d9d-c981dbe50ad4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038734 Oct 13 08:35:58.487174 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 329/627] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:58.495191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:58.496062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:58.505451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.506136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.506545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.507301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.507952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.508557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.547048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.555551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.557662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.558873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5db1aa19-a33d-4abc-89b9-8c588d3c1ebf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.577594 Oct 13 08:35:58.575268 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 299/628] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:57 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:58.582388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:58.583588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:58.589385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.589878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.590316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.591074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.591527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.591949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.713239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.723918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.725513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.732408 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-817e6ac2-5cd0-438b-9d15-1a9313c9b29f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.156390 Oct 13 08:35:58.743756 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 300/629] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:58 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:58.751930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:58.752678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:58.760749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.761495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.762027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.762859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.763416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.763938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.956545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:58.964789 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39b44943-7865-4617-83fd-bcad033fc7a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.475908 Oct 13 08:35:58.965464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 330/630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:58 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:58.984909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:58.985516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:58.991687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.992172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.992603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:58.993299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:58.994236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:58.994679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.171911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.182439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.184402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.189674 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b148934-2821-44a6-808b-74aa9dd97184 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.444682 Oct 13 08:35:59.190565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 301/631] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:58 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:35:59.195434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.196283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.202743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.203470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.204374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.205302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.206098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.206785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.306067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.314443 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ad19c27-9da6-4eac-a063-5ae88ffe9345 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1272 microversion: 2.1 time: 0.122464 Oct 13 08:35:59.315028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 302/632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:59 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:59.324471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.325284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.332916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.333640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.334082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.335556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.336036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.336590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.343622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.351263 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-44f9b881-2028-48dd-a80e-76920f89a1ff tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1473 microversion: 2.1 time: 0.370267 Oct 13 08:35:59.369757 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 331/633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:58 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:59.375203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.375919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.382068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.382813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.383241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.383942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.384914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.385335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.408555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Request method failure captured: Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31/diagnostics HTTP/1.1 Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83bt8dldSmboDzSa5HDt7tAZYRDUXbUK6mEeeQihHQAd3YWggVTfimTYx6eWMaTBEOvlevdtl1s5tSKP9M71GJmnIiLtwrB6Km59K8L3hTsxQiAllPN0rB7lh0Q4NPYCJND0MSKCnMJZyVKUEC6vQRB4Ua8FI-tj-1Ro8_sK3MM3lQ Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 8e4e09c7157949bca928e509abfef71d Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:35:59.410612 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e4e09c7157949bca928e509abfef71d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 8e4e09c7157949bca928e509abfef71d Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiagnosticsNegativeTest-538791567-project Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 7716895497df4077ac7967afb033c26f Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-538791567-project Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:35:59.412025 n-d-858384-11 devstack@n-api.service[127031]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'f1e8b9bd-e6c9-4661-a967-a36c26e98b31'} Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:35:59.412772 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:35:59.414453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:35:59.416308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21e041bb-ad16-4b03-9279-84e000c7f284 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.040993 Oct 13 08:35:59.417001 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 332/634] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:35:59 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31/diagnostics => generated 117 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:35:59.433658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.434068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.437153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:59.445006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.445662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.446379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.447648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.448089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.448502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.481997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:35:59.629036 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef4678e2-0d55-4213-82cb-ba9d6b4eef8c tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 204 len: 0 microversion: 2.1 time: 0.200926 Oct 13 08:35:59.630029 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 333/635] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:35:59 2022] DELETE /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:35:59.645072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee2b36a-ea79-4853-98d8-fabbe1cdb884", "tag": "839a253a-27a0-4254-8f21-3655f4cbd69a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:35:59.671017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.671398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.677205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.694840 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] Creating event network-changed:839a253a-27a0-4254-8f21-3655f4cbd69a for instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 on n-h1-858384-11 Oct 13 08:35:59.701148 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3a7ea24e-179e-4c84-8e6a-726566b2ee14 req-d6caa3d9-cfd6-4630-9143-cd4e0b4e1e02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069378 Oct 13 08:35:59.702742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 334/636] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:35:59.709883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.711090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.721707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.722774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.723602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.724489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.725350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.725854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.732372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:35:59.753713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:35:59.769145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2c9fa75-202e-4dd9-aef7-09795a5236a8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.452765 Oct 13 08:35:59.778734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 303/637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:59 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:35:59.794653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:35:59.795474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:35:59.802194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.802993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.803697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:35:59.804578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:35:59.805199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:35:59.805780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.028217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.038720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.040553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.041955 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69f8758d-a8fc-4ac7-a37d-3c8c3e75279f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.337955 Oct 13 08:36:00.042531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 335/638] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:35:59 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:00.067868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:00.068472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:00.076274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.077053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.078674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.079683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.080306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.080884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.160586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.168465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.170036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.172001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.177875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dbba540b-b3b1-4a31-a2da-bcb95d4ab9cb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.120043 Oct 13 08:36:00.179077 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 336/639] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:00 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:00.179223 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17f2d34c-3287-415a-9634-56ca73ff6e02 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1479 microversion: 2.1 time: 0.397876 Oct 13 08:36:00.185095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:00.186047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:00.191724 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 304/640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:35:59 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1479 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:00.192660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.193311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.193911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.194788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.195389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.196121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.218737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:00.219261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:00.227366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.229470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.230506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.232357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.233542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.234166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.360890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.371145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.372844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.377629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.378557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e15b19f-c950-473c-93a9-fbd7586d7dad tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.164382 Oct 13 08:36:00.379324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 305/641] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:00 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:00.384166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:00.385543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:00.399415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.404874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d81a237b-cf4f-4ecf-8766-cfea4e95007c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.224442 Oct 13 08:36:00.405771 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 337/642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:00 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:00.406074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.406595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.407342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.407809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.408244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.640263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:00.650087 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36f6057e-f490-49b4-bcc7-b665904ddae1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.269548 Oct 13 08:36:00.650888 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 306/643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:00 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:00.675719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5dea53-e2ce-46bd-9b5f-a1c92c84de59", "name": "network-vif-unplugged", "status": "completed", "tag": "10e40049-79d3-4179-b381-ed58724b5472"}, {"name": "network-changed", "server_uuid": "3b5dea53-e2ce-46bd-9b5f-a1c92c84de59", "tag": "10e40049-79d3-4179-b381-ed58724b5472"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:00.687672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.688276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.688867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.700733 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Creating event network-vif-unplugged:10e40049-79d3-4179-b381-ed58724b5472 for instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 on n-h1-858384-11 Oct 13 08:36:00.701365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] Creating event network-changed:10e40049-79d3-4179-b381-ed58724b5472 for instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 on n-h1-858384-11 Oct 13 08:36:00.707092 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-153b6368-5018-4a97-b092-b32e9b5913c2 req-816fddd6-b4cb-4f61-af48-42b9f3fc6933 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035021 Oct 13 08:36:00.707865 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 338/644] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:00.803833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:00.804420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:00.817894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.818399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.818973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:00.819737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:00.820188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:00.820656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.017810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.026599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3bbbec08-1f0a-42e6-8a11-693354e82b3b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.226495 Oct 13 08:36:01.027177 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 307/645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:00 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:01.072042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.073240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.080583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.081153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.081757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.082591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.083139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.083621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.205738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.206423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.213342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.213833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.214290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.215051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.215498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.216052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.339033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.348956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.350868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.352226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-28c3baf4-e97c-4446-92ff-434b35667536 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.285519 Oct 13 08:36:01.357340 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 339/646] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:01.358932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.359766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.366948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.367840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.368675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.369649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.370347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.371271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.373972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.382745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9c5cdec-42c5-4eec-90e2-3138e092da7a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1479 microversion: 2.1 time: 0.182148 Oct 13 08:36:01.401495 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 308/647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1479 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:01.408686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.409683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.416006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.416727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.418792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.420339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.420805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.421556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.469112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.477672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.479871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.484918 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52d43dc0-94cf-4304-93c5-be7a82b49687 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.129808 Oct 13 08:36:01.485488 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 340/648] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:01.500899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.501842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.508461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.509270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.509919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.510874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.511523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.512143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.557855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.565471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.566947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.571844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-373156de-e8ac-486b-8ebf-929f509e4bea tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.167400 Oct 13 08:36:01.583475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 309/649] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:01.674688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:01.675459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:01.681356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.681852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.682269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.683014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.683474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.683900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.773180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.784762 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e0f3f7c-d20f-4fa2-8be5-35733c2a4e70 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.287558 Oct 13 08:36:01.794467 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 341/650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:01.794467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f27e3ec-05b3-4a22-af1d-4e78cf511500", "tag": "74e59cb1-3537-4e2b-a7a5-0511d5710d36"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:01.798954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:01.799427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:01.799861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:01.811707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] Creating event network-changed:74e59cb1-3537-4e2b-a7a5-0511d5710d36 for instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 on n-h2-858384-11 Oct 13 08:36:01.816678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-88f20945-76d2-46c9-bbaf-5ace95e9b186 req-1239d6d3-c384-44fb-9fa8-d6042c16d216 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030196 Oct 13 08:36:01.817279 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 342/651] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:01.971229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:01.991293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c79b3784-7f2e-4924-92a4-e4fb3a24f741 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.320981 Oct 13 08:36:01.992584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 310/652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:01 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:02.054161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.055303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.062534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.063678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.064352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.065274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.066349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.067018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.309443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.317275 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52cbac70-d0b4-449d-a2ec-7550979f185b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.270192 Oct 13 08:36:02.317843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 343/653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:02.377857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.378762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.385444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.385944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.386375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.387460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.387921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.388344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.422705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.424089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.434456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.434959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.435403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.436179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.436638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.437125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.507510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.518821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37c7a515-9664-4e4b-a9a2-c3f3a3b011e4 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1437 microversion: 2.1 time: 0.104116 Oct 13 08:36:02.520762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 344/654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:02.526328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.527228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.535109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.535563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.536001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.536738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.537188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.537609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.614035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.625819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.627327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.633643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66cc23b9-ebde-4c0a-8c8e-50ee928afd58 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.111306 Oct 13 08:36:02.635608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 345/655] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:02.643840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.644023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "name": "network-vif-plugged", "status": "completed", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:02.653796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.654020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.654359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.654814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.656252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.657615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b585fb5a-d52b-469c-88f3-cfc5177aa038 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.283942 Oct 13 08:36:02.658525 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 311/656] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:02.663612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.664405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.668596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] Creating event network-vif-plugged:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h1-858384-11 Oct 13 08:36:02.671861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.672349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.673159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.673400 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-865c4eff-b63f-405e-a67a-bd70f48192ff req-0541c6c2-69cf-4dd5-abaf-62c5f7095aab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036671 Oct 13 08:36:02.674158 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 346/657] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:02.674716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.675395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.676739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.724109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e8b9bd-e6c9-4661-a967-a36c26e98b31", "name": "network-vif-deleted", "tag": "e97c2a29-be58-4d94-be68-6e7ab62e96c1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:02.734936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.735401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.735823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.747555 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] Creating event network-vif-deleted:e97c2a29-be58-4d94-be68-6e7ab62e96c1 for instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 on n-h2-858384-11 Oct 13 08:36:02.752678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5b0fa709-c5bb-48a1-b019-b6ead4d12a26 req-518e5eb8-4dc4-4708-9a8d-314f2a4674d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032993 Oct 13 08:36:02.753434 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 347/658] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:02.780905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.792061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.793592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.798474 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80e0788a-bdc5-4111-9ae5-ce116bf0d072 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.138760 Oct 13 08:36:02.799038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 312/659] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:02.808866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:02.809564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:02.816791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.817701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.818382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.819166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:02.819746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:02.820296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:02.960503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:02.968101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7e383b2-c28d-45cf-a34a-1377bc9c67d8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.163717 Oct 13 08:36:02.968665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 348/660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:02 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:03.014980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.015588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.021445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.021920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.022353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.023140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.023592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.024702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.027345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:03.341517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.342286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.344372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:03.345243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=26 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:03.351542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.351973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.352414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.353754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.354252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.354704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.420974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.429173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-745809ae-a1a1-4088-a3c8-f7e4335d73d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.418013 Oct 13 08:36:03.429741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 313/661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:03.487459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.495106 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-397da854-5966-4b33-bd29-0f4d98d61dbb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1313 microversion: 2.1 time: 0.158017 Oct 13 08:36:03.495661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 349/662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:03.543221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.543833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.549703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.550188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.550659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.551348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.551799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.552231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.611567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.619171 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b1e9ff4a-863d-43a2-8007-52dad702168e tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1437 microversion: 2.1 time: 0.080600 Oct 13 08:36:03.619766 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 314/663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:03.665326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.665929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.671843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.672318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.672749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.673433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.673880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.674300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.686366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.687017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.688821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=62 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:03.694606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.694899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.695497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.696255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.697288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.697623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.742704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.750836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.752280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.757231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35b01376-be34-48c3-8543-4b2b2c76e737 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.095849 Oct 13 08:36:03.757980 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 350/664] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:03.825673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.826265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.826428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:03.832686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.833167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.833596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.834277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:03.834528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.834746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:03.835165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:03.835977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.837166 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8ddefd9-2799-450b-98f4-0a09df2096de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.154534 Oct 13 08:36:03.838549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 315/665] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:03.897229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.905832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.907352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:03.912001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c81b55c1-c5b2-4ed2-bf3e-00694ca0f717 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.090819 Oct 13 08:36:03.912555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 351/666] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:03.991271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:03.991990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.000583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.001065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.001498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.002191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.002661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.003079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.137802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.145995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7827bdf8-9f49-4835-8f0f-6f2e678c2116 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.158801 Oct 13 08:36:04.146513 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 316/667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:03 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:04.451540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.452908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.459390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.460156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.460473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.461171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.461614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.462059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.518104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.518929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.526114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.526905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.527568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.528342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.528991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.529485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.604159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.613299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6820af3b-4681-42fe-9ba8-9d21d417fd7b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.165627 Oct 13 08:36:04.614198 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 352/668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:04.643212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.643819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.649816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.650220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.650679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.652028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.652028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.652224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.672832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.680924 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ab9c355-f8a2-439e-8bd4-4ad1798b2473 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1463 microversion: 2.1 time: 0.166563 Oct 13 08:36:04.682217 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 317/669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:04.684320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.684813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.685224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.685661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lazy-loading 'fault' on Instance uuid f1e8b9bd-e6c9-4661-a967-a36c26e98b31 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:04.726814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.735597 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac2ec09f-5eb1-4706-bdeb-1608929a2d2b tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1313 microversion: 2.1 time: 0.096354 Oct 13 08:36:04.736416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 353/670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:04.755141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.755754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.761641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.762138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.762598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.763291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.763743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.764165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.788735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.789605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.796240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.796737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.797178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.797887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.798342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.798803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.803530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:04.864192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.872364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.873807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:04.879127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-563208f3-46d1-40c8-a6b8-cf49c8d111d0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.094925 Oct 13 08:36:04.879632 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 354/671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:04.904766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:04.905322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:04.912358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.913069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.913793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:04.914522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:04.915157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:04.916294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.034036 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28214544-fa3a-4edf-b90a-d2341ac2cb86 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1616 microversion: 2.1 time: 0.334100 Oct 13 08:36:05.044313 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 318/672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1616 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:05.050282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.050995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.057719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.058289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.058844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.059610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.060133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.060647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.074773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.084989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.086887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.088229 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7340916d-c992-40fc-bda7-66882957d5f8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.192786 Oct 13 08:36:05.088745 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 355/673] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:04 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:05.094102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:05.094868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.108285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.108875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.109678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.110485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.111160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.111922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.132435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.141071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.142822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.147738 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ac1b543-4e2f-40aa-ac17-199463919b91 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.101840 Oct 13 08:36:05.148760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 319/674] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:05.168800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.169329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.175194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.175678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.176114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.177030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.177482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.177904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.190843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dec1894ad3634352b78498c20407d5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf3f0eb48244598a8d29911f2a4ae6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.191433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] flavor_id is None. Assuming migration. {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 13 08:36:05.191870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 08:36:05.306943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.315125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c05b1644-975a-41a6-b583-e072ab8c9e73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.150532 Oct 13 08:36:05.315720 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 320/675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:05.514684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de049707-6f17-4780-ad44-06aaeeaec9ea tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221/action" status: 202 len: 0 microversion: 2.1 time: 0.424645 Oct 13 08:36:05.515289 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 356/676] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:05 2022] POST /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:36:05.523198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.523809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.530180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.530850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.531125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.531898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.532263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.532680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.637194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.637809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.644035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.644457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.644899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.645600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.646056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.646496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.705547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.714256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17d370c2-d039-4a33-aa79-1b0d9ebba49a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.194668 Oct 13 08:36:05.715101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 321/677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:05.747346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.748038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.754660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.755874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.756575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.757500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.758055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.758760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.786798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.790783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:36:05.797750 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe09f884-10e7-4a26-bc50-8c6800e633d5 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.164343 Oct 13 08:36:05.798563 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 357/678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:05.803103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.804158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.818104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.818758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.819327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.820188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.821056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.822740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.857917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.858928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.859055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.859570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lazy-loading 'fault' on Instance uuid f1e8b9bd-e6c9-4661-a967-a36c26e98b31 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:05.876970 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50b559ee-5297-4b93-b9cf-e7e09898c3dd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 204 len: 0 microversion: 2.1 time: 0.133944 Oct 13 08:36:05.877798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 322/679] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:36:05 2022] DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:36:05.907001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:05.911089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:05.911846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:05.916824 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-abc58c99-6b67-4bad-b920-de1581cc9225 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1313 microversion: 2.1 time: 0.117465 Oct 13 08:36:05.917829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 358/680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1313 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:05.931599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.932187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.932633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.933421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:05.933874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:05.934295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:05.998561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-765402786", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "1863734187", "adminPass": "***", "networks": [{"uuid": "d08e537b-1238-4354-9155-b6cf1b700138"}], "security_groups": [{"name": "tempest-securitygroup--743865233"}], "key_name": "tempest-keypair-571656106", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:06.006722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.015230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.016660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.021567 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce87033a-0f2e-491a-aa8f-5f53a1e07e1d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.114565 Oct 13 08:36:06.022125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 323/681] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:05 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:06.114043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.114677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.121924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.122438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.122874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.123569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.124010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.124432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.131823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] validate_networks() for [('d08e537b-1238-4354-9155-b6cf1b700138', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:06.268583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.277061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.278553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.279744 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8f54c42-500e-4ef3-89af-401a034e2a8a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.169563 Oct 13 08:36:06.280515 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 324/682] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:06.287246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.288334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.294905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.295616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.296243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.297135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.297762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.298383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.373882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.382865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.385226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.389153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:06.392094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cddc1fc-92e2-4c5a-a39d-986c94a02bc6 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.108533 Oct 13 08:36:06.392931 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 325/683] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:06.397446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.398048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.404156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.404645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.405176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.405762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.406208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.406674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.551032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.560256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f35fafa-af9b-4165-ae96-7ceecb6cff03 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.166531 Oct 13 08:36:06.561071 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 326/684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:06.566314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:06.566922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:06.567601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:06.568283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:06.568765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:06.578385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.579260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.579614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.580520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.580986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.581410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.594968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee2b36a-ea79-4853-98d8-fabbe1cdb884", "name": "network-vif-plugged", "status": "completed", "tag": "839a253a-27a0-4254-8f21-3655f4cbd69a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:06.600258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for project a695033da9494b63aa3f1b4e6927efd1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:06.605678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Getting quotas for user a8d17f582a274ea9b07f376fcfdcb19e and project a695033da9494b63aa3f1b4e6927efd1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:06.607279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.607899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.608689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.619027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:06.621860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] Creating event network-vif-plugged:839a253a-27a0-4254-8f21-3655f4cbd69a for instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 on n-h1-858384-11 Oct 13 08:36:06.622222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:06.626814 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-edc1841b-3917-47ca-9ef8-2584a6c976dc req-7dc072a9-5c96-4a14-be42-ec8b15210948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035735 Oct 13 08:36:06.627772 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 327/685] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:06.675937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3eb43f0-cfd6-4ba7-bc67-0feceb9859f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681587 Oct 13 08:36:06.676833 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 359/686] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:36:06.688765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6292888-8d30-4bde-aee3-af301878a577 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.689751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6292888-8d30-4bde-aee3-af301878a577 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.737348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.738263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.749823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b6292888-8d30-4bde-aee3-af301878a577 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.752600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.753154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.753603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.754551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.755058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.755489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.757868 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6292888-8d30-4bde-aee3-af301878a577 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1263 microversion: 2.1 time: 0.073397 Oct 13 08:36:06.758481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 328/687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1263 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:06.821168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.822526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.829570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.830167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.830584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.831285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.831731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.832432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.921469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:06.930951 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3aadaf5a-5e9c-47e5-b633-11d095c8d5f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.197692 Oct 13 08:36:06.932011 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 360/688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:06.942084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:06.942724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:06.951417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.952245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.952857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.954343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.955060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.955496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.995173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:06.995704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:06.996268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:06.996737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lazy-loading 'fault' on Instance uuid f1e8b9bd-e6c9-4661-a967-a36c26e98b31 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:07.019271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.021583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:07.033784 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e4b21ac-b305-4d66-8747-a788fbc4aeef tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.216426 Oct 13 08:36:07.034591 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 329/689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:07.050337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.057200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.058044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.059562 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fde7e18f-48f4-46cb-8733-1655dfe5a3d9 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1313 microversion: 2.1 time: 0.121558 Oct 13 08:36:07.060455 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 361/690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:06 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1313 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:07.064957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.065668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.066100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.066837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.067445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.067890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.150880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.161471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.163155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.169978 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71a478dd-ba8e-4d12-a27a-a51bbc9312b9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.117749 Oct 13 08:36:07.171026 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 330/691] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:07.304959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.305578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.307988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:07.313199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.313683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.314119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.314890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.315336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.315765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.420696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.421330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.427312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.427789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.428226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.428899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.429342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.429757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.518577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.524232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.539495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.542623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.543979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.544406 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd16d8ea-9b2d-4127-a6ce-8a02e960ea11 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.243095 Oct 13 08:36:07.545868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 362/692] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:07.548070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.558959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbed36ca-5a87-4607-b57f-4cc525e08826 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.143141 Oct 13 08:36:07.560219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 331/693] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:07.583979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.584597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.591254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.591737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.592378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.593084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.593528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.594117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.785230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.786175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.795177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.795919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.796577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.797498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.798156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.798837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.818931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.841555 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-492b3524-3136-4750-b85e-d21e59025671 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1311 microversion: 2.1 time: 0.261364 Oct 13 08:36:07.855559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 363/694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:07.875025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:07.883173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32051dcf-c9b8-4866-bf91-62be18f90d56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1267 microversion: 2.1 time: 0.104900 Oct 13 08:36:07.883752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 332/695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:07.955061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:07.955700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:07.961732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.962791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.963228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:07.963925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:07.964383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:07.964807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.056669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.057532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.059190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:08.064972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.065458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.065894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.066623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.067076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.067504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.101485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.109300 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96d950bf-aa2a-4d0b-8f66-bbe4cbb961b6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.158359 Oct 13 08:36:08.109867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 364/696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:07 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:08.114359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.114990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.120752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.121236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.121670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.122449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.122907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.123331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.155921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.156410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.156847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.157300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lazy-loading 'fault' on Instance uuid f1e8b9bd-e6c9-4661-a967-a36c26e98b31 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:08.203448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.211770 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a98405cc-6220-4eba-812d-07a488f25723 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1313 microversion: 2.1 time: 0.100850 Oct 13 08:36:08.220870 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 365/697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1313 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:08.221451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.221572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.221572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.224523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.224967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.225401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.226102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.226583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.227191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.236454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4cc8e21a-3a7f-4daa-bc39-b3aef5e5b849 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.183990 Oct 13 08:36:08.237052 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 333/698] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:08.304435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.312563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.314006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.318710 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f9809e2-2189-4da5-bb66-72d05da29732 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.104800 Oct 13 08:36:08.319270 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 366/699] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:08.579841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.580547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.587397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.587948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.588386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.589073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.589519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.589938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.591221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.591826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.597837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.598318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.598782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.599476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.599924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.600342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.664429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.673127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.674603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.680277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79e75345-176d-49e0-8a9a-a7719f7fd23e tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.092971 Oct 13 08:36:08.681629 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 367/700] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:08.723179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.731991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.733418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:08.734595 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53d48bd5-1aa6-4865-9406-89b71e0ad74c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.158920 Oct 13 08:36:08.735140 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 334/701] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:08.867575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.868178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.874456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.874939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.875379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.876062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.876510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.876927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.906008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:08.908025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:08.930125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.932477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.933266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:08.946242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:08.952616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:08.953509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.075114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.085457 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9dda61ff-cec3-4c04-ab73-8c52585fbe74 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1267 microversion: 2.1 time: 0.182757 Oct 13 08:36:09.088357 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 335/702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:09.132404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.133157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.140203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.140691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.141172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.141877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.142333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.142783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.255280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.259748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:09.267510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eee2def0-2b25-4db2-b4a6-d28e35764746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1493 microversion: 2.1 time: 0.403660 Oct 13 08:36:09.268471 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 368/703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:08 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1493 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:09.290654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.292044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.301623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.302481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.303229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.304138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.304766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.305349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.309299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.318929 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8804db33-00c0-4a13-9498-f303521fd067 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.190279 Oct 13 08:36:09.326470 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 336/704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:09.326470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.326470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.334948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.335800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.336435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.337186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.337641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.338064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.346599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.347007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.347462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.347897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lazy-loading 'fault' on Instance uuid f1e8b9bd-e6c9-4661-a967-a36c26e98b31 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:09.390271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7716895497df4077ac7967afb033c26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4e09c7157949bca928e509abfef71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.399734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67f76796-c4af-4f70-b066-cfe610f2763a tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 200 len: 1313 microversion: 2.1 time: 0.117074 Oct 13 08:36:09.400320 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 369/705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 1313 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:09.404956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.405724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.412378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.413068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.413512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.414390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.415057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.416089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.597312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.605784 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2759a1a6-fccd-43f9-9344-b80f4202a1e7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.285162 Oct 13 08:36:09.606358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 337/706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:09.610898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.611694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.617316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.617800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.618610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.619509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.619965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.620615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.686119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.694391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.695864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.701373 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2cdbff06-49a2-41e6-8143-d4e6ec873543 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.094043 Oct 13 08:36:09.710601 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 338/707] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:09.710601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-plugged", "status": "completed", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:09.716852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.717274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.717712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.728643 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] Creating event network-vif-plugged:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:36:09.733601 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-204f98a3-c5bd-4eaa-bc10-02fdf97cc938 req-7c65184d-a37a-4b6e-b54f-75e8ab8ef5f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029974 Oct 13 08:36:09.734336 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 339/708] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:09.739180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.739874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.746077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.746601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.747045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.747743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.748201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.748626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.752451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9f9bafcd-5e8c-43c8-b27c-e51228391145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1646 microversion: 2.1 time: 0.350883 Oct 13 08:36:09.754806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 370/709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1646 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:09.764936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.766608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.772108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.772431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.772866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.773568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.774057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.775166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.815579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.824317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.825746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.830856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d83ce87a-8b8d-43bf-9f9b-b5c6071b8daa tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.095522 Oct 13 08:36:09.831425 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 340/710] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:09.835694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:09.836470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:09.843851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.845528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.846202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.847424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:09.848103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:09.848748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:09.915273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.923500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.924938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:09.926079 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80439781-9246-444f-994a-23ec61a416c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.165226 Oct 13 08:36:09.926655 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 371/711] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:10.110209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.110763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.121272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.121832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.140136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.141052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.146617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-786042a7-d4f2-422f-bdbb-04475f0fe71b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1646 microversion: 2.1 time: 0.314083 Oct 13 08:36:10.147432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 341/712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:09 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1646 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:10.172937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.173474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.185479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.204365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.205016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.205547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.206422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.206899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.207513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.232213 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10e560fc-026e-43f0-81bf-8580abe6ac54 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.055830 Oct 13 08:36:10.232978 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 342/713] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:10.245484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:10.246016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.252431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.252892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.253326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.254017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.254482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.254901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.330110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c30d8cd3-eed3-4a8c-bbbd-c5decd4927e0 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884/action" status: 202 len: 0 microversion: 2.1 time: 0.088961 Oct 13 08:36:10.330798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 343/714] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:10 2022] POST /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:36:10.340298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.340995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.347872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.348405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.349326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.350055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.350545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.350981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.518437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-285d5d7b-998c-4067-890f-bd825b5834d6 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1651 microversion: 2.1 time: 0.182868 Oct 13 08:36:10.519333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 344/715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1651 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:10.523601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.524285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.532316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.532886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.533677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.534861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.535367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.535806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.543227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.559604 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5979fb67-eb1f-40a1-88c2-b86b8ab79663 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1259 microversion: 2.1 time: 0.453227 Oct 13 08:36:10.560851 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 372/716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:10.565642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.566508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] [instance: f1e8b9bd-e6c9-4661-a967-a36c26e98b31] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.574511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.576071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.576071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.576839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.577388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.578065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.595799 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] HTTP exception thrown: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Request method failure captured: Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 HTTP/1.1 Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83bt8dldSmboDzSa5HDt7tAZYRDUXbUK6mEeeQihHQAd3YWggVTfimTYx6eWMaTBEOvlevdtl1s5tSKP9M71GJmnIiLtwrB6Km59K8L3hTsxQiAllPN0rB7lh0Q4NPYCJND0MSKCnMJZyVKUEC6vQRB4Ua8FI-tj-1Ro8_sK3MM3lQ Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 8e4e09c7157949bca928e509abfef71d Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:36:10.597840 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e4e09c7157949bca928e509abfef71d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e4e09c7157949bca928e509abfef71d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 8e4e09c7157949bca928e509abfef71d Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-538791567 Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiagnosticsNegativeTest-538791567-project Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 7716895497df4077ac7967afb033c26f Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-538791567-project Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. Oct 13 08:36:10.599744 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f1e8b9bd-e6c9-4661-a967-a36c26e98b31'} Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:10.600522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. Oct 13 08:36:10.601758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:36:10.608460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] Returning 404 to user: Instance f1e8b9bd-e6c9-4661-a967-a36c26e98b31 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:10.609665 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1263e67-7c37-4d2a-bc6d-97920a64f278 tempest-ServerDiagnosticsNegativeTest-538791567 tempest-ServerDiagnosticsNegativeTest-538791567-project] 10.222.0.23 "GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31" status: 404 len: 111 microversion: 2.1 time: 0.047781 Oct 13 08:36:10.610509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 373/717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/f1e8b9bd-e6c9-4661-a967-a36c26e98b31 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:36:10.629866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.639237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.649454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.650071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.650616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.654034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.654571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.655007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.741300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.749777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cce31c74-124a-4a09-a72d-027aa7611e2a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.229613 Oct 13 08:36:10.750580 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 345/718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:10.754978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.755582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.761424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.761915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.762362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.763087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.763689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.763970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.837917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.840704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:10.850390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.850390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.859114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89f0cea1-8259-4fcf-afc4-59852fe1731a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.107708 Oct 13 08:36:10.862847 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 346/719] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:10.871924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.872550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.884943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.885478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.885920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.886649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.887148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.887575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:10.952417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.964028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.965508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:10.971044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-588cc16d-4410-4e8d-936c-390132c358d9 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.107305 Oct 13 08:36:10.971784 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 347/720] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:10.981752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:10.982454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:10.992456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:10.994291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:10.995343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.003124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.004281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.005126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.067907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:11.098003 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a0d7732-3726-4f18-a0fd-cf009315b9ac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.471211 Oct 13 08:36:11.107586 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 374/721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:11.208815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:11.220994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:11.222660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:11.223656 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06170770-0a01-4a7a-9341-27e5c7ec7c3b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.245896 Oct 13 08:36:11.234581 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 348/722] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:10 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:11.541056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:11.541659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:11.551128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.551935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.552669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.553811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.554683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.555196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.588283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:11.588902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:11.598146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.598682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.599129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.599848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.600303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.600731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.691336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:11.702717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ab33c81-fbc6-43ab-9c59-4836186bcf56 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1315 microversion: 2.1 time: 0.118384 Oct 13 08:36:11.706458 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 349/723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:11 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:11.710294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0da86d-73c7-4b2f-a3f3-7f5096310a01", "name": "network-vif-deleted", "tag": "609ef1bd-ddea-4c9c-84cc-f4be3290e108"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:11.735808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.736797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.737566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.763437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] Creating event network-vif-deleted:609ef1bd-ddea-4c9c-84cc-f4be3290e108 for instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 on n-h2-858384-11 Oct 13 08:36:11.772690 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b49af0a2-d080-49f7-92f7-9dde573a3b0f req-b43ed346-3631-4f51-a7a6-a5317b45e28a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066065 Oct 13 08:36:11.773625 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 350/724] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:11.785798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f27e3ec-05b3-4a22-af1d-4e78cf511500", "name": "network-vif-plugged", "status": "completed", "tag": "74e59cb1-3537-4e2b-a7a5-0511d5710d36"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:11.804937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-096b246c-c856-43f4-9cc5-f343b8caa580 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1631 microversion: 2.1 time: 0.264023 Oct 13 08:36:11.806364 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 375/725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:11 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1631 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:11.834051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.834574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.834858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:11.835160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.836026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:11.845329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.845825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.846535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.847434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.848053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.848680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.852076 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] Creating event network-vif-plugged:74e59cb1-3537-4e2b-a7a5-0511d5710d36 for instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 on n-h2-858384-11 Oct 13 08:36:11.858801 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-aa0802ba-4e40-47ea-a94f-29ce131d7e9e req-1e8db0f9-030e-44f4-bf6c-b9e33d87bb53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082622 Oct 13 08:36:11.862950 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 351/726] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:11.871788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": true, "disk_over_commit": false}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:11.875147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:11.882161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.882685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.883349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.884046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:11.884499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:11.884915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:11.937243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lazy-loading 'flavor' on Instance uuid 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:11.950666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127030) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:36:12.028244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.037879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25a349d5-8693-48db-9482-45828b8e8c8c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.209463 Oct 13 08:36:12.039066 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 376/727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:11 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:12.045469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:12.046332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:12.053522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.054002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.054748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.056453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.057088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.057664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.364554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.380174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.386003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.394683 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1191730-da41-496b-9d5f-88be87befa49 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.352993 Oct 13 08:36:12.395713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 377/728] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:12 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:12.400815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:12.401416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:12.417901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.417901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.417901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.417901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.418294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.418294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.536002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.562504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.566293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.587164 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43c8b8a9-5af0-4a4b-a558-97f350fcebab tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.188172 Oct 13 08:36:12.588017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 378/729] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:12 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:12.599702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:12.603818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:12.612704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.617584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.622591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.624016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.624734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.625482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.815672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:12.824143 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-065b2b83-0dea-4c93-8252-b07be9e2df20 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.234977 Oct 13 08:36:12.824798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 379/730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:12 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:12.836169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:12.837581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:12.844067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.844557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.845213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.845931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:12.846389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:12.846903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:12.992631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.010017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.011740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.013100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ebac22be-336a-4fdd-9ba5-a8293c8567e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.187005 Oct 13 08:36:13.013820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 380/731] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:12 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:13.026465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:13.027439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:13.034762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.035248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.035680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.036429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.036878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.037329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.107270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.142393 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f38e7ae2-4c79-49e7-bae7-556055510b13 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1315 microversion: 2.1 time: 0.125621 Oct 13 08:36:13.143348 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 381/732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:13 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:13.161259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:13.162243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:13.172557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.173394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.173837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.175058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.175574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.176007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.341162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.349172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe93a264-231f-435f-b34a-8725f70a8361 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.204658 Oct 13 08:36:13.349826 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 382/733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:13 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:13.424603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:13.425247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:13.431756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.432289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.432717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.433586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.434034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.434474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.499260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.507293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.511528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.517183 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-02959eed-ad6c-46b6-9272-e2e908841e88 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.096408 Oct 13 08:36:13.518010 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 383/734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:13 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:13.619573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:13.620179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:13.625995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.626503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.626940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.627629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.628110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.628559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.695816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.704396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.705880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:13.710835 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1596f6e3-5b18-4a11-8bf4-ab6f144ec7ec tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.095627 Oct 13 08:36:13.712688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 384/735] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:13 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:13.850956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:13.851570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:13.857399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.857891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.858337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:13.859060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:13.859513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:13.859941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.004554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:14.008060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:14.013673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c594ffc-960e-4acf-b96a-30f109df0198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1314 microversion: 2.1 time: 0.167274 Oct 13 08:36:14.014261 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 385/736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:13 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:14.153114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-399473711", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:14.208477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:14.410314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:14.410854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:14.411426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:14.411932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:14.412435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:14.425117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.425779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.426251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.427244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.427943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.428465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.447808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Getting quotas for project e4e25ce9839e4295878b7781cbb269c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:14.453815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Getting quotas for user d46a17fe841d40e8b6dd8155217fb30b and project e4e25ce9839e4295878b7781cbb269c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:14.469450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:14.472362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:14.526643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-906cf3e3-4048-4099-a72f-546fc81f69af tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511242 Oct 13 08:36:14.527596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 386/737] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:36:14.532418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:14.533205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:14.543380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.544075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.544892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.545989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.546718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.547323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.902498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:14.913633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:14.916609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:14.918790 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f416a840-e830-4248-b687-5ef0b9efa078 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.390080 Oct 13 08:36:14.919996 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 387/738] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:14 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:14.937631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:14.939267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:14.946746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02f88535-279a-43d9-9bc0-4f87cb324c8f tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884/action" status: 202 len: 0 microversion: 2.1 time: 3.081485 Oct 13 08:36:14.947949 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 352/739] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:11 2022] POST /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884/action => generated 0 bytes in 3084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:36:14.952414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.952930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.953376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.954351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.955130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.956219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.958169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:14.960726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:14.974883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.975454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.975964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:14.976794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:14.977300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:14.979007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.077214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.105837 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-24684077-39ef-4bc8-89f1-9faa496c6b61 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1321 microversion: 2.1 time: 0.184465 Oct 13 08:36:15.124681 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 388/740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:14 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:15.141860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.143743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a6149701-1bba-4036-ae1f-17dddca9412c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.144722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a6149701-1bba-4036-ae1f-17dddca9412c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.151598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b7dc8b3-6152-4bdc-9b60-249eccf9ea1c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.202286 Oct 13 08:36:15.170801 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 353/741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:14 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:15.176172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.176948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.183938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.186693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.187405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.188354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.189180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.190290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.250864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a6149701-1bba-4036-ae1f-17dddca9412c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.260877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a6149701-1bba-4036-ae1f-17dddca9412c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1221 microversion: 2.1 time: 0.134661 Oct 13 08:36:15.262045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 389/742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:15.267683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.268379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.272938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.283484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.284105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.284764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.285243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.285891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.286787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.287390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.287954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.291939 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ccc961a-220c-4148-ac9c-59ee51b7e03e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.119869 Oct 13 08:36:15.292659 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 354/743] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:15.298256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.299160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.305212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.305977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.306681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.307754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.308426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.309066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.405993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.414719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.417068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.422749 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-685cdc67-6da4-4357-b135-5e86930da609 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1446 microversion: 2.75 time: 0.159243 Oct 13 08:36:15.423532 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 390/744] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:15.449386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.450075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.464246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.464773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.465225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.466017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.471086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.471963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.481217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.490240 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ad612d5-8a7f-4b80-a965-0a3fcb62445b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.196435 Oct 13 08:36:15.494650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 355/745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:15.808336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:15.816042 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fbac1c6-246d-4d09-9ca8-904064387f68 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1464 microversion: 2.1 time: 0.375901 Oct 13 08:36:15.828481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 391/746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:15.841418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.842046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.849345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.849840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.850286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.851027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.851481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.851914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.947277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:15.947888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:15.955025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.955509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.956139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.956848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:15.957624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:15.958060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:15.993779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.003500 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2b7efc36-8061-45f5-86de-07a215ed198b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1463 microversion: 2.1 time: 0.167194 Oct 13 08:36:16.004404 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 356/747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:16.139490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2133924455", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ad5fe5f5-2da0-4798-a903-0566d82403a8"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:16.192038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.209431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.213096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:16.231277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.232963 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30cf38d0-4012-4751-9942-f1502315acc9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1567 microversion: 2.25 time: 0.290242 Oct 13 08:36:16.233506 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 392/748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:15 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:16.238671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:16.244924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:16.256800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.261212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.261894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.264082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.265020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.266827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.491953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:16.493126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:16.493728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:16.494248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:16.494792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:16.515149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.515785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.516832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.518755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.519314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.519867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.540275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:16.545626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Getting quotas for user e1765243aa04484fb46f41db48beac54 and project 415617a067b44660b1e29f33c12110e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:16.558328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:16.560709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:16.612080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-437493d3-97a8-4427-9530-2af72b257271 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478069 Oct 13 08:36:16.613528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 357/749] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:36:16.626321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.626946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:16.627289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:16.631070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:16.637688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e66b11c-2c05-4a0e-a41d-1f7defc200b9 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.402525 Oct 13 08:36:16.638903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.639573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.640598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.642149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.642653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.643087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.651679 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 393/750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:16 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:16.658760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:16.659378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:16.674603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.675512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.676118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.677579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.678271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.679071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.835430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.838795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:16.847249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9782fc71-8e53-40f7-befc-eebb1c44fc1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.224431 Oct 13 08:36:16.847928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 358/751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:16 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:16.854832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b715b675-6d9c-4abd-8962-546df8690fba tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1273 microversion: 2.1 time: 0.200323 Oct 13 08:36:16.855570 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 394/752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:16 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:16.860317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:16.861036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:16.863402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:16.864176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:16.866540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:16.868333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.868969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.869626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.870759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.871329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.871859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.872229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.873316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.873979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.874954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:16.875680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:16.876308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:16.993674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.009165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.020836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.020988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.035628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43a947b6-da12-44f1-a5d4-cd9e91184e9d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1452 microversion: 2.75 time: 0.179007 Oct 13 08:36:17.037280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.037521 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 395/753] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:16 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:17.039189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.045130 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2279e35b-95a5-4237-9840-592ff697dd7b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.196029 Oct 13 08:36:17.045687 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 359/754] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:16 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:17.059642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.065523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.068383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de8f32ad-2f43-4211-8cf7-205ce78c25b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.069006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de8f32ad-2f43-4211-8cf7-205ce78c25b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.075741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.076482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.077126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.078116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.087756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.088350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.148159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de8f32ad-2f43-4211-8cf7-205ce78c25b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.156058 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de8f32ad-2f43-4211-8cf7-205ce78c25b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1214 microversion: 2.1 time: 0.109197 Oct 13 08:36:17.156953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 360/755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:17.262714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.264094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.271262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.272357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.273027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.273994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.275300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.276009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.405093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.419811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.427835 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0da2c66c-152d-4052-891b-1fdfcc563bcd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.389050 Oct 13 08:36:17.429248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 396/756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:17.437168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.439010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:17.441808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51387daa-34ed-4ec2-8636-cb1e5f211116 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1542 microversion: 2.25 time: 0.185726 Oct 13 08:36:17.454428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 361/757] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:17.467881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-185dfbd4-fa10-4842-9c61-72149493986d tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '.version_select at 0x7f5376ed7b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.471742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-185dfbd4-fa10-4842-9c61-72149493986d tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.472095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-185dfbd4-fa10-4842-9c61-72149493986d tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.472602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-185dfbd4-fa10-4842-9c61-72149493986d tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.483222 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-185dfbd4-fa10-4842-9c61-72149493986d tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2631 microversion: 2.25 time: 0.019119 Oct 13 08:36:17.484109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 397/758] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/os-migrations => generated 2631 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:17.501650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.502273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.509469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.509984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.510436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.511165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.511597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.512018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.611879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0", "tag": "7169b5d1-d049-4c15-ab84-1767da982939"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:17.626189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.627000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.628701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.641928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] Creating event network-changed:7169b5d1-d049-4c15-ab84-1767da982939 for instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 on n-h2-858384-11 Oct 13 08:36:17.647322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-05baa25a-4d1a-406d-bd94-606a5faaaccd req-f34efe74-d84d-44d7-b17f-a6b5866616a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040975 Oct 13 08:36:17.648387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 398/759] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:17.666905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.667690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.674542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.675275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.675877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.676579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.677354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.677728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.685587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:17.717054 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e191314d-a5de-4377-b6e2-9962b6a60c67 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 2036 microversion: 2.25 time: 0.220307 Oct 13 08:36:17.717861 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 362/760] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 2036 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:17.754764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b319e1cc-d929-440a-a957-07dd85625380 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: .version_select at 0x7f5376e49820>, body: {"keypair": {"name": "tempest-keypair-1103736582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEHrSxapmWwTEBtLCKqf4+bV9U3d0zVyP9zJAgTqzQY6p3562YWioqQhPxpNhQrKdPTvg+VpxPdYnPc/gU6aKGAD4HDApUoScGIBc8nNLF2DpfRqYramIHH/yb9HSyH/w=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:17.772252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b319e1cc-d929-440a-a957-07dd85625380 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for project bce8c77c716d424abb6b86181e409501. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:17.776779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b319e1cc-d929-440a-a957-07dd85625380 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for user c09ea2313b3343579cb75d16d8f220ee and project bce8c77c716d424abb6b86181e409501. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:17.802831 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b319e1cc-d929-440a-a957-07dd85625380 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.051886 Oct 13 08:36:17.810044 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 363/761] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:36:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 13 08:36:17.874639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:17.875342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:17.882054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.882535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.883030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:17.883773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:17.884579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:17.884847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.064166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.075260 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17058d9c-0493-4a3a-b0e7-2a908d5007b7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.416567 Oct 13 08:36:18.075772 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 399/762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:18.082147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.085686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:18.087007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:18.091769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89423e56-bf08-4c2a-ae73-e49bbdd86be2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.221651 Oct 13 08:36:18.100793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.101724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.102187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.103729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.104191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.104626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.124559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 364/763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:17 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:18.129745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:18.132702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:18.156259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.156888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.157677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.158634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.159287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.159718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.164402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:18.238228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.248035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.249498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.254762 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbddc974-a7d4-4c8b-86fa-3df95dee213f tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1452 microversion: 2.75 time: 0.128798 Oct 13 08:36:18.255465 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 365/764] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:18 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:18.256446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.260423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:18.261379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:18.264945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4b19cb3-f21a-404e-9c97-fdac0809c615 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1279 microversion: 2.1 time: 0.187996 Oct 13 08:36:18.265627 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 400/765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:18 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:18.279895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.280685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.281297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.282501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.283179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.283758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.286579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:18.287526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:18.294876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.295497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.296369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.297276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.297932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.298607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.409631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.421010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.422888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.423884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.429194 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba8a0243-ad7d-4008-971e-2032d78a2bf3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.172551 Oct 13 08:36:18.429768 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 366/766] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:18 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:18.451935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:18.452511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:18.456254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6f64f06-9167-42e9-98c0-92c49784c487 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1266 microversion: 2.1 time: 0.173456 Oct 13 08:36:18.458685 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 401/767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:18 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:18.460422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.460990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.461439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.462804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:18.463260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:18.463848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:18.616815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:18.625649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a0374fd-6e1d-43ff-a994-ce2dc68c95ee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.177555 Oct 13 08:36:18.626495 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 367/768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:18 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:19.101866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.103232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.110195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.111098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.112121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.113208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.113688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.121232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.121842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.125345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.128611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.134063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.134800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.135719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.136344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.136781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.381350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.397034 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c87d198-b509-48f9-85fd-c70675e284cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1472 microversion: 2.1 time: 0.279862 Oct 13 08:36:19.398898 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 368/769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:19.404675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.405710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.412273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.413008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.426479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.427498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.428124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.428874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.470144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.481418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e86f8411-eda1-42f3-94b0-f60f21f51b86 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.383989 Oct 13 08:36:19.496828 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 402/770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:19.496828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.496828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.503817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.504918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.509175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.510087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.510607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.512025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.552311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.570806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.579494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.589563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08be1442-3901-4a72-8cc7-69c0389694b2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1452 microversion: 2.75 time: 0.189334 Oct 13 08:36:19.590505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 369/771] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:19.597032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.598329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.616218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.617001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.617633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.618615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.619067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.619637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.776856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.793053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.796722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.820167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a340e949-17f7-4d80-b848-1dd5e26972a3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.228349 Oct 13 08:36:19.820777 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 370/772] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:19.846363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.847262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.866638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.867174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.871951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.872747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.873223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.873656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.924956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.939505 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-655210a5-4f24-4ebd-ab29-e4db537c3ed2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.455940 Oct 13 08:36:19.940804 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 403/773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:19.954706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:19.955859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:19.965034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.965841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.967558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.967819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:19.968719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:19.969646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:19.970621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:19.978545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-803955f0-d3bb-416f-b974-4b3c7d8b1ea1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1272 microversion: 2.1 time: 0.138308 Oct 13 08:36:19.979464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 371/774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:20.213640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.223617 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b67dd3b0-1bba-41c3-a93a-3b179bd6b7b0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.279485 Oct 13 08:36:20.224929 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 404/775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:19 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:20.386973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1214074796", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "31ab6cfd-c0f3-4111-b8a2-4e38788505cb"}], "security_groups": [{"name": "tempest-securitygroup--938769070"}], "key_name": "tempest-keypair-1103736582", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:20.420222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:20.421044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:20.434158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.436873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.437395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.439338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.440404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.444764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.468444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:20.537151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] validate_networks() for [('31ab6cfd-c0f3-4111-b8a2-4e38788505cb', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:20.600622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.608330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fe88eb3-3236-4835-b312-adb11ec98c9f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.192197 Oct 13 08:36:20.608890 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 405/776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:20 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:20.619854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:20.620593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:20.627722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.628210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.628649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.629360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.629814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.630239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.764944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.773167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79538400-193a-4ed7-978e-311325b880ec tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.157721 Oct 13 08:36:20.773730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 406/777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:20 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:20.778295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:20.779122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:20.785337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.785891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.786391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.787380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.787902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.788447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.854600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.862736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.864204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.869001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e9b4d79-4c3b-4379-acd5-36a686726d1d tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1437 microversion: 2.75 time: 0.094279 Oct 13 08:36:20.869547 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 407/778] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:20 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:20.874052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:20.874681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:20.880894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.881574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.882208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.882928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.884102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.884532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.921404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:20.921829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:20.922300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:20.922736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:20.923150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:20.931878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.932359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.932796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.933519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:20.933973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:20.934395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:20.947550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.951642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:20.955705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for user c09ea2313b3343579cb75d16d8f220ee and project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:20.955942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.957380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:20.962915 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-652c1d9c-8213-4f22-919e-b3c990b79af8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.092409 Oct 13 08:36:20.963479 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 408/779] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:20 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:20.973794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:20.976313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:21.024595 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a275920-20f1-49ef-ad82-6b9b38db0db0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.642771 Oct 13 08:36:21.031316 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 372/780] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:36:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:36:21.031316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.031316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.036884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.037447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.037798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.038642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.038982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.039409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.107374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:21.110461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.117667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.118827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.119573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.120429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.121035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.121475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.224527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.234344 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-acc58897-abe2-42f3-ab19-b39c4eb8d835 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.208117 Oct 13 08:36:21.236236 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 373/781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:21.241189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.241895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.248233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.248809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.249545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.250389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.250903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.251424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.259171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:21.259649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:21.260060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:21.260468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:21.261264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:21.355157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.365323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.366179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.368080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.368553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.369008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.369436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.432560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.441732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a789d126-83cb-4ac4-986d-d1819895e233 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.203079 Oct 13 08:36:21.442845 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 374/782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:21.458244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.459097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.464725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:21.500250 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9c5a237-d406-4761-8c0b-f735f234df43 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5/action" status: 202 len: 1942 microversion: 2.75 time: 0.535577 Oct 13 08:36:21.502306 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 409/783] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:36:20 2022] POST /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5/action => generated 1942 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 13 08:36:21.510375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.516522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.530464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.530970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.531452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.532205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.532773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.533318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.541060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.549526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.551454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.553028 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d45bd17-aa31-4c91-b694-98d466103735 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1286 microversion: 2.25 time: 0.103450 Oct 13 08:36:21.553747 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 375/784] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:21.580303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.580920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.595631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.596330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.597126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.597842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.598302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.598954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.686210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:21.702655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.716439 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-36862ed7-15a8-412a-a887-2ed30b1e5afa tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.209796 Oct 13 08:36:21.717269 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 410/785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:21.721207 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02c70285-5c60-4e13-8e7c-23bb1b7c4e82 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.152523 Oct 13 08:36:21.721900 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 376/786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:21.723198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.723808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.731405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.732162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.732603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.733353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.733839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.734268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.797198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.797808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.804257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.805154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.807644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.808362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.808819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.809239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.879265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.891842 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e42ef44f-c4d8-45d6-a1a8-a93b59badd04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.173280 Oct 13 08:36:21.892528 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 411/787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:21.958776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:21.967910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d36388c9-1095-4efc-b534-9d09327dd8af tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.174555 Oct 13 08:36:21.968676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 377/788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:21.990944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:21.991586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:21.998089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:21.998606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:21.999042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:21.999736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.000187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.000609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.065349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.073673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.075150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.080434 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d1bd07e2-1543-417d-9b0e-721eb6951ceb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.093712 Oct 13 08:36:22.080991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 412/789] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:21 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:22.257947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:22.258864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:22.265237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.265842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.266364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.267241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.267807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.269186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.461121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.465599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:22.467038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:22.478197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.478713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-141036e5-c3eb-4b0a-882d-8507d5990828 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.224557 Oct 13 08:36:22.478938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.479808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.480924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.481536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.482375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.491849 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 378/790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:22 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:22.586184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:22.587832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:22.595008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.595492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.596099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.596981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.597593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.598193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.674657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.684798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.686561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.687906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a6e30c1a-5c4b-4dc1-8d58-04a8129af91c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1356 microversion: 2.25 time: 0.109249 Oct 13 08:36:22.688874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 379/791] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:22 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:22.740590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:22.741405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:22.748255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.748502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.748966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.749884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.750497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.751021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.953801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:22.964038 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-054dad01-a6a5-4d49-b094-4aeb2ce8f2d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.227539 Oct 13 08:36:22.964924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 380/792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:22 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:22.984845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:22.985554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:22.992458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.992955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.993394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:22.994104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:22.994603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:22.995057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.077349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:23.094989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a8988b0-0de5-4cd1-8f19-bf54cdcbc2b1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.115333 Oct 13 08:36:23.111735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 381/793] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:22 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:23.111735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:23.111735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:23.111735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.111735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.112282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.112282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.112282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.112282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.265579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.275263 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98506402-4ed0-46cd-9516-def69c949841 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.814472 Oct 13 08:36:23.276159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 413/794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:22 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:23.293554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:23.294274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:23.300485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.300981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.301410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.302614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.302614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.303047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.582801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.585377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:23.592724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-153ea4d0-4538-4cf4-94fb-f2636abd9075 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.495758 Oct 13 08:36:23.607888 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 382/795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:23 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:23.614975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:23.615697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:23.622145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.622743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.623413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.624284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.624733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.625349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.697138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.707987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.708452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.713761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37e9424a-fdc7-4a16-b64b-7f64895b10f1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.104675 Oct 13 08:36:23.714330 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 383/796] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:23 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:23.719004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:23.719773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:23.726095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.726938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.727626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.728639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.729370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.729949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.756327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.769165 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a6b6b3e-297f-47c7-affb-27cac4da2456 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.484019 Oct 13 08:36:23.770263 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 414/797] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:23 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:23.787729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:23.788861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:23.795837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.796324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.798659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.798659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:23.798659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:23.799389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:23.962171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:23.972407 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb962ee2-f556-45f5-b03b-e9a88f531a71 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.256832 Oct 13 08:36:23.973366 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 384/798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:23 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:23.994913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee2b36a-ea79-4853-98d8-fabbe1cdb884", "name": "network-vif-unplugged", "status": "completed", "tag": "839a253a-27a0-4254-8f21-3655f4cbd69a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:24.004237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.016455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:24.028114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.031091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.032307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-58672dbd-2f78-47f4-8da3-8908520fe585 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1344 microversion: 2.25 time: 0.256178 Oct 13 08:36:24.032761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.033474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.035895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.049593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 415/799] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:23 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1344 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:24.058453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.059096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.065907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] Creating event network-vif-unplugged:839a253a-27a0-4254-8f21-3655f4cbd69a for instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 on n-h1-858384-11 Oct 13 08:36:24.067024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.068407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.068879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.070068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.070566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.071042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.078603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e2198dd5-d49c-475f-834a-8660d90a6d98 req-0a69c070-e9d9-4f7d-97b4-360b0fb48e6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087984 Oct 13 08:36:24.080423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 385/800] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:24.124224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.125209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.132225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.132979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.133558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.134758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.135481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.135995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.239106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:24.260119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1ade06c-2ee9-48be-a41b-797f8e8c1017 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.140137 Oct 13 08:36:24.261130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 386/801] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:24.300043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.300721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.307180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.307695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.308151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.308894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.309326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.309740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.440359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:24.468587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.480385 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74da1d54-90b5-460b-be16-69423dcc5de0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.182984 Oct 13 08:36:24.481145 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 387/802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:24.494320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.507630 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e45c808-188c-44b9-83ef-3255c2969bb0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.456793 Oct 13 08:36:24.509003 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 416/803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:24.618864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.619482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.625440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.625926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.626567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.627272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.627739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.628167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.751203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.751885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.761112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.762533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.762981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.763842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.764495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.765321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.767829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.778963 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5157e09-312c-4005-ad82-a4b39517c8fb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.163769 Oct 13 08:36:24.780112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 388/804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:24.800420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.801204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:24.807596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.808202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.808720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.809501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:24.810019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:24.810545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:24.918924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.928582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.930060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.935331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a973076-aa57-4b29-ba66-4e792b24b8a0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.192641 Oct 13 08:36:24.935898 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 417/805] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:24.950551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:24.954914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ea96591-1d0c-4cbf-ab6d-a71c68d30e30 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.164326 Oct 13 08:36:24.955806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 389/806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:24.999783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:24.999974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.000617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34788658-a03f-4156-8054-05dd3360632f", "tag": "13e155fe-51b9-41d9-bea6-de41e0205f05"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:25.006628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.007333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.007927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.009341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.009936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.010687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.011381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.011860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.012292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.023466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] Creating event network-changed:13e155fe-51b9-41d9-bea6-de41e0205f05 for instance 34788658-a03f-4156-8054-05dd3360632f on n-h2-858384-11 Oct 13 08:36:25.036615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-37616903-aa0f-47fc-aba2-e031aaa36289 req-a2fcda86-4ea3-4ad3-a0d7-e29a4e2a9809 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040543 Oct 13 08:36:25.037586 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 390/807] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:25.064992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.065855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.073407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.073893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.074331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.075055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.075539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.075965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.219965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.228512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.230106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.231183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3cf97b6a-b36a-4ff5-8cbf-ef01c9324b28 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.170663 Oct 13 08:36:25.246891 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 391/808] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:25.256606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:25.288986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.289646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.296126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.296610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.297038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.297737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.298186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.298822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.384322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:25.407125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a76242ef-a564-4bda-89ad-f9f809c622de tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.122003 Oct 13 08:36:25.408205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 392/809] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:25.439022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.464414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21a75def-49d5-4288-b017-4e3dd87a9061 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.471430 Oct 13 08:36:25.477778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 418/810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:24 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:25.504032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.505020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.512387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.512816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.513425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.514137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.514628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.515193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.535462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.536392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.552734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.553220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.553660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.554377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.554856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.555828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.596840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:25.678834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.689010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c9e7e4b-f59b-4ba1-93f5-68778844c683 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.189088 Oct 13 08:36:25.689624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 393/811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:25.804093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.804710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.810725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.811203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.811633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.812316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.812763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.813181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.946876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:25.954877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-692ec248-685f-4227-8f47-054a6d091ed9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.154687 Oct 13 08:36:25.955452 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 394/812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:25.964205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:25.964807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:25.971016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.971496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.971925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:25.972615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:25.973061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:25.973629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.037685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.046234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.047696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.052836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3627619-657b-4434-9b01-c358a5e0e8c0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.092968 Oct 13 08:36:26.053410 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 395/813] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:26.058594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.059131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.065403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.066086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.066312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.067109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.067553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.067974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.123841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.148787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9dd1e65-1c91-4358-84c7-b075ef1fd307 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.620570 Oct 13 08:36:26.150116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 419/814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:25 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:26.154994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee2b36a-ea79-4853-98d8-fabbe1cdb884", "tag": "839a253a-27a0-4254-8f21-3655f4cbd69a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:26.172541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.173339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.174017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.187848 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] Creating event network-changed:839a253a-27a0-4254-8f21-3655f4cbd69a for instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 on n-h1-858384-11 Oct 13 08:36:26.194353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1968606b-9bb9-4a5e-b42f-f5d360ae5c2b req-7a6cac6e-808f-47d5-82ab-c26c4fd4c3ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042893 Oct 13 08:36:26.195553 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 420/815] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:26.223143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.232768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b1c22cd-1c5a-4cb1-a36c-e92085c05d33 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.178175 Oct 13 08:36:26.233688 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 396/816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:26.258829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.259848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.266634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.267330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.269061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.270027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.270736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.271601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.437215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.437822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.445360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.445844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.446274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.447150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.447606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.448025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.538355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:26.541674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.555608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.557449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.558875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-448dcebc-e710-48b1-8c4f-73bce77af66b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.305433 Oct 13 08:36:26.574547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8974d74a-37c6-47c6-9cb6-f4b51cf14317 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.130339 Oct 13 08:36:26.576031 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 397/817] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:26.576558 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 421/818] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:26.583449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.584731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.591335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.591894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.592408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.593183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.593722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.594215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.713229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.714333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.721310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.721878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.722375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.723234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.723889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.724567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.783509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.795836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4525fea-a815-43b4-8ce1-742d6250e260 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.219092 Oct 13 08:36:26.796769 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 398/819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:26.961046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:26.969518 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88919c21-0037-4634-af5c-b4eb86681f48 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.260997 Oct 13 08:36:26.970100 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 422/820] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:26.979140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:26.979921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:26.987010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.987496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.987936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:26.988630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:26.989085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:26.989513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.060157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d5adb7-6c94-4cb8-9f59-964155385c9a", "tag": "f1569de7-562e-436f-9aa8-09e3c11cca9b"}, {"name": "network-changed", "server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:27.071550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.072027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.072919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.091063 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Creating event network-changed:f1569de7-562e-436f-9aa8-09e3c11cca9b for instance b1d5adb7-6c94-4cb8-9f59-964155385c9a on n-h2-858384-11 Oct 13 08:36:27.091563 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] Creating event network-changed:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h1-858384-11 Oct 13 08:36:27.099966 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b56a201e-ed4c-4888-bb9c-d9e6389dd95d req-8634f15c-04b1-4074-9470-b3e5824b5efa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043387 Oct 13 08:36:27.101406 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 423/821] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:27.106699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.107151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.113854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.114243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.114701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.115409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.116196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.116320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.132319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.137522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:27.146237 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-39bb00fe-6f9d-43a0-a62e-47f53fc00de7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.170901 Oct 13 08:36:27.147057 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 399/822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:26 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:27.171987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.172800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.179072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.179566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.180004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.181273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.181731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.182160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.315882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.323715 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-065447ab-f5c9-41ab-9e0d-88805d439bd3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.155616 Oct 13 08:36:27.324291 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 400/823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:27.328681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.329556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.333868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.335376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.335861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.336295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.337483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.337937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.338369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.346034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.347526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.353345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9127ae10-3087-4890-9f97-37dbac39d00a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.250996 Oct 13 08:36:27.354286 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 424/824] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:27.492155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.501603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e64aa1aa-323b-440d-8b72-c10916d668ab tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.176353 Oct 13 08:36:27.502264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 401/825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:27.585451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.586079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.592571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.592723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.593219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.593329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.593653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.594347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.594999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.595428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.599971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.601035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.601546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.602881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.603710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.603873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.682966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:27.701500 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12282637-8c88-43d6-bc90-05e8d049d5f6 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.112570 Oct 13 08:36:27.702750 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 402/826] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:27.734904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.743714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.745231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.746393 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0724bfc1-49e8-4cc2-90eb-03388c2451d1 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.164958 Oct 13 08:36:27.747445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 425/827] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:27.789291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0", "name": "network-vif-plugged", "status": "completed", "tag": "7169b5d1-d049-4c15-ab84-1767da982939"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:27.800013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.800602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.801203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.813234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] Creating event network-vif-plugged:7169b5d1-d049-4c15-ab84-1767da982939 for instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 on n-h2-858384-11 Oct 13 08:36:27.818033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-23c66b13-1794-45e4-995c-964d8999fced req-e149a0cc-7ff5-4f9b-a2f3-0a65a662d1e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Oct 13 08:36:27.818786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 403/828] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:27.820308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.821057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:27.827674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.828168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.828643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.829767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:27.830289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:27.830800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:27.961175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:27.969455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05a3f6fc-38cc-4fb0-b1b8-ed199b1f995b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.153345 Oct 13 08:36:27.970022 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 426/829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:27.993518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:27.994214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.000321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.000824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.001261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.001949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.002398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.002843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.129922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.138386 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c4ac9e0-3f0e-454b-b7cd-c6c8b5da8d4e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.149603 Oct 13 08:36:28.138978 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 404/830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:27 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:28.169053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.169573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.175615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.176103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.176542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.177270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.177726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.178153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.311536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.319315 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afb93272-8def-4752-bac0-c140c63d4273 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.154272 Oct 13 08:36:28.319872 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 427/831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:28.347328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.347934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.354336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.354840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.355268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.355947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.356393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.356810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.379515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.380129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.386061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.386591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.387033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.387731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.388186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.388613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.455909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.464166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.465627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.470591 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9fa7ab3-eddb-4ee9-b887-eb74efe27e63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.094874 Oct 13 08:36:28.471176 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 428/832] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:28.488468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.496894 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcc53cb0-079d-4890-8d79-ad85b458c4e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.153424 Oct 13 08:36:28.497446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 405/833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:28.524136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.524745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.530659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.531142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.531578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.532268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.532720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.533146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.731505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.732122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.738580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.739169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.739680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.740383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.740838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.741266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.745838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.754932 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bb5e5816-776f-48dd-abd3-ba8836291ac4 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.234424 Oct 13 08:36:28.755592 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 429/834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:28.773630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.774662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:28.780912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.782156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.782846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.783636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:28.784246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:28.784833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:28.825850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:28.843211 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7344285f-371f-40b5-a45e-acf7ddedd530 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.116159 Oct 13 08:36:28.843794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 406/835] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:28.968021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.976097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.978205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:28.979328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d736d4de-3221-4a0b-8d1d-1d72d2713a18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.212035 Oct 13 08:36:28.980069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 430/836] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:28.994377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:28.995038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.001094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.001609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.002100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.002825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.003280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.003706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.136605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.144914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32613d23-b6ec-43f1-9ff9-f004ff07a78c tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.154679 Oct 13 08:36:29.145475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 407/837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:28 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:29.161211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.161821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.168293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.168780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.169217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.169904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.170356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.170801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.299434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.307139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ed65420-60ed-4572-b719-3bda3f6d777c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.150021 Oct 13 08:36:29.307707 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 431/838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:29.343378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.343982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.349858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.350332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.350790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.351479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.351925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.352342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.483680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.491401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07d4599e-616d-4a94-b23d-3a89da0c89b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.151804 Oct 13 08:36:29.493405 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 408/839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:29.498046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.498690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.504613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.505021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.505448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.506126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.506609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.507029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.544150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.544819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.561078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.561571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.562009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.562748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.563203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.563622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.596049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.604916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.606380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.611436 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0c260ba-1b49-482d-8871-0a505c4cffe0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.117098 Oct 13 08:36:29.612013 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 432/840] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:29.715440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:29.723665 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0abc4af1-de5e-4c00-a169-c080bdb8ddad tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.188527 Oct 13 08:36:29.724555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 409/841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:29.780046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.780658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.787630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.788110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.788546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.789485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.789922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.790613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.872149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:29.872859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:29.879238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.879716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.880175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:29.880852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:29.881296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:29.881716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.007389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.016056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2166ced-14c3-491b-ad57-bd991b63e2f5 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.240059 Oct 13 08:36:30.031719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 433/842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:30.031719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.031719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.031719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.032189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.032189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.032189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.032189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.032488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.127346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:30.144139 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2b515c1a-b6e0-41a4-b8e0-ed23537a5308 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.276342 Oct 13 08:36:30.144720 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 410/843] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:29 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:30.168008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.168733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.174938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.175422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.175858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.176557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.177089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.177521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.221021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.232025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.232961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.234621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8f5e25a-98b7-469d-8062-73a78b9195b2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.216519 Oct 13 08:36:30.234829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 434/844] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:30.318980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.327010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2f894a0-1797-4354-88bb-2bbb503026f8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.163245 Oct 13 08:36:30.327864 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 411/845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:30.330517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.331174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.334195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:30.339737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.340225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.340657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.341351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.341798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.342217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.468631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.476305 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a5b2eea-a16e-4605-81ac-b9f4580d4e94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.150102 Oct 13 08:36:30.476869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 435/846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:30.515179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.515884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.521810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.522290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.522760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.523447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.524436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.524861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.640161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.640864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.646994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.647557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.648519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.650416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.650416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.650954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.654421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.662467 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ebfccd4-672c-432e-a471-3f9b563796e8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.151084 Oct 13 08:36:30.663226 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 412/847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:30.715708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.724124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.725633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.730674 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7eae8ab2-b75a-4d1a-b236-08d0c74fe0f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.094639 Oct 13 08:36:30.731239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 436/848] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:30.750311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:30.751087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:30.757134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.757732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.758788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.759558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:30.760089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:30.760587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:30.891659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:30.899936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a3f771a-e492-41e4-9ddd-cc05265ff3ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.157618 Oct 13 08:36:30.900482 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 413/849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:30 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:31.043936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.043936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.046470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.046958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.047389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.048087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.048534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.048961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.067523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:31.171533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.172296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.174291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:31.181172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.181587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.182156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.182903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.183350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.183775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.188630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.199379 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21b79f2a-679e-4936-ac1b-73fe870f9720 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.164083 Oct 13 08:36:31.200798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 437/850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:31.260817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.261543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.267845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.268409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.268915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.269733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.270251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.270811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.275015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:31.293167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6cb4eda-b644-4a34-9fb6-ae45d033fdc1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.125323 Oct 13 08:36:31.294387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 414/851] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:31.351560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.352689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.358666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.359146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.359577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.360261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.360711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.361131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.406172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.412345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.413787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.415443 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a42a521-b792-4279-ab16-bcf00e60cbf3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.159500 Oct 13 08:36:31.415991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 438/852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:31.490624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.493510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:31.499953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.500328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49bc93be-f324-4a35-a846-f8905f56b6de tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.152774 Oct 13 08:36:31.500739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.501135 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 415/853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:31.506991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.507474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.507916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.508616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.509068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.509492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.642555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.651616 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc30c87c-21d2-48db-874f-50566e8f5a22 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.155484 Oct 13 08:36:31.652193 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 439/854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:31.685484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.686083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.688102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=22 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:31.693437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.693910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.694342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.695148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.696075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.696500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.757169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.757881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.764512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.764994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.765431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.766123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.766611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.767037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.830899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.831532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.839401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.840168 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e38c051-d6bd-4a4f-a233-f1f9255ffc92 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.158479 Oct 13 08:36:31.840814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 416/855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:31.841058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:31.846040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d29f9dd-3c00-4dc8-99e8-ca44d99fb7f7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.092830 Oct 13 08:36:31.846627 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 440/856] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:31.922984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:31.923593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:31.929860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.930883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.931314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:31.932000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:31.932452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:31.932873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.058783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.066486 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e0e6b3f-563d-4afc-b4c2-f897e2914b04 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.147301 Oct 13 08:36:32.067041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 417/857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:31 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:32.223217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.223827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.231610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.232082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.232520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.233292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.234089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.234921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.323084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.323690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.329815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.330299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.330754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.331449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.331902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.332326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.392244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.401392 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-242b42b2-1c40-4eda-bb40-2d3fb804840f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.181904 Oct 13 08:36:32.424100 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 441/858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:32.441579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.442178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.448551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.449042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.449475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.450179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.450670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.451093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.508288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:32.528547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ed954e9-bc5e-42b4-891d-3d01cab76ebf tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.209058 Oct 13 08:36:32.546041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 418/859] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:32.555136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.556264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.563104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.564111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.564790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.565730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.566571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.567400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.718789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.730310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.732213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.734184 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fec35fd-b59d-42df-94b5-87c85e7a6a22 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.297251 Oct 13 08:36:32.735402 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 442/860] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:32.740539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.741230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.747608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.748670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.749316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.750226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.750912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.751684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.781990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.791496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-834712ee-9b97-4e7c-8ded-d6fd91785fc8 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.242810 Oct 13 08:36:32.792362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 419/861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:32.812350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34788658-a03f-4156-8054-05dd3360632f", "name": "network-vif-plugged", "status": "completed", "tag": "13e155fe-51b9-41d9-bea6-de41e0205f05"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:32.822793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.823033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.823529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.837260 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] Creating event network-vif-plugged:13e155fe-51b9-41d9-bea6-de41e0205f05 for instance 34788658-a03f-4156-8054-05dd3360632f on n-h2-858384-11 Oct 13 08:36:32.842394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-17a60d2b-9a73-4a18-acc2-b5111370d351 req-8185728c-16e1-4bc2-afd4-1427c680b00a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Oct 13 08:36:32.843211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 420/862] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:32.864463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.864708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.872649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.873136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.874085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.874828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.875288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.875699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.905733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:32.914492 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9c62a32-c6d8-42b5-8d87-ef6d829b8a75 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.177706 Oct 13 08:36:32.915079 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 443/863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:32.920239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:32.921182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:32.927756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.928446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.929170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.930112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:32.930779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:32.931209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:32.997870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.005937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.007465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.012207 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-799cd2dd-9e24-4c30-9d5a-c9dd84eab425 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.095983 Oct 13 08:36:33.012772 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 444/864] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:33.013908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.021837 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f7bc3e2-24cf-47e5-baed-1da60d368df9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.162264 Oct 13 08:36:33.022387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 421/865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:32 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:33.089016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:33.089643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:33.095591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.096064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.096515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.097195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.097649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.098066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.304577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.312231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3c8547e-cde0-4ecf-81f6-c5505a6f44ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.227143 Oct 13 08:36:33.312792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 445/866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:33 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:33.430345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:33.430914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:33.436866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.437347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.437780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.438497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.438950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.439375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.556906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:33.557508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:33.563435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.563916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.564346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.564977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.565108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.565469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.565890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.573617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3774a0f1-3d3b-4947-a40c-39ae2ed4714f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.147249 Oct 13 08:36:33.574187 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 422/867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:33 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:33.638511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:33.655059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d3e1aa7-7466-4882-8b76-0a04739e6294 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.101882 Oct 13 08:36:33.655630 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 446/868] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:33 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:33.759680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:33.760325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:33.766243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.766767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.767204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.767901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.768359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.768788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.818502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:33.819113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:33.825641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.826131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.826606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.827303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:33.827756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:33.828180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:33.985642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.994705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.996331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:33.997728 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aac56a85-83f6-4129-a385-34fe09ac99dc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.242827 Oct 13 08:36:34.009786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 423/869] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:33 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:34.022967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.024565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.033620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.034398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.035036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.036036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.036504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.036938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.217355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.227452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b72ed11-12b2-4445-822c-a91792e3b0d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.211813 Oct 13 08:36:34.229996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 424/870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:34.237365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.237854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.244560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.245051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.245489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.246228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.246717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.247146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.314850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.323818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.325278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.327963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:34.331623 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7dfce5b6-5562-4f09-a6e3-8b02e16006aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.100846 Oct 13 08:36:34.332206 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 425/871] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:34.337284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.338025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.348444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.349325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.349466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.350069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.350780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.351476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.379035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.388344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d1dbb4d-a604-4db1-9bd0-d9c66c7cf470 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.573642 Oct 13 08:36:34.401230 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 447/872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:33 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:34.401230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.401230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.409692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.410664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.411119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.411909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.413255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.413763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.516141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.524239 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82df6117-d442-454c-81ae-011b99a1c448 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.191032 Oct 13 08:36:34.526640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 426/873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:34.568614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.576453 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f05acf3-a405-4a29-a964-fc99873f9b4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.186100 Oct 13 08:36:34.577140 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 448/874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:34.597059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.597810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.604600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.605157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.605663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.606440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.606978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.607472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.683322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:34.684025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:34.690324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.690895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.691800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.692159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.692640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.693264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.744320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:34.752510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-015da049-272c-4716-89bf-8b987a09b61a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1388 microversion: 2.1 time: 0.159282 Oct 13 08:36:34.762752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 427/875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1388 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:34.778392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:34.795400 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99d7b2b2-cc40-4528-98de-f3df4f07b913 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.116856 Oct 13 08:36:34.795967 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 449/876] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:34 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:34.857966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "name": "network-vif-plugged", "status": "completed", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:34.867317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:34.867790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:34.868218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:34.879029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] Creating event network-vif-plugged:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h1-858384-11 Oct 13 08:36:34.883794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4c9cf14e-11f5-4d0b-a7ec-863c4a0c9639 req-95065386-8942-4978-a889-8bf013d1170a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029483 Oct 13 08:36:34.884363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 428/877] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:35.030653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.031271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.037153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.037621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.038061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.038784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.039238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.041014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.169703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.178026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.179515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.180618 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dcc8cd68-674d-47bb-bdf6-072ebf5aca81 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.154057 Oct 13 08:36:35.181182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 450/878] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:35.252527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.253225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.259853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.260332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.260763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.261457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.261902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.262323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.360771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.361478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.367838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.368385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.368912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.369670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.370238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.370710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.395419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.403707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bffc303b-82e1-47e1-95c4-c23151568a2e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.155939 Oct 13 08:36:35.404282 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 429/879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:35.415879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.416532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.422519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.423010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.423449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.424156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.424620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.425048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.434795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.442883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.444322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.449648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-387ad5f3-b9b9-488c-8a6d-4c16dccfafc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.092756 Oct 13 08:36:35.461356 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 451/880] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:35.549034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.549645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.555459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.556290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.556773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.557204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.557899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.558346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.558791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.563766 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7f220c8-1a63-4f7c-8590-20f63cbf2897 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1321 microversion: 2.1 time: 0.152195 Oct 13 08:36:35.564433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 430/881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:35.600045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.600780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.606928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.607657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.608105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.608806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.609263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.609692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.688868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.697519 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ee93326-15e1-49a8-b20b-8d959aac6ae0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.152360 Oct 13 08:36:35.698161 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 452/882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:35.740238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:35.748395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68a4b8f4-15a9-4ded-ab6a-8837a62024c3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.152218 Oct 13 08:36:35.748959 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 431/883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:35.775064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.775705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.782075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.782686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.783218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.784075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.784653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.785140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.802804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:35.823005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:35.823675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:35.829987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.830493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.830928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.831622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:35.832075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:35.832619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:35.903025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:35.919914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc26f15c-2b06-43a2-aa75-8c356d091540 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.101138 Oct 13 08:36:35.920497 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 432/884] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:36.027138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.035417 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-885b29c9-5295-4d9e-8e59-e92b27387926 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1586 microversion: 2.1 time: 0.264194 Oct 13 08:36:36.036047 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 453/885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:35 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1586 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:36.058776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.059272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.065155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.065640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.066078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.066802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.067256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.067686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.071418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:36.147439 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc14088b-12f3-4811-a37a-ed56fbf1f7aa tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093167 Oct 13 08:36:36.148038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 433/886] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:36.205462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.206103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.212593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.213076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.213514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.214207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.214690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.215113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.427202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.427812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.433999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.434554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.434948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.435793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.436253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.436695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.503817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.515269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.516739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.517901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da724045-8e1d-4651-bbe8-0b23ab5bc3e9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1411 microversion: 2.25 time: 0.316710 Oct 13 08:36:36.518669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 454/887] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1411 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:36.535112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.536828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.550789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.551799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.552251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.552961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.553444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.553839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.614029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.621736 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed7ff344-ee6c-4865-a4bc-d089c3859b95 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.199078 Oct 13 08:36:36.622306 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 434/888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:36.627671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.628443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.634928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.635592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.636206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.637048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.637681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.638205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.650199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.658940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.660567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.666488 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b2153c9a-7cd3-489c-984f-312e9891582d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.135865 Oct 13 08:36:36.667424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 455/889] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:36.721423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.722118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.728640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.729209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.729859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.730670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.731196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.731688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.773073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.781744 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8539ebda-68ff-402f-aad9-f13a89c89c35 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1470 microversion: 2.1 time: 0.158148 Oct 13 08:36:36.782788 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 435/890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:36.788232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:36.789039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:36.795803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.796517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.797106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.798069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:36.798764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:36.799336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:36.951674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:36.959974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f079b285-1ddf-4c70-9812-f5bab18655ab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1503 microversion: 2.1 time: 0.175339 Oct 13 08:36:36.960547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 436/891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:37.025442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:37.026020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] [instance: 2502de8c-2317-41c3-b480-d130a7d7700a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.033816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] HTTP exception thrown: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Request method failure captured: Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/2502de8c-2317-41c3-b480-d130a7d7700a/action HTTP/1.1 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839lxQEs8OSp82bklxvn32uHbmjPS8u0Pbvka8lKmcnZMeCw0DBkcYQGaVNyCHRCl2S778qkvCRdFgryUo5EMKGO3mw9zHuWHKRTgWEoJs0721406MQ2qlH1nKd39xIvEIWmjtwIOBB_CttEQYiVj0geLK2UWlnBIMkyo7PumIldzs Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:36:37.035802 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_436ef6b0d8264ece8802e97baf719388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 071b57486fd84cadad576609f1617324 Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: {"migrate": {}} Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:37.037399 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '2502de8c-2317-41c3-b480-d130a7d7700a', 'body': {'migrate': {}}} Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:37.038277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. Oct 13 08:36:37.039871 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:37.041662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Returning 404 to user: Instance 2502de8c-2317-41c3-b480-d130a7d7700a could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:37.042711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ef154ec-d2e2-477e-8953-1f4134dfd695 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2502de8c-2317-41c3-b480-d130a7d7700a/action" status: 404 len: 111 microversion: 2.1 time: 0.080502 Oct 13 08:36:37.043458 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 437/892] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:36 2022] POST /compute/v2.1/servers/2502de8c-2317-41c3-b480-d130a7d7700a/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:36:37.048054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:37.049472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.068226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.069873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.071097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.076534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.077238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.078115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.104601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.121530 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4997d265-e1b5-4ed2-90a7-f8a4beecc7ae tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1477 microversion: 2.1 time: 0.404309 Oct 13 08:36:37.121995 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 456/893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:36 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:37.134764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d5adb7-6c94-4cb8-9f59-964155385c9a", "name": "network-vif-plugged", "status": "completed", "tag": "f1569de7-562e-436f-9aa8-09e3c11cca9b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:37.148331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.149616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.150302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.169678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] Creating event network-vif-plugged:f1569de7-562e-436f-9aa8-09e3c11cca9b for instance b1d5adb7-6c94-4cb8-9f59-964155385c9a on n-h2-858384-11 Oct 13 08:36:37.177666 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-da97d271-1a23-4538-8e94-69465732d67f req-a59b3303-7f9b-4bca-9942-ed3ae89897d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051281 Oct 13 08:36:37.182374 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 457/894] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:37.190949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1278152379", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:37.210685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:37.231761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c944b4de-188d-4ea7-a51e-264767c5778f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.187086 Oct 13 08:36:37.232998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 438/895] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:37 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:37.273209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:37.544216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:37.544938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.551796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.552286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.552720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.553482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.553930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.554351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.684381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.693778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.704488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.705733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ffc3472-4352-47bc-82d1-bcc5aee4080f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1607 microversion: 2.25 time: 0.165386 Oct 13 08:36:37.706273 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 439/896] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:37 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1607 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:37.718586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:37.718586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.722659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.723568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.724205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.724993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.725656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.725935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.864772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.873078 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f768bc0-a6f5-40b4-841b-91cf045e9206 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.165789 Oct 13 08:36:37.873821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 440/897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:37 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:37.878307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:37.878907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.885693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.886182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.887193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.887991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.888372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.888791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.957907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.966654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.968108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:37.972838 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef7afe5f-082a-403f-ba35-333fdd0b4521 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.098182 Oct 13 08:36:37.973405 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 441/898] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:37 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:37.978613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:37.979104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:37.984839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.985319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.985757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:37.986480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:37.986935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:37.987361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.030327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:38.030327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:38.030327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:38.030327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:38.030327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:38.040762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.041332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.041839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.042684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.043383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.043886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.062510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Getting quotas for project e4e25ce9839e4295878b7781cbb269c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:38.066770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Getting quotas for user d46a17fe841d40e8b6dd8155217fb30b and project e4e25ce9839e4295878b7781cbb269c4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:38.067520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3bfce11-bc4f-40fb-8f1e-78132a8f30e7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.092916 Oct 13 08:36:38.068189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 442/899] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:36:37 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:36:38.073215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.074092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.081345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.081969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.082538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.084148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.085994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.086623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.093356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:38.097370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:38.163508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35d8852e-621e-4837-98fe-af57e8559c95 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979641 Oct 13 08:36:38.164884 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 458/900] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:36:38.177325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.178167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.186715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.186898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.187226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.188147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.188674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.189108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.432957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:38.452013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a12e8549-43a7-4923-b176-610dd86487ec tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1478 microversion: 2.1 time: 0.382566 Oct 13 08:36:38.452835 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 443/901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1478 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:38.458228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cf78e69-6070-4eb6-b197-543d4d8c342b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.459026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5cf78e69-6070-4eb6-b197-543d4d8c342b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.465920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:38.496316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19f048f9-760d-4c93-b071-d83abcd3c10c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1476 microversion: 2.1 time: 0.328530 Oct 13 08:36:38.497020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 459/902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:38.512731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.513663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.528352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.529217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.531918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.532952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.533533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.534079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.615749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cf78e69-6070-4eb6-b197-543d4d8c342b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:38.625794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cf78e69-6070-4eb6-b197-543d4d8c342b tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1222 microversion: 2.1 time: 0.171768 Oct 13 08:36:38.626676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 444/903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:38.638230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.643545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.655118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.655634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.656145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.656274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:38.656920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.657374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.657901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.680757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cfddaae-b876-4be3-8886-e7dc2a2cdfd1 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.180021 Oct 13 08:36:38.681682 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 460/904] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:38.686637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1394d27d-24af-406c-ab80-99fbd4804d20 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '.version_select at 0x7f5376b60a60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.692075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1394d27d-24af-406c-ab80-99fbd4804d20 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.693156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1394d27d-24af-406c-ab80-99fbd4804d20 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.693916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1394d27d-24af-406c-ab80-99fbd4804d20 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.706556 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1394d27d-24af-406c-ab80-99fbd4804d20 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1968 microversion: 2.1 time: 0.023005 Oct 13 08:36:38.708877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 461/905] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/os-migrations => generated 1968 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:38.714750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0", "tag": "7169b5d1-d049-4c15-ab84-1767da982939"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:38.730006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.730552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.731424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.757800 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] Creating event network-changed:7169b5d1-d049-4c15-ab84-1767da982939 for instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 on n-h2-858384-11 Oct 13 08:36:38.771459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ad9090be-6136-405b-a183-5d55099acd90 req-de056435-ec4f-4dff-9fd0-819692c6f88e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060038 Oct 13 08:36:38.777264 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 462/906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:38.797903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:38.799120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:38.809580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.810846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.811611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.812715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:38.813334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:38.814218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:38.987633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:39.000652 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3160b04f-71d9-455e-828e-57c312ad0e1a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1586 microversion: 2.1 time: 0.372046 Oct 13 08:36:39.004840 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 445/907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1586 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:39.013476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:39.016656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:39.023962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.025193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.025875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.026876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.027557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.028220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.075245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ac9705e-bafa-4a38-8127-3a8ca6578e38 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1631 microversion: 2.1 time: 0.296361 Oct 13 08:36:39.075824 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 463/908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:38 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1631 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:39.088880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:39.089731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:39.106715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.107222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.107666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.108377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.108885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.109291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.214846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:39.230380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:39.232692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:39.240535 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-15d82778-dec0-45f1-8011-fcbca01bd598 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.155851 Oct 13 08:36:39.242335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 464/909] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:39 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:39.249273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d523b902-f385-4cdd-b832-f5a168c55d45 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: .version_select at 0x7f5376b60310>, body: {"keypair": {"name": "tempest-keypair-1654064360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh6Bvdp99z/ZfaWnsUB8X3WGQRPcOQAC0m0dlWkjZwqWkEIyBHrw3CJPtHw4XcPq2Th9e0bwyrKNNoDbYGb1z4qpr0aq9V8x06AGtOscJGUOij+dQWtGB/vPiDI2Tk7Lw=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:39.287797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d523b902-f385-4cdd-b832-f5a168c55d45 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:39.294454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d523b902-f385-4cdd-b832-f5a168c55d45 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for user c6b6dd069e4f4c57a9f41197a2cc25d5 and project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:39.325764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:39.340757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d523b902-f385-4cdd-b832-f5a168c55d45 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096328 Oct 13 08:36:39.342495 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 465/910] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:36:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:39.524411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:39.525653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:39.536078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.537086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.537857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.539683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.540531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.541204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.832331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:39.843090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d19a02d-06ac-40bf-af03-9e8143c8a482 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1314 microversion: 2.1 time: 0.833651 Oct 13 08:36:39.845270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 446/911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:39 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:39.853086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:39.853990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:39.865358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.866250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.867060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:39.868328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:39.869060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:39.869720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.013951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:40.023536 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a76384e1-d401-4880-9bec-8327246b2097 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1274 microversion: 2.1 time: 0.175458 Oct 13 08:36:40.024121 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 447/912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:39 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:40.038301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:40.038951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:40.052739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.053240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.060228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.063123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.063798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.068364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.243825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:40.245589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:40.254738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11a21270-1df6-457c-a677-23c7e30770d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1476 microversion: 2.1 time: 0.735405 Oct 13 08:36:40.260007 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 466/913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:39 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:40.274534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:40.275469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:40.284725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.288377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c967266e-03ef-4bb8-a8ee-cb40eee7b80f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.253874 Oct 13 08:36:40.289427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.290066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 448/914] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:40 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:40.290210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.291137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.291753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.292344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.465839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:40.496876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:40.500404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:40.508711 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-847fcb10-e184-404c-b06d-348df2449fb3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.237944 Oct 13 08:36:40.536373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 467/915] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:40 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:40.673675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:40.698013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.701463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.704947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.726953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] Creating event network-changed:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h1-858384-11 Oct 13 08:36:40.738603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a4662f3a-c823-4f7c-9c4c-daa1b2a243f1 req-d3c7bac0-9498-4651-9d65-26d6fc642409 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068619 Oct 13 08:36:40.739827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 449/916] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:40.868730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:40.870604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "name": "network-vif-unplugged", "status": "completed", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:40.871250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:40.886221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.889178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.889915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.890693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.891166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.891604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.893136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:40.893724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:40.894269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:40.920754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Creating event network-vif-unplugged:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h2-858384-11 Oct 13 08:36:40.943742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:36:40.972812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6a8f478c-8676-404d-81ba-94c05b2ea7ee req-91914eb1-b623-499f-9ee1-a8b35cd1ab00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108176 Oct 13 08:36:40.973817 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 450/917] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:41.050366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:41.051278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:41.066746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.067496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.068136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.070112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.074848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.075511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.229876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:41.240256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5307c36f-b4d1-43ab-8a11-f440127c32aa tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1280 microversion: 2.1 time: 0.194500 Oct 13 08:36:41.243493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 451/918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:41 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:41.291353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:41.291966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:41.310368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.310886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.311320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.312033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.312492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.315421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.559677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:41.592588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6491a5b7-c829-4343-b6c4-6cad1f3c3c87 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1464 microversion: 2.1 time: 0.725631 Oct 13 08:36:41.598475 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 468/919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:40 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1464 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:41.622457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:41.623371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:41.631576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.632341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.633143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.634018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.634742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.635459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.647129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:41.649984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:41.663749 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6457c5bc-6d93-4232-a25f-a48609a30e50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1476 microversion: 2.1 time: 0.376642 Oct 13 08:36:41.665553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 452/920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:41 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1476 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:41.682697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:41.683591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:41.694452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.694947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.695425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.696129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:41.696577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:41.696998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:41.814679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:41.845102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bfc16fa5-473a-4747-9480-154667978816 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.245229 Oct 13 08:36:41.846474 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 469/921] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:41 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:41.974343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:41.987755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:41.989137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:42.008673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09dae83a-a31a-445b-abe5-07139da4f63e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.340692 Oct 13 08:36:42.009643 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 453/922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:41 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:42.143942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:42.152791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'deleted': False, 'project_id': '70b038fc340c436197449dd62d6782c0'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:42.159685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.160662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.161334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.162288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.164212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.165025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.270488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:42.271612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:42.283118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.285989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.292521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.293561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.294599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.295231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.405160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7fec2f27-a313-48e3-9109-13041a9ee4ca tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.553415 Oct 13 08:36:42.406563 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 470/923] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:36:41 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:36:42.443847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:42.461168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'deleted': False} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:42.471531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.475011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:42.485012 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f87f077-c3a9-46db-b8e2-1ad669f7c033 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1280 microversion: 2.1 time: 0.218898 Oct 13 08:36:42.485896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.490661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.494987 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 454/924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:42 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:42.496425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.498099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.503019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.665717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:36:42.688624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:42.689585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:42.699211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.704700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.706201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.707685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.709222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.709833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:42.881547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:42.882225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:42.883796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.044975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:43.058082 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3084e0fd-98b3-43a7-8794-7d5b7f47af9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1476 microversion: 2.1 time: 0.373639 Oct 13 08:36:43.061685 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 455/925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:42 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:43.068023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:43.068880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:43.076395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:43.077449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:43.078105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.079069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:43.080120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:43.080778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.182861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:43.221999 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5ca1b02-f03b-43df-b34d-37fffa5bce3f tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.158857 Oct 13 08:36:43.234669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 456/926] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:43 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:43.246949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:43.268360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:43.269710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:43.270659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.289377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Creating event network-changed:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h2-858384-11 Oct 13 08:36:43.297377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:36:43.318429 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2ad3eb43-ba5b-48dd-b99a-1254373d30e7 req-bf39b669-995c-498d-ba11-3815be2291d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077826 Oct 13 08:36:43.319671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 457/927] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:43.326438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:43.327435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:43.337679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:43.338184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:43.338677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.339398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:43.339856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:43.340287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:43.476381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:43.491868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:43.495153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:43.502335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbe9272e-ad65-4052-80b6-53f69175a33f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.181339 Oct 13 08:36:43.504787 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 458/928] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:43 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:43.524867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-580399072", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "855f3368-1207-411b-b46e-0f9d164fb505"}], "security_groups": [{"name": "tempest-securitygroup--1637676033"}], "key_name": "tempest-keypair-1654064360", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:43.717108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] validate_networks() for [('855f3368-1207-411b-b46e-0f9d164fb505', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:44.178825 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-198f9183-7413-452c-b330-2cc185c2a835 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22641 microversion: 2.1 time: 1.739084 Oct 13 08:36:44.180475 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 471/929] 10.222.0.23 () {58 vars in 1171 bytes} [Thu Oct 13 08:36:42 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22641 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:36:44.185314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:44.186841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:44.200791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.201641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.202277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.203222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.207064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.208728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.589015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:44.600745 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cd60117-2b00-4250-8faf-d2fe8f3ee8a5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.416994 Oct 13 08:36:44.601522 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 472/930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:44 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:44.612790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:44.613859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:44.614600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:44.615182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:44.615770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:44.623935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:44.624826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:44.628669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.629168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.629650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.630387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.630873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.631584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.632780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.633983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.634692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.635773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.636457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.637109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.653078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:44.658030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for user c6b6dd069e4f4c57a9f41197a2cc25d5 and project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:44.662263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:44.674578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:44.677267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:44.714066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:44.740710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1067a4e2-1c98-4004-bc9b-d87e9df3f722 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.233584 Oct 13 08:36:44.741634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 459/931] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:36:44.746894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:44.752811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'deleted': False, 'project_id': '70b038fc340c436197449dd62d6782c0'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:44.771305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.772062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.772700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.773673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.774341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.775034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.897297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc53f47a-70d0-47bc-ae5c-8dd5c9940007 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=415617a067b44660b1e29f33c12110e9" status: 200 len: 15 microversion: 2.1 time: 0.153717 Oct 13 08:36:44.897881 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 460/932] 10.222.0.23 () {58 vars in 1231 bytes} [Thu Oct 13 08:36:44 2022] GET /compute/v2.1/servers/detail?tenant_id=415617a067b44660b1e29f33c12110e9 => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:36:44.902623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:44.903235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:44.926976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.928026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.928469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:44.929238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:44.930910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:44.931337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.044502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:45.081743 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11ce5efd-428c-4f01-8cc0-9f663f3f9db5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.179497 Oct 13 08:36:45.083958 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 461/933] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:44 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:45.091048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:45.092181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:45.099384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.100267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.102134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.103411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.104382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.105359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.221194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.236332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.237749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.252149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a50779cc-64b1-4885-8f17-fb508d8e6e45 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.167040 Oct 13 08:36:45.260022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 462/934] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:45.269552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.280995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9428c12-cebd-487f-981b-56d246dab817 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:45.281885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9428c12-cebd-487f-981b-56d246dab817 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:45.288930 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3be843f5-2a65-4d53-a619-8e373caee2cd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1474 microversion: 2.1 time: 0.671519 Oct 13 08:36:45.291469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 473/935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:44 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1474 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:45.308069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:45.334566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'tenant_id': '415617a067b44660b1e29f33c12110e9', 'deleted': False} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:45.387833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.395078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.396085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.397098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.398634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.399687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.431050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9428c12-cebd-487f-981b-56d246dab817 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.443353 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9428c12-cebd-487f-981b-56d246dab817 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1234 microversion: 2.1 time: 0.181134 Oct 13 08:36:45.451063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 463/936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1234 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:45.469448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652f0740-6e60-49be-9fd2-4d761d4fab0f", "tag": "9546fe4b-c336-4185-9d9c-99a978a65a3b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:45.482468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.483078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.483605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.485828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:36:45.495736 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] Creating event network-changed:9546fe4b-c336-4185-9d9c-99a978a65a3b for instance 652f0740-6e60-49be-9fd2-4d761d4fab0f on n-h1-858384-11 Oct 13 08:36:45.503427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7ccb96d3-6872-46db-ba02-aa2abd3a657d req-6fd2bbbc-141c-4628-b8f3-2a11b7674186 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050831 Oct 13 08:36:45.504285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 464/937] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:45.609062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.609544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.610003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.628545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:45.629251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:45.651242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.651641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.652088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.652918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.653377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.653808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.860004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a49d7648-360a-4e49-bc21-37c09800fe61 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=415617a067b44660b1e29f33c12110e9" status: 200 len: 4833 microversion: 2.1 time: 0.567412 Oct 13 08:36:45.861087 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 474/938] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=415617a067b44660b1e29f33c12110e9 => generated 4833 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:45.890276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:45.901868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'tenant_id': '70b038fc340c436197449dd62d6782c0', 'deleted': False} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:45.909560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:45.916422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.917149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.917579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.918297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:45.919001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:45.919758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:45.921434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d592068b-6375-4b58-9a5f-56bd5d00a152 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.296619 Oct 13 08:36:45.926955 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 465/939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:45.954007 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd594d18-b38b-4d55-9596-b1080f0821f6 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=70b038fc340c436197449dd62d6782c0" status: 200 len: 15 microversion: 2.1 time: 0.069051 Oct 13 08:36:45.955436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 475/940] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=70b038fc340c436197449dd62d6782c0 => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:36:45.986863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1615e08d-acd4-4007-98ba-ab625c1d2ff4 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.002524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1615e08d-acd4-4007-98ba-ab625c1d2ff4 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.021321 Oct 13 08:36:46.008648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 466/941] 10.222.0.23 () {58 vars in 1189 bytes} [Thu Oct 13 08:36:45 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:36:46.036719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:46.044672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.051900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.052671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.053330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.054261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.055485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.056128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.117471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.118224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.131978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.132587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.133064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.137311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.137844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.140971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.161771 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-654dbce4-2866-45ed-b679-232af6f7d67b tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 0 microversion: 2.1 time: 0.128773 Oct 13 08:36:46.165453 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 476/942] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:46 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:36:46.171294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.177758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.178789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '415617a067b44660b1e29f33c12110e9'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:46.185953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.186528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.187130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.187927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.188453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.188948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.280728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:46.330893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b3cabbc-a5e0-4051-9fcd-c3232987a316 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.215130 Oct 13 08:36:46.331455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:36:46.350486 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 467/943] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:46.350486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.350486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.352760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.353353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.354040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.355965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.356493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.357015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.408998 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00b4198d-6407-4d18-85ff-c59c6ab76061 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.240337 Oct 13 08:36:46.409579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 477/944] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:46.415145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.415766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.432822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.433436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.433980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.434938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.435463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.435964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.446745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.456157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.457653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.464981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42bf2062-b05c-473a-937e-5600040835aa tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.124245 Oct 13 08:36:46.464981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 468/945] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:46.464981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:46.475280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.485241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.485734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.486175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.486920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.487376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.488896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.589524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d0529c3-834c-4ec6-a958-f41024f20795 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 0 microversion: 2.1 time: 0.122967 Oct 13 08:36:46.593359 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 469/946] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:46 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:36:46.595881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.596491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.602538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.603025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.603457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.604657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.604657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.605018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.619057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.632263 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b5c33bf-2db1-4b17-bcca-1eef958823c8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1474 microversion: 2.1 time: 0.221584 Oct 13 08:36:46.633427 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 478/947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1474 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:46.644143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.644143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.645436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.645971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.646443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.647248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.647808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.648365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.682366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:46.695604 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b343e86f-9d58-4ba0-8498-d74f15464c21 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1286 microversion: 2.1 time: 0.103897 Oct 13 08:36:46.696462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 470/948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:46.797676 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-104562d8-3d47-4cac-ad2b-2e062a71c852 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1616 microversion: 2.1 time: 0.163087 Oct 13 08:36:46.798295 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 479/949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1616 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:46.879868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.880702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.887393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.887818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.888257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.888938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.889399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.889825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.894495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:46.945152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:46.945737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:46.953164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.953664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.954110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:46.955248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:46.955715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:46.956218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.039907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-147fe2dc-41a1-4219-84a5-cc97f20844dd tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1616 microversion: 2.1 time: 0.163220 Oct 13 08:36:47.055745 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 471/950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1616 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:47.062040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.068256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'host': 'n-h2-858384-11', 'deleted': False} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:47.073897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.074382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.074945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.075671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.076122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.076542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.161413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:47.173549 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9bb78957-83e8-4a05-a689-83cd8a2ea605 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.232209 Oct 13 08:36:47.174830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 480/951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:46 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:47.185103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:36:47.286462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a95fcb32-e728-4eed-8b7a-c9cc86f9b3bf tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h2-858384-11&all_tenants=1" status: 200 len: 2979 microversion: 2.1 time: 0.227782 Oct 13 08:36:47.287302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 472/952] 10.222.0.23 () {58 vars in 1192 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers?host=n-h2-858384-11&all_tenants=1 => generated 2979 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:47.300760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.306308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:36:47.321969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.321969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.321969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.322674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.324095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.325120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.368703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.369423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.381677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.382270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.383505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.384705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.386866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.387379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.451876 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52fdaa4d-0c94-451c-9bbe-5ee348160c51 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.155045 Oct 13 08:36:47.467027 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 481/953] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:36:47.475524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:47.479100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.504471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.509971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.510709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.511745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.512357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.512969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.535615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:47.559679 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c174aee-0583-46df-8c1b-43821f59e143 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.200479 Oct 13 08:36:47.575642 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 473/954] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:47.591854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.592593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.599791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.600411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.600917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.602426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.605850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.606371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.660933 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f19e3a1-c3be-49bb-b2d9-6b0921865b6c tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 0 microversion: 2.1 time: 0.191204 Oct 13 08:36:47.665643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 482/955] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:47 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:36:47.670845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.672224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.678618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.679110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.680080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.680801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.681264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.681990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.702001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:47.714502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:47.716197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:47.725688 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcf1edc2-db42-4be0-b531-0fc3f2deb58f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.148703 Oct 13 08:36:47.727646 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 474/956] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:47.734984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:47.738837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.747983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.748981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.749589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.750730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.751365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.751955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.882142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:47.882658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:47.883469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:47.883891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:47.884383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:47.919784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:47.943706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c623665-9e79-44ee-9789-99488831e5c1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1474 microversion: 2.1 time: 0.277953 Oct 13 08:36:47.945856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 483/957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1474 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:47.955346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:47.958334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:47.967477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.968405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.969334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.971426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:47.972419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:47.973360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:47.999924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:48.010792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.011680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.012131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.012847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.013364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.013790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.065452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-085c94e4-fbc5-4516-b091-76d15a669b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 1067 microversion: 2.1 time: 0.333039 Oct 13 08:36:48.066041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 475/958] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:47 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 1067 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 13 08:36:48.088047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:48.088659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:48.096688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.097310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.097900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.098648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.099281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.099774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.108775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.129551 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d391281-ad61-41f5-910b-fc1fbe420c99 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1286 microversion: 2.1 time: 0.181731 Oct 13 08:36:48.134517 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 484/959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:47 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:48.197862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:48.198989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:48.215281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.218265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.219085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.220037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.220798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.221504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.335536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.346069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76a7ad20-7f28-49bf-89b3-3f5c598b0e6f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.261871 Oct 13 08:36:48.351717 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 476/960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:48 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:48.419004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.430730 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ca86cb2-135e-4347-9b3e-dd4e6fcc9516 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.237354 Oct 13 08:36:48.442430 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 485/961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:48 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:48.594696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:48.595346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:48.605792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.606284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.606743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.614660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.616754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.620461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.756951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:48.758436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:48.771015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.771629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.772079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.772782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:48.777320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:48.777881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:48.940590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.952780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:48.956838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.958281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:48.983351 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-661bfe9f-4268-45eb-8b13-82b0ef40d27c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.231103 Oct 13 08:36:48.988910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 486/962] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:48 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:48.996095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:49.010343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.022260 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5226685-9dcb-4cb4-ae64-5b5bcc8fa0aa tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1929 microversion: 2.75 time: 0.431536 Oct 13 08:36:49.030155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.030713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.031149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.031868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.032316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.032732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.033898 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 477/963] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:48 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1929 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:49.058560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:49.165056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:49.165987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.174012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.174770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.175391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.176310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.177128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.177849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.354899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:49.363155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad0cd9a5-44b8-49eb-b691-c00fd10a6465 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1471 microversion: 2.1 time: 0.373093 Oct 13 08:36:49.363742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 487/964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:48 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:49.375976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:49.377229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.391256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.392045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.392817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.393778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.394389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.394954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.645372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:49.660058 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48ae04cf-b337-4465-8867-55ddba980c2d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.290817 Oct 13 08:36:49.672138 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 488/965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:49 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:49.677658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:49.685490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df3c5293-2d22-45b9-b23d-ef90d84a9248 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1292 microversion: 2.1 time: 0.528669 Oct 13 08:36:49.686068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 478/966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:49 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1292 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:49.686457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:49.687119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.694199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.694742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.695749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.696476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.696934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.697363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.713388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:49.713388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.733967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.734479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.734922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.736144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.736144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.736494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.830330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38fee97c-5820-4abe-8ada-e2fbb1cd4840 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221/action" status: 204 len: 0 microversion: 2.1 time: 0.147985 Oct 13 08:36:49.832511 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 489/967] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:49 2022] POST /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221/action => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:36:49.848537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:49.849250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:49.866354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.868289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.869025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.869464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:49.869921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:49.870345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:49.913651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:49.923168 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f886709-8d06-453a-8375-71ce5bb150b2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.216342 Oct 13 08:36:49.934872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 479/968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:49 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:50.017067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:50.020840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:50.027556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.028554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.029275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.031160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.031911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.032802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.328455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.339954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c1fb70a-2870-4641-af79-07843cb61172 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1471 microversion: 2.1 time: 0.500877 Oct 13 08:36:50.343116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 490/969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:49 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:50.353486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.357268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:50.358004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:50.362879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.374512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.375198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.375664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.378896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.379589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.381957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.383334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.399177 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f4dd465-962e-48db-94cb-f22f36426a91 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.383355 Oct 13 08:36:50.411933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 480/970] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:50 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:50.590909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:50.609880 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9fc2b61-cda9-46e9-9ffb-6626307285d5 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1935 microversion: 2.75 time: 0.264781 Oct 13 08:36:50.622432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 491/971] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:50 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1935 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:50.701452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:50.721827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:50.724873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:50.725966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:50.729059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.729557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.729993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.730732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.733535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.734474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.735016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.735529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.736188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.737585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:50.738155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:50.738727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:50.968328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.974920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:50.979411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-97d83b35-d444-4b20-abd1-51d7202c59d9 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.269489 Oct 13 08:36:50.980195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 492/972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:50 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:50.990017 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-270cdc60-87e8-496d-a5cf-d9147e46d4bd tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.305109 Oct 13 08:36:50.991735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 481/973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:50 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:51.021596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:51.022562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:51.048766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.049254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.049692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.050424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.050868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.051297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.313003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:51.321687 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a00e55df-96d1-4e54-bbe0-e5cbc7f05ce6 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.318769 Oct 13 08:36:51.322304 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 493/974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:50 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:51.372618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:51.373234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:51.381113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.381592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.390296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.393727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.394210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.394965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.432662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:51.433549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:51.445417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.446247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.446914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.447892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.449708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.450351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.602883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:51.624950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:51.634043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:51.658531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9b5b7769-d5d9-42d7-bceb-e1fa37b42c2a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.230783 Oct 13 08:36:51.663366 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 494/975] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:51 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:51.676326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:51.679459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:51.707649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.710485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.711674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.712957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:51.722973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:51.725140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:51.908728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:51.924191 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfcddb91-283e-42a1-93b2-722bfa4d0c63 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1471 microversion: 2.1 time: 0.555249 Oct 13 08:36:51.926544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 482/976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:51 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1471 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:51.978852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] Lazy-loading 'services' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:51.993504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "name": "network-vif-plugged", "status": "completed", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:52.021315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.021805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.022234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.045765 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d115da38-3858-4cb0-b492-90012a126330 tempest-ServersAdmin275Test-4044725 tempest-ServersAdmin275Test-4044725-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1920 microversion: 2.75 time: 0.374553 Oct 13 08:36:52.046590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 495/977] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:51 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1920 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:52.082257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.092961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.094494 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Creating event network-vif-plugged:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h2-858384-11 Oct 13 08:36:52.106812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.107308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.107751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.108465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.108918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.109342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.111702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:36:52.135429 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-570920a5-839b-4718-9978-538bb7c5297b req-5605e075-f676-49ff-8959-9d579ce9669f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146160 Oct 13 08:36:52.137030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 483/978] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:52.152247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.152964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.168050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.171720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.174946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.176337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.177249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.179008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.403899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:52.415278 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62d9ff2e-a673-4877-9158-52c2ae3a728a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.340043 Oct 13 08:36:52.417449 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 496/979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:52 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:52.425433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.426938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.459741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.460363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.461583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.462346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.463498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.465530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.500913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:52.510205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4d256fb0-abf5-4c43-9622-0182557d208c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.371958 Oct 13 08:36:52.513203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:36:52.522415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 484/980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:52 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:52.527957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.528867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.535600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.536512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.537063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.537882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.538493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.539276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.545048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:52.737493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-faae9609-9cd6-4c55-aad2-de7ca8e91034 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 204 len: 0 microversion: 2.75 time: 0.316830 Oct 13 08:36:52.741229 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 497/981] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:36:52 2022] DELETE /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:36:52.744712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:52.765856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.766344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.766803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.793688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] Creating event network-changed:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h1-858384-11 Oct 13 08:36:52.801010 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-708712b9-7e94-46fb-8e69-eb1aac68d66a req-76948e2a-770d-4f88-af9e-362e145df94e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061486 Oct 13 08:36:52.819004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 498/982] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:52.821263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:52.824901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.825799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.831579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2ee12e4-adff-4ce0-abeb-f3f8813172bc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.307282 Oct 13 08:36:52.833409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.838947 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 485/983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:52 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:52.840056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.840839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.841882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.842527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.844254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.877165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:52.882836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:52.911081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.913582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.916614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:52.919351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:52.922177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:52.925148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.057298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.071341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.073131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.086820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3d19c09-ec39-49c5-876c-ecaef2772eb2 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1443 microversion: 2.75 time: 0.219675 Oct 13 08:36:53.088708 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 486/984] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:52 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1443 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:53.096547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:53.097386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:53.106940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.107704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.109204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.110545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.111158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.111764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.120240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.131013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.134132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.140317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6da81fba-967b-46e8-a96f-93fdb9e50855 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.319756 Oct 13 08:36:53.159277 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 499/985] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:52 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:53.256101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.266912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8577f91b-916d-4876-81d2-b7cede883c06 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1471 microversion: 2.1 time: 0.176953 Oct 13 08:36:53.268056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 487/986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:53 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:53.444660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:53.445976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:53.452457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.453060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.454554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.455278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.455901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.456323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.539191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:53.540802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:53.547514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.547995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.548425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.549122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.549566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.550129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.620660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.633596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17ca0078-8810-441f-8839-9a062d8b52e6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.191911 Oct 13 08:36:53.646996 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 500/987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:53 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:53.698529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:53.708465 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f3d5996-f952-4ee1-adc4-2f6bd8966b55 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.173083 Oct 13 08:36:53.709529 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 488/988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:53 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:53.868255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:53.868838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:53.871001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:53.877808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.878382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.878926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.879853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:53.880419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:53.880842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:53.886160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:54.031080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.042715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c62a02bf-a7b5-44b3-8e27-1ac227c96b88 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.176143 Oct 13 08:36:54.055031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 501/989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:53 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:54.118705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.119356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.127694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.128678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.129400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.130602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.131214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.131796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.162041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652f0740-6e60-49be-9fd2-4d761d4fab0f", "name": "network-vif-plugged", "status": "completed", "tag": "9546fe4b-c336-4185-9d9c-99a978a65a3b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:54.173335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.173975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.174539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.197398 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] Creating event network-vif-plugged:9546fe4b-c336-4185-9d9c-99a978a65a3b for instance 652f0740-6e60-49be-9fd2-4d761d4fab0f on n-h1-858384-11 Oct 13 08:36:54.202858 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c0de96ae-ab73-417e-b628-f19bbe4ab2e8 req-3c396e18-a1fd-4dd1-973e-670e57255e22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046720 Oct 13 08:36:54.208776 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 502/990] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:36:54.214901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.215644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.217813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.222705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.223289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.224376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.225183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.225713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.226282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.231764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.237638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.251996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc64bd14-c1f1-47d0-b9aa-49928407fe52 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1443 microversion: 2.75 time: 0.136739 Oct 13 08:36:54.254741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 489/991] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1443 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:54.290700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.291466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.298935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.300274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.300973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.302086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.308061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.308912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.330731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.347690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.349268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.354990 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e63e6130-dded-4b40-9e80-9e872752495d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.144870 Oct 13 08:36:54.355559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 503/992] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:54.475804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.484500 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97df44c8-9e22-4a39-8fba-26dacce3802d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1463 microversion: 2.1 time: 0.197806 Oct 13 08:36:54.485082 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 490/993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1463 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:54.514019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.515537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.522036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.522567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.523039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.523743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.524197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.524623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.656964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.657719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.667288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.668451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.668848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.671014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.671486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.671920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.681081 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8973b909-69a6-4ccf-9c4b-93dfcf140aab tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1616 microversion: 2.1 time: 0.174055 Oct 13 08:36:54.681842 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 504/994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1616 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:54.716339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-226ea7fa-aed7-4281-9dd0-93a2a233eccc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '.version_select at 0x7f537683e430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.719830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-226ea7fa-aed7-4281-9dd0-93a2a233eccc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.720315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-226ea7fa-aed7-4281-9dd0-93a2a233eccc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.720766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-226ea7fa-aed7-4281-9dd0-93a2a233eccc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.732089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-226ea7fa-aed7-4281-9dd0-93a2a233eccc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1965 microversion: 2.1 time: 0.019886 Oct 13 08:36:54.732839 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 505/995] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/os-migrations => generated 1965 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:54.771804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:54.772627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:54.779811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.780401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.780999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.781807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:54.782453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:54.783006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:54.864574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:54.874302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-708d3bed-fbd3-445d-8b15-1a9d75cefc78 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.221290 Oct 13 08:36:54.890723 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 491/996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:54.924542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1667568873", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:55.009110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.013574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:36:55.032377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fff2b1b8-89a1-4b5f-8ec5-b04df51e0bfe tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.269949 Oct 13 08:36:55.033356 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 506/997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:54 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:55.075351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:55.075351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:55.082911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.084960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.084960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.094062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.094062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.094062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.243597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.253468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e83a631c-2473-4bdf-9e14-12b323e316e7 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.183306 Oct 13 08:36:55.254804 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 507/998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:55 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:55.299075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:55.301881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:55.311281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:36:55.312223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:36:55.312881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:36:55.313456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:36:55.314049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:36:55.321550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.322165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.323402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.326104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.327856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.328405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.332173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.332661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.333130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.333861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.334316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.334765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.395855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:36:55.407589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:36:55.413363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:55.426821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:36:55.431451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:36:55.452841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.482381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.492666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.513179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7669afe2-3949-4004-82b9-a3b26330c788 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1443 microversion: 2.75 time: 0.234124 Oct 13 08:36:55.515042 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 508/999] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:55 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1443 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:55.528983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:55.533671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:55.554848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.557494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.562392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.564443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.566956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.567635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.586189 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-859ba006-d125-44be-b781-ed5acbe3941e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663613 Oct 13 08:36:55.590863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 492/1000] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:36:55.600215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f59e6a1-6173-44a7-800d-07ddfc1d78d8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:55.602276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f59e6a1-6173-44a7-800d-07ddfc1d78d8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:55.606785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:55.694685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f59e6a1-6173-44a7-800d-07ddfc1d78d8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.700670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.716840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f59e6a1-6173-44a7-800d-07ddfc1d78d8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1213 microversion: 2.1 time: 0.121642 Oct 13 08:36:55.718150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.720832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 493/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:55 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:55.721151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:55.726361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00f813a7-70e9-462c-8a4f-2e111e012f67 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.209482 Oct 13 08:36:55.727712 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 509/1002] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:55 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:55.901223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:55.902727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:55.909419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.910732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.922123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:55.924226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:55.924943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:55.925594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.058238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:56.058863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:56.064995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.065474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.065902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.066627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.067073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.067495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.083940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.091770 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-be5417e2-08dc-437a-a180-e655ec1b4716 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.197482 Oct 13 08:36:56.092341 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 494/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:55 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:56.203622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.211671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1af426e-5411-431a-8e37-ad60a30f468b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.157894 Oct 13 08:36:56.212232 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 510/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:56 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:56.276602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:56.277244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:56.283933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.284416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.284850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.285535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.285982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.286398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.455276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.465327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67e6e704-8be5-4e20-ac9b-dc985e0f9449 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1322 microversion: 2.1 time: 0.192436 Oct 13 08:36:56.465936 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 495/1005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:56 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:56.546229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:56.547132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:56.553146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.553827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.554264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.555127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.555601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.556028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.589016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.589497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.589934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.590380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lazy-loading 'fault' on Instance uuid ec598e36-f013-4945-8bb5-3fc3b32ce8b5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:56.629270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.637101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.638604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1680cbcb1d94e5b8989789a5d37acec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5e7548316844ffb543c4a0393e49ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.643265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61944aea-c7db-4077-b59e-e314d9a50139 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 200 len: 1448 microversion: 2.75 time: 0.102265 Oct 13 08:36:56.643851 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 511/1006] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:56 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 1448 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:56.764432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:56.765017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:56.771219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.771704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.772344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.773552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.774012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.774126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:56.774458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.774720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:56.780604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.781156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.781627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.782514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:56.782999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:56.783478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:56.839733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.847903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3da47712-67a6-4075-983b-83def298fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1209 microversion: 2.1 time: 0.087367 Oct 13 08:36:56.848478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 496/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:56 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:56.862562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.862562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.863868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:56.869937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8cdef004-e711-46b5-ab14-a30d9af7cf4a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.100386 Oct 13 08:36:56.870535 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 512/1008] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:56 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:36:57.116602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.117895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.124699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.125173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.125626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.126560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.127018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.127501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.237355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.238311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.244996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.245484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.245915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.246665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.247116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.247543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.276291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:57.285144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d88446c0-3c61-4bb7-8bb4-061eaba37f1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.173709 Oct 13 08:36:57.285642 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 497/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:57.360364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:57.489171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.489783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.496876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.497367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.497801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.498676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.499134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.499560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.643597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:57.653652 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b80b20f-c8d7-4f67-98bb-50d76ec8d395 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1471 microversion: 2.1 time: 0.167870 Oct 13 08:36:57.654764 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 498/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:57.675715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.676824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] [instance: ec598e36-f013-4945-8bb5-3fc3b32ce8b5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.685533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.686027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.686665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.687373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.687829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.688262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.703013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] HTTP exception thrown: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Request method failure captured: Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 HTTP/1.1 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83b94BnB2avsyxY9Fk5aTYpv4hobwWdL65Y0TQYjy-1rxkR5RkQrY0n-qyqRIRy94zhUJ9aS5zOt6To4LeiGlVYnlUUilJqIaAtt7cuhTu_puqCacXtMNX546fVS9LUMXoZ2e4AUTAcIKWdyUcJCzORMdAXSvw3_MohmnTjxvxbxWs Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.75 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bb5e7548316844ffb543c4a0393e49ea Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdmin275Test-895248932 Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:36:57.705046 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb5e7548316844ffb543c4a0393e49ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb5e7548316844ffb543c4a0393e49ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb5e7548316844ffb543c4a0393e49ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb5e7548316844ffb543c4a0393e49ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdmin275Test-895248932 Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bb5e7548316844ffb543c4a0393e49ea Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdmin275Test-895248932 Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdmin275Test-895248932-project Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f1680cbcb1d94e5b8989789a5d37acec Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdmin275Test-895248932-project Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. Oct 13 08:36:57.706854 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ec598e36-f013-4945-8bb5-3fc3b32ce8b5'} Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:57.707740 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. Oct 13 08:36:57.708983 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:57.710093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] Returning 404 to user: Instance ec598e36-f013-4945-8bb5-3fc3b32ce8b5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:57.710093 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6c44db3-cedd-4644-bb74-ca35b72171b0 tempest-ServersAdmin275Test-895248932 tempest-ServersAdmin275Test-895248932-project] 10.222.0.23 "GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5" status: 404 len: 111 microversion: 2.75 time: 0.039254 Oct 13 08:36:57.710093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 499/1011] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/ec598e36-f013-4945-8bb5-3fc3b32ce8b5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:36:57.712424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:57.712990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.719297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.719779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.720212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.720913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.721518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.721839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.746744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lazy-loading 'flavor' on Instance uuid 652f0740-6e60-49be-9fd2-4d761d4fab0f {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:36:57.784655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:57.800397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08416fb7-e9f0-4066-a7d4-551fb4cb3432 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.568724 Oct 13 08:36:57.801396 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 513/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:57.823607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd725b63-b67f-42e0-9b81-b610c188f350 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f/action" status: 202 len: 0 microversion: 2.1 time: 0.114769 Oct 13 08:36:57.827499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 500/1013] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:57 2022] POST /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:36:57.837098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.840551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.853396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.854180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.856951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.857688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.858308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.858961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.873507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.875332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.883633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.884374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.885094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.886085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.886803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.887443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.964347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:57.973223 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b023e537-fdd8-4efc-b1cb-a7c551d5188a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1271 microversion: 2.1 time: 0.104134 Oct 13 08:36:57.973779 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 501/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:57.978779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:57.979565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:57.985660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.986461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.987059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:57.987916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:57.988524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:57.989100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:58.010199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:36:58.068664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:58.077592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:58.079170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:58.084899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0568999-e1a1-42be-96cc-4de4bf5ff6b3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.109973 Oct 13 08:36:58.086499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 502/1015] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:58.219468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4067270d-a68a-4300-95f9-5d67c4bda98b tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1632 microversion: 2.1 time: 0.388712 Oct 13 08:36:58.234809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 514/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:57 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1632 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:58.308591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:58.309207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:58.315618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:58.316122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:58.316749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:58.317592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:58.318197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:58.318793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:58.468288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:58.476607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5518cca9-1a14-47a4-b5ca-b7fb7d79d83a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.171224 Oct 13 08:36:58.477455 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 503/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:58 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:58.825068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:58.825700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:58.836927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:58.837422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:58.837934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:58.839952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:58.839952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:58.839952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:58.997638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:58.998921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.007830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.010113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.010759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.011638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.013027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.014188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.131836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.145574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fc77c3c8-c2c4-4aa3-8702-edd012851c3a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.324941 Oct 13 08:36:59.158581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 515/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:58 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:59.158581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:59.158581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.165719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.166298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.166864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.168264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.168794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.170094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.249072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.251082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.262491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-14a45604-2800-4a4f-a624-49c9cabc024c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.268590 Oct 13 08:36:59.275312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.275312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.280126 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 504/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:58 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:59.281959 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a3ae20d-26ed-4b02-99f9-3c5a79424ddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.133571 Oct 13 08:36:59.284921 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 516/1020] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:36:59 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:36:59.285078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:59.285731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.309579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.310267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.310876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.311756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.312359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.312951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.500785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:59.501774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.503328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22856d40-9771-45de-b8bc-4c0cebe8ad8c tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1615 microversion: 2.1 time: 0.221388 Oct 13 08:36:59.504585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 505/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:59 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1615 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:36:59.513188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.513699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.514460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.515337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.515984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.516598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.528554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:59.529629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.551324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.551820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.552257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.552963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.555844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.556655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.641022 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] HTTP exception thrown: Cannot 'migrate' instance 652f0740-6e60-49be-9fd2-4d761d4fab0f while it is in vm_state suspended Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Request method failure captured: Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f/action HTTP/1.1 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839lxQEs8OSp82bklxvn32uHbmjPS8u0Pbvka8lKmcnZMeCw0DBkcYQGaVNyCHRCl2S778qkvCRdFgryUo5EMKGO3mw9zHuWHKRTgWEoJs0721406MQ2qlH1nKd39xIvEIWmjtwIOBB_CttEQYiVj0geLK2UWlnBIMkyo7PumIldzs Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:36:59.642753 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_436ef6b0d8264ece8802e97baf719388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 071b57486fd84cadad576609f1617324 Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: {"migrate": {}} Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:59.644306 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'migrate' instance 652f0740-6e60-49be-9fd2-4d761d4fab0f while it is in vm_state suspended Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '652f0740-6e60-49be-9fd2-4d761d4fab0f', 'body': {'migrate': {}}} Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f in vm_state suspended. Cannot resize while the instance is in this state. Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.645348 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 652f0740-6e60-49be-9fd2-4d761d4fab0f while it is in vm_state suspended Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.646808 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.648991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:36:59.648991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:36:59.648991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 652f0740-6e60-49be-9fd2-4d761d4fab0f while it is in vm_state suspended Oct 13 08:36:59.648991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.650609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Returning 409 to user: Cannot 'migrate' instance 652f0740-6e60-49be-9fd2-4d761d4fab0f while it is in vm_state suspended {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:59.650826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3353dbb4-40f7-42d9-8049-95312425b2db tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f/action" status: 409 len: 148 microversion: 2.1 time: 0.126288 Oct 13 08:36:59.656700 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 506/1022] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:59 2022] POST /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f/action => generated 148 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:36:59.661340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4135d4d1-1619-4964-bb7d-bab1029a2bef tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4135d4d1-1619-4964-bb7d-bab1029a2bef tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Request method failure captured: Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action HTTP/1.1 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 39 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839lxQEs8OSp82bklxvn32uHbmjPS8u0Pbvka8lKmcnZMeCw0DBkcYQGaVNyCHRCl2S778qkvCRdFgryUo5EMKGO3mw9zHuWHKRTgWEoJs0721406MQ2qlH1nKd39xIvEIWmjtwIOBB_CttEQYiVj0geLK2UWlnBIMkyo7PumIldzs Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:36:59.669346 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_436ef6b0d8264ece8802e97baf719388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 071b57486fd84cadad576609f1617324 Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: {"os-resetState": {"state": "invalid"}} Oct 13 08:36:59.670722 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '34788658-a03f-4156-8054-05dd3360632f', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'invalid' Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.671894 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:36:59.673424 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 13 08:36:59.676327 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.676327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4135d4d1-1619-4964-bb7d-bab1029a2bef tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:59.676327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4135d4d1-1619-4964-bb7d-bab1029a2bef tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action" status: 400 len: 144 microversion: 2.1 time: 0.013073 Oct 13 08:36:59.676327 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 507/1023] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:59 2022] POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action => generated 144 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:36:59.680799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe337034-8251-4054-8c1b-94525077e860 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe337034-8251-4054-8c1b-94525077e860 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Request method failure captured: Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action HTTP/1.1 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 31 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839lxQEs8OSp82bklxvn32uHbmjPS8u0Pbvka8lKmcnZMeCw0DBkcYQGaVNyCHRCl2S778qkvCRdFgryUo5EMKGO3mw9zHuWHKRTgWEoJs0721406MQ2qlH1nKd39xIvEIWmjtwIOBB_CttEQYiVj0geLK2UWlnBIMkyo7PumIldzs Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:36:59.687671 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_436ef6b0d8264ece8802e97baf719388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 071b57486fd84cadad576609f1617324 Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: {"os-resetState": {"state": 1}} Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:59.689005 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '34788658-a03f-4156-8054-05dd3360632f', 'body': {'os-resetState': {'state': 1}}} Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 1 Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:59.689920 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 13 08:36:59.691616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.692701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe337034-8251-4054-8c1b-94525077e860 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:59.692701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe337034-8251-4054-8c1b-94525077e860 tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action" status: 400 len: 120 microversion: 2.1 time: 0.012085 Oct 13 08:36:59.692701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 508/1024] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:36:59 2022] POST /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f/action => generated 120 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:36:59.701884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:59.704198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Failed to fetch instance by id 999 {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:36:59.704972 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Request method failure captured: Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 37 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839lxQEs8OSp82bklxvn32uHbmjPS8u0Pbvka8lKmcnZMeCw0DBkcYQGaVNyCHRCl2S778qkvCRdFgryUo5EMKGO3mw9zHuWHKRTgWEoJs0721406MQ2qlH1nKd39xIvEIWmjtwIOBB_CttEQYiVj0geLK2UWlnBIMkyo7PumIldzs Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:36:59.706743 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_436ef6b0d8264ece8802e97baf719388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/436ef6b0d8264ece8802e97baf719388"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 436ef6b0d8264ece8802e97baf719388 Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-600114629 Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 071b57486fd84cadad576609f1617324 Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-600114629-project-admin Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: {"os-resetState": {"state": "error"}} Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:36:59.708205 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 999 could not be found. Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:36:59.708976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:36:59.710196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a37cfb88-64eb-4ea3-a0b5-e394c2581a5d tempest-ServersAdminNegativeTestJSON-600114629 tempest-ServersAdminNegativeTestJSON-600114629-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.009937 Oct 13 08:36:59.714156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 509/1025] 10.222.0.23 () {60 vars in 1179 bytes} [Thu Oct 13 08:36:59 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:36:59.719197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:59.719686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.726954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.727447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.727885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.728596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.729033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.729457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.742679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:36:59.754658 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8edc29f6-adee-45bd-88d6-e245bec48c31 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.257667 Oct 13 08:36:59.756907 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 517/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:59 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:36:59.764606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:36:59.775010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:36:59.792627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.793492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.794152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.807823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] Creating event network-changed:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h1-858384-11 Oct 13 08:36:59.813009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4fd22dad-b6d6-41ed-a28f-d6107a63b3a0 req-60488b66-1e19-4103-a872-71b9dc278fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042211 Oct 13 08:36:59.814219 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 518/1027] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:36:59.877014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d71df44-f166-4eba-bccb-4f2708652e30 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "DELETE /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 204 len: 0 microversion: 2.1 time: 0.162446 Oct 13 08:36:59.877861 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 510/1028] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:36:59 2022] DELETE /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:36:59.887278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:36:59.887985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:36:59.895185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.895681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.896119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.896966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:36:59.897427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:36:59.900274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:36:59.916398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:00.033614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.042631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1fe82825-39f0-49c9-997f-35068810fcf1 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1468 microversion: 2.1 time: 0.160441 Oct 13 08:37:00.043206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 519/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:36:59 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:00.169233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:00.169928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:00.176218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.176887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.177354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.178053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.178543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.178993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.288897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:00.289800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:00.296005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.296576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.296999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.297887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.298572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.299181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.319288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.330370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db696c4c-7c80-4b60-be20-e4e0d27200b0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1471 microversion: 2.1 time: 0.164689 Oct 13 08:37:00.331030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 511/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:00 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:00.347358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:00.347986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:00.354210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.354763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.355201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.356568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.357033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.357459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.424953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.433948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.435414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.440448 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-481a1ccb-6b23-4422-ae84-7a285d91d625 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.108088 Oct 13 08:37:00.441582 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 512/1031] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:00 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:00.455894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.464399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7177b1c-020b-437a-9beb-0ec37eef2f78 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.180573 Oct 13 08:37:00.480546 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 520/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:00 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:00.778101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:00.778856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:00.786168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.786988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.787730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.789242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.790000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.790872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.801725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "name": "network-vif-plugged", "status": "completed", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:00.814062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:00.814803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:00.815431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:00.827325 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] Creating event network-vif-plugged:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h1-858384-11 Oct 13 08:37:00.833384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b219eec4-7578-4521-a1b8-28cf473b567a req-412b66a6-0317-40ba-9e42-11060ca4eab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035327 Oct 13 08:37:00.835195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 521/1033] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:00.941315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:00.950261 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8e30369-d196-47f7-bcc1-f19939846572 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.176417 Oct 13 08:37:00.950858 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 513/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:00 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:01.068453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.069534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.079113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.080379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.080810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.081527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.081983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.082434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.143696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-819946538", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:01.213725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:01.268026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.277622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a23c01a-3d18-4bbb-9f57-8278b2ae990e tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1468 microversion: 2.1 time: 0.213643 Oct 13 08:37:01.278572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 514/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:01.353611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.354226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.360710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.361454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.361881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.362774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.363424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.363842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.493185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:01.493609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:01.494084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:01.494522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:01.494931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:01.503222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.503782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.504264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.504706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.505459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.505918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.506337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.511075 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-baf8b450-3f0e-46e3-86cd-c3b4df7e5312 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.161927 Oct 13 08:37:01.519393 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 515/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:01.519393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.519393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.523642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.524121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.524256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:01.524554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.525244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.525682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.526103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.528416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:01.540514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:37:01.543009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:01.591298 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2665ce73-7f21-4d19-a5b4-6a19e435f55f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592130 Oct 13 08:37:01.597997 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 522/1037] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:37:01.598266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.598397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.598397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.604949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.605127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.605518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.605949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.606393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.606679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.612602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9efab5bd-5b0d-426e-a5d0-6057e1eafdc0 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1540 microversion: 2.91 time: 0.099446 Oct 13 08:37:01.620329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.620898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.646831 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 516/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1540 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:01.660497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1d3dd89-ea56-4fc6-ba6e-995b972e7ecd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.661418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1d3dd89-ea56-4fc6-ba6e-995b972e7ecd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.754455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1d3dd89-ea56-4fc6-ba6e-995b972e7ecd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.756623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=19 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:01.764986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1d3dd89-ea56-4fc6-ba6e-995b972e7ecd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1216 microversion: 2.1 time: 0.116725 Oct 13 08:37:01.766051 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 517/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:01.771065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:01.774056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.781886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.782741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.783705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.784697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.785655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.786382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.845924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:01.863565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858384-11". {{(pid=127030) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 08:37:01.865336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8749ac81-c1c1-4aa5-862b-87e0100017b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.270686 Oct 13 08:37:01.866702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 523/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:01.939732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-887f772f-a79d-42d4-9a24-a5571b829cc9 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action" status: 202 len: 0 microversion: 2.91 time: 0.172348 Oct 13 08:37:01.940517 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 518/1041] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:37:01 2022] POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:37:01.949821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.950730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.960211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.961379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.962529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.963504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.964402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.965050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.975569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:01.977013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:01.985014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.993328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.995680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:01.996921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:01.997595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:01.998207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.055799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.067261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.069467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.077422 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2253c135-d1bb-4e4a-9f6a-2ece134d0082 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1548 microversion: 2.91 time: 0.132325 Oct 13 08:37:02.078500 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 524/1042] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1548 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:02.290992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.301515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:02.302097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:02.306769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38e6b695-614c-4fcc-9258-5d21533ba311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.335875 Oct 13 08:37:02.322439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.322439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.322439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.322439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.323955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.323955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.326317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 519/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:01 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:02.421710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.437726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652f0740-6e60-49be-9fd2-4d761d4fab0f", "name": "network-vif-deleted", "tag": "9546fe4b-c336-4185-9d9c-99a978a65a3b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:02.459526 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d41c6a97-4f52-40fa-ba2f-e6b571052447 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1426 microversion: 2.1 time: 0.162116 Oct 13 08:37:02.460046 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 525/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:02 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:02.476971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.477528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.478626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.496579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] Creating event network-vif-deleted:9546fe4b-c336-4185-9d9c-99a978a65a3b for instance 652f0740-6e60-49be-9fd2-4d761d4fab0f on n-h1-858384-11 Oct 13 08:37:02.504277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b9f9768d-1fcb-4909-97f1-f73dbb615d2c req-076e2ce3-f965-4dde-b384-c6b69e64849f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071619 Oct 13 08:37:02.505986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 520/1045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:02.535093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:02.535705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:02.543736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.544235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.544681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.545389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.545850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.546449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.681260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.688775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7b1ed2a-e9a8-4e2d-bd29-202164c3c6b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.157564 Oct 13 08:37:02.689331 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 526/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:02 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:02.792115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:02.792751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:02.798886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.799366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.799801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.800498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.800952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.801376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.805934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:02.867607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:02.875180 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a95b4620-a6ce-4e0a-aa13-6133d2f7f06f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1220 microversion: 2.1 time: 0.087544 Oct 13 08:37:02.875728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 521/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:02 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:02.888441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:02.889155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:02.895222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.895698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.896130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:02.896818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:02.897270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:02.897695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.021683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.029424 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51606548-f905-4df7-8ccb-fcc60a0d1b68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.144771 Oct 13 08:37:03.029994 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 527/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:02 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:03.107764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:03.108373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:03.114300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.114809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.115246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.115939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.116391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.117470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.181295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.189313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.190788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.195476 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea36c02d-f77d-4213-bdac-4d6076bf8ffb tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1548 microversion: 2.91 time: 0.091630 Oct 13 08:37:03.196031 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 522/1049] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:03 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1548 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:03.334771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:03.335876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:03.342518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.343029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.343485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.344257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.344715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.345133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.484012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:03.484610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:03.491032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.491540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.491980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.492672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.493120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.493472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.493600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.519308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-87a39a66-ca0b-45a9-a783-671cbc2edc56 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1360 microversion: 2.1 time: 0.188222 Oct 13 08:37:03.533938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.534481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.535092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.535702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lazy-loading 'fault' on Instance uuid 652f0740-6e60-49be-9fd2-4d761d4fab0f {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:03.539117 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 528/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:03 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:03.610696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.620111 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0aa3a000-477f-4554-beac-a8699a5b1d32 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 200 len: 1312 microversion: 2.1 time: 0.140548 Oct 13 08:37:03.620681 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 523/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:03 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:03.712562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:03.713524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:03.719955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.720533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.721032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.721788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.722329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.722815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.853030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.860853 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e58e1b4-4e4a-4c03-825a-11d3138e75c3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.152895 Oct 13 08:37:03.861449 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 529/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:03 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:03.897531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:03.898719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:03.904559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.905037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.905468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.906147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:03.906619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:03.907046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:03.965955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:03.973619 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-489a4054-bf56-4fdc-8d92-f4dc4d3b6e5b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1212 microversion: 2.1 time: 0.079846 Oct 13 08:37:03.974180 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 524/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:03 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:04.052952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.053799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.061558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.062278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.062923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.063790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.064240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.064833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.219030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:04.223312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.224012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.230247 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be0ebb63-bbf8-44fe-9e8c-c2042d6beec5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.181386 Oct 13 08:37:04.230877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 530/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:04.235267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.236919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.237457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.238264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.238851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.239340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.481333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:04.489839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:04.491387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:04.496750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23bf8a9a-bc5b-4d93-8a36-c5ecd110e546 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1548 microversion: 2.91 time: 0.277425 Oct 13 08:37:04.497394 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 525/1055] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1548 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:04.548952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.549637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.556191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.556663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.557087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.557762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.558211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.558670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.643843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.644773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 652f0740-6e60-49be-9fd2-4d761d4fab0f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.651317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.652242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.652856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.653942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.655612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.656327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.673331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] HTTP exception thrown: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Request method failure captured: Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f HTTP/1.1 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR839YorDhZMyrYeVsp4qjXG7jDLwXiNHXUSvzRBdoRC0_5hFi5VCOM2nER2-8F0PSSKNAm7_V080ukQsQ172VPtOjsZWPNyhmmogybGB4PrOf-uykGxBiEzbwDEVAn0f-Mu-d-JX1QT_MG-xSgmKcInGzxm_17hCmIq-1hzNI7ldEuU Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: e4e25ce9839e4295878b7781cbb269c4 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:37:04.676412 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: e4e25ce9839e4295878b7781cbb269c4 Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-778911599-project Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: d46a17fe841d40e8b6dd8155217fb30b Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-778911599-project Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. Oct 13 08:37:04.678010 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '652f0740-6e60-49be-9fd2-4d761d4fab0f'} Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:37:04.678931 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. Oct 13 08:37:04.681088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:04.682141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Returning 404 to user: Instance 652f0740-6e60-49be-9fd2-4d761d4fab0f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:37:04.682141 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-428fbd43-c513-4d80-adc5-21a77594d855 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f" status: 404 len: 111 microversion: 2.1 time: 0.039347 Oct 13 08:37:04.682141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 526/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/652f0740-6e60-49be-9fd2-4d761d4fab0f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:37:04.688824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.689315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.696698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.697192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.697796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.698533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.700348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.702953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.703572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:04.733087 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de6dc448-fcd2-48d2-8477-0a62f2b8fa4a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1542 microversion: 2.1 time: 0.187741 Oct 13 08:37:04.734225 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 531/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1542 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:04.735722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:37:04.755935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.756548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.762586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.763167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.763675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.764616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.765140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.765711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.813245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:04.823888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54352cbb-3db3-471b-92f9-ee3de8f2824d tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "DELETE /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 204 len: 0 microversion: 2.1 time: 0.138623 Oct 13 08:37:04.825505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 527/1058] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:37:04 2022] DELETE /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:37:04.834184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.834991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.842602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.843191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.843696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.844468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.844926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.845342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.853313 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d872d382-2b94-4fc1-a6d8-9e831286cde5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101650 Oct 13 08:37:04.853911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 532/1059] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:04.884460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:04.885069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:04.891213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.891699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.892186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:04.892914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:04.893368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:04.893792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.079926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.088057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae0eed55-446d-4b07-b955-ff7a24a656fc tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1476 microversion: 2.1 time: 0.258444 Oct 13 08:37:05.088634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 528/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1476 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:05.108906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:05.109510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:05.115908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.116405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.117401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.118126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.118599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.119160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.180433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.188807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8eba91a-a7ba-4a65-b3e4-599006602107 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.308739 Oct 13 08:37:05.189493 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 533/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:04 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:05.205364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.214128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e0ae6c5-6c9d-42c5-9130-6ec083beb86e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1274 microversion: 2.1 time: 0.110050 Oct 13 08:37:05.214999 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 529/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:05 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:05.253388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:05.254090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:05.261097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.261581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.262343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.263101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.263554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.264154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.530349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:05.532387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:05.539889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:05.543867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.544634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.546019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.547980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.548683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.550629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.663219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.674887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.677719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.690497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc00dc08-f1fb-4916-ab20-b91e18e008df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1488 microversion: 2.91 time: 0.169547 Oct 13 08:37:05.702455 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 530/1063] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:05 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1488 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:05.703130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:05.703840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-unplugged", "status": "completed", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:05.714739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:05.715268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:05.715696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:05.719520 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e40e8db-870d-42a3-b2c8-fa1527408d7d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.469629 Oct 13 08:37:05.720267 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 534/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:05 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:05.728723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] Creating event network-vif-unplugged:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:37:05.733728 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9f012d0f-92e3-4e93-91be-13a0ab6c3329 req-3ad3d804-a404-4671-bfa1-3e5e26c9fa9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040806 Oct 13 08:37:05.734520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 531/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:06.114632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:06.115299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:06.122136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.122655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.123147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.124170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.124790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.125472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.214692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:06.215623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:06.221978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.222507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.222941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.223648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.224241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.224686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.349965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.361006 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0209b454-ceae-4933-923c-3a0161215ff2 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1476 microversion: 2.1 time: 0.250494 Oct 13 08:37:06.366835 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 535/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:06 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:06.371850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:06.373048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:06.384354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.385047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.385727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.386679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.387144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.388679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.444332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.464012 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21deb61a-e373-446e-b9a5-711f12ac16b3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.254168 Oct 13 08:37:06.465185 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 532/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:06 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:06.488425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:06.531431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.532764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.533472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.553210 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] Creating event network-changed:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h1-858384-11 Oct 13 08:37:06.559657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-73cbd0a4-8b3d-4694-8aaa-8ca5a092e4dd req-38a9a03c-2324-47fe-b7d9-a0a153c5a755 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093015 Oct 13 08:37:06.561306 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 533/1068] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:06.569054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb726935-3fe0-4a8d-b3c7-0d230b45e5ac", "tag": "8c5f10eb-b7a2-4817-85f1-c15720da15ec"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:06.581587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.582369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.583450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.586276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.598495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca17feac-b4ec-45eb-8236-be586546396e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.234900 Oct 13 08:37:06.599479 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] Creating event network-changed:8c5f10eb-b7a2-4817-85f1-c15720da15ec for instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac on n-h1-858384-11 Oct 13 08:37:06.614485 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 536/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:06 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:06.614700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-82b53072-681c-4161-aed0-03cbe5410122 req-2300cf3a-95a5-44ba-bee6-4d63d3e42751 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050761 Oct 13 08:37:06.621217 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 534/1070] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:06.721225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:06.721899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:06.724822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:06.732553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.733048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.733482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.734187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.740076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.740606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.743936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:06.744939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:06.770229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.771252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.773835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.776905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:06.777636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:06.778302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:06.861187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.869056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:06.876938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.878432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:06.896816 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3050c037-d035-47a2-a071-41f30e1347e7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1488 microversion: 2.91 time: 0.179274 Oct 13 08:37:06.897493 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 537/1071] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:06 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1488 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:07.064518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:07.074816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-311b3b8b-e72b-4f33-ba2a-1cb2df9c09a1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.335647 Oct 13 08:37:07.075590 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 535/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:06 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:07.390779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:07.391733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:07.399015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.399714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.400489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.401374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.402007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.402630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.490229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:07.490981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:07.498454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.499726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.500248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.501302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.501995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.502681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.642421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:07.654261 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b072f1f5-8784-4dda-b6a7-c71a726834f5 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1476 microversion: 2.1 time: 0.272854 Oct 13 08:37:07.654882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 538/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:07 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:07.674170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:07.679807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:07.697270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.698945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.703024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.710985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:07.720870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.721315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.721853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.728334 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e838a5b-c588-4c84-9c43-d5842c3575c1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.243898 Oct 13 08:37:07.739998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 536/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:07 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:07.928170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:07.928491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:07.935356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.935845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.936279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.936988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:07.937487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:07.937852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:07.959454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.013776 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1385648a-556b-451c-8bbf-7438cad50aaa tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.335258 Oct 13 08:37:08.013776 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 539/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:07 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:08.036303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.045991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.047487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.061343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79e60954-3f2e-4d56-806a-35c5699d0c66 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1490 microversion: 2.91 time: 0.137151 Oct 13 08:37:08.062134 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 537/1076] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:07 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1490 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:08.104789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:08.105780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:08.113704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.114398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.115169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.115906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.116403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.118055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.277353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.287986 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e3b76dd-0f3e-4555-b2ad-d924bca3ef68 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.191561 Oct 13 08:37:08.290781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 540/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:08 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:08.585643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34788658-a03f-4156-8054-05dd3360632f", "name": "network-vif-deleted", "tag": "13e155fe-51b9-41d9-bea6-de41e0205f05"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:08.596453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.597252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.597999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.611454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] Creating event network-vif-deleted:13e155fe-51b9-41d9-bea6-de41e0205f05 for instance 34788658-a03f-4156-8054-05dd3360632f on n-h2-858384-11 Oct 13 08:37:08.616466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2eea1d56-6131-4c92-a9e0-ee53705ff848 req-c864e5ac-b3dd-4c1d-918b-12060b16a22e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Oct 13 08:37:08.617250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 538/1078] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:08.679307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:08.680208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:08.690839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.691640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.693783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.695610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.697997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.714552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.764799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:08.765523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:08.782234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.793218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.794796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.795565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.796045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.796477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.811209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:08.820165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:08.821224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:08.827195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:08.828929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lazy-loading 'fault' on Instance uuid 34788658-a03f-4156-8054-05dd3360632f {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:08.879746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:08.891314 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b409ebf2-582f-471b-95cc-94d0a03a95eb tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1311 microversion: 2.1 time: 0.216661 Oct 13 08:37:08.906995 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 541/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:08 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:09.020372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.030873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9311004f-531a-4e06-af81-669dc061bd39 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.280843 Oct 13 08:37:09.031604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 539/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:08 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:09.043269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:09.044121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:09.051283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.051773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.052326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.052903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.053359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.053792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.061645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "name": "network-vif-plugged", "status": "completed", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:09.073488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.074249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.075051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.089662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] Creating event network-vif-plugged:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h1-858384-11 Oct 13 08:37:09.095911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1871343e-d3f0-4528-a2ea-dc9a3a4c4428 req-e0241b65-ad96-4cd6-a0f3-27aa226cd04f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037896 Oct 13 08:37:09.097192 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 540/1081] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:09.102728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:09.103734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:09.111451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.112322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.112928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.113808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.115001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.115612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.214646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.222428 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c05c76c-6170-4183-91fe-eb115181b0c2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.182961 Oct 13 08:37:09.223006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 542/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:09 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:09.231782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.241230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.243295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.248431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2d20c29-71e5-4c25-ad3c-a91c15dd39f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.149857 Oct 13 08:37:09.249184 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 541/1083] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:09 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:09.311285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:09.312267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:09.318904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.320193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.320841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.321680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.322262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.322713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.544057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:09.551921 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ada97fc7-2ccb-454a-a6cb-26305cfdb683 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1313 microversion: 2.1 time: 0.244507 Oct 13 08:37:09.552482 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 543/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:09 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:09.917270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:09.917887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:09.924421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.924909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.925348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.926042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.926531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.926963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.957461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:09.957946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:09.958389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:09.959075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lazy-loading 'fault' on Instance uuid 34788658-a03f-4156-8054-05dd3360632f {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:10.004507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46a17fe841d40e8b6dd8155217fb30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e25ce9839e4295878b7781cbb269c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.012967 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99d2eba4-6a09-4423-b07d-67f8daed330a tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 200 len: 1311 microversion: 2.1 time: 0.099966 Oct 13 08:37:10.013574 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 542/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:09 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:10.054839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:10.055551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:10.061948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.062569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.063074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.063842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.064362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.064851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.219903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.229196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a16ef70e-1f59-4887-a20b-4aeff8f8a2d9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.178132 Oct 13 08:37:10.229856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 544/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:10 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:10.248370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:10.249710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:10.256477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.257102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.257605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.258993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.259649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.260356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.277650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:10.278258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:10.288965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.289457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.289901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.290639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.296041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.296488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.445862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.464545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.466539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.485756 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bfa6efd9-60f5-4997-949a-818db83990e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.211833 Oct 13 08:37:10.486287 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 545/1087] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:10 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:10.561744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.573970 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a9edeaa-af9b-4146-ac62-ed3afc28c79d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.331301 Oct 13 08:37:10.576951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 543/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:10 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:10.577886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:10.578657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:10.594028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.594581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.597306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.598753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.601394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.602024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.816089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:10.828576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7bffa960-bbfc-4291-a44d-2c911cedff17 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1463 microversion: 2.1 time: 0.255629 Oct 13 08:37:10.848125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 546/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:10 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:10.853436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:10.856483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:10.872379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.873191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.873782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:10.875641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:10.879052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:10.879701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.036759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:11.037378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] [instance: 34788658-a03f-4156-8054-05dd3360632f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:11.043111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.054866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.056277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Old instance type m1.heat2, new instance type m1.heat {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 08:37:11.063305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.064110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.065096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:11.065433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.065698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:11.066222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:11.066549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.066675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:11.067060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:11.067689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.117113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] HTTP exception thrown: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Request method failure captured: Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f HTTP/1.1 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR839YorDhZMyrYeVsp4qjXG7jDLwXiNHXUSvzRBdoRC0_5hFi5VCOM2nER2-8F0PSSKNAm7_V080ukQsQ172VPtOjsZWPNyhmmogybGB4PrOf-uykGxBiEzbwDEVAn0f-Mu-d-JX1QT_MG-xSgmKcInGzxm_17hCmIq-1hzNI7ldEuU Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: e4e25ce9839e4295878b7781cbb269c4 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:37:11.118933 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e4e25ce9839e4295878b7781cbb269c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: e4e25ce9839e4295878b7781cbb269c4 Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-778911599 Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersAdminNegativeTestJSON-778911599-project Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: d46a17fe841d40e8b6dd8155217fb30b Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersAdminNegativeTestJSON-778911599-project Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. Oct 13 08:37:11.120518 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '34788658-a03f-4156-8054-05dd3360632f'} Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:37:11.121429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. Oct 13 08:37:11.123028 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:11.127525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] Returning 404 to user: Instance 34788658-a03f-4156-8054-05dd3360632f could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:37:11.130720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0dd502c2-b905-4173-9dd1-0eedb4b6a4c0 tempest-ServersAdminNegativeTestJSON-778911599 tempest-ServersAdminNegativeTestJSON-778911599-project] 10.222.0.23 "GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f" status: 404 len: 111 microversion: 2.1 time: 0.095669 Oct 13 08:37:11.135673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 547/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:11 2022] GET /compute/v2.1/servers/34788658-a03f-4156-8054-05dd3360632f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:37:11.144080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-plugged", "status": "completed", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:11.175608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.176103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.176543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.199090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] Creating event network-vif-plugged:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:37:11.204982 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ff1af6a5-bd70-4d53-b779-fef28808e860 req-f3c8503e-5d81-4376-b94d-794202342ab9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064752 Oct 13 08:37:11.205882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 548/1091] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:11.242751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc099534-93ba-45af-975b-b5951453fc35 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e/action" status: 202 len: 0 microversion: 2.1 time: 0.394371 Oct 13 08:37:11.247923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 544/1092] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:37:10 2022] POST /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:37:11.254058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:11.255820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:11.256569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:11.257152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:11.270705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.271222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.271653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.271946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.272383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.273038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.273369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.274272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.275499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.278000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.278676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.280348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.513831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:11.536589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:11.646860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.665640 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7586968e-6180-491a-9c85-f05e8dfaf892 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.414294 Oct 13 08:37:11.683310 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 549/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:11 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:11.699218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:11.700431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:11.715833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.716824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.717610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.720036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.721357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.722043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.781949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:11.824498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.832409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.837849 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b063e67e-3a5f-47a2-92e7-e7ec77eafc57 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.588034 Oct 13 08:37:11.844692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.846913 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 545/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:11 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:11.850198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:11.860750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:11.861725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:11.861864 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb4af3d4-a199-4419-8b9e-9e157708f0fc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.176128 Oct 13 08:37:11.867776 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 550/1095] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:11 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:11.875337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.875795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.878181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:11.879962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:11.880434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:11.880863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.142386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:12.151426 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6dc605ad-966f-43ca-9f91-ffdd4c5767b7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.301643 Oct 13 08:37:12.167836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 546/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:11 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:12.698805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:12.699456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:12.706149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.706891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.707543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.708409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.709104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.709699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.864830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:12.865918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:12.875550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.879573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.880297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.881666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.885012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.885720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.925593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:12.936288 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60b4c3ae-d587-4569-9874-d2f0794845a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.240217 Oct 13 08:37:12.951318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 551/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:12 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:12.960423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:12.962077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:12.969529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.970422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.972000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:12.973052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:12.973982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:12.974754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:13.125048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:13.134714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:13.138795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:13.151955 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2da15ccd-7c7e-49ef-b4db-61d8a79dd7f3 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.199003 Oct 13 08:37:13.167415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 552/1098] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:12 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:13.187275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:13.188382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:13.197607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:13.198284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:13.198919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:13.199950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:13.200739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:13.201579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:13.207980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:13.218575 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-957e82ec-d10c-455d-8d29-5de2855e3200 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.358706 Oct 13 08:37:13.221750 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 547/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:12 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:13.235378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb726935-3fe0-4a8d-b3c7-0d230b45e5ac", "name": "network-vif-plugged", "status": "completed", "tag": "8c5f10eb-b7a2-4817-85f1-c15720da15ec"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:13.251672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:13.252326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:13.252927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:13.268796 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] Creating event network-vif-plugged:8c5f10eb-b7a2-4817-85f1-c15720da15ec for instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac on n-h1-858384-11 Oct 13 08:37:13.275217 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-312660d9-8dff-4854-875b-90a6ff728bc1 req-ddcb4898-31ca-44ab-af8d-9227f9caeee1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051609 Oct 13 08:37:13.276288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 548/1100] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:13.455615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:13.465367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac448632-b42b-48ab-9420-619663fb9e05 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.286965 Oct 13 08:37:13.479954 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 553/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:13 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:13.966577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:13.967282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:13.973437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:13.974137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:13.974781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:13.975674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:13.976295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:13.976942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.140712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.150001 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2b9105a-2c30-45e2-b075-8954ecde9db5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.189307 Oct 13 08:37:14.151334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 549/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:13 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:14.200015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:14.200607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:14.213763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.214254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.214895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.215592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.216221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.216805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.302961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.313138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.314958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.320706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6846ebd-8bba-4004-8411-6c4c2dfc9e5f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.136919 Oct 13 08:37:14.321850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 554/1103] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:14 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:14.339353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:14.340394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:14.352367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.352943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.353389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.354101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.354596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.355338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.386253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:14.389916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8210a646-9576-443c-baea-1a71d367c0c6 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:14.401581 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8210a646-9576-443c-baea-1a71d367c0c6 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.181325 Oct 13 08:37:14.402502 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 550/1104] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:37:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:14.495884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:14.496889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:14.509076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.512547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.513133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.514549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:14.516293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:14.516837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:14.565647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.584718 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba6785a0-5811-4b82-a3c1-80a0f5e565d3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.261576 Oct 13 08:37:14.585863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 555/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:14 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:14.709762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:14.718769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-baf4e271-853e-4044-af89-4b376efee0ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1316 microversion: 2.1 time: 0.229880 Oct 13 08:37:14.719351 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 551/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:14 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:15.127387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1869801280", "imageRef": "55352ccf-d7ea-4dac-9faa-e8b24d9b0886", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:15.177181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:15.178861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:15.187502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.188349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.189301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.190194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.190842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.191584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.206711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:15.373474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.381301 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bafcb3d-a92e-45e3-8c23-0facfc8e753c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.211289 Oct 13 08:37:15.382462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 552/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:15 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:15.386908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:15.387708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:15.400964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.401629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.401881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.402796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.403401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.403982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.440545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] Request method failure captured: Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 143 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR846IJs9dnkY8ELy913Fyo4ViX_SXQXucWW1YglUJ-EUTrjgkQbY4ubxi1R32gdwsq114x_HeycTBlORyAH0J5ncinfZDTxYgbto2osyml1Fa5ytaSi2IFSAfypZjjhR7-YuI4jtoijrfXMtLzDx1IEaLLm1czKvSzIlTcuSA9RjEvI Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3e68bc55015d4e8fb7228b8d32b59862 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FlavorsV2NegativeTest-120818466 Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:37:15.443149 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e68bc55015d4e8fb7228b8d32b59862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e68bc55015d4e8fb7228b8d32b59862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e68bc55015d4e8fb7228b8d32b59862"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e68bc55015d4e8fb7228b8d32b59862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FlavorsV2NegativeTest-120818466 Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3e68bc55015d4e8fb7228b8d32b59862 Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-120818466 Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FlavorsV2NegativeTest-120818466-project Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb6e8824e8af4a40a94bf6d6d38c4950 Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FlavorsV2NegativeTest-120818466-project Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1869801280", "imageRef": "55352ccf-d7ea-4dac-9faa-e8b24d9b0886", "flavorRef": "452"}} Oct 13 08:37:15.445512 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: exception: Flavor's memory is too small for requested image. Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1869801280', 'imageRef': '55352ccf-d7ea-4dac-9faa-e8b24d9b0886', 'flavorRef': '452'}}} Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:15.446374 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:15.447848 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 13 08:37:15.449257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:37:15.450803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:37:15.451882 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78245e1f-d050-468a-9751-2ed0a49ff6d2 tempest-FlavorsV2NegativeTest-120818466 tempest-FlavorsV2NegativeTest-120818466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.328452 Oct 13 08:37:15.452571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 556/1108] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:15 2022] POST /compute/v2.1/servers => generated 93 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:37:15.496393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.505131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.507460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.512789 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-400b33be-3be8-432c-9ee7-65704b915cd1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.129354 Oct 13 08:37:15.518933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 553/1109] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:15 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:15.611144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:15.612012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:15.620492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.622679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.623625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.624358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.624818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.625242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.741849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:15.742507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:15.749215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.750199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.750818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.751700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:15.752332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:15.752754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:15.803336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.811773 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c9410a0-9961-4c16-a34d-c2be8028a27f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.204529 Oct 13 08:37:15.814661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 557/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:15 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:15.936001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:15.944150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e84ae00-470d-400e-a7ed-5b4900c6b8b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1466 microversion: 2.1 time: 0.206200 Oct 13 08:37:15.945531 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 554/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:15 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1466 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:16.144818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:16.145579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:16.151799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.152272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.153033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.153856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.154545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.155193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.412245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:16.414111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:16.422226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.423106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.423730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.425731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdbdf86e-8343-4c54-80be-06f208acb44a tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1619 microversion: 2.1 time: 0.460317 Oct 13 08:37:16.426221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.427178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.427530 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 558/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:15 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1619 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:16.443801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.455559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: .version_select at 0x7f53768ee790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-244448346", "policies": ["affinity"]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:16.488894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:16.493735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:16.576702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:16.582340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:16.597451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fbded219-602d-42d9-afbf-8a4ab4194210 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.147045 Oct 13 08:37:16.598798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 559/1113] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Oct 13 08:37:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:16.603825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:16.604652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:16.612526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.614167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.614804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.615687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.616358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.617082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.681174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:16.699427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10ea3cb1-6fa7-4a10-b0c6-43a0c7be1121 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.292180 Oct 13 08:37:16.714817 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 555/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:16 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:16.736833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:16.749297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:16.751935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:16.785899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-494279590", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5791035c-43d5-499c-a80c-e0ef13bd1007"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:16.791368 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a279354-1a1b-47c8-8400-3fed09c621df tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.191082 Oct 13 08:37:16.792677 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 560/1115] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:16 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:16.845985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:16.846795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:16.856149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.858440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.860343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.862176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:16.865098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:16.865842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:16.871043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:17.245325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:17.245862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:17.246367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:17.246810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:17.247213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:17.248261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:17.259982 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-252479a4-55bd-4430-949b-265906d0f31b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.414035 Oct 13 08:37:17.260625 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 561/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:16 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:17.293936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.294514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.294972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.310920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.311423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.312029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.344700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:17.350022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:17.362356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 2 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:37:17.366121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:17.408510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127030) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 13 08:37:17.431730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:17.434431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:17.440813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:17.475473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:17.476091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:17.495927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.496434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.496879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.497879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.498339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.498807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.551365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:17.557958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:17.586141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=176cd4f6-ef1e-48ed-8ffb-e7740993b2fa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:17.667136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:17.672516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:17.724712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:17.729009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:17.744820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:17.767528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d008944f-0918-427a-b102-09dc31ec44b5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.985656 Oct 13 08:37:17.769034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 556/1117] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:37:17.773997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:17.774960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:17.788107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.789920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.790624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.791553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.792159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.792739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.796545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c75f8302-d25c-48ce-8271-615050579f5c tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 2346 microversion: 2.25 time: 0.337784 Oct 13 08:37:17.797463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:17.806960 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 562/1118] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:17 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 2346 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:17.822952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:17.828869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:17.830251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Searching by: {'deleted': False, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:37:17.847906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.849223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.849996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:17.851606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:17.852299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:17.852909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.019680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:37:18.122124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.141466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ba4a9d9-1005-496c-8976-9754e7709ca3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.371101 Oct 13 08:37:18.142342 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 557/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:17 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:18.159554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:18.172433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.173846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.174980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.177638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.178150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.179205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.213528 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c85f4a6e-cb23-4993-b6ba-1d67c0b46b45 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.395472 Oct 13 08:37:18.218856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 563/1120] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:37:17 2022] GET /compute/v2.1/servers => generated 1001 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:18.233099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:18.233635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:18.239885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d6cdf1b-bc95-4ca6-ad73-d6cdae707015 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.086023 Oct 13 08:37:18.241813 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 558/1121] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Oct 13 08:37:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:37:18.241813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d2496fc-e04b-4c0c-ad6a-c8620ae75e5a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:18.255227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.256164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.257661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.258674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.259294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.260837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d2496fc-e04b-4c0c-ad6a-c8620ae75e5a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:18.262839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.374261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.383976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.385823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.394037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b525cd8-22ee-48f7-8d60-41c40e98bcb5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.173827 Oct 13 08:37:18.395667 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 564/1122] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:18 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:18.402613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:18.403520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:18.411291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.412379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.413736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.414865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:18.415553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:18.416186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:18.434058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d2496fc-e04b-4c0c-ad6a-c8620ae75e5a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.448661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d2496fc-e04b-4c0c-ad6a-c8620ae75e5a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1218 microversion: 2.1 time: 0.203289 Oct 13 08:37:18.449402 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 559/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:18 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:18.619322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:18.631507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be7a3781-8557-4c0e-93a3-406c495cf287 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.234236 Oct 13 08:37:18.633372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 565/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:18 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:19.175629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:19.176490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:19.184403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.185239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.185916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.186879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.187543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.188185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.404112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.414060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29a9990b-3bf5-4d9e-935e-0ac0b5d5f387 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.243004 Oct 13 08:37:19.414833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 560/1125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:19 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:19.429761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:19.431218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:19.442426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:19.444456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.445164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.445709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.446638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.447154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.447721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.473570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:19.474256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:19.505970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.508700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.513550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.514374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.518976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.519505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.525863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.535056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.537035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.543601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2b67632-91fd-4ad6-acb0-0fc3a22cd038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.119610 Oct 13 08:37:19.550575 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 566/1126] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:19 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:19.629918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.638882 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b63d1613-3e34-4968-84f4-b33d88c4bcd1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1222 microversion: 2.1 time: 0.169262 Oct 13 08:37:19.640136 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 561/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:19 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:19.659799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:19.660452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:19.678072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.678594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.679691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.680559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:19.681159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:19.681735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:19.826025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:19.836192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d83afdf-53a4-488b-9e3c-1dfcaede20ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.180128 Oct 13 08:37:19.837069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 567/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:19 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:20.456089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:20.456089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:20.469532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.469916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.470352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.471083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.471536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.471964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.579390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:20.580604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:20.595393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.596152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.596799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.597739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.598890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.599484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.682147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:20.691897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:20.693587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:20.700502 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a30a2d7-1dc7-4279-8eee-1ec1ca69cb04 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.130575 Oct 13 08:37:20.701577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 568/1129] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:20 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:20.706889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:20.707790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:20.714678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.715382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.715984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.716842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.717452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.718018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.790170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:20.803824 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8192e68c-87e1-4629-bc57-14f054c4e621 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1222 microversion: 2.1 time: 0.100759 Oct 13 08:37:20.804419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 569/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:20 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:20.808189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:20.822166 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d6b5e61-8037-443c-af99-c7a4afea3763 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.381793 Oct 13 08:37:20.823035 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 562/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:20 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:20.860026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:20.860739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:20.876987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.877772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.878395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:20.879116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:20.879540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:20.880315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.089110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:21.104354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9a2d024-4329-48a5-9d86-e37566dc77b2 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.247943 Oct 13 08:37:21.104959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 570/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:20 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:21.381963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48fdab05-27c8-4387-bb33-73bea980efd5", "device": "/dev/xvdb"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:21.385457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:21.391919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.392429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.392860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.393560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.394010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.394455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.739138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:21.739659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:21.753048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.753554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.764678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.765808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.766474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.769103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.855717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e1c2a20-7b59-4ce8-b7d2-cc7e5c42e0e4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.476384 Oct 13 08:37:21.861068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 563/1133] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 13 08:37:21 2022] POST /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:37:21.880090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:21.881071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:21.889148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.889776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.890217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.891125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.891730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.892480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.897310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:21.908937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:21.911905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:21.927901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8bda7c89-9436-43ec-bd00-49a4a1617f06 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.192738 Oct 13 08:37:21.929135 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 571/1134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:21 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:21.946648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:21.947446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:21.953659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.956599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.957353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:21.958227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:21.961739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:21.962375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:22.098216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:22.112382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-150437d0-a2f4-4fb1-909d-42a1e2bc620a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1222 microversion: 2.1 time: 0.248715 Oct 13 08:37:22.114057 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 564/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:21 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:22.129176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:22.129786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:22.136454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:22.136937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:22.137575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:22.138478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:22.139088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:22.139668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:22.303269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:22.313678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df65f34a-9577-4070-8473-4af0d34e8c3c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.187545 Oct 13 08:37:22.314802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 565/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:22 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:22.534946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:22.553163 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0e82052-9431-4c98-a621-a6f13b60fd77 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.622725 Oct 13 08:37:22.554356 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 572/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:21 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:22.959534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:22.960772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:22.967549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:22.968034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:22.968664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:22.969515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:22.969817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:22.970239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.083209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.094819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.097129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.104108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31ac8000-96b0-4a23-9ba1-ec241968e0f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.148216 Oct 13 08:37:23.104791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 566/1138] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:22 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:23.138262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:23.139292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:23.170346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.171508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.171508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.177593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.178093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.181601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.216792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:23.307898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.321155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9439209-a51c-4021-a053-ac8c01d66876 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1222 microversion: 2.1 time: 0.186415 Oct 13 08:37:23.326555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 573/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:23 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:23.349223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:23.351031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:23.364394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.365351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.366635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.367634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.368361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.368992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.566455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.578400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:23.579406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:23.621663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f26035b-0e0f-4251-aac3-85529eefe47a tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.277181 Oct 13 08:37:23.622336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.624919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.625363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 567/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:23 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:23.625991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.627003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:23.627851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:23.628442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:23.918559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:23.927463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f448252-f35e-4a9c-a179-d7c5dae919ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.353461 Oct 13 08:37:23.928907 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 574/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:23 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:24.135381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:24.136586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:24.144775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.145518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.146126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.147249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.148372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.148808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.246911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:24.271641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:24.273156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:24.288851 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6cfdb40c-e28a-46e8-a1f2-5525659f82f6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.159961 Oct 13 08:37:24.290696 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 568/1142] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:24 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:24.345817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:24.347074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:24.356058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.356780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.357607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.358334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.358931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.359524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.429974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:24.439193 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3211f794-7f5a-4ac2-a881-bec1f7a8fbbf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1270 microversion: 2.1 time: 0.097802 Oct 13 08:37:24.440105 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 575/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:24 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:24.542367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b09bd5da-0628-44d9-9d3e-4c6608f7eb06 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Action: 'create', calling method: .version_select at 0x7f53769df670>, body: {"pool": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:24.648116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:24.649236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:24.659616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.660181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.660691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.661406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.661863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.662287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.841500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:24.851105 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-446eabe9-329c-4a29-a193-492e8f5b5452 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.207998 Oct 13 08:37:24.859724 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 576/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:24 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:24.953212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:24.954268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:24.963639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.964491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.965056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:24.965714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:24.966171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:24.966815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.124417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:25.134019 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98545825-0e28-4e59-b2c8-4caaa5b8b0ec tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.186587 Oct 13 08:37:25.146436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 577/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:24 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:25.317521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:25.318131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:25.324690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.325176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.325614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.326312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.326803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.327233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.638145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:25.646936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:25.648434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:25.653807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a7f56059-65f0-40a8-9e44-240427343898 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.340163 Oct 13 08:37:25.666443 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 578/1146] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:25 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:25.666443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:25.666443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:25.666443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.666864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.667093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.667963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.668577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.669154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.741987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:25.750778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5ec9dcc-81ee-4f37-97d2-62a7f633c160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1270 microversion: 2.1 time: 0.094944 Oct 13 08:37:25.751862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 579/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:25 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:25.866910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b09bd5da-0628-44d9-9d3e-4c6608f7eb06 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.481213 Oct 13 08:37:25.868987 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 569/1148] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:37:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:25.878462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:25.879369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:25.886987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.887676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.888119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.888823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:25.889274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:25.889698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:25.890572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28814d59-d7e0-4205-bb82-f8594944e9fd tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f53769d7670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.051629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.063041 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56305c13-b467-4ff4-a30f-a07c0a56c556 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.192797 Oct 13 08:37:26.064477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 580/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:25 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:26.095188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28814d59-d7e0-4205-bb82-f8594944e9fd tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/755add97-4998-4ee2-88e6-dcd996ce129b" status: 200 len: 142 microversion: 2.1 time: 0.211426 Oct 13 08:37:26.095760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 570/1150] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:37:25 2022] GET /compute/v2.1/os-floating-ips/755add97-4998-4ee2-88e6-dcd996ce129b => generated 142 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:26.108479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-880ab618-b090-4d3e-8a6e-8d198f9c177e tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f5376774700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.158674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.159804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:26.169356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.170133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.170812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.171764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.172420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.174198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.356663 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-880ab618-b090-4d3e-8a6e-8d198f9c177e tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.251596 Oct 13 08:37:26.357458 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 581/1151] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:37:26 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:26.370465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.380423 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb1eb5fd-b577-4b3a-9f49-a211be4a2cd8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.226274 Oct 13 08:37:26.381280 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 571/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:26 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:26.381408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b299705b-c66c-4f03-9904-39cf44541613 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f5376711700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.591708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:26.685324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.686143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:26.693863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.694628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.695248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.696131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.696771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.697356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.772939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.782655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.784497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.791293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82179c0e-355d-40f1-928d-e3a9bcc7ce0d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.111012 Oct 13 08:37:26.792404 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 572/1153] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:26 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:26.797500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:26.798284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:26.804508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.805224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.805852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.806753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:26.807396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:26.808027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:26.881031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:26.892662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-994653af-e9fd-4651-bb05-d8cc9038e6fe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1270 microversion: 2.1 time: 0.099043 Oct 13 08:37:26.895263 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 573/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:26 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:27.088919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:27.090114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:27.098666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.099406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.100838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.101671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.102234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.102784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.294297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:27.306357 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0fc1dc3-1351-44e0-9930-d1e8201fe1bb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1477 microversion: 2.1 time: 0.221813 Oct 13 08:37:27.310446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 574/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:27 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:27.407182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:27.407815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:27.420994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.422638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.423855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.424878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.425579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.426234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.504697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b299705b-c66c-4f03-9904-39cf44541613 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/755add97-4998-4ee2-88e6-dcd996ce129b" status: 202 len: 0 microversion: 2.1 time: 1.138452 Oct 13 08:37:27.505395 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 582/1156] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:37:26 2022] DELETE /compute/v2.1/os-floating-ips/755add97-4998-4ee2-88e6-dcd996ce129b => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:37:27.514920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4baa062e-d545-40cc-90f4-36c06209a875 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Action: 'create', calling method: .version_select at 0x7f5376711af0>, body: {"pool": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:27.594300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:27.603135 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17b71a80-9b57-4896-9075-1973859c0805 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.201005 Oct 13 08:37:27.607866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 575/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:27 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:27.825772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:27.827541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:27.834576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.835336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.836031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.837903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.838629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.839277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.846258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:27.904219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:27.925147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:27.935654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:27.937213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:27.943325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8855194d-d8d1-42c0-9daa-2fa1035b8d30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.121755 Oct 13 08:37:27.958159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 576/1158] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:27 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:27.964146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:27.964867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:27.971125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.971607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.972137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:27.972911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:27.973367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:27.973788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.053181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:28.061684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe7cb7d8-8602-437e-9907-d25aa349bf2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1270 microversion: 2.1 time: 0.102029 Oct 13 08:37:28.062467 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 577/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:27 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:28.327031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:28.332509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:28.333223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:28.341817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.342379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.342927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.343701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.344243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.344741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.439494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=24 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:28.529944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:28.543345 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a2d5edc-5c72-4393-83d6-d1f4c49aaeae tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1463 microversion: 2.1 time: 0.217892 Oct 13 08:37:28.546024 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 578/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:28 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:28.573941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:28.574753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:28.585482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.586016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.586445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.587173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.587972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.588120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.757753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:28.766730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bccae721-b910-4685-bbf3-2eee0ca874c8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1463 microversion: 2.1 time: 0.200184 Oct 13 08:37:28.770994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 579/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:28 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:28.774974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:28.775769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:28.777864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:28.788285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.788836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.789407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.790269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.790964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.791368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.948726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:28.956584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d01d233-0d3c-4c70-a936-0cbf785d8ead tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.186044 Oct 13 08:37:28.957473 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 580/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:28 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:28.962356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:28.965584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:28.984954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.985465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.985903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:28.986678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:28.992983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:28.993494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.079559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:29.080231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:29.080695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:29.081095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:29.081499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:29.141521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:29.147548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.148035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.148472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.149170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.149619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.150039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.176698 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d828bdcd-04f3-4f27-b921-c4fd17b84e90 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 1067 microversion: 2.1 time: 0.218141 Oct 13 08:37:29.177547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 581/1163] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:37:28 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 1067 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 13 08:37:29.182349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:29.182990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:29.188792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.189277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.189716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.190396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.190866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.191320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.197771 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4baa062e-d545-40cc-90f4-36c06209a875 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.686572 Oct 13 08:37:29.205961 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 583/1164] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:37:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:29.205961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:29.205961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:29.212227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.212432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.212838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.213602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.214199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.214711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.256184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:29.264871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:29.266341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:29.271267 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-baed9d71-32b3-4b65-9b98-1ad997d60511 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.092981 Oct 13 08:37:29.271832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 582/1165] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:29 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:29.276243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:29.276765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:29.281753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:29.282510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.282995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.283426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.284117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:29.284564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:29.284980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:29.291230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39af41d6-2193-4775-909a-40e2ef3a7b69 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1270 microversion: 2.1 time: 0.091540 Oct 13 08:37:29.291796 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 584/1166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:29 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:29.296874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0995ab8f-251f-4878-bc7b-205c29f1d781 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f5376774f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:29.414594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:29.422605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69747da2-db73-4f27-ba0b-56e449dafd09 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.149678 Oct 13 08:37:29.423209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 583/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:29 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:29.984196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:29.985746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:30.009701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.010781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.011462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.012530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.013422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.014356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.200881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.221750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3bfac089-d0ca-48e5-86fb-f100c55d9ce8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.244182 Oct 13 08:37:30.235680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 584/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:29 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:30.298956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:30.299586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:30.306188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.306777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.307273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.308307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.308970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.309711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.337484 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0995ab8f-251f-4878-bc7b-205c29f1d781 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80" status: 202 len: 0 microversion: 2.1 time: 1.044314 Oct 13 08:37:30.338068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 585/1169] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:37:29 2022] DELETE /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:37:30.342856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:30.343474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:30.352680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.353170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.355574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.356887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.357667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.358122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.387236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.398088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.399695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.405135 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09c2bc6b-4953-4468-b6fb-6cbd7c26fd63 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.109991 Oct 13 08:37:30.405786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 585/1170] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:30 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:30.410187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f53769d4700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:30.462432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.467482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a991fbee-6f84-449c-89a0-19bf06b4ff80 could not be found", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:37:30.467798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] HTTP exception thrown: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.476204 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cb6ed99-3c28-4fdc-952b-9ec1664b9914 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1276 microversion: 2.1 time: 0.136381 Oct 13 08:37:30.476778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 586/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:30 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:30.483002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:30.483661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Request method failure captured: Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80 HTTP/1.1 Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85E1BOsu9UfaTdO5D7bsmuT-Yh4Ag4RnE-Avkl51wrgf5KodjXFfvquU5p0V_oj5Q4FSvIXI9LSQ6urhtlO3MV5c6ci13gYDB2yJ2Qt_bz9iOh4CaDkzY0JR8U5MdxXRlqBnv5qgsXrVTEFoqlxhFTA7k2Chb8q0b3fReP7jlMSYmg Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cd2bb1ab6f6d4e1498177c6d913bf08d Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:37:30.483998 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cd2bb1ab6f6d4e1498177c6d913bf08d Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsTestJSON-878949202-project Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3a3cb3de72d94dab8630b9c33198a2a8 Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsTestJSON-878949202-project Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: exception: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a991fbee-6f84-449c-89a0-19bf06b4ff80'} Oct 13 08:37:30.485507 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:37:30.486563 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a991fbee-6f84-449c-89a0-19bf06b4ff80 could not be found Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70a786ab-825d-4c67-95ee-c4214c8370e6'] Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80. Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.491128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:37:30.493789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:37:30.496420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.496420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.496420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Returning 404 to user: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:37:30.496420 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-013628a7-5844-4215-bb28-21904fddc133 tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80" status: 404 len: 111 microversion: 2.1 time: 0.079317 Oct 13 08:37:30.496420 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 586/1172] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:37:30 2022] GET /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:37:30.508507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Calling method '.version_select at 0x7f53768a6d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:30.519648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.522813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.526046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.526897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:30.527845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:30.530583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:30.587885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a991fbee-6f84-449c-89a0-19bf06b4ff80 could not be found", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:37:30.588568 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] HTTP exception thrown: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Request method failure captured: Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80 HTTP/1.1 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85E1BOsu9UfaTdO5D7bsmuT-Yh4Ag4RnE-Avkl51wrgf5KodjXFfvquU5p0V_oj5Q4FSvIXI9LSQ6urhtlO3MV5c6ci13gYDB2yJ2Qt_bz9iOh4CaDkzY0JR8U5MdxXRlqBnv5qgsXrVTEFoqlxhFTA7k2Chb8q0b3fReP7jlMSYmg Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cd2bb1ab6f6d4e1498177c6d913bf08d Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:37:30.590458 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd2bb1ab6f6d4e1498177c6d913bf08d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cd2bb1ab6f6d4e1498177c6d913bf08d Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsTestJSON-878949202 Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsTestJSON-878949202-project Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3a3cb3de72d94dab8630b9c33198a2a8 Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsTestJSON-878949202-project Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: exception: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a991fbee-6f84-449c-89a0-19bf06b4ff80'} Oct 13 08:37:30.592204 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:37:30.593359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a991fbee-6f84-449c-89a0-19bf06b4ff80 could not be found Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0340b59-b020-4e74-be87-97e288a3ec80'] Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80. Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.594823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:37:30.596263 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:37:30.597847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 Oct 13 08:37:30.597847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:37:30.597847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] Returning 404 to user: Floating IP not found for ID a991fbee-6f84-449c-89a0-19bf06b4ff80 {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:37:30.597847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89a400a0-6763-41b4-b254-fed4a5039d4f tempest-FloatingIPsTestJSON-878949202 tempest-FloatingIPsTestJSON-878949202-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80" status: 404 len: 111 microversion: 2.1 time: 0.100700 Oct 13 08:37:30.597847 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 587/1173] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:37:30 2022] DELETE /compute/v2.1/os-floating-ips/a991fbee-6f84-449c-89a0-19bf06b4ff80 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:37:30.923047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:30.941570 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0cd1c75-03db-4b07-abda-4d73e4754c14 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.453055 Oct 13 08:37:30.942623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 587/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:30 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:31.246892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:31.248193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:31.262936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.265489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.266779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.269256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.270077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.270790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.433630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:31.434229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:31.441101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.441646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.442115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.442851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.444599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.445194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.464942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:31.474561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d68737e1-f4b9-482f-99e0-5e8715547c66 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.231807 Oct 13 08:37:31.491405 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 588/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:31 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:31.499765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:31.500635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:31.507778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.508392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.509054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.509850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.510430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.510948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.589341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:31.601925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:31.603895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:31.610096 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82d1a771-95ef-4e6f-81ee-69a132ea3368 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1533 microversion: 2.91 time: 0.180708 Oct 13 08:37:31.610850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 588/1176] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:31 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1533 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:31.638753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:31.640144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:31.647760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.648265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.648867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.649842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.650020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.650649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.658894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:31.666914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f13f8dbf-6a96-4025-af5d-9f73cdfe9e9a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.170918 Oct 13 08:37:31.678591 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 589/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:31 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:31.973310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:31.974634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:31.987278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.987877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.988389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:31.989358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:31.990030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:31.990707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.016560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lazy-loading 'services' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:32.053981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df918344-595c-4443-b1ec-923fc5b75fc1 tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1940 microversion: 2.91 time: 0.420029 Oct 13 08:37:32.055149 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 589/1178] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:31 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1940 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:32.083783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:32.085246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:32.092198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.092976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.093600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.094536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.095310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.095812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.120392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lazy-loading 'flavor' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:32.253589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.270858 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-788e54c0-b65f-40da-9bf9-69b573d837cb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.308108 Oct 13 08:37:32.272861 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 590/1179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:31 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:32.347201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-678599c6-6cea-4482-b830-8809cc0abc02 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action" status: 202 len: 0 microversion: 2.91 time: 0.268545 Oct 13 08:37:32.348141 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 590/1180] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:37:32 2022] POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:37:32.357877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:32.358909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:32.371841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.372769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.373714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.375460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.376092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.377031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.466297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.476318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.478468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.485683 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c8d5eb1-3055-4283-a9bc-bb2e9f6cc7f9 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.132020 Oct 13 08:37:32.486838 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 591/1181] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:32 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:32.514440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:32.515756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:32.523679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.524408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.525048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.525965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.526717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.527359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.689083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:32.689883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:32.696927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.697692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.698425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.699241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:32.699818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:32.700344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:32.859718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.864060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:32.871753 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cbf1434-c61d-4fdc-8e99-242164232643 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.186099 Oct 13 08:37:32.872528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 592/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:32 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:32.937101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:32.939444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:32.946279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f203ab2b-0800-4df7-a161-f347ec55c0c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1472 microversion: 2.1 time: 0.437493 Oct 13 08:37:32.946930 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 591/1183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:32 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:33.295552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:33.296168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:33.304491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.305093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.305595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.306367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.306916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.307340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.462232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:33.471134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85df43d9-2e8b-41f5-a92d-4f06dc8952b1 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.179710 Oct 13 08:37:33.472046 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 593/1184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:33 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:33.524119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:33.525392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:33.534534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.535247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.536303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.537253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.538879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.539545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.681895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ed7230-49a3-4df6-a262-e345916ead82", "tag": "f8cede54-70ed-417a-95b6-f164d1529923"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:33.692672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.697854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.698694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.712138 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] Creating event network-changed:f8cede54-70ed-417a-95b6-f164d1529923 for instance c4ed7230-49a3-4df6-a262-e345916ead82 on n-h2-858384-11 Oct 13 08:37:33.713443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:33.722954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-93ac8522-5467-4129-8a02-443c5bfbb1f1 req-b4d42c3a-9350-411e-95f6-aec79d5529c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045580 Oct 13 08:37:33.726189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 594/1185] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:33.727749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:33.729331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:33.735885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fc913fd0-1dd2-4390-8cb5-feb72f98d559 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.218375 Oct 13 08:37:33.737203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 592/1186] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:33 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:33.895942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:33.896660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:33.903814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.904557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.905008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.905702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.906334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.906782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.969607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:33.970693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:33.979689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.980182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.983389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:33.984314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:33.984935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:33.985527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:34.091209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.100527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d7e51e8-268b-4caf-a228-ca6f08e72419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.208678 Oct 13 08:37:34.101255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 595/1187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:33 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:34.495533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:34.496290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:34.503189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:34.503832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:34.504386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:34.505202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:34.505692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:34.506125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:34.675633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.684101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8251743-71df-4015-a1c6-1be369ec5a76 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.193109 Oct 13 08:37:34.684766 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 596/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:34 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:34.712382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.720217 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17f8e081-f81b-4f7f-a455-5d1d2ea435b8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.755014 Oct 13 08:37:34.720904 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 593/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:33 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:34.764825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:34.765435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:34.772507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:34.772996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:34.773429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:34.774431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:34.774890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:34.775344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:34.846596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.855404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.856847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:34.862553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f330276-124b-4fab-b6cb-13d4bcc44478 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.101701 Oct 13 08:37:34.863357 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 597/1190] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:34 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:35.127810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:35.129615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:35.142266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.143201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.143844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.144782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.145998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.146715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.392225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:35.403480 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89d7c765-0dcc-4d91-be4c-f269ab957520 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.282957 Oct 13 08:37:35.406153 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 594/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:35 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:35.709235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:35.709932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:35.716899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.717473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.718107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.718851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.719312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.719745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.753516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:35.754882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:35.764472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.765352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.766268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.767091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.768454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.769409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.914637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:35.923459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57c1414b-e400-474e-919a-bd587d8956bf tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.180463 Oct 13 08:37:35.924055 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 595/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:35 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:35.929363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "176cd4f6-ef1e-48ed-8ffb-e7740993b2fa", "tag": "601614ad-4798-4fcb-a597-dd06bf562d8d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:35.939808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.940291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.940724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.952267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] Creating event network-changed:601614ad-4798-4fcb-a597-dd06bf562d8d for instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa on n-h2-858384-11 Oct 13 08:37:35.957760 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ac87f325-6252-4eab-b2f2-b65727f62799 req-465e5d3a-1ec4-4c75-bf5b-3a381d1bec27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Oct 13 08:37:35.958381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 596/1193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:35.963610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:35.964378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:35.971289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.971787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.972226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:35.972943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:35.973399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:35.973829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.043332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:36.052981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:36.054974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:36.060523 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-caf25c8e-03a6-458d-aa04-04fa9bce4986 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.100937 Oct 13 08:37:36.061107 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 597/1194] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:35 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:36.210892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:36.211604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:36.217726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.218294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.218907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.219680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.220470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.220985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.285411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:36.294709 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-745ec1e6-db52-4b18-ac88-2ba180443bb0 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.590308 Oct 13 08:37:36.299572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 598/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:35 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:36.361089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:36.374094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b17b37e-a414-4905-87ac-84e5d9f9d4af tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 2424 microversion: 2.25 time: 0.167785 Oct 13 08:37:36.374725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 598/1196] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:36 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 2424 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:36.399261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": "auto"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:36.401715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:36.407589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.408690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.409131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.409824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.410271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.410719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.427086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:36.427698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:36.433498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.433985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.434430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.435146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.435761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.436474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.436622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'flavor' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:37:36.450262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127030) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:37:36.601686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:36.615450 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcf22852-56ff-4235-aa0c-bce62286bac1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.192054 Oct 13 08:37:36.620221 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 599/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:36 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:36.952315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:36.953336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:36.969403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.969905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.970354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:36.971091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:36.977079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:36.978197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.137603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.145837 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25196509-8815-4b5d-9776-ce2ce49e75cb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.202282 Oct 13 08:37:37.146474 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 600/1198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:36 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:37.151833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:37.152681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:37.158383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.159004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.159573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.160353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.160895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.161416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.230147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.238483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.239932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.244783 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac355f0f-24ff-49d4-acf7-0b1c08e8d663 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.096488 Oct 13 08:37:37.245375 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 601/1199] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:37 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:37.317824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:37.318150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:37.325001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.325489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.325925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.326653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.327096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.327517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.465610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.473736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c9083a8-7d33-4337-9ede-93bfaa21b006 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.160153 Oct 13 08:37:37.474624 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 602/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:37 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:37.645080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:37.645689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:37.652210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.652690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.653120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.653803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:37.654249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:37.654699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:37.792829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:37.800874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11bdfa95-e0c8-4758-a289-c2f7898fcd6e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.159644 Oct 13 08:37:37.801444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 603/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:37 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:38.174109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:38.174763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:38.182074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.182892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.183417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.184316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.184771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.185372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.489619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:38.497797 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d85bce3e-badf-4adb-ba01-67715192eaa8 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.328833 Oct 13 08:37:38.514152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 604/1202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:38 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:38.519229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:38.520100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:38.527906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.528762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.529883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.530840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.531743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.532364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.676567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:38.694007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:38.696009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:38.701547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0db69ae8-a86a-4b51-b942-c9da0dfd1bc6 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.194825 Oct 13 08:37:38.702119 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 605/1203] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:38 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:38.707117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:38.707718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:38.714199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.714888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.715689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.716548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.717169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.717744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.806558 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-826e9ab0-223a-422a-919f-aaa06ad3b288 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/action" status: 202 len: 0 microversion: 2.25 time: 2.411430 Oct 13 08:37:38.807934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 599/1204] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:37:36 2022] POST /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/action => generated 0 bytes in 2414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:37:38.821618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:38.822489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:38.840181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.843264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.843747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:38.844474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:38.844930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:38.845372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.004444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.014509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.015962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.017425 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-083b6612-60d2-436c-9dd5-770dfa68e21a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.204385 Oct 13 08:37:39.017981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 600/1205] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:38 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:39.023721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:39.025135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:39.031306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.031991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.032425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.033118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.033563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.033981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.164642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.166729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.172917 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bfab010-5838-4eb6-bcad-762887aff58c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.153573 Oct 13 08:37:39.173491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 601/1206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:39 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:39.175642 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-886653f8-b1cf-4e5d-9922-73d3a66700e3 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.472120 Oct 13 08:37:39.176278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 606/1207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:38 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:39.521275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:39.521937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:39.528522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.529010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.529441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.530137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.530617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.531041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.664006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.672847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-306943b2-86cd-4ed6-b419-b1c227445707 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.155503 Oct 13 08:37:39.673588 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 602/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:39 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:39.730106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:39.731154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:39.737619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.738114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.738587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.739324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:39.739784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:39.740214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:39.925371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.939925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.941649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:39.947501 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d3d7536e-80b2-4ef7-8cbb-ac13dcbe4eb2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.221527 Oct 13 08:37:39.961338 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 607/1209] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:39 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:40.050724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:40.051915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:40.064286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.066211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.066887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.067789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.069711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.070698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.195495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:40.196115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:40.202219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.202745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.203174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.203893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.204341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.205019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.312562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:40.324103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:40.325975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:40.327767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4061a13d-93db-4e47-ab0a-4c74708691b5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.283639 Oct 13 08:37:40.329536 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 603/1210] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:40 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:40.336522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:40.337592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:40.341130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:40.343574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:40.348859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.349642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.350351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.350976 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71e4ea7a-c75a-466c-9383-2cab9f2f7a06 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.159478 Oct 13 08:37:40.351559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 608/1211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:40 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:40.352185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.352703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.353086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.510859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:40.518847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4b9924e-b40d-4753-874a-e239e051bb66 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.187683 Oct 13 08:37:40.519426 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 604/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:40 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:40.697472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:40.698493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:40.703403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:40.705430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.705913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.706542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.707438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.707923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.708356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.976199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:40.977155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:40.983917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.984489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.985628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.986723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:40.987205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:40.987888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:40.994835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.002603 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04a77e85-3d33-409b-a993-858e854c31e7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.309729 Oct 13 08:37:41.015350 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 609/1213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:40 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:41.080770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.091002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.093347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.099247 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d505d46-11a8-463e-98c3-0a1632b37f5e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.127198 Oct 13 08:37:41.114436 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 605/1214] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:40 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:41.358567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:41.359072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:41.366777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.367991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.368669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.369504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.370110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.370743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.375592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:41.376414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:41.387106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.388095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.388696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.389592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.390327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.391113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.605971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.627071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ed4867b-53d4-4da6-aded-99e3949e3b2e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.255173 Oct 13 08:37:41.638488 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 606/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:41 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:41.638488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:41.638488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:41.641420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.641926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.642548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.643348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:41.643818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:41.644347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:41.648003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.661357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.662954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.664136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab6459ab-2ce1-4ae1-965e-3162de9fb794 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.310465 Oct 13 08:37:41.664700 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 610/1216] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:41 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:41.798953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:41.807400 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6adc558-1430-466b-aa8d-e38093a189d4 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.179072 Oct 13 08:37:41.822650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 607/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:41 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:42.031334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:42.031941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:42.039852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.040740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.041338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.042199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.042918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.043490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.129193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:42.130438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:42.139696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.140474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.140964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.141927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.142395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.143001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.148083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:42.262240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.271242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.274741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.280240 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbff18f1-ecd3-43d3-af38-92f2a60b7ce4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.155422 Oct 13 08:37:42.281392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 608/1218] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:42.289725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.300703 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8417140d-fce6-4227-83c3-f47f0363d167 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.272847 Oct 13 08:37:42.303081 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 611/1219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:42.650008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:42.650723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:42.657312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.657992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.659070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.660018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.660641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.661228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.691097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:42.692325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:42.699438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.700175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.700776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.701936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.702600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.703182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.837639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.846305 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00441115-8a64-42c9-a1d6-20b270b85b67 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.200670 Oct 13 08:37:42.847344 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 609/1220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:42.851997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:42.852945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:42.860832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.861505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.862283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.863350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:42.863972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:42.864583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:42.963153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.983119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.987274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:42.994313 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52ee2795-62c6-444a-9350-21ed132754ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.307592 Oct 13 08:37:42.996053 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 612/1221] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:43.002384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:43.003337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:43.011634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.012738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.014303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.015427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.016380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.017059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.029162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:43.038502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6472eac2-4ba6-4724-b329-64690bbc3fad tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.190063 Oct 13 08:37:43.039094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 610/1222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:43.265152 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6e9774d-8a61-414b-a649-84f4f0ee5931 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1814 microversion: 2.1 time: 0.267661 Oct 13 08:37:43.266226 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 613/1223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:42 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1814 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:43.291165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:43.295733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.297815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.298331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.299375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.299901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.300394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.315374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:43.316384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:43.326876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.328003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.329233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.330231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.330870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.331445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.339046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ff82dc8-3f5e-4ad4-a17f-b48f3326e21b tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.051668 Oct 13 08:37:43.339779 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 611/1224] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:37:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:43.353297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:43.354240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:43.363563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.365040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.366473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.367650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.368321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.368956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.442222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:43.454556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:43.459061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:43.472308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c1a9bd6-a1a9-43f3-b84f-46617c020204 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.164337 Oct 13 08:37:43.491187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 614/1225] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:43 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:43.561409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:43.572576 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-574d9250-7966-4796-b4c9-96e8ae62eda9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.221069 Oct 13 08:37:43.573232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 612/1226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:43 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:43.592284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed7230-49a3-4df6-a262-e345916ead82", "name": "network-vif-plugged", "status": "completed", "tag": "f8cede54-70ed-417a-95b6-f164d1529923"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:43.605420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.606114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.606668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.621050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] Creating event network-vif-plugged:f8cede54-70ed-417a-95b6-f164d1529923 for instance c4ed7230-49a3-4df6-a262-e345916ead82 on n-h2-858384-11 Oct 13 08:37:43.626761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d0b72292-c74d-4f26-94a1-d65bb486ef5b req-63f57314-1f56-46b6-8cb9-75f18d5358cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038688 Oct 13 08:37:43.627949 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 615/1227] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:43.870374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:43.871017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:43.880278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.880773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.881308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:43.882018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:43.882501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:43.883317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.027208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:44.030869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:44.082082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.082606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.083040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.083751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.096012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.096476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.198158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.208745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d73aabe1-ba97-4fda-a5fe-621743896474 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.342589 Oct 13 08:37:44.210001 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 613/1228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:43 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:44.219869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:44.226196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:44.244913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.245911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.246537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.248059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.248900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.249485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.419799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.431732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd80aba0-590c-4590-9c19-ea043fa28522 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.218001 Oct 13 08:37:44.432454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 614/1229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:44 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:44.491285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.501147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:44.501924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.502080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:44.503531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.505187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba065ba6-df8a-4f2f-996d-a56615dbc5e0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.486096 Oct 13 08:37:44.506305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 616/1230] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:44 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:44.508191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.508867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.509458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.510325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.510808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.514563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.596921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:44.597733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:44.605862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.606607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.607197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.608085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:44.608758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:44.609558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:44.636853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.648805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.653309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.664269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a50666d9-c240-423c-8b2d-3fdf70414e46 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.166929 Oct 13 08:37:44.666670 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 615/1231] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:44 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:44.963748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:44.975308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48db7d3b-c501-45ef-b133-278ecda66347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1477 microversion: 2.1 time: 0.380580 Oct 13 08:37:44.981681 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 617/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:44 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:45.238229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:45.239311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:45.248549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.249739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.250180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.252087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.252562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.252991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.456456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:45.457054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:45.469483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.469990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.470462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.471206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.471654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.472079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.567378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:45.593187 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cde3cdc5-b4dc-4dc2-a5b7-43dacfdf87dd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1318 microversion: 2.1 time: 0.360707 Oct 13 08:37:45.595159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 616/1233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:45 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:45.609181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:45.614225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:45.642774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.645835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.646289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.656908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.659384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.660023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.888534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:45.902114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ecac86a-2fde-4054-8898-f9dbfc1cb7ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.449688 Oct 13 08:37:45.904218 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 618/1234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:45 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:45.921482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:45.922254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:45.934884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.935673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.936346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.938906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:45.939754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:45.940926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:45.954327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:45.970537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:45.972029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:45.978350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-604218ba-b080-4aac-9f15-7bb6d0b21716 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.380689 Oct 13 08:37:45.979354 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 617/1235] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:45 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:45.999988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:46.001615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:46.010533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:46.011681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:46.012742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:46.013619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:46.014226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:46.015004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:46.061098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:46.075765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:46.078385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:46.090433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a41d53ac-4331-4d71-9c48-c639dc5e3d69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.182802 Oct 13 08:37:46.096022 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 619/1236] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:45 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:46.241997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:46.252053 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-228bb670-06b9-4a43-98df-5923a964b3bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1476 microversion: 2.1 time: 0.256078 Oct 13 08:37:46.254098 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 618/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:45 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:46.386590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1664256381", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:46.425907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4874e04-08f1-438a-81f5-479134c341ed", "device": "/dev/xvdb"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:46.429580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:46.446294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:46.448092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:46.449131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:46.452997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:46.455235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:46.455680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:46.484420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:46.906968 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ac95a2e-1293-4195-b511-f2e13ee8d36b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492232 Oct 13 08:37:46.908015 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 619/1238] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:37:46 2022] POST /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:46.922764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "name": "network-vif-unplugged", "status": "completed", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:46.957092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:46.958253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:46.958766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:46.981775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Creating event network-vif-unplugged:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h2-858384-11 Oct 13 08:37:46.998259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] Instance 688aabbd-0274-4749-88e1-91a4f421063e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:37:47.034160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d6ceeadd-d678-42a1-a65c-1fd015321f7b req-b3de6d8b-73f5-4cff-bf0c-8ff0b8ee7e44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124533 Oct 13 08:37:47.047193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 620/1239] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:47.057850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:47.058602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:47.060623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:47.077475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.078165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.078726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.079540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.080346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.081162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.421823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:47.429847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b50f4d70-fb40-4d79-86d4-cca568908877 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1468 microversion: 2.1 time: 0.381442 Oct 13 08:37:47.444985 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 621/1240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:47 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1468 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:47.461702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:47.462540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:47.476998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.477514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.477955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.483313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.484547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.485281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.779775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:47.788723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-293b7c66-33e3-4d1b-9a43-05dec3643470 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.342489 Oct 13 08:37:47.789328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 622/1241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:47 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:47.800219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:47.800850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:47.808378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.808882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.809330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.810052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:47.811032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:47.811032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:47.998874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.008694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.010869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.012370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c29be3a-895b-4520-ac46-1045da50df79 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.222103 Oct 13 08:37:48.013474 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 623/1242] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:47 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:48.018659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:48.020090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:48.036339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.037756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.038442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:48.038998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.039377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:48.039850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:48.040250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:48.040662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:48.041036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.041659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.042336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.062374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.062835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.063278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.064025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.064480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.064908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.085828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:48.118937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:48.137012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:48.167306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:37:48.170187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:48.192204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.203754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.205551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.223895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b23a200-765e-42a5-bf94-f9f29b35afdf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.209013 Oct 13 08:37:48.224478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 624/1243] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:48 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:48.229765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:48.232581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:48.250493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.251267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.251885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.252763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.253376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.253961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.273101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-915905d3-374c-4ac8-b1c4-3beaeecead13 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147255 Oct 13 08:37:48.274382 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 620/1244] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:37:48.284059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:48.289029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:48.313303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.314131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.323046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.324640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.325274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.325888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.483959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.492815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f4ef22d-3440-445b-8997-0001b16882bb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1476 microversion: 2.1 time: 0.266589 Oct 13 08:37:48.494623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 625/1245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:48 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:48.500386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3eaef29-70da-416b-9df9-6afeece56320 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:48.501221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3eaef29-70da-416b-9df9-6afeece56320 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:48.588713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3eaef29-70da-416b-9df9-6afeece56320 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.595867 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3eaef29-70da-416b-9df9-6afeece56320 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1208 microversion: 2.1 time: 0.100171 Oct 13 08:37:48.602385 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 626/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:48 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:48.673311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:48.692118 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50cd3eb8-f6d5-40e9-af93-87c27fc69afb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.416304 Oct 13 08:37:48.693168 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 621/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:48 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:48.817381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:48.817962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:48.834533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.835060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.835547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:48.836480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:48.837111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:48.837718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.040764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:49.041383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:49.054152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.054747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.055177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.060219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.060900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.061502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.147189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.175226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2039837d-2974-4b32-83c9-69957bf28f03 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.357279 Oct 13 08:37:49.175809 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 627/1248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:48 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:49.183015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:49.207358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.210323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.212928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.238301 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Creating event network-changed:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h2-858384-11 Oct 13 08:37:49.257971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] Instance 688aabbd-0274-4749-88e1-91a4f421063e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:37:49.272239 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6cf93dc1-c80c-4842-9b73-87fccfdf4ee0 req-230520d7-86aa-4dae-a918-3d54d40471eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094459 Oct 13 08:37:49.273140 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 628/1249] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:49.286921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:49.288449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:49.301774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.302277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.302789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.303499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.303951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.304377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.360794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.371895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.376041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.377700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d3d694e-5707-44f1-8304-0f3f5bf0edc8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.342449 Oct 13 08:37:49.378871 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 622/1250] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:49 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:49.397253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176cd4f6-ef1e-48ed-8ffb-e7740993b2fa", "name": "network-vif-plugged", "status": "completed", "tag": "601614ad-4798-4fcb-a597-dd06bf562d8d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:49.408757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.410085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.413222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.471960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] Creating event network-vif-plugged:601614ad-4798-4fcb-a597-dd06bf562d8d for instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa on n-h2-858384-11 Oct 13 08:37:49.486637 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-be0e0211-8870-454e-b016-3ad41f72ddd9 req-41d0eab4-5da2-4784-a557-5fc6b6b5ddb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105655 Oct 13 08:37:49.487549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 623/1251] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:49.522532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:49.526899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:49.542353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.542880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.543320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.544032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.544486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.544923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.562264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.579590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.584107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.593365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8bb4340a-1b92-4e00-9e50-82a0cbca0de8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.318781 Oct 13 08:37:49.593972 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 629/1252] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:49 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:49.624049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:49.624693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:49.632414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.632904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.633536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.634244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.634779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.635208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.749344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.767094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8a8107c-5668-4820-b3cf-b9c53eb3fb51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1260 microversion: 2.1 time: 0.144111 Oct 13 08:37:49.768172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 630/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:49 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:49.785357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:49.788154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:49.800124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:49.805755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.808340 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e85d5786-4869-449e-b3bb-d9be777963ef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1474 microversion: 2.1 time: 0.291495 Oct 13 08:37:49.808926 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 624/1254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:49 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1474 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:49.810957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.811412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:49.812151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:49.812599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:49.813344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.043967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.057033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-196ca41c-a52c-4413-bd09-e7fe8642c217 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.287622 Oct 13 08:37:50.073944 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:49 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:50.205371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:50.206747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:50.215265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.216054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.216652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.217561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.218273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.218879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.407409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:50.408788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:50.418983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.420512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.421286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.422677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.423477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.424368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.481604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.496860 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32740172-9bb5-4ba9-9132-bc2db05432f8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.296755 Oct 13 08:37:50.497464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 625/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:50 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:50.623974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:50.625065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:50.631991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.632927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.633837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.634354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.635296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.635953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.636551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.649907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.652161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.653656 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb24903d-f843-4867-827e-6bcf8fdafc93 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.253295 Oct 13 08:37:50.667405 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 632/1257] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:50 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:50.753953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.769683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.773129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.792029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:50.792620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-07216d0f-1d05-4c25-a562-befd2da121f8 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.174356 Oct 13 08:37:50.793594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:50.796676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 626/1258] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:50 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:50.811044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.813603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.815962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.818812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.820644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.822288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.837008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:50.837636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:50.846267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.846808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.847247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.847974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:50.848431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:50.848862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:50.902869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:50.959954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:50.970963 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-510c07d1-6981-4183-b459-78a1828b45ed tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1266 microversion: 2.1 time: 0.184118 Oct 13 08:37:50.979005 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 633/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:50 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:51.084737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:51.085374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:51.095201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.096292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.097161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.098182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.100152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.100870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.162374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.171380 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b39b755-4a41-404c-8fa5-2ada1effed3f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1474 microversion: 2.1 time: 0.339433 Oct 13 08:37:51.172273 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 627/1260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:50 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:51.259684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.268886 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9927fb8-dca6-4ad6-b220-fdfa085f88f1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.191034 Oct 13 08:37:51.270041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 634/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:51 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:51.521035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:51.522433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:51.529663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.530454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.531184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.532322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.533036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.533524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.684859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:51.686174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:51.693260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.693414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.693815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.694582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.695263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.695458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.744831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.756522 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ecae8ddf-9ac1-4094-9916-48ec8ccd205c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.238111 Oct 13 08:37:51.766438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 628/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:51 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:51.830974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:51.831759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:51.838295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.839110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.839882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.840807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:51.841461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:51.842320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:51.863021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.873580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.875617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.877786 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-585a13a8-a81e-4a9f-a746-584a072131b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.196791 Oct 13 08:37:51.879193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 635/1263] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:51 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:51.967639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.977213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.978844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:51.984338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6b4b52e-e166-455a-9fc1-1ee3fd7d75be tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.157625 Oct 13 08:37:51.984936 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 629/1264] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:51 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:51.995116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:51.996062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:52.002419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.003074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.003593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.004341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.004977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.005799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.153444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:52.162632 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52cfdec9-4ced-44bb-83a5-5c97e6f73757 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.170562 Oct 13 08:37:52.163479 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 636/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:51 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:52.206658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967fa910-47ba-4b35-913a-93408711c30e", "tag": "5ed99e5a-ac8c-4ece-b303-80872d42e22c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:52.212550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:52.213218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:52.228435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.230584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.234801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.235543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.237974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.238441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.241228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.241719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.242152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.257249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] Creating event network-changed:5ed99e5a-ac8c-4ece-b303-80872d42e22c for instance 967fa910-47ba-4b35-913a-93408711c30e on n-h1-858384-11 Oct 13 08:37:52.262001 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2c7aeb6e-16ac-4e1d-8e55-ba2526a900d8 req-c8db7902-eead-44d8-923d-9e1938cab1e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059756 Oct 13 08:37:52.263092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 637/1266] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:52.293141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:52.294589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:52.301014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.301686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.302130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.302905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.306063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.306539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.443805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:52.451962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b80cdff6-b896-4537-9178-106612f71dc0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.162926 Oct 13 08:37:52.452734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 638/1267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:52 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:52.471092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:52.479944 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e34d5628-6460-4111-a021-1ffe56502702 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1474 microversion: 2.1 time: 0.286694 Oct 13 08:37:52.480667 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 630/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:52 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1474 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:52.779717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:52.780477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:52.787569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.788066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.788511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.789258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.789705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.790133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.907652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:52.908972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:52.917634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.918421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.919045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.920172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:52.920840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:52.921428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:52.946439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:52.968771 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9ef49cd-7a52-4c5b-85f7-ae9a2cda3e21 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.192903 Oct 13 08:37:52.969924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 639/1269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:52 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:53.013795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.014359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.020325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.020823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.021741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.022647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.023102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.023524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.100342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.109336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.111626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.117689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c3515ac5-3c72-4976-92a4-7b4cdd5cedcf tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.108454 Oct 13 08:37:53.118524 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 640/1270] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:53.179223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.188145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.189627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.192859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.194868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.196346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b8a048f-3baa-4487-98d3-bb02f276b6ca tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.296195 Oct 13 08:37:53.197376 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 631/1271] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:52 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:53.199263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.199752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.200181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.200876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.201321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.201731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.309394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:53.414867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.425107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b6bfaef-9954-4a71-acd9-7ab8b75516a8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.240900 Oct 13 08:37:53.441222 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 641/1272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:53.476510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.477191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.483266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.483748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.484190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.484887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.485338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.485765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.504511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.505399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.513092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.513887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.514520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.515386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.518557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.519181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.619484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.631287 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf91ee4a-3e0b-43bc-8967-f681724e64b9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.159124 Oct 13 08:37:53.631895 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 632/1273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:53.673807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:53.681712 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-39124837-5bab-42de-a9dc-84fe80cc4dcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1471 microversion: 2.1 time: 0.181524 Oct 13 08:37:53.682303 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 642/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:53.704233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:53.705028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.711620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.712104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.712544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.713242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.713701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.714133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.772051 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db3c750e-d74b-459c-8a02-8c59e98839d9 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e/action" status: 204 len: 0 microversion: 2.1 time: 0.071551 Oct 13 08:37:53.772705 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 633/1275] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:37:53 2022] POST /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:37:53.781028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.781636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:53.788630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.789128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.789643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.790470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:53.791848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:53.792744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:53.799915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:53.995594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:53.997334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:54.013274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.014436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.015225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.016887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.020041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.021040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.036269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.052280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-090bd616-7b44-4dc3-88a0-e46f91ab2b94 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1471 microversion: 2.1 time: 0.275300 Oct 13 08:37:54.057408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 643/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:54.145432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:54.146334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:54.154563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.160160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.160878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.161634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.162650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.163085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.247015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.258226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.260592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.266885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12d1fa8b-1c33-40b0-8fd8-15a8b136883c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.125286 Oct 13 08:37:54.279191 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 644/1277] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:54 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:54.279191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:54.279191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:54.290427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.290427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.290427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.290427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.290926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.290926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.379677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.389494 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6c7a164-48d0-4a48-8466-5977378b8f86 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.400828 Oct 13 08:37:54.390252 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 634/1278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:53 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:54.448798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:54.449402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:54.455779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.456259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.456690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.457379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.457824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.458253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.470040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.483968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.486337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.487751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab14c5a2-fec9-4ca4-a46e-532bcb18e350 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.218467 Oct 13 08:37:54.504411 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 645/1279] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:54 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:54.629519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.638085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2f0fd89-bb78-4aba-9fb1-2b69ebf07f51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.193115 Oct 13 08:37:54.651049 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 635/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:54 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:54.656945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:54.657495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:54.665529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.666016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.666473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.667175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:54.667622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:54.668043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:54.905574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:54.914617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3067a5b3-998b-4b9f-8f09-632e8cfcecd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1318 microversion: 2.1 time: 0.261666 Oct 13 08:37:54.915131 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 646/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:54 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:55.081270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.081892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.090512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.091964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.092747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.093703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.094239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.095495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.246425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.255149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-01a5addf-130a-4e01-8748-6c4e8cabfa76 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1471 microversion: 2.1 time: 0.182325 Oct 13 08:37:55.256608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 636/1282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:55.297502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.298103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.304835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.305320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.305747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.306475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.306944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.307467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.384350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.393410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.395706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.401326 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-855538a7-15df-4843-a5b8-af3b0b8b9a7d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.107844 Oct 13 08:37:55.401915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 647/1283] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:55.422897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.428955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.435463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.435964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.436406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.437117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.437575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.438004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.515765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.516918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.524072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.525393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.526115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.527213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.527648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.528942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.606608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.617060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3541c4c-13ac-4160-899d-5e520fc1cc28 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.205682 Oct 13 08:37:55.618184 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 637/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:55.665881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.666054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.681949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.682342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.683059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.683516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.683973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.684402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.722867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.734003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.736134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.737309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0b296b2-6223-4734-b41a-069e82f8c3ec tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.225785 Oct 13 08:37:55.742452 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 648/1285] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:55.890792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:55.903155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "name": "network-vif-plugged", "status": "completed", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:55.907354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96d1fda5-d85e-4eca-bb22-9b2e6e372cd7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.244709 Oct 13 08:37:55.908028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 638/1286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:55.925026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.926373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.927064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.944882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:55.945415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:55.952562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.953120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.953575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.954351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:55.955082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:55.955569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:55.956624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] Creating event network-vif-plugged:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h2-858384-11 Oct 13 08:37:55.970826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8b1a62b3-ed4d-4f67-b38c-166e03ba29d1 req-c53e5f29-e418-4cb3-9d04-d1d8a559c1c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072059 Oct 13 08:37:55.971687 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 649/1287] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:56.120964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.129266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f2d26c5-2b07-4aea-bd74-5ec610554ddc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1468 microversion: 2.1 time: 0.189442 Oct 13 08:37:56.129836 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 639/1288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:55 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:56.153250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.159701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.160573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Searching by: {'reservation_id': 'r-txyoo7mt', 'deleted': False, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:37:56.167976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.168550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.168988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.169714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.170173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.170642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.279533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.280461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.286893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.287579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.288262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.289201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.289860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.290344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.314590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:37:56.398494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.405753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.406318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.406862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.434961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.444830 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd628c89-887f-4d45-993e-d55ca155db4d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1463 microversion: 2.1 time: 0.169294 Oct 13 08:37:56.445732 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 640/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:56.454474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.455627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.463707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.464496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.465035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.465960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.466660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.467163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.544602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c0ecd2d-b102-4fe9-ae01-32f0a0a4dc3a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-txyoo7mt" status: 200 len: 2929 microversion: 2.1 time: 0.395422 Oct 13 08:37:56.545234 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 650/1290] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/detail?reservation_id=r-txyoo7mt => generated 2929 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:56.548083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.550182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.551139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.557536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.557925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.558397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.558857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.559344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.559659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.560112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.560531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.564538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88db0c9e-02c2-4a1c-b2e4-8dd6a9e9e264 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.117499 Oct 13 08:37:56.565359 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 641/1291] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:56.570426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.596415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_groups [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Querying cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) for 2 instances {{(pid=127031) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 13 08:37:56.597149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.597638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.598078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.630345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-706d51e7-c13f-4e3e-93a9-482a00c6c153 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/5791035c-43d5-499c-a80c-e0ef13bd1007" status: 200 len: 265 microversion: 2.1 time: 0.063839 Oct 13 08:37:56.631575 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 642/1292] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/os-server-groups/5791035c-43d5-499c-a80c-e0ef13bd1007 => generated 265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:56.639742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.640302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.646892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.647391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.647833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.648557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.649017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.649450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.655201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:56.791078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.800112 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc2ccce7-6f28-430a-99e2-e79923dc4122 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.164363 Oct 13 08:37:56.800690 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 643/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:56.805526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.806141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.811872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.812354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.812786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.813474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.813922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.814342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.895742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:56.905025 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-edefd7c5-d10a-442b-a49f-f35ae9d13fde tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1463 microversion: 2.1 time: 0.358484 Oct 13 08:37:56.905852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 651/1294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1463 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:56.915609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:56.916314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:56.922832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.923413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.923929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.924702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:56.925279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:56.925852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:56.961179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2eb8e647-fb95-4a12-9d26-438aa21c4cad tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1621 microversion: 2.1 time: 0.156651 Oct 13 08:37:56.961839 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 644/1295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:56.971889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8f7fdc2-55c4-4e5a-a269-dcd3f66aa902 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'create', calling method: .version_select at 0x7f5376fd5310>, body: {"keypair": {"name": "tempest-keypair-1960283656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfux5AihlcIv4MoS3UGqbCxz43MMZzGS3vN8a8Bt0IsStQoWZUULze5MwBo176V6XSmGb/eH+mSxnrX6H959xbieLOuNK5FjSN5DDrcdPJWzassZ3aa0PA5/HykQMl75g=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:56.985547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:56.993476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a8f7fdc2-55c4-4e5a-a269-dcd3f66aa902 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:56.998624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a8f7fdc2-55c4-4e5a-a269-dcd3f66aa902 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.034650 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8f7fdc2-55c4-4e5a-a269-dcd3f66aa902 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071699 Oct 13 08:37:57.035467 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 645/1296] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:37:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:57.041219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:57.041914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:57.051580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.052130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.053137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.054543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.054543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.054893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.105164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.114823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.116877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.118442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2dc02cd-d013-4031-9020-3db4ea2420ee tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.206599 Oct 13 08:37:57.119392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 652/1297] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:56 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:57.124070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:57.124663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:57.131818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.132320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.132756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.133467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.133918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.134342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.274055 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87c73b0e-1783-4027-911d-6458124a6503 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 200 len: 1621 microversion: 2.1 time: 0.153509 Oct 13 08:37:57.274683 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 653/1298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:57 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:57.300589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: .version_select at 0x7f5376868280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-184035385", "policies": ["anti-affinity"]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:57.319292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:57.323479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.364710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:57.372520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:57.377070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.389668 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa5cfd3c-6674-470f-8311-4bcfd6212b89 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.093122 Oct 13 08:37:57.390496 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 654/1299] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Oct 13 08:37:57 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:57.529136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1069117246", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "91b07ecc-4a74-4159-9fe9-d5a96f4c6c8b"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:57.534922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.553337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3f757f4-d4df-4604-aad0-b31072861c61 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.516396 Oct 13 08:37:57.553928 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 646/1300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:57 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:57.592438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:57.592930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:57.593578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:57.600396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.600882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.601704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.602802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.603289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.603921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.690922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.701420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.703527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:57.710823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d52716b5-d8ad-430f-b706-effa0b2d414b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.121420 Oct 13 08:37:57.711963 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 647/1301] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:57 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:57.820669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:57.821233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:57.821845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:57.822344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:57.822950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:57.825552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:57.826445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:57.835256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.835871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.836301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.837074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.837598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.837993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.839425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.840081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.840527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.841437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:57.842248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:57.842374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:57.859814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:57.863963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.875708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 2 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:37:57.878270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:57.930583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:57.935298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.976152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:57.980618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:57.995310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=96e2c187-9fa4-4db0-986b-b99ac19b653b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:58.009575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.019417 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa9704b7-3019-4960-9246-6c8b1e36f630 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.198467 Oct 13 08:37:58.020606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 648/1302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:57 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:58.053511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:58.057685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:58.101861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:58.106170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'server_group_members'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:58.141955 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a60e57f-370c-4d14-a165-935ac75b4021 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.620569 Oct 13 08:37:58.144762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:58.145847 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 655/1303] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 13 08:37:58.146496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:58.151350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:58.154604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:58.156305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.156707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.156981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Searching by: {'deleted': False, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:37:58.157524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.158118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.159408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.160761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.161498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.174303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.174820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.175260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.175997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.176454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.176976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.284648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:37:58.345380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.356096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.358215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.359437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-557c0e67-14fc-4213-a75e-9072a36b0ef5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.219305 Oct 13 08:37:58.368333 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4909c4cf-8845-4782-96e9-8fc398784bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.221097 Oct 13 08:37:58.369221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 656/1304] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:37:58 2022] GET /compute/v2.1/servers => generated 1663 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:58.371509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 649/1305] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:58 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:37:58.383703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2112970a-61f6-4245-a6d0-806b8854cbeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:58.384616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2112970a-61f6-4245-a6d0-806b8854cbeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:58.442758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2112970a-61f6-4245-a6d0-806b8854cbeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.451145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2112970a-61f6-4245-a6d0-806b8854cbeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1219 microversion: 2.1 time: 0.071554 Oct 13 08:37:58.451770 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 657/1306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:58 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:58.577430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:58.586329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:58.595940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.606008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.606492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.607234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.607689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.608110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.740289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:58.740914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:58.749720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.753599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.754501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.755524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.757116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:58.757468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd4c03c5-fe0e-4554-bae5-925238d8a8cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.184013 Oct 13 08:37:58.760011 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 650/1307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:58 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:58.764449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:58.765265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:58.847437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.857906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.859573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:58.865493 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c901489-fdbc-4d1a-af19-428186aa39a4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.130374 Oct 13 08:37:58.878491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 658/1308] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:58 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:59.047743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.049165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:59.064020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.064530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.064985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.065710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.066165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.066626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.109267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967fa910-47ba-4b35-913a-93408711c30e", "name": "network-vif-plugged", "status": "completed", "tag": "5ed99e5a-ac8c-4ece-b303-80872d42e22c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:59.146202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.147457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.148662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.172431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] Creating event network-vif-plugged:5ed99e5a-ac8c-4ece-b303-80872d42e22c for instance 967fa910-47ba-4b35-913a-93408711c30e on n-h1-858384-11 Oct 13 08:37:59.181139 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-90ad83ed-1ffc-4dd0-a6b4-0d0cd0eb17c9 req-e933e148-2899-4b72-81e7-982c8a8dd0a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075916 Oct 13 08:37:59.182096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 659/1309] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:59.268308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c10f0d6-67a5-48a7-a311-fe9daba715f1 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '.version_select at 0x7f537685b550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.281438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c10f0d6-67a5-48a7-a311-fe9daba715f1 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.285912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c10f0d6-67a5-48a7-a311-fe9daba715f1 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.286835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c10f0d6-67a5-48a7-a311-fe9daba715f1 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.289680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.298703 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bc0c41d-fc33-4b21-9e09-818d99d7da50 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.254947 Oct 13 08:37:59.299284 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 651/1310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:59.302906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c10f0d6-67a5-48a7-a311-fe9daba715f1 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2750 microversion: 2.1 time: 0.039525 Oct 13 08:37:59.305803 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 660/1311] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/os-migrations => generated 2750 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:37:59.331313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b0a676f-4ced-444d-9ef0-496c557962d6 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.338597 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b0a676f-4ced-444d-9ef0-496c557962d6 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011523 Oct 13 08:37:59.339409 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 652/1312] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:37:59.385735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.386526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:59.394429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.394940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.395629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.396885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.397346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.397776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.411900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1aaa437-5a4b-4388-8924-7e6be843e8dc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1887189357", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:59.432957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1aaa437-5a4b-4388-8924-7e6be843e8dc tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.024909 Oct 13 08:37:59.433526 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 653/1313] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Oct 13 08:37:59 2022] POST /compute/v2.1/flavors => generated 499 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:37:59.445906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cb35004-3c3a-49df-a187-69282c375e8d tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.453425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cb35004-3c3a-49df-a187-69282c375e8d tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011766 Oct 13 08:37:59.454130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 654/1314] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:37:59.472948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.473560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:59.479568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.480050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.480511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.481212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.481657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.482081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.551937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.557770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.562262 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e9924cc-5550-4deb-8215-01064ea724c8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1215 microversion: 2.1 time: 0.092619 Oct 13 08:37:59.563874 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 655/1315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:59.567491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.570822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.572868 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c501fc0b-6c94-4485-8854-492565694194 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.190723 Oct 13 08:37:59.574133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 661/1316] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:37:59.598564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-56161018", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "df4afcb6-48a7-4f4c-b007-c2dc9d4587a6"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:37:59.658454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:37:59.781174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.781891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:59.787972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.788574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.789122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.790015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.790899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.791560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.871400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:37:59.871765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:37:59.872380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:37:59.872803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:37:59.873222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:37:59.882869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.883354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.884344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.885311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.885983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.886481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.905134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:37:59.909192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:37:59.920823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:37:59.923155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:37:59.929553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:37:59.937846 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9ed0cf9-5658-460b-a0aa-50a367362daa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1308 microversion: 2.1 time: 0.160612 Oct 13 08:37:59.942782 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 662/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:37:59.943170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.943632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:37:59.950299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.950917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.951485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.952274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:37:59.952862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:37:59.953376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:37:59.973779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:37:59.977179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a28e9e4b-1ab0-466d-8919-363651968a64 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.382331 Oct 13 08:37:59.977849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 656/1318] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:37:59.990799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df23e4ca-1d1b-4ba1-a7d5-dfa67b62fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:37:59.991269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df23e4ca-1d1b-4ba1-a7d5-dfa67b62fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:00.045456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.056279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.057756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.059595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df23e4ca-1d1b-4ba1-a7d5-dfa67b62fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.062897 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab49611f-eb36-4602-be00-d25906e20d6f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.123405 Oct 13 08:38:00.063771 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 663/1319] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:00.087256 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df23e4ca-1d1b-4ba1-a7d5-dfa67b62fd01 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1277 microversion: 2.1 time: 0.102096 Oct 13 08:38:00.091010 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 657/1320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:37:59 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:00.322539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:00.323503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:00.331527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.332448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.333094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.334491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.335020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.335567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.518703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.529623 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d90f216-ea1d-4d76-8830-6a8f6c49abac tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.210532 Oct 13 08:38:00.530094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 664/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:00 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:00.589951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:00.591109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:00.598751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.599473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:00.599473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:00.600781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.601451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.602439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.603219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.604012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.606795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:00.612991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.615059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.616946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.620851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.621770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.622470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.683207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.691232 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c8871f3-4ec9-4a40-8479-eeae5d6468fc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1215 microversion: 2.1 time: 0.108125 Oct 13 08:38:00.691805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 658/1322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:00 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:00.837416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.848969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.850529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:00.851723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d36caabb-5d00-41a7-b0d3-5bd3a0774e76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.257004 Oct 13 08:38:00.852614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 665/1323] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:00 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:00.961019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:00.961661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:00.967551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.968027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.968455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:00.969144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:00.969590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:00.970007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.094718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.095721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.102223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.103741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.105068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.106046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.106636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.107075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.111744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.138019 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2744a60f-6851-4dc2-91b9-92c5610f61ab tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1488 microversion: 2.1 time: 0.181600 Oct 13 08:38:01.139721 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 659/1324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:00 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1488 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:01.145833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.146661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.155021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.155506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.156318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.157025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.157476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.157897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.187059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.196174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.198292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.203545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de4f159b-5c20-4150-9516-fee40cef11d1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.114057 Oct 13 08:38:01.204307 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 666/1325] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:01.223017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:01.223194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.224551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.231198 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d20663b7-c466-493e-854d-4c4aac545631 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1329 microversion: 2.1 time: 0.089970 Oct 13 08:38:01.231371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.231808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.232034 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 660/1326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:01.232433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.233143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.233591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.234012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.303068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62469390-1bfe-4ac7-87ce-d96219a6e89e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.087056 Oct 13 08:38:01.306736 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 667/1327] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:01 2022] POST /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:01.312378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.313066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.322605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.323388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.325530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.326246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.326881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.333554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.555126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.556644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.565415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.566203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.571694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.572889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.573605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.574253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.634524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.643869 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38905e83-2571-459d-9053-506194534075 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1493 microversion: 2.1 time: 0.335786 Oct 13 08:38:01.647100 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 661/1328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1493 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:01.721651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.723984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.740264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.748659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.749484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.750530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.751214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.751868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.853444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.865485 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3206b475-1014-4a74-8885-c0aaaf93ba56 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1215 microversion: 2.1 time: 0.152209 Oct 13 08:38:01.866267 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 662/1329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:01.879517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:01.880134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:01.899915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.900411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.900848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.901550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:01.902218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:01.902740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:01.952673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:01.961835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a931f1b-922c-4f45-a12b-226b6621beb8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.411236 Oct 13 08:38:01.968265 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 668/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:02.042328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.054209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.055773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.057271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c1f63f4-6518-4fa3-9e47-50103c0f9cf2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.181696 Oct 13 08:38:02.058373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 663/1331] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:01 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:02.231685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:02.232515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:02.239160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.239757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.240201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.241123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.241732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.242321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.256012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:02.256633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:02.267437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.268076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.269764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.270884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.273885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.274485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.348496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.353441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.361668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.362876 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-941c7ef1-0f5f-4fe1-91d7-5f36153f8970 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1335 microversion: 2.1 time: 0.110609 Oct 13 08:38:02.363307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.371200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 664/1332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:02 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:02.375279 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5b769fc-ac1f-44be-a521-14171f013ab2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.147896 Oct 13 08:38:02.376324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 669/1333] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:02 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:02.445457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e2c187-9fa4-4db0-986b-b99ac19b653b", "tag": "ab68af6b-b5f2-448e-907d-790ed2c631d4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:02.455798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.456626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.457457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.471500 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] Creating event network-changed:ab68af6b-b5f2-448e-907d-790ed2c631d4 for instance 96e2c187-9fa4-4db0-986b-b99ac19b653b on n-h1-858384-11 Oct 13 08:38:02.477768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e7fe65b6-e549-42a3-b167-ccf894a608a0 req-8e10ee25-94c7-4e7d-92c4-12788d5a7ab5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036296 Oct 13 08:38:02.488248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 665/1334] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:38:02.566042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:02.567385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:02.574232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.574744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.575234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.575936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.576384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.576863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.669809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:02.670556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:02.680363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.681138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.681737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.685241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.685718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.686147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.693948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:02.895468 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-881e646a-a7f2-41e6-bd4c-7fa95665ec3d tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1860 microversion: 2.1 time: 0.320881 Oct 13 08:38:02.896879 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 670/1335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:02 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1860 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:02.904987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:02.905611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:02.925582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.926082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.926847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.927356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:02.927840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:02.928596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:02.976529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:02.987948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-995c2db5-6ef5-4e61-ad61-5257ce315abf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 200 len: 1473 microversion: 2.1 time: 0.322767 Oct 13 08:38:02.988803 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 666/1336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:02 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 1473 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:02.993885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": true, "disk_over_commit": false}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:02.996468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.005854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.006704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.007306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.008263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.008944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.009705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.013795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.022278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47a6ae8c-26fb-4198-b78a-34e54fec708b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1215 microversion: 2.1 time: 0.121087 Oct 13 08:38:03.038970 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 671/1337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:02 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:03.051287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:03.052095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.054233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lazy-loading 'flavor' on Instance uuid f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:03.058770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.059487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.059927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.060644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.061101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.061528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.068658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127031) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:38:03.269273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.280204 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e43cb920-c00c-4452-baf7-d86693beb8ff tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.240227 Oct 13 08:38:03.281208 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 672/1338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:03 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:03.289302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-94420812"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:03.292107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.298609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.299097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.299536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.300242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.300930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.301569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.531043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4267ad47-06d7-4689-b633-28745cb5797f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.245262 Oct 13 08:38:03.531703 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 673/1339] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:03 2022] POST /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:38:03.537430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:03.538185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.545041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.545721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.546357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.547091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.547546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.548143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.709520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.720850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.722964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.724923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ad6385d-8876-4ac2-a287-32948aeb8dce tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.191247 Oct 13 08:38:03.725566 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 674/1340] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:03 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:03.730385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:03.731265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.737623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.738376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.738911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.739740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.740777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.741535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.913334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:03.922097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4c44e4c-4307-4c36-9390-5b132973018d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.195228 Oct 13 08:38:03.923343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 675/1341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:03 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:03.928944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:03.929553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:03.935713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.936338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.936778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:03.937496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:03.937955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:03.938393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.014374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.049008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.053352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.064764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89532912-c3fe-414a-8c1d-cd5238b528e2 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.139954 Oct 13 08:38:04.078599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 676/1342] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:03 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:04.078599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e185251-88f8-4eb9-996a-ddcf66436f60 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53769dfaf0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:04.128129 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e185251-88f8-4eb9-996a-ddcf66436f60 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.059334 Oct 13 08:38:04.138727 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 677/1343] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:04 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:04.144570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca", "tag": "2b02ad32-7aa5-4a2e-803d-aa110cd56d87"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:04.156288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.157027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.157666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.172385 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] Creating event network-changed:2b02ad32-7aa5-4a2e-803d-aa110cd56d87 for instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca on n-h1-858384-11 Oct 13 08:38:04.178472 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-dbd7a904-9417-4622-af11-0affe137261f req-aa0b00e8-3af2-4941-8f46-e24271f68d9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038035 Oct 13 08:38:04.179844 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 678/1344] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:04.185465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:04.186446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:04.193536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.194301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.194981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.195973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.196434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.196898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.219558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:04.283390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.294131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbc82962-36c2-4754-8284-20363bf0b08b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1271 microversion: 2.1 time: 0.112880 Oct 13 08:38:04.294794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 679/1345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:04 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:04.308641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:04.310246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:04.318865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.319481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.319924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.321163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.321605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.322033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.554646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.566097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29e0ce16-7baf-4f48-acd2-819bc8403ff8 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.264032 Oct 13 08:38:04.566969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 680/1346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:04 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:04.753430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:04.754936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:04.765804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.766341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.767659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.768547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.769709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.770776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.933918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.943725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.945160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:04.946332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef8da7bc-49d4-4db5-b2d7-61497f61c331 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.198213 Oct 13 08:38:04.946937 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 681/1347] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:04 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:04.951507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:04.952120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:04.958956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.959442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.959874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:04.960571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:04.961019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:04.961438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.101850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.110073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-258a9cf2-27d7-48c0-b1cf-fd039ea27150 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.161984 Oct 13 08:38:05.110634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 682/1348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:04 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:05.115808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:05.116420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:05.122299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.122817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.123250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.123955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.124410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.124836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.196565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.205309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.206800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.212274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a818567d-932d-4bd5-afcd-9a7cbfb99404 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.100631 Oct 13 08:38:05.212866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 683/1349] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:05 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:05.217529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e918bebb-bef2-4218-815a-dfc2ace83511 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376fdf8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:05.267946 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e918bebb-bef2-4218-815a-dfc2ace83511 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.054002 Oct 13 08:38:05.278430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 684/1350] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:05 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:05.319500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:05.320155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:05.326940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.327425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.327854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.328561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.329009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.329433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.392510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.400234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-13e22c77-055d-43ee-9ce5-d4a94918c87e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1271 microversion: 2.1 time: 0.084762 Oct 13 08:38:05.400798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 685/1351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:05 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:05.594415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:05.595054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:05.601864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.602354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.602816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.603518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.603972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.604403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.734131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:05.741897 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ceff74a-666d-4b89-a95c-5e9419d7e162 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1472 microversion: 2.1 time: 0.151402 Oct 13 08:38:05.742477 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 686/1352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:05 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:05.972697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:05.973343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:05.986459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.986998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.988639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:05.989399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:05.989906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:05.995148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.341881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.351150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.352190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.353350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2b29fc8-66c9-4463-82da-ed0a459aee5b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.385123 Oct 13 08:38:06.353911 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 687/1353] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:05 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:06.363769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.363769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:06.365267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.365929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.366362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.367142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.367520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.367940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.554866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.563674 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6031dfe5-9536-4449-93dc-571d75720f6d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.208624 Oct 13 08:38:06.564262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 688/1354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:06.569432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "name": "network-vif-unplugged", "status": "completed", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}, {"name": "network-changed", "server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:06.582295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.582295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.582295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.592987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Creating event network-vif-unplugged:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h1-858384-11 Oct 13 08:38:06.593490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] Creating event network-changed:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h1-858384-11 Oct 13 08:38:06.598631 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7b68e578-1735-4cd9-87ce-edf0d915b7ef req-30329810-0229-48cb-887d-aa9f035f81f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033235 Oct 13 08:38:06.599772 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 689/1355] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:06.604981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.605699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:06.611814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.612325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.612757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.613450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.613903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.614623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.676180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fca707e8-08ce-465f-b361-8c28c6d60c66 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/action" status: 202 len: 0 microversion: 2.1 time: 3.685772 Oct 13 08:38:06.677008 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 667/1356] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:02 2022] POST /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/action => generated 0 bytes in 3687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:06.683025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f3e02ab-12ec-43d4-a963-a78aa39637db tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376c68f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.736115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.750647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.758562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.767666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a210e2f1-bd52-403a-95af-bedc05697f20 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.166704 Oct 13 08:38:06.778489 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 690/1357] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:06.778489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.778489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:06.782673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f3e02ab-12ec-43d4-a963-a78aa39637db tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.103536 Oct 13 08:38:06.783578 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 668/1358] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:06.785921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.786996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.787707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.788611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.789204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.789774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.795552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.796405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:06.805454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.806399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.807185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.808363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.809082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.809814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.880707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:06.889346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ecd98fe4-6155-448b-a033-5fba8f739fbe tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1271 microversion: 2.1 time: 0.119659 Oct 13 08:38:06.890195 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 691/1359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:06.895335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:06.896177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:06.902494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.903273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.903907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:06.904794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:06.905736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:06.906336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.030103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.041356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0138726-fff8-4727-9cf3-ea42d92e400e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.256717 Oct 13 08:38:07.042458 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 669/1360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:07.095377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.104155 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6821976a-7dd6-4cc5-8175-65aa2d377b83 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.212726 Oct 13 08:38:07.104938 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 692/1361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:06 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:07.378995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:07.379909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:07.389168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.389908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.390570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.391606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.392216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.393024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.571738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.582966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.583193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.585016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d51e01c-dd90-40a7-9524-3a8744353cef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.210387 Oct 13 08:38:07.585866 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 670/1362] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:07 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:07.590344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:07.591224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:07.599515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.600232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.600685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.601412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.601961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.602399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.739452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.748744 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b90a0de6-f1d9-4235-9d67-11036ff027a5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.162653 Oct 13 08:38:07.749334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 693/1363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:07 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:07.797384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:07.798030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:07.804607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47889f4f-8857-4e43-b91f-5af7e06e1f81 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53769df280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:07.833928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.834523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.834976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.835717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.837721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.838351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.855497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47889f4f-8857-4e43-b91f-5af7e06e1f81 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.055111 Oct 13 08:38:07.869148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 694/1364] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:07 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:07.916877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:07.921770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:07.948467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.948991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.949584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.950309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:07.950786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:07.951207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:07.967597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.977512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.979520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:07.986214 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b7c56b2-ca90-49d2-8a90-c7893110d418 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.192938 Oct 13 08:38:08.006250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 671/1365] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:07 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:08.069932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:08.071065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:08.081594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:08.082439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.083211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.084248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.086806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.087718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.088729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.094968 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3daff5fb-96ee-4f62-a737-75a5c742d4c5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1289 microversion: 2.1 time: 0.185677 Oct 13 08:38:08.095197 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 695/1366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:07 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1289 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:08.130540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:08.131701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:08.138543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.139072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.139609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.140500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.141108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.141954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.215004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:08.293085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:08.303712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc381832-169e-4104-8a23-df69859bff23 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.241334 Oct 13 08:38:08.304428 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 672/1367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:08 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:08.334458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:08.342859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac7d5b47-d877-47f3-99ca-6d09bcd01d94 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.218492 Oct 13 08:38:08.343627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 696/1368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:08 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:08.611484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:08.613211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:08.620050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.620854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.621523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.622592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.623266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.623994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.779777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:08.780641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:08.790863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:08.793036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.793763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.794460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:08.795395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:08.803185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:08.803625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.069497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.079460 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77769d59-1daa-4f20-956d-5613e60dbfdd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.303428 Oct 13 08:38:09.098964 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 697/1369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:08 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:09.110370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c363526-3316-45a2-9787-19e154121446 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53778393a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:09.132467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.144604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.147347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.149105 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab23f4d7-f0df-4ca1-96a4-e63fdcfcec1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.543562 Oct 13 08:38:09.150305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 673/1370] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:08 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:09.162847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c363526-3316-45a2-9787-19e154121446 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.057669 Oct 13 08:38:09.164825 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 698/1371] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:09 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:09.170169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:09.173988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:09.174704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:09.175290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:09.182508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.182996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.183435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.183751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.184293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.184695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.184822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.185155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.185745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.186744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.187312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.187847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.274672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.275667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.279639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:09.285721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.288184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f76efe4-a178-4dd0-b851-c26d64d6c610 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1289 microversion: 2.1 time: 0.120585 Oct 13 08:38:09.290486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.299508 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 699/1372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:09 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:09.306261 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ad15121-ad51-4af8-8a8c-122617512b81 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.154755 Oct 13 08:38:09.307465 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 674/1373] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:09 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:09.340218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:09.348310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:09.355158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.355774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.356309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.357113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.357783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.358312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.367119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:09.368356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:09.374680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.375375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.375964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.376858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.377467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.378176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.539767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.549848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05957cb4-0b97-4d63-b1b6-2d93532cdfcc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.221124 Oct 13 08:38:09.565828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 700/1374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:09 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:09.565828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967fa910-47ba-4b35-913a-93408711c30e", "name": "network-vif-plugged", "status": "completed", "tag": "5ed99e5a-ac8c-4ece-b303-80872d42e22c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:09.572427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:09.572908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:09.573480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:09.578476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:09.595459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fd28992-8820-44ad-ae65-1a9f741dc635 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.232641 Oct 13 08:38:09.596499 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] Creating event network-vif-plugged:5ed99e5a-ac8c-4ece-b303-80872d42e22c for instance 967fa910-47ba-4b35-913a-93408711c30e on n-h1-858384-11 Oct 13 08:38:09.602830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 675/1375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:09 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:09.605195 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ce745c62-e495-4d4d-a384-61e657a01235 req-29026fe8-83cb-41fe-b134-2b91fcf69cb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047290 Oct 13 08:38:09.606091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 701/1376] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:10.106850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.107851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.114713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.115560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.116072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.116770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.117234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.117657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.176703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.177537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.184424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:10.186508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:10.188357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.189110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.189768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.190823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.191595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.192253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.289389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.298600 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73590827-f2d6-4ae6-94ad-d4574b47de6f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.196856 Oct 13 08:38:10.315481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 702/1377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:10.315481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe92e64b-c681-44a8-a947-5864fafb48dc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53771348b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.358953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe92e64b-c681-44a8-a947-5864fafb48dc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.058353 Oct 13 08:38:10.359782 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 703/1378] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:10.365547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.366379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.373256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.373999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.374179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.374941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.375352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.375771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.384861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.396510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.397986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.399546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d54fa94-7f06-4ffa-a835-41dc68378ecc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.227175 Oct 13 08:38:10.402456 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 676/1379] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:10.407039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.407823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.415367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.416065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.416684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.417561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.418165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.418792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.478841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.487780 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-72b701d8-845d-453a-81dc-87db4dac5ae2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1289 microversion: 2.1 time: 0.126859 Oct 13 08:38:10.488452 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 704/1380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1289 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:10.509325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.517701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.519501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.525594 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fd21eb0-048a-4184-a401-6765784aa038 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.124085 Oct 13 08:38:10.526167 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 677/1381] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:10.574373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.575197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.581854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.582480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.583031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.584439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.584967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.585462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.629252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.630736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.637415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:10.647524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.648101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.648756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.649556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.650083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.650748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.749524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.760618 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4cd5527-16a8-40a1-9c0d-0c591ef4dd06 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.190118 Oct 13 08:38:10.777565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 705/1382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:10.783126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.783737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.791894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.792458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.793044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.794045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.794637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.795256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.824971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:38:10.856123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:10.864359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4bdeed7-8207-4f13-98c3-db88ad1054fc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.238976 Oct 13 08:38:10.873205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 678/1383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:10.919032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8981a807-17cd-46f5-8db8-e3135e2107c7 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 204 len: 0 microversion: 2.1 time: 0.139625 Oct 13 08:38:10.920005 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 706/1384] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:10 2022] DELETE /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:10.929767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:10.931216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:10.939593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.940077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.940548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:10.941250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:10.941702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:10.942153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.179716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.191721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17a061ca-9dc6-4fb3-be23-5657cfa0a5b1 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1711 microversion: 2.1 time: 0.267578 Oct 13 08:38:11.192306 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 679/1385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:10 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1711 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:11.327463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.328846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.336888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.337608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.338230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.339006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.339704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.340130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.377950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fb1ea0d-7cc0-49c3-babe-f518a7486f90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53768eec10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.487069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fb1ea0d-7cc0-49c3-babe-f518a7486f90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.114336 Oct 13 08:38:11.488951 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 680/1386] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:11.496068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.497079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.499852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.507345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.508068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.508711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9afe01b8-f919-46fe-ac11-478b68c2e382 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.187263 Oct 13 08:38:11.508956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.509585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 707/1387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:11.515487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.517300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.517966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.519014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.519637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.533344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.533832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.534275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.535030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.538035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.538436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.607707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.616001 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b28b5e1d-ff9f-4b7b-bc05-379d68b8a6f9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1277 microversion: 2.1 time: 0.105069 Oct 13 08:38:11.630862 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 708/1388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:11.636799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.637412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.643542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.644025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.644457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.645167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.645609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.646589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.706866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.719023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.720753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.722467 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2cb13e97-d49d-41c6-9bfe-d79c812cfcbf tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.231138 Oct 13 08:38:11.731555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.731762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 681/1389] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:11.740743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.742318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e2c187-9fa4-4db0-986b-b99ac19b653b", "name": "network-vif-plugged", "status": "completed", "tag": "ab68af6b-b5f2-448e-907d-790ed2c631d4"}, {"server_uuid": "7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca", "name": "network-vif-plugged", "status": "completed", "tag": "2b02ad32-7aa5-4a2e-803d-aa110cd56d87"}, {"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-unplugged", "status": "completed", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:11.742538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:11.748354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-280695d8-dd72-4b48-9765-8acc641c9714 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.116303 Oct 13 08:38:11.748951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 709/1390] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:11.756861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.757442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.758301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.774712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Creating event network-vif-plugged:ab68af6b-b5f2-448e-907d-790ed2c631d4 for instance 96e2c187-9fa4-4db0-986b-b99ac19b653b on n-h1-858384-11 Oct 13 08:38:11.775345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Creating event network-vif-plugged:2b02ad32-7aa5-4a2e-803d-aa110cd56d87 for instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca on n-h1-858384-11 Oct 13 08:38:11.775922 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] Creating event network-vif-unplugged:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:38:11.786331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.787581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.793901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-66632c0b-0e5a-46e1-86d3-d9bd29e769b5 req-0048a225-08c8-449e-8a10-53c3db1b6d3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.060650 Oct 13 08:38:11.794843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 682/1391] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:11.794961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.795178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.795704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.796528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.796983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.797518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.900407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:11.901134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:11.919766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.919766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.919766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.919766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:11.920296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:11.920296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:11.952305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:12.035311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.044654 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8752185-e06a-40a0-9848-72537f3a7bc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.262157 Oct 13 08:38:12.059823 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 710/1392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:12.124070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.137937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91af953a-2c70-4a1d-b412-e07467e660ea tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.247930 Oct 13 08:38:12.140183 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 683/1393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:11 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:12.216093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.216990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:12.220227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:12.224300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.224711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.225139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.225829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.226274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.226720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.364152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.375371 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a62de00f-5eb0-481e-803c-aa04bcb83535 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1711 microversion: 2.1 time: 0.163270 Oct 13 08:38:12.391085 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 711/1394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1711 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:12.504132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e44736c1-7035-4690-85b7-09ba709ea214 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376d7eee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.532873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.535099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:12.562614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.563299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.563931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.564926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.565567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.566687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.591738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e44736c1-7035-4690-85b7-09ba709ea214 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.091912 Oct 13 08:38:12.592309 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 684/1395] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:12.642990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.643702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:12.651613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.652202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.652703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.653501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.654023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.654540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.718807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.724024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.729036 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6be509bc-6f15-411b-bd28-b544bef43613 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1377 microversion: 2.1 time: 0.199821 Oct 13 08:38:12.730336 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 712/1396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1377 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:12.746725 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ca52427-a5f3-45f0-9d9e-be65f4cc6db1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1277 microversion: 2.1 time: 0.107867 Oct 13 08:38:12.747316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 685/1397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:12.749389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.750223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:12.758199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.759395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.760236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.761297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.761876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.762434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.778263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:12.779929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:12.788390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.789111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.789543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.791031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:12.792156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:12.792943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:12.865403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.878728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.880985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:12.886775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-516b9ef9-00d2-4eac-9e1d-05d8ed856dc7 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.112894 Oct 13 08:38:12.903118 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 686/1398] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:13.072486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.073288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.082379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.083036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.083625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.084612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.085134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.085625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.222556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.235512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.237415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.238661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e2f9afb-8176-4191-bac8-12b98772994f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.493660 Oct 13 08:38:13.241692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 713/1399] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:12 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:13.246771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.248378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.262552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.262935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.263386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.264102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.264557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.264981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.299857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.309235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d4a37f1-3e02-4eb6-909a-e74e74203298 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.243723 Oct 13 08:38:13.310241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 687/1400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:13.404873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.405295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.416352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.418991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.419570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.420388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.422330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.423665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.470635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.479506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-879cf060-1fd0-4258-9994-e28a3b6816f9 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.238344 Oct 13 08:38:13.481792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 714/1401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:13.606730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f35709c-b724-4838-8dd5-a5cfc47c5306 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5377036dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.626481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.635598 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71f9d102-689d-467c-ac5e-44c017571194 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1711 microversion: 2.1 time: 0.238237 Oct 13 08:38:13.636188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 688/1402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1711 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:13.673667 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f35709c-b724-4838-8dd5-a5cfc47c5306 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.070782 Oct 13 08:38:13.682300 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 715/1403] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:13.757590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.758531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.765640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.766567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.767340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.768543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.769170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.769762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.773544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.774563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.785751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.786438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.788019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.789807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.793785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.794595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.879087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:13.891563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-690b571d-6b68-4240-ab30-366619204578 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1277 microversion: 2.1 time: 0.122099 Oct 13 08:38:13.892866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 716/1404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:13.916312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:13.917199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:13.924532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.925319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.927683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.928590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:13.929370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:13.929873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:13.955704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:14.058812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.071014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.073182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.081070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9b1d491-10d5-4506-a27c-86835db0957e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.167489 Oct 13 08:38:14.081823 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 717/1405] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:14.096365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.105267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdf91701-4561-402e-b413-4ee1fb471347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1526 microversion: 2.1 time: 0.352796 Oct 13 08:38:14.118431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 689/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:13 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1526 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.128783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.129395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.135795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.136566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.136876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.137834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.138363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.138892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.267984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.268591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.283087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.284661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.287372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.290359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.292287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.293268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.374593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.384621 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc0b8182-5056-496b-9d38-54fdffa94f7c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1526 microversion: 2.1 time: 0.259570 Oct 13 08:38:14.400181 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 718/1407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1526 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.400181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.400181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.400181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.400624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.401086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.401892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.402475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.405693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.517991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.549413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.569300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.572227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-352a0a50-76de-4022-bdce-db355f5920c6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.309812 Oct 13 08:38:14.574584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.582756 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 690/1408] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:14.584902 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ac3ceec-b3e3-4dd4-b130-e5bfa48f7ab2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.197126 Oct 13 08:38:14.598430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 719/1409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.598430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.598430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.599122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.599608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.600101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.600955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.601416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.601848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.607471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a4f6100-2045-4b2c-9185-1e16bdd0f8b5 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.682818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a4f6100-2045-4b2c-9185-1e16bdd0f8b5 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/df4afcb6-48a7-4f4c-b007-c2dc9d4587a6" status: 202 len: 0 microversion: 2.1 time: 0.098338 Oct 13 08:38:14.686893 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 691/1410] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:14 2022] DELETE /compute/v2.1/flavors/df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:14.700189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.700864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.717486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.717989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.718444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.719170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.719626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.722437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.837844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:14.851717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aace3d06-a76f-4f40-a827-fc29f9988316 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.264741 Oct 13 08:38:14.866432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 720/1411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.866432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d55c368-0228-4f62-95be-24f089f42c25 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376922a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.938544 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d55c368-0228-4f62-95be-24f089f42c25 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.081804 Oct 13 08:38:14.947233 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 721/1412] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.952294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdf767ae-040f-4b20-87db-c919bde7e4cb tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.977831 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdf767ae-040f-4b20-87db-c919bde7e4cb tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.029039 Oct 13 08:38:14.978860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 722/1413] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:14.985210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:14.985210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:14.992461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.993080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.993644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:14.994495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:14.995057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:14.995587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.156608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.174721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4381e5b4-8a3f-4ae0-a585-c7b637dfd3cd tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1711 microversion: 2.1 time: 0.488572 Oct 13 08:38:15.175629 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 692/1414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1711 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:15.180785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:15.191058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:15.203352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.206425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.211280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.211870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.213509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.214808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.216601 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4398a02a-f178-4f9e-a493-ce7e7f35162b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.236403 Oct 13 08:38:15.216760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.218590 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 723/1415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:14 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:15.233650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:15.234263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:15.241593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.242433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.243739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.244704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.245896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.246627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.376334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.388157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.389942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.397290 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f93401b-1c6d-4c9e-b1ca-23f0634a48f4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.177289 Oct 13 08:38:15.398599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 724/1416] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:15 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:15.433120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.440583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Old instance type tempest-test_resize_flavor_-1887189357, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 08:38:15.452898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:38:15.453854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:38:15.455738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:38:15.456238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:38:15.457288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:38:15.595945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8c945c8-ef39-4f48-99ea-a4f2b6e79347 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca/action" status: 202 len: 0 microversion: 2.1 time: 0.419360 Oct 13 08:38:15.601138 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 693/1417] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:15 2022] POST /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:15.605174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:15.605766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:15.612409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:15.614223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:15.620458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.620956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.621389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.622108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.622601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.623031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.623461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.624057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.624599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.625433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.625992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.626579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.871532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:15.883640 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab411bc0-4ea9-4524-8bad-68a11f27c126 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1535 microversion: 2.1 time: 0.282224 Oct 13 08:38:15.884513 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 725/1418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:15 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:15.890640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:15.891616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:15.912364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.912874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.913312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:15.914125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:15.914684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:15.915119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.063731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.072979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.074464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.075649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7205373-5a9f-4c7c-bb68-307354fc3c5f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.470622 Oct 13 08:38:16.079761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 694/1419] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:15 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:16.097239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.100830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:16.125634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.126580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.127466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.128414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.138020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.138867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.140756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.151610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df5ffb7e-0328-4e12-b82a-403d8474b9be tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.266100 Oct 13 08:38:16.152558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 726/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:15 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:16.168667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18b34cb8-783c-4722-922d-59e245db3d6c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53773a8430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.241417 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18b34cb8-783c-4722-922d-59e245db3d6c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.087691 Oct 13 08:38:16.249821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 727/1421] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:16.249821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.249821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:16.255163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.257450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.257450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.257880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.258645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.259213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.350536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.361318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-550759cd-a4e9-4c03-9236-e997bce744fc tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1644 microversion: 2.1 time: 0.117556 Oct 13 08:38:16.376554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 728/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1644 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:16.391278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.392032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:16.401372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.402242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.402928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.403867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.405170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.406877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.608081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.618666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-000a7a8a-2e75-4d12-88c1-7186379cd5eb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.240418 Oct 13 08:38:16.619894 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 729/1423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:16.626012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.626914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:16.635487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.636259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.637266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.638549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.639015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.639617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.695485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.703798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de9be659-134a-4228-b53a-0fee9da8b6ba tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.622754 Oct 13 08:38:16.724598 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 695/1424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:16.748435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.757788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.759190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:16.768917 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-021bfb90-dc95-4d2f-84e3-4c62dd264433 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1560 microversion: 2.91 time: 0.147525 Oct 13 08:38:16.769519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 730/1425] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:16.941470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:16.946069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:16.963986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.964696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.966373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:16.968308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:16.969030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:16.971422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.109145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:17.109763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:17.122608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.123397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.123851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.124587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.128461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.129152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.501211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:17.534016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:17.539530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:17.543422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f1cdd42-44e0-44c1-bb51-bacdd050ac82 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.439164 Oct 13 08:38:17.562074 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 731/1426] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:17 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:17.596094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:17.598321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:17.617424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.618070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.620030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.622033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.622788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.624021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.761224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:17.772788 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b597810-3512-4905-af34-8b171bb6bec3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1535 microversion: 2.1 time: 0.852904 Oct 13 08:38:17.791568 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 696/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:16 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1535 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:17.812067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0", "name": "network-vif-deleted", "tag": "7169b5d1-d049-4c15-ab84-1767da982939"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:17.863029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.867869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.868419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.896838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:17.903868 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] Creating event network-vif-deleted:7169b5d1-d049-4c15-ab84-1767da982939 for instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 on n-h2-858384-11 Oct 13 08:38:17.910031 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ffa4a0f-906b-450f-a6d1-01fe0b5aeb5b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.337058 Oct 13 08:38:17.914742 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 732/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:17 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:17.923275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f454ee9-fa18-41b0-9890-3c9345fd748d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53769d7dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:17.926958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b7ddd1dd-66fb-4dd3-ad81-f9a2ff35c0f8 req-3d03fb7b-1e85-4b66-86b9-77d38fa13aa3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125879 Oct 13 08:38:17.927755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 697/1429] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:17.943353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:17.945858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:17.963086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.963886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.964700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:17.968725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:17.969635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:17.971753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.036068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.036612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.037804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.038884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lazy-loading 'fault' on Instance uuid ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:18.187145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8d17f582a274ea9b07f376fcfdcb19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a695033da9494b63aa3f1b4e6927efd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:18.207460 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a6fb065-3aed-4f6b-b459-67d4bbe1159f tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 200 len: 1353 microversion: 2.1 time: 0.272995 Oct 13 08:38:18.216188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 698/1430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:17 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 1353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:18.226739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:18.227618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:18.242021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.243568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.245700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f454ee9-fa18-41b0-9890-3c9345fd748d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1412 microversion: 2.1 time: 0.326722 Oct 13 08:38:18.247245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.248580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.249350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.249599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 733/1431] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:17 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1412 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:18.250356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.263713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:18.265657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:18.286219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.288258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.289271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.291395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.292486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.295907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.691203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:18.707728 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0b67cde-9527-4df7-860c-d4155fb95e23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.488050 Oct 13 08:38:18.708329 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 699/1432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:18 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:18.740425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:18.741577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:18.749467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.750381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.751152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.753262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.758012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.758357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.814214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:18.824420 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8292cd4c-20d7-4ecd-8292-b8e3b9903de7 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.571650 Oct 13 08:38:18.828372 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 734/1433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:18 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:18.839127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-plugged", "status": "completed", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:18.891364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:18.898426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:18.899152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:18.963714 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] Creating event network-vif-plugged:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:38:18.976623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:18.983090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-472ba04c-8ee3-4610-acb3-162c817ff570 req-9d09712b-e5fd-493d-911d-863ae990970f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147149 Oct 13 08:38:18.983755 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 735/1434] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:19.010541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:19.011318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:19.013093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.015392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.021972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-796fb13e-ae09-4076-9f65-c1ad43e40a57 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.307004 Oct 13 08:38:19.035016 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 700/1435] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:18 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:19.039744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.040527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.044417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.048040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.049324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:19.050576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.051037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.058164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:19.069828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.070579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.071240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.087585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.088516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.098478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.125637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:19.721152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.731871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.737023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.739071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4be6daa0-6030-4c7f-895b-62f7f9ca013f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.754195 Oct 13 08:38:19.761918 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 736/1436] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:18 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:19.767224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:19.773224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:19.787424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:19.789753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.790469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.791087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.792898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.793534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.795104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.797057 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-469e4fce-a3d1-4a65-8a26-3ecbe2786e04 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1535 microversion: 2.1 time: 0.760594 Oct 13 08:38:19.801075 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 701/1437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:19 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1535 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:19.806616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:19.807392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:19.813770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.814387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.814990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.815825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:19.816342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:19.816920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:19.833361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 HTTP/1.1 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:38:19.835313 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:19.836780 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0'} Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:19.837631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:19.839101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:19.843902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:19.845104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a657935-59c0-42d8-96d8-ece99a144de0 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 404 len: 111 microversion: 2.1 time: 0.042422 Oct 13 08:38:19.845934 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 702/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:19 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:19.854780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-480715f3-8fb8-43a9-b85f-a7f56b6e6ec9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53770dca60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:20.151963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:20.168687 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bb13952-2928-4eeb-b9df-2c261fa577e0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.405244 Oct 13 08:38:20.169551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 737/1439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:19 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:20.175758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:20.176591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:20.183899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.184589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.185186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.186256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.186868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.187432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.483666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:20.487256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:20.503725 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4de6cab-1e42-4368-874b-f4d96ac153cd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.332669 Oct 13 08:38:20.504631 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 738/1440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:20 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:20.518176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:20.518855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:20.525249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.525749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.526190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.531348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.531837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.532280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.824030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:20.838837 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eba66019-5765-4555-af43-b905ce81a844 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.331883 Oct 13 08:38:20.839586 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 739/1441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:20 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:20.856655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:20.857774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:20.868383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.869160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.871946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.872886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.873513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.874106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.909977 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 HTTP/1.1 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:38:20.912698 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:20.914301 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bc0da86d-73c7-4b2f-a3f3-7f5096310a01'} Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:20.915100 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:20.916332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:20.918618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:20.919650 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-877152d4-7302-41b0-b6d0-4bebb321f809 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 404 len: 111 microversion: 2.1 time: 0.079072 Oct 13 08:38:20.920419 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 740/1442] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:20 2022] DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:20.927727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e231d1-10c1-4162-a6e3-8e42aaf1166b", "tag": "82e568ee-646c-4b9b-9668-f8ae1e883443"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:20.954393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:20.957103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:20.957746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:20.985455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] Creating event network-changed:82e568ee-646c-4b9b-9668-f8ae1e883443 for instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b on n-h2-858384-11 Oct 13 08:38:20.994770 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-15c53024-8b53-4bd7-b222-c8dd8385fcb3 req-d5da1676-0636-437d-ad68-56c1013a68dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071076 Oct 13 08:38:21.000855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 741/1443] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:21.007467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:21.011127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:21.044826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.047172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.048796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.049601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.051010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.051463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.155266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.169444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.178180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.196731 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f66259ba-8c15-4660-bde7-0dc716fd6d0f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.194269 Oct 13 08:38:21.197546 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 742/1444] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:21 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:21.223650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:21.224274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:21.230300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.230839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.231276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.232458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.232917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.233343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.546865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.568354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.576142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.581469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-352a6a4f-24bf-4824-b2d9-e4e0d32133da tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.369070 Oct 13 08:38:21.583241 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 743/1445] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:21 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:21.601263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:21.601890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:21.622499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.622996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.623435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.624146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.624603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.625031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.934000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:21.965101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-402ef5ce-d55d-4560-885d-9817d2202c83 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.379322 Oct 13 08:38:21.965882 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 744/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:21 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:21.977434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:21.978062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:21.991566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.992073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.992650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:21.993376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:21.993833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:21.994266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.012151 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 HTTP/1.1 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:38:22.015249 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:22.016604 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bc0da86d-73c7-4b2f-a3f3-7f5096310a01'} Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:22.017928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:22.020341 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:22.033262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:22.033262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a986b2e0-aaff-4f95-917a-3ca32f5dd3ce tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 404 len: 111 microversion: 2.1 time: 0.057157 Oct 13 08:38:22.040909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 745/1447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:21 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:22.051017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:22.052599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:22.062391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.063284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.063979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.064937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.065700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.066514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.677753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:22.691560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0dbfdf51-e73b-4958-9079-2283e4b4c6b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.649464 Oct 13 08:38:22.695382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 746/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:22 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:22.712445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:22.713852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:22.727402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.730254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.731000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.736232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.737079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.737806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.946176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:22.962233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6b934ef-cda0-4647-b97b-0672db89e4a8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.265390 Oct 13 08:38:22.963462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 747/1449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:22 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:22.978839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:22.980606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:22.989316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-480715f3-8fb8-43a9-b85f-a7f56b6e6ec9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1421 microversion: 2.1 time: 3.141982 Oct 13 08:38:22.989893 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 703/1450] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:19 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1421 bytes in 3143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:22.990583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.991324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.991944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:22.992828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:22.993435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:22.994113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.000144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-baf58fae-744f-439f-8927-434c10ede114 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '.version_select at 0x7f53767adaf0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.025939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-baf58fae-744f-439f-8927-434c10ede114 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571656106" status: 202 len: 0 microversion: 2.1 time: 0.034777 Oct 13 08:38:23.027543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 704/1451] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571656106 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:23.033872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.035387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:23.043330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.044455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.045246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.060995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.061963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.062615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.144150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.155296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.157005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.163438 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57910e48-83f5-4911-968d-f7e7efeb3cad tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.134614 Oct 13 08:38:23.164255 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 705/1452] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:23 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:23.169356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.170091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:23.176678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.177167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.177611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.178333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.178800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.179228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.237832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.258842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afb27c2b-3fbf-4574-a1e0-0b36d643233f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.293506 Oct 13 08:38:23.260148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 748/1453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:22 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:23.279711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.280903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:23.289350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.291058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.291685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.292602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.293381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.294700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.594781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.603445 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb147f8e-6a21-4251-a0e9-62073d445a9a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.339651 Oct 13 08:38:23.617741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 749/1454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:23 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:23.617741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70801c78-193c-4e26-9bc8-c42b97609fd6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376cfdee0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.668303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.674976 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70801c78-193c-4e26-9bc8-c42b97609fd6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 200 len: 1421 microversion: 2.1 time: 0.069412 Oct 13 08:38:23.679939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.681369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:23.682713 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1d9b3a4-3027-493b-912d-cc3ce5efb6d4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.517047 Oct 13 08:38:23.683430 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 706/1455] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:23 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:23.690053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 750/1456] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:38:23 2022] GET /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:23.695296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5b7b6c2-b1eb-474e-b3ec-47e8d9c6fa1c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53773a89d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.725567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:23.726208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:23.734154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.734703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.735145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:23.736056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:23.737032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:23.737032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.149907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.177842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9868ee0c-ed3b-42cb-9b03-3db8a23debc0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.458246 Oct 13 08:38:24.178391 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 751/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:23 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:24.191762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.193086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.206012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.207015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.207665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.217534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.218430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.219572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.402642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.414855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23348607-93fc-4f41-8169-57c7f7784100 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.233917 Oct 13 08:38:24.415474 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 752/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:24.443856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.444407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.462033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.463293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.463902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.464777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.465424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.466012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.514009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5b7b6c2-b1eb-474e-b3ec-47e8d9c6fa1c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 204 len: 0 microversion: 2.1 time: 0.822258 Oct 13 08:38:24.514860 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 707/1459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:23 2022] DELETE /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:24.523476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9935f6f8-4865-4a23-89f7-1dd1c96e8048 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.573852 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9935f6f8-4865-4a23-89f7-1dd1c96e8048 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/928434669" status: 202 len: 0 microversion: 2.1 time: 0.054031 Oct 13 08:38:24.579078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 708/1460] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:38:24 2022] DELETE /compute/v2.1/flavors/928434669 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:24.586150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.587291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.594353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.594991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.595612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.596584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.597326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.597970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.601025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.610224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.615255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.623149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-827abadb-8185-4de1-9a98-21fcd83fc817 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.189814 Oct 13 08:38:24.624498 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 753/1461] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:24.629773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.630573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.638844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.639551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.640178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.641216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.641826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.642433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.677475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:38:24.820760 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c73213a-6171-4d8a-9f2a-8c8228115546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 204 len: 0 microversion: 2.1 time: 0.194387 Oct 13 08:38:24.823127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 754/1462] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:24 2022] DELETE /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:24.839467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d063eb2a-cff1-4844-8439-6c5c6ae1db82 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.858080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d063eb2a-cff1-4844-8439-6c5c6ae1db82 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.033331 Oct 13 08:38:24.876246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 755/1463] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:24.883942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.884898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.892683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.893345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.893908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.894763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.895565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.896462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.939988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:24.947817 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99976773-def0-4ece-886e-c1562364673e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1478 microversion: 2.1 time: 0.367411 Oct 13 08:38:24.948397 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 709/1464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1478 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:24.954623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:24.954623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:24.972683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.974183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.974901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:24.975794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:24.976399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:24.977070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.115905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:25.125981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9081499-4205-4ac6-a984-60b6ba23bfef tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.247934 Oct 13 08:38:25.143317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 756/1465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:25.149318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f43e9f65-7c63-4be1-95dd-28719ce1f85a tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.163391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:25.172782 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f43e9f65-7c63-4be1-95dd-28719ce1f85a tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1863734187" status: 202 len: 0 microversion: 2.1 time: 0.028027 Oct 13 08:38:25.173925 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 757/1466] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:38:25 2022] DELETE /compute/v2.1/flavors/1863734187 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:25.181237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1234429600", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:25.247174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:38:25.267230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:25.290372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:25.292323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:25.299983 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df3c26e4-d841-482e-ab9e-57683e4b99df tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1813 microversion: 2.25 time: 0.349645 Oct 13 08:38:25.300980 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 710/1467] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:24 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1813 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:25.311357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f19720a6-1d9b-45cf-9105-7c0f37776ef1 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.343644 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f19720a6-1d9b-45cf-9105-7c0f37776ef1 tempest-ServersWithSpecificFlavorTestJSON-420246202 tempest-ServersWithSpecificFlavorTestJSON-420246202-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040804 Oct 13 08:38:25.364762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 711/1468] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:25.382798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.385306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:25.391673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.392157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.392591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.393645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.396147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.396921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.728652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:25.745696 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5f99592-eb80-468b-af41-c774b8b5092d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.378238 Oct 13 08:38:25.746911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 712/1469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:25 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:25.762206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.762928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:25.769162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.771820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.772471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.773344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.774961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.775395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.803610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 HTTP/1.1 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:38:25.805183 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:25.806840 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0'} Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:25.807681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:25.808873 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:25.810557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:25.810557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d41fb07a-75c7-42f3-8bc6-c252ee4bc110 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 404 len: 111 microversion: 2.1 time: 0.058479 Oct 13 08:38:25.810557 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 713/1470] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:25 2022] DELETE /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:25.826066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.826716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:25.834978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.835814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.836406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.837030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:38:25.837717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:38:25.837974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.838201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:38:25.838677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:38:25.838955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.839074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:38:25.839626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.851405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.851899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.852339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.853072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:25.853682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:25.854119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:25.878677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:38:25.883605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:38:25.897237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:38:25.899940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:38:25.978003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2387d5ac-5a54-47a0-8ddd-189d106e0198 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802604 Oct 13 08:38:25.985274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 758/1471] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:38:25.996144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:25.997191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.004694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.005916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.006487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.007612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.008180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.009256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.037477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:26.065505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.077248 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a7da76b3-7d54-48f3-b239-1f2cdb8b27d0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.267376 Oct 13 08:38:26.079983 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 714/1472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:25 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:26.086636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.087728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.095470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.096187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.096800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.097676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.098281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.099652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.116664 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 HTTP/1.1 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:38:26.118638 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:26.120270 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0'} Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:26.121142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. Oct 13 08:38:26.123006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.125297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:26.125597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.126720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6185e6e6-55f6-4534-b81a-cff752aa2396 tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0" status: 404 len: 111 microversion: 2.1 time: 0.045354 Oct 13 08:38:26.127795 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 715/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/ecec2ebb-ac48-4d7e-afb8-226a6ebf96f0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:26.132933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.133803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.138209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.141244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.143350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.144083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.144945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.145893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.146562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.147458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.148567 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d597353a-53bd-4c35-81c5-fefb210e8562 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.163830 Oct 13 08:38:26.149514 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 759/1474] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:25 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:26.155046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65f49835-994d-41f4-bc42-96d1443c9a8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.155860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-65f49835-994d-41f4-bc42-96d1443c9a8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.217584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65f49835-994d-41f4-bc42-96d1443c9a8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.226340 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65f49835-994d-41f4-bc42-96d1443c9a8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1208 microversion: 2.1 time: 0.075728 Oct 13 08:38:26.239882 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 760/1475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:26.250674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.251273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.260425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.260930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.261372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.262745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.263379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.263978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.278903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 HTTP/1.1 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:38:26.292973 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.294480 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bc0da86d-73c7-4b2f-a3f3-7f5096310a01'} Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:26.295331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.303196 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.304559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:26.304559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ce06613-0fdf-4dda-becf-df82f591151a tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 404 len: 111 microversion: 2.1 time: 0.053162 Oct 13 08:38:26.304559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 761/1476] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:26 2022] DELETE /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:26.306317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.307195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.316708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.317494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.318172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.319382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.320063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.320711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.418550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.430189 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e561cbc-b78a-47cc-9ad4-ecaae850dc74 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1463 microversion: 2.1 time: 0.300631 Oct 13 08:38:26.430648 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 716/1477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:26.449165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.454519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] [instance: bc0da86d-73c7-4b2f-a3f3-7f5096310a01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.476051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.479016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.480901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.483421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.484101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.484954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.517115 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] HTTP exception thrown: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Request method failure captured: Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 HTTP/1.1 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR812jMmPcwEQo2_hy7I03kW4jGQU3Da0HGcWxPopgZTSHV3i2AK01U94IRin5LTYQe8Jv8tnP-v2guc9wBtldxoZ9ATwhsHg8Uz-zcsDs0BdBe0jxwjf1LS-DTFF0n4t_m3pH3ufXwUWiQ_6pfDkM1yye1ENFnHluC3IFj2wvdYOv_Q Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:38:26.518703 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a695033da9494b63aa3f1b4e6927efd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a695033da9494b63aa3f1b4e6927efd1 Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755 Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a8d17f582a274ea9b07f376fcfdcb19e Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-572795755-project Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.520133 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'bc0da86d-73c7-4b2f-a3f3-7f5096310a01'} Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:26.521390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. Oct 13 08:38:26.522742 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:26.525612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] Returning 404 to user: Instance bc0da86d-73c7-4b2f-a3f3-7f5096310a01 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:26.526717 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b425cdc9-48ae-4807-8b40-80ea82472afe tempest-ServersWithSpecificFlavorTestJSON-572795755 tempest-ServersWithSpecificFlavorTestJSON-572795755-project] 10.222.0.23 "GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01" status: 404 len: 111 microversion: 2.1 time: 0.094859 Oct 13 08:38:26.527819 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 717/1478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/bc0da86d-73c7-4b2f-a3f3-7f5096310a01 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:26.537758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.539491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.548316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.549291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.550121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.551109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.554678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.555172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.656026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.674172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0765f97c-9559-45e9-af44-fcbef1ca4f28 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.375299 Oct 13 08:38:26.675871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 762/1479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:26.686556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:26.688854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.701756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.702253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.702796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.703415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.703872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.704295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.818976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.831194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.839865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:26.841387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-663d2c62-3d29-4a22-8b32-c9203d3de379 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1803 microversion: 2.25 time: 0.312153 Oct 13 08:38:26.844668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 718/1480] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1803 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:26.853385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.854006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.874173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.874713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.876039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.878950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.879518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.880544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.899721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2c39637-7b5b-4cfe-bcf7-3920e6aaf133 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 0 microversion: 2.1 time: 0.219815 Oct 13 08:38:26.906138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 763/1481] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:26 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:26.917212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ab27822-c233-4af3-843b-a35b8ea768c6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '.version_select at 0x7f5377037670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.923768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab27822-c233-4af3-843b-a35b8ea768c6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.924297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab27822-c233-4af3-843b-a35b8ea768c6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:26.924749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab27822-c233-4af3-843b-a35b8ea768c6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:26.953272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ab27822-c233-4af3-843b-a35b8ea768c6 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 4325 microversion: 2.25 time: 0.045940 Oct 13 08:38:26.955018 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 764/1482] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/os-migrations => generated 4325 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:26.986462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:26.986462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:26.999271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:26.999774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.000215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.006823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.007369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.007824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.094969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.095470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.095914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.096375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lazy-loading 'fault' on Instance uuid ad5fe5f5-2da0-4798-a903-0566d82403a8 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:27.133813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:27.168649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69dbf7c9-1739-4a39-80bf-fae37e2424bd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.322568 Oct 13 08:38:27.173598 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 719/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:27.192490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:27.193534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:27.207390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:27.209789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.212793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.213514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.217276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.217995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.218711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.409427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2171c288-d983-4db2-8c6b-35050a5dd4ab tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1599 microversion: 2.1 time: 0.444190 Oct 13 08:38:27.410445 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 765/1484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:26 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1599 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:27.423397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e231d1-10c1-4162-a6e3-8e42aaf1166b", "name": "network-vif-plugged", "status": "completed", "tag": "82e568ee-646c-4b9b-9668-f8ae1e883443"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:27.443052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.443897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.444489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.465592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] Creating event network-vif-plugged:82e568ee-646c-4b9b-9668-f8ae1e883443 for instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b on n-h2-858384-11 Oct 13 08:38:27.471683 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-66373b60-71c6-48f8-b195-28b6d05dfec6 req-929473d9-76c5-4ec2-a7ed-1d096b3276ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059292 Oct 13 08:38:27.473998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 766/1485] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:27.475657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:27.486065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:27.487031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:27.491449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75825a70-7c7b-42c4-999e-881a9aa8d805 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 2424 microversion: 2.25 time: 0.315484 Oct 13 08:38:27.508887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.509335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 720/1486] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:27 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 2424 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:27.509991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.510877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.512238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.513056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.513701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.514274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:27.522755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:27.569095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.571480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.573664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.574684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.577096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.578065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.738079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:27.752851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:27.755454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:27.766192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ccc6d6e-39a1-4768-b5b3-6684c65a9b0b tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.255489 Oct 13 08:38:27.767233 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 721/1487] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:27 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:27.773547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:27.774520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:27.795379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.797914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.798667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.801218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.803338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.804259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.910021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:27.919988 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83324d24-511c-4e3d-94b3-1928132fef42 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1204 microversion: 2.1 time: 0.151494 Oct 13 08:38:27.920922 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 722/1488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:27 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1204 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:27.926315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:27.931617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:27.939375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.940469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.941119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:27.943129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:27.943852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:27.944503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.079687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:28.092597 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a593dd5a-48eb-448d-9c82-00a613de0db7 tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action" status: 202 len: 0 microversion: 2.1 time: 0.169763 Oct 13 08:38:28.097454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 723/1489] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:27 2022] POST /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:28.102101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:28.102806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:28.113506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.114546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.115000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.115725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.116324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.117042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.190359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:28.200103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77446c8f-1ff5-4fd3-bba1-ca74a42f89ef tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.719767 Oct 13 08:38:28.212152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 767/1490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:27 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:28.212152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:28.212430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:28.229451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.230277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.234968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.235915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.236570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.237192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.336298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:28.350011 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2387debb-877d-4248-8d02-1839052fbf82 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 2424 microversion: 2.25 time: 0.252036 Oct 13 08:38:28.364697 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 724/1491] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:28 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 2424 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:28.378592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:28.379211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:28.390246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.390763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.391194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.393818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.394297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.394748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.672467 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-771228e9-4b97-480e-b514-35ce30cfcb5e tempest-ServersAdminTestJSON-1825039292 tempest-ServersAdminTestJSON-1825039292-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1616 microversion: 2.1 time: 0.304127 Oct 13 08:38:28.694193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:28.700533 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 725/1492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:28 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1616 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:28.715442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:28.719132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:28.720004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e3d2e96-06a0-4bff-927d-8dc783fe88be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.511019 Oct 13 08:38:28.727158 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 768/1493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:28 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:28.732396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:28.736553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:28.748967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.749745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.750919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.753033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.754531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.755069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.755512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.759123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:28.759620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.760061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.770966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:28.771993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:28.921968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lazy-loading 'services' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:29.003394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.045590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5db80af9-5b54-44c3-9808-8b92b35bb0ba tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.339291 Oct 13 08:38:29.045590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 726/1494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:28 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:29.065703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.069739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.081643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.082157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.083005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.084258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.085022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.085626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.127195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:38:29.132505 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e05832e1-0433-4421-8b57-8476e955a004 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments/48fdab05-27c8-4387-bb33-73bea980efd5" status: 202 len: 0 microversion: 2.25 time: 0.403782 Oct 13 08:38:29.141259 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 769/1495] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 13 08:38:28 2022] DELETE /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments/48fdab05-27c8-4387-bb33-73bea980efd5 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:29.147125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.148046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.155033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.155744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.156363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.157275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.157894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.158500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.305861 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bedf1f77-2d5d-419b-b386-efeabc7ce7fa tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 204 len: 0 microversion: 2.1 time: 0.252670 Oct 13 08:38:29.306596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 727/1496] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:29 2022] DELETE /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:29.318835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.319874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.327566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.328202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.328756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.329567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.330596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.331213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.413520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.428800 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0afa1081-e9e8-4db5-b9a3-fe927114cee9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1260 microversion: 2.1 time: 0.120395 Oct 13 08:38:29.442433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 728/1497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1260 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:29.442808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.443269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967fa910-47ba-4b35-913a-93408711c30e", "name": "network-vif-deleted", "tag": "5ed99e5a-ac8c-4ece-b303-80872d42e22c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:29.449038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.449038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.449038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.449557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.458473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.461470 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] Creating event network-vif-deleted:5ed99e5a-ac8c-4ece-b303-80872d42e22c for instance 967fa910-47ba-4b35-913a-93408711c30e on n-h1-858384-11 Oct 13 08:38:29.467156 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2255b391-44ba-4ae1-8651-a323bde16928 req-61f635bf-934b-49b3-bee7-6e60ddb41f5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Oct 13 08:38:29.468752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 729/1498] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:29.475961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.478653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.490838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.491359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4d472c36-bcf1-4106-a303-d20349d19e30 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.329303 Oct 13 08:38:29.491623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.492167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.493004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 770/1499] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:29.493391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.494113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.494965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.506759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.507666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.524768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.532274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.532732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.533473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.537285 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d8a9a4f-dc9e-44dd-b96d-1db233da4cf4 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066656 Oct 13 08:38:29.538204 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 730/1500] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:29.542982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:29.543704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:29.547911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.548369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.550667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.551274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.551860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.552652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.553204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.553728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.882895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.892331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a82b1afb-158c-4615-b19c-fd0385ab8a71 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1470 microversion: 2.1 time: 0.352786 Oct 13 08:38:29.898078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 731/1501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:29.916185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967fa910-47ba-4b35-913a-93408711c30e", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed99e5a-ac8c-4ece-b303-80872d42e22c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:29.929973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:29.935438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:29.936908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:29.943404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:29.952785 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e61f5ebe-a57f-4305-b347-1e761c723550 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.457397 Oct 13 08:38:29.953200 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] Creating event network-vif-unplugged:5ed99e5a-ac8c-4ece-b303-80872d42e22c for instance 967fa910-47ba-4b35-913a-93408711c30e on n-h1-858384-11 Oct 13 08:38:29.957246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 771/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:29.973250 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a9f16ca9-5aea-4fdb-aa44-523ebfe8d55c req-10134ade-3f4f-4001-8e23-b1ecfb08c45a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073390 Oct 13 08:38:29.974492 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 732/1503] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:29.992137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.001434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.011272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.012169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.012838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.013793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.014489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.015132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.073217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.074219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.089097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.098332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.098950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.099711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.100280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.100710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.320752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.332142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8408d0c8-34b4-487b-93a5-0b182fe47205 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.263132 Oct 13 08:38:30.334551 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 733/1504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:30.456978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.459130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.468409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.475687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.476584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.477797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.478515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.480631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.538199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.560557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd9bedcf-038d-4ad2-b64e-a3ffb74f7ed2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.575970 Oct 13 08:38:30.565037 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 772/1505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:29 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:30.575565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.579571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.592067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.592565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.595174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.599555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.600175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.601414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.607362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.619742 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3018f17-0f64-4adf-b49a-04621e6ca34b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1266 microversion: 2.1 time: 0.167131 Oct 13 08:38:30.635091 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 734/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:30.644303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.647422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.654012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.654834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.655553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.656500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.657201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.657828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.691696 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b884e90a-4b34-4a93-9b79-a9f0c48ac5de tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055393 Oct 13 08:38:30.693511 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 735/1507] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:30.766959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.792722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.797429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:30.811282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b940307-3148-48b8-b929-ce61b8498b9d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.244791 Oct 13 08:38:30.812786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 773/1508] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:30.925016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.925544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:30.942573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.943846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.945009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.946101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:30.946729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:30.947548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:30.993360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:30.996070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:31.008729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.010804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.012614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.013723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.015182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.016724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.323990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:31.339057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a4e793a-89c1-4543-bee5-55b4abaa6b3b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1319 microversion: 2.1 time: 0.357665 Oct 13 08:38:31.339669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 774/1509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:31.356863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:31.357552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:31.370831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.371336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.371785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.378445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.379107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.379632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.416150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:31.425336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7feb0d2d-358b-41f8-97ad-9d0075e1571c tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1470 microversion: 2.1 time: 0.504216 Oct 13 08:38:31.442527 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 736/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:30 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1470 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:31.590985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:31.592224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:31.613442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.616147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.617529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.619761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.621344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.623279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.652053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:31.667132 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed87d0a3-ab97-4ba7-bcc2-53da47e09e59 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.312997 Oct 13 08:38:31.688168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 775/1511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:31 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:31.695943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:31.697939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:31.715189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.716071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.716741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:31.718845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:31.719535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:31.720179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.008985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.012277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:32.024758 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f15e4887-62dc-4199-8bc7-701716997542 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.331147 Oct 13 08:38:32.025782 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 776/1512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:31 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:32.038343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:32.041347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:32.063814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.064650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.066733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.068190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.071504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.072073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.154319 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d2266f0-73a1-470b-8ce2-d9b3976d763e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124499 Oct 13 08:38:32.160088 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 777/1513] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:32 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:32.172252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:32.173058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:32.193167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.194418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.196273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.215355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.216150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.217902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.313605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.325654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.328977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.346098 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b6edbd1-07ac-46bf-a2bb-c7598679310f tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.184234 Oct 13 08:38:32.347367 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 778/1514] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:32 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:32.366439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:32.367331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:32.381439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.382058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.382743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.383662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.384190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.384685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.503010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.513237 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29414c85-1051-4a49-ae89-0e0b17cfada5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.926172 Oct 13 08:38:32.513237 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 737/1515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:31 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:32.526518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:32.526760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:32.550016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.550548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.550993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.552168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.552168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.557959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.716446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:32.728956 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2f37ce9-4be4-4989-8f57-f78dfb279f24 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1469 microversion: 2.1 time: 0.366846 Oct 13 08:38:32.733622 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 779/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:32 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:32.750750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:32.751854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:32.766380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.767292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.767950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:32.768897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:32.769589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:32.770810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.164557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.181229 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ec83474-99bd-4cf9-9276-9fa373b183b2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.445515 Oct 13 08:38:33.183379 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 780/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:32 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:33.196378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:33.198329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:33.219068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.220073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.220719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.221724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.222377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.223757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.402390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.426495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1bb31eb0-e6af-4d3a-b850-87a03822937b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1470 microversion: 2.1 time: 0.913019 Oct 13 08:38:33.427581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 738/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:32 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1470 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:33.448953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:33.450922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:33.475179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.476951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.477715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.478859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.479587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.480375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.598657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.606431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4eb513d-f411-49be-9bd8-7bec5b5cfa70 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 200 len: 1469 microversion: 2.1 time: 0.418774 Oct 13 08:38:33.618686 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 781/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:33 2022] GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:33.618686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:33.620669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:33.646734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.647445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.648049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.648949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.649563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.650154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.706386 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73fcc19c-0ce0-4dc2-8c57-090d873fc50d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091628 Oct 13 08:38:33.712290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 782/1520] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:33 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:33.718176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:33.719636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:33.726225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.727075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.727743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.728711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.734851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.735682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.869928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.884975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.886799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:33.896493 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f80719f6-8aa7-45ed-b36d-df8886322867 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.182044 Oct 13 08:38:33.903771 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 783/1521] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:33 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:33.908730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93157e5-04e7-4922-9b38-81e0aa31372b", "tag": "d8b032df-6ee5-4303-b419-04dff11a0421"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:33.927743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.929080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.931425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.951314 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] Creating event network-changed:d8b032df-6ee5-4303-b419-04dff11a0421 for instance d93157e5-04e7-4922-9b38-81e0aa31372b on n-h1-858384-11 Oct 13 08:38:33.962856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d3b995b8-a300-4b40-9d95-0faba9c2873a req-e8470e58-3e30-4220-acde-3bfb7829a906 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057565 Oct 13 08:38:33.965293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 784/1522] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:33.970646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:33.977731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:33.988630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.989900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.990550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:33.991477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:33.992149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:33.993728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.269804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:34.302680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:34.313656 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f684849-a5b7-42b2-a5d4-ee5f3a77b36d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.884258 Oct 13 08:38:34.315671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:34.319977 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 739/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:33 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:34.342600 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db630a28-350b-428d-9830-7f6f2262c2e1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.375874 Oct 13 08:38:34.343499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 785/1524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:33 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:34.352589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:34.353205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:34.359068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:34.369459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.369459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.370151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.370909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.371363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.371791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.375843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:34.382213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Searching by: {'reservation_id': 'r-v9bapngw', 'deleted': False, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:38:34.394203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.401553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.402330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.403382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.404012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.404723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.659964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:38:34.771652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:34.780926 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b7ce7fe-5931-48c2-a5d7-1aed94f3d966 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.436701 Oct 13 08:38:34.791203 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 786/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:34 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:34.800112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:34.814511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:34.845779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.846297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.846773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.855431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.857980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.858453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:34.923116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:34.959878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:34.961842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:34.962507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.050637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.059197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.060405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.063582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lazy-loading 'fault' on Instance uuid b1d5adb7-6c94-4cb8-9f59-964155385c9a {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:35.319155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a828edec-8700-4dc7-b63c-96d71c5edbc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-v9bapngw" status: 200 len: 2931 microversion: 2.1 time: 0.997113 Oct 13 08:38:35.320692 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 740/1526] 10.222.0.23 () {58 vars in 1197 bytes} [Thu Oct 13 08:38:34 2022] GET /compute/v2.1/servers/detail?reservation_id=r-v9bapngw => generated 2931 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:35.327354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d5adb7-6c94-4cb8-9f59-964155385c9a", "name": "network-vif-deleted", "tag": "f1569de7-562e-436f-9aa8-09e3c11cca9b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:35.348962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.351010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.354751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.387002 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] Creating event network-vif-deleted:f1569de7-562e-436f-9aa8-09e3c11cca9b for instance b1d5adb7-6c94-4cb8-9f59-964155385c9a on n-h2-858384-11 Oct 13 08:38:35.394639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-14d7d7d4-795a-4508-af83-a6c5371b8d56 req-edfd342c-87e6-44d1-8db3-b2a8bc57a8ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072425 Oct 13 08:38:35.401684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 741/1527] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:35.413329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.427692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:35.439019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.439601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.440044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.440785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.443573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.444307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.500617 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c8e9648-8180-457c-b90b-632fab2c88d2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097522 Oct 13 08:38:35.501882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 742/1528] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:35.508960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.510212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:35.520655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.522051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.523089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.524448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.525168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.525668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.630720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:35.644772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:35.646306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:35.657408 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d41f209-3fa7-423b-b4de-4b083009ddea tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.153606 Oct 13 08:38:35.670861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 743/1529] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:35.684433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.685235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:35.697035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.697795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.698418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.699313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.699923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.700588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.776542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:35.784986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d7f1903-73b7-45af-8224-9be925c17d9e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 200 len: 1304 microversion: 2.1 time: 0.992461 Oct 13 08:38:35.799317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 787/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:34 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 1304 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:35.814536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.865330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_groups [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Querying cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) for 2 instances {{(pid=127030) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 13 08:38:35.871769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.874316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.876825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.886836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:35.897022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54ba7765-2175-4aa0-aa42-40b276e771b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.223305 Oct 13 08:38:35.898146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 744/1531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:35.904509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.906158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:35.919804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:35.947340 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94f26084-47f0-4eab-bd19-6f079ab91eda tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/91b07ecc-4a74-4159-9fe9-d5a96f4c6c8b" status: 200 len: 270 microversion: 2.1 time: 0.146638 Oct 13 08:38:35.960639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 788/1532] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/os-server-groups/91b07ecc-4a74-4159-9fe9-d5a96f4c6c8b => generated 270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:35.967131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:35.968100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:35.978977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.979818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.980577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.981624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.982293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.982948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.992134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.992956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.993598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:35.994670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:35.995340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:35.998278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.222978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:36.375469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:36.390805 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-779fd8a4-5f36-4e13-956d-6339c2165c97 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.484363 Oct 13 08:38:36.391627 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 745/1533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:36.424943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.425574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:36.468299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.471702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.472158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.474058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.474058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.474366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.552931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:36.563304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9fd5ff9-5cdf-406c-b992-27eca8e04cd0 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.600989 Oct 13 08:38:36.587989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 789/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:35 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:36.595641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.597881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:36.618954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.619460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.619891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.620650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.621102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.621522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.700937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74ca8418-752d-4186-8083-51f91deb8d51 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1622 microversion: 2.1 time: 0.287937 Oct 13 08:38:36.703603 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 746/1535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1622 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:36.712296 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0273e5e-d763-4468-99ec-80eedc42975d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122856 Oct 13 08:38:36.714269 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 790/1536] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:36.716751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.717596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:36.725245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.725963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.726588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.727513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.728148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.728726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.734143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.735010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:36.742105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:36.747675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.749853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.750588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.752414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.753292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.755576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.877887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:36.888522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:36.890985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:36.898162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-adf86d82-e76d-4c01-80b6-d94807986025 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.192800 Oct 13 08:38:36.899363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 747/1537] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:36.921377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.922890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: b1d5adb7-6c94-4cb8-9f59-964155385c9a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:36.935967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.937092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.937901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.939349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:36.940117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:36.940894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:36.962789 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] HTTP exception thrown: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Request method failure captured: Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a HTTP/1.1 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83ixSJJey0N1AACDM0zkNdz0Z605TWl7jn5y5ZSWGoYLUS9jMaCALXxy33B426T2S7jzdjm7zqzR00tP-JRVtbKrBApLArMiIhC2AcogffXMqDENKGuobPv7OKS6oMnwWRm0zS7y6JaHkhQ9Ec1CBnm8-IVy5vD7Rt2DAbHnDWGWcQ Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:38:36.965240 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415617a067b44660b1e29f33c12110e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e1765243aa04484fb46f41db48beac54 Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. Oct 13 08:38:36.967040 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b1d5adb7-6c94-4cb8-9f59-964155385c9a'} Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:36.968019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. Oct 13 08:38:36.969729 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:38:36.972923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Returning 404 to user: Instance b1d5adb7-6c94-4cb8-9f59-964155385c9a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:36.974359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf550ed1-1fd8-45ca-a7a8-5fa1082a701d tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a" status: 404 len: 111 microversion: 2.1 time: 0.073258 Oct 13 08:38:36.978670 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 748/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/b1d5adb7-6c94-4cb8-9f59-964155385c9a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:36.985251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:36.986116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:37.003463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.006935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.007788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.008686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.009309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.014096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.096196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02c51b09-b4d0-4b23-9342-e7c1f33afe75 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 200 len: 1622 microversion: 2.1 time: 0.365865 Oct 13 08:38:37.112364 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 791/1539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 1622 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:37.117813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:37.123347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:37.136354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.137075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.137679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.143243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.144106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.144758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.201636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:38:37.314293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:37.402229 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49b8f5cd-f7ee-4ccf-bd42-d69cad4aca84 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 204 len: 0 microversion: 2.1 time: 0.286252 Oct 13 08:38:37.404702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 792/1540] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:37 2022] DELETE /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:37.414665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1165403045", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "cb726935-3fe0-4a8d-b3c7-0d230b45e5ac"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:37.472647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:38:37.491760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:37.507449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3295c967-568f-4bc0-a216-7312acc8fede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.527467 Oct 13 08:38:37.509606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 749/1541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:36 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:37.513396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:37.514012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:37.530501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.531010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.531440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.532155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.532611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.533041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.768748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:38:37.770692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:38:37.771247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:38:37.771840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:38:37.772655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:38:37.787738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.787899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:37.788761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.789665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.790694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.791345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.791955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.796496 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75b99463-137c-44e0-b91e-922896993a12 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1470 microversion: 2.1 time: 0.287461 Oct 13 08:38:37.797694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 750/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:37 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:37.809706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:37.812998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:37.825976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:38:37.829266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.829763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.830482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.831193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.833454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.834985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.841172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:38:37.870392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:38:37.872869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:38:37.937936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29b0401e-a4e0-4131-9666-135c12515783 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530479 Oct 13 08:38:37.945429 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 793/1543] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:38:37.951830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:37.952669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:37.961605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.962343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.963753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:37.964805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:37.965642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:37.966677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.131260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.131703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.139873 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9a0c95d-9799-456b-bdc6-c48dd3ab186c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.340938 Oct 13 08:38:38.140718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38c7a415-060a-4666-996c-a2d25c42a706 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.193846 Oct 13 08:38:38.141294 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 794/1544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:37 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:38.142670 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 751/1545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:37 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:38.154441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:38.155052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:38.166261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:38.171652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.171909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:38.172151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.172586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.173292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.173740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.174159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.191018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.191437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.191935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.199122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.199647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.200090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.241246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0e6a43f-fd7e-4eec-9356-036898df4e80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098595 Oct 13 08:38:38.242142 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 795/1546] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:38 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:38.247246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2c4dad6-5fda-4405-bafc-cb1e657429fb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:38.248081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2c4dad6-5fda-4405-bafc-cb1e657429fb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:38.286828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.296187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.298020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.305607 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d655c26e-3ba5-4ca2-8699-fcfcd1c8dddd tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.161836 Oct 13 08:38:38.318500 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 752/1547] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:38 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:38.333730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f2c4dad6-5fda-4405-bafc-cb1e657429fb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.341401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2c4dad6-5fda-4405-bafc-cb1e657429fb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1217 microversion: 2.1 time: 0.097862 Oct 13 08:38:38.342442 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 796/1548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:38 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:38.531101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:38.532389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:38.539276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.540030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.540691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.541652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.542325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.543017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.805938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:38.820436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:38.821315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:38.827137 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c828faee-032f-484a-aebb-5bba4d1f847a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.299794 Oct 13 08:38:38.831207 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 753/1549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:38 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:38.839451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.847218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.848527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:38.849863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:38.850519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:38.851110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.027835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.036527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba2ce3e4-e19f-4a72-b81c-97be7034e797 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1470 microversion: 2.1 time: 0.220381 Oct 13 08:38:39.052362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 797/1550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:38 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:39.164248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.165176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.172004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.172778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.173057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.173678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.174067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.174977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.175601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.176233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.190324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.190838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.191266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.192514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.192970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.193395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.370239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.394327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7610c038-7479-4eed-a1fc-6723e5216a91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.224949 Oct 13 08:38:39.397904 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 798/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:39.404615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.408495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.428511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.429021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.429465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.430184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.430715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.431144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.490926 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-886de7ca-e0af-47a7-b8e3-8e70e9f22af6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091435 Oct 13 08:38:39.503168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 799/1552] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:38:39.508622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.510047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.520655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.521057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.521503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.523098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.523565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.523991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.606086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.616102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.617636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.630593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7269ff95-6a01-4686-ae70-b19773334900 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1555 microversion: 2.91 time: 0.129695 Oct 13 08:38:39.638812 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 800/1553] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:39.652377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.653077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.661432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.662612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.663135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.664424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.664888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.667193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.729665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.739443 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47aa1364-5628-4462-92ab-47a5ff2c3798 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.579165 Oct 13 08:38:39.744605 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 754/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:39.762728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93157e5-04e7-4922-9b38-81e0aa31372b", "name": "network-vif-plugged", "status": "completed", "tag": "d8b032df-6ee5-4303-b419-04dff11a0421"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:39.778590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:39.790372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.791239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.791679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.792245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d06f628d-41b3-483d-8f29-14f56bb24160 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1269 microversion: 2.1 time: 0.152179 Oct 13 08:38:39.793030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 801/1555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:39.817545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] Creating event network-vif-plugged:d8b032df-6ee5-4303-b419-04dff11a0421 for instance d93157e5-04e7-4922-9b38-81e0aa31372b on n-h1-858384-11 Oct 13 08:38:39.825414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-837a6cf1-0f9d-4280-9a5f-d2f7604348f5 req-b4f40a60-85af-4641-968e-57ed8da91d21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079124 Oct 13 08:38:39.826094 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 755/1556] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:39.866362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:39.867182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:39.877045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.878898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.879996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:39.880828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:39.881397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:39.882195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.060912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:40.061959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:40.070992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.071500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.071943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.072665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.073126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.073555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.256806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:40.267366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6611bf9c-5be9-4bfa-99e9-31a79ab33546 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1308 microversion: 2.1 time: 0.416411 Oct 13 08:38:40.271169 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 802/1557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:39 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:40.423897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:40.424515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:40.439506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.440548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.441270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.443179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.445687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.446382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.626899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:40.641789 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7d577bb3-208a-41bf-a298-bc1676546c59 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1470 microversion: 2.1 time: 0.585000 Oct 13 08:38:40.644249 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 756/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:40 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1470 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:40.655383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:40.658449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:40.693342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.695658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.699161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.700859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.705013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.706786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.793738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:40.813883 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c682f537-5f58-4788-a03f-fbbaed6feeef tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.166236 Oct 13 08:38:40.814384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 757/1559] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:38:40 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:40.830086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:40.834321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:40.850075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.852410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.852966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:40.855565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:40.856514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:40.859779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.102238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.114881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.131939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.136444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.143367 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5dbfa6f-051b-47a1-b2b4-64292d4ffe2a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.723885 Oct 13 08:38:41.153839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9017f54c-5371-4691-810e-157a03faf9f5 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.331939 Oct 13 08:38:41.154982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 758/1560] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:40 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:41.156062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 803/1561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:40 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:41.162045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:41.162983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:41.171519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:41.172446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:41.178315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.179181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.179790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.187478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.188176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.189804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.190749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.193060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.193973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.194723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.196230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.206564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.350727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.359682 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a0b32c7-0ae8-4996-a7ab-a7147d529e09 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1269 microversion: 2.1 time: 0.202395 Oct 13 08:38:41.364475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 804/1562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:41 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:41.375096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f27e3ec-05b3-4a22-af1d-4e78cf511500", "name": "network-vif-deleted", "tag": "74e59cb1-3537-4e2b-a7a5-0511d5710d36"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:41.404773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.406330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.406953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.433351 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] Creating event network-vif-deleted:74e59cb1-3537-4e2b-a7a5-0511d5710d36 for instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 on n-h2-858384-11 Oct 13 08:38:41.450362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b4fafc00-5242-4e68-a1f1-f39192afeb6a req-4f4257b6-6a99-424c-b7cf-12b560cc2cc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080462 Oct 13 08:38:41.451003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 805/1563] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:41.467212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.478062 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7752c3f0-ad78-44b7-8243-b35e2774a851 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.321802 Oct 13 08:38:41.487326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:41.487326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:41.487571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 759/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:41 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:41.513195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.513700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.514143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.518335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.518892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.519339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.669099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:41.669895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:41.681042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.681554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.682001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.682759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.683220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.683640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.784428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.794264 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4689d56-26c7-426c-9b92-9ef5210a327b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1489 microversion: 2.1 time: 0.342061 Oct 13 08:38:41.816399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 806/1565] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:41 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1489 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:41.826333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:41.833918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:41.834751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:41.835382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:41.859645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:41.871480 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9e8c1db-de21-4a63-88fb-c0fb9d49b84e tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1428 microversion: 2.1 time: 0.206197 Oct 13 08:38:41.887472 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 760/1566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:41 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1428 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:41.930188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:38:41.982850 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a0316ad5-7e13-4cc1-94ee-42e0b46a2141 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b/action" status: 202 len: 0 microversion: 2.1 time: 0.159236 Oct 13 08:38:41.983871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 807/1567] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:38:41 2022] POST /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:38:42.007693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.013808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.032130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:42.035507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.040841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.042386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.047217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.047755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.048193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.176251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.178054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.196359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.207256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.209579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.210723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.211989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.212721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.303282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.312547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fe309d5-98c2-499b-b880-dcae19cf5933 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.322189 Oct 13 08:38:42.318476 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 761/1568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:41 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:42.323336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.328351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.369566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.370092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.370679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.374129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.374912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.376152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.454128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.485560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56899fd5-3001-4d10-ab30-39ff6f221d5a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.318552 Oct 13 08:38:42.487603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 808/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:42 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:42.500396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.501230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.509084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.509842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.510507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.511408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.512020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.512607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.514251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.536707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.543755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.556772 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f425d38c-ad2a-4107-a5c8-3eaf68a0e21a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1537 microversion: 2.91 time: 0.234689 Oct 13 08:38:42.557376 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 762/1570] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:42 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:42.592615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.593077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.600617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.601675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.601919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.602434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.603051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.603472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.627518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:42.636158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a5c9430-68ae-4960-a917-8bf5d925205d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1269 microversion: 2.1 time: 0.145800 Oct 13 08:38:42.636742 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 809/1571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:42 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:42.894717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:42.895601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:42.917108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.930748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.932212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:42.933200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:42.936240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:42.936943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.002803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.022601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d2be102-81b5-4bde-af73-66aaa58a4701 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.448663 Oct 13 08:38:43.034871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:43.050691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 763/1572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:42 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:43.142655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.155442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1ad868d-c22f-4fa6-b58b-a70a6ba75376 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1299 microversion: 2.1 time: 0.264282 Oct 13 08:38:43.166440 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 810/1573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:42 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:43.347176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:43.347802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:43.372542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.373034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.373477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.374190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.374668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.375099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.511007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:43.511619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:43.519189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.520496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.521123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.523656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.524350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.524782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.706901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.730007 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06a8ba40-c155-48d9-b6b7-5e359c898bee tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.222919 Oct 13 08:38:43.732011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 811/1574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:43 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:43.736843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:43.737610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:43.746400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.747242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.747915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.752438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.753178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.753615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.773332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.782212 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa369107-5900-4234-8756-e01b1341f7ae tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.441823 Oct 13 08:38:43.795543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 764/1575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:43 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:43.806924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:43.807991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:43.815271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.815992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.817702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.818680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.819288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.819914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.881866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.894294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.899695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:43.915064 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-72d84528-1a61-44d2-a07b-8dcd748100e1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1540 microversion: 2.91 time: 0.181651 Oct 13 08:38:43.930433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 812/1576] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:43 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1540 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:43.944096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:43.946889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:43.961877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.962380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.966890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:43.967643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:43.968112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:43.968545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.019439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858384-11". {{(pid=127030) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 08:38:44.081483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.093203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fc47095-dc3e-45a5-8dcf-b3a927d01ec2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1275 microversion: 2.1 time: 0.295567 Oct 13 08:38:44.095175 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 765/1577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:43 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:44.103719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:44.104512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:44.123067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.123558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.123992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.124697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.125143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.125709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.149368 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47e9ffee-c785-405c-ad59-1eb5397aee6b tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action" status: 202 len: 0 microversion: 2.91 time: 0.209951 Oct 13 08:38:44.153854 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 813/1578] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:38:43 2022] POST /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:38:44.159016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:44.159640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:44.167028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.167514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.168193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.168905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.169355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.169779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.297389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.333867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.344119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.363190 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb4f25b6-5bb0-40a3-ad40-560055b7a290 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1548 microversion: 2.91 time: 0.208166 Oct 13 08:38:44.363824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 814/1579] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:44 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:44.382873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:44.386072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:44.401969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.403095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.403727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.418892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.419550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.420265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.505460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.518226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d1cb25d-327f-4cc2-ac22-6e5247a21555 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.418140 Oct 13 08:38:44.529398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.532638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.533901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.534900 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 766/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:44 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:44.537966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lazy-loading 'fault' on Instance uuid 8f27e3ec-05b3-4a22-af1d-4e78cf511500 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:44.654731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:44.665330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f1a8ac6-b373-46f7-94d3-97e5d2db37a6 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 200 len: 1304 microversion: 2.1 time: 0.296687 Oct 13 08:38:44.679657 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 815/1581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:44 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 1304 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:44.754915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:44.767511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:44.770951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:44.784525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.786508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.787189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.788595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.790885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.792528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.811690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:44.812303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:44.825538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.826041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.830170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.834134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:44.834691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:44.835132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:44.911451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:45.067505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:45.079927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4fc4b85d-51bf-4888-bf04-a4f54d57ce19 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.327735 Oct 13 08:38:45.081375 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 767/1582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:44 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:45.123827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:45.125447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:45.139825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.151374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.153181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:45.154812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.159439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.167440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:45.296758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:45.306468 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f58bd60d-48c3-40ca-8734-5493af1208c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.499348 Oct 13 08:38:45.310465 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 816/1583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:44 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:45.398778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:45.399480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:45.415098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.417019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.418719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:45.420478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.424061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.424769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:45.673815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:45.701522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:45.703804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:45.721808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d67e3b6-605e-4520-b9e7-e823547bcf87 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.330564 Oct 13 08:38:45.727737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 817/1584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:45 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:38:45.736110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:45.738617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:45.747307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.748046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.748853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:45.749762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:45.750379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:45.750985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.060002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:46.072452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19d0e1b4-a485-49b2-81d6-c74eeba3b0ce tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.343207 Oct 13 08:38:46.073940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 818/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:45 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:46.079898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.080873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: 8f27e3ec-05b3-4a22-af1d-4e78cf511500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.092723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.093609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.094359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.099375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.112038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.117307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.130611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:46.139563 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29a6dae3-2358-4d0b-bf43-27bc8cd5360b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 1.025866 Oct 13 08:38:46.158592 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 768/1586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:45 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:46.170098 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] HTTP exception thrown: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Request method failure captured: Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 HTTP/1.1 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83ixSJJey0N1AACDM0zkNdz0Z605TWl7jn5y5ZSWGoYLUS9jMaCALXxy33B426T2S7jzdjm7zqzR00tP-JRVtbKrBApLArMiIhC2AcogffXMqDENKGuobPv7OKS6oMnwWRm0zS7y6JaHkhQ9Ec1CBnm8-IVy5vD7Rt2DAbHnDWGWcQ Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:38:46.177004 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415617a067b44660b1e29f33c12110e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e1765243aa04484fb46f41db48beac54 Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. Oct 13 08:38:46.178789 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8f27e3ec-05b3-4a22-af1d-4e78cf511500'} Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:46.179707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. Oct 13 08:38:46.181190 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:46.182669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.182669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.193695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Returning 404 to user: Instance 8f27e3ec-05b3-4a22-af1d-4e78cf511500 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:46.195559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d62515ed-d424-4d91-8640-0a284580e198 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500" status: 404 len: 111 microversion: 2.1 time: 0.119627 Oct 13 08:38:46.197006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.198125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 819/1587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:46 2022] GET /compute/v2.1/servers/8f27e3ec-05b3-4a22-af1d-4e78cf511500 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:46.202611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.203115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.206370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.207939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.208745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.213014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.220097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.231995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.248031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.249615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.251115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.252303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.253421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.305881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:38:46.488779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:46.511808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9dc93b73-2661-45ab-b34c-1e11b7b33e1b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 204 len: 0 microversion: 2.1 time: 0.308831 Oct 13 08:38:46.516038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 820/1588] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:38:46 2022] DELETE /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:38:46.528271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.529052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.555718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.556208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.559508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.562108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.562814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.563396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.641344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:46.653808 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-089bef41-6784-4982-84b5-852fcbe48d82 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.493880 Oct 13 08:38:46.654395 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 769/1589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:46 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:46.669955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.676973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.698214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.701534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.702134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.703308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.704054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.704741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.850548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:46.865612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f161e385-5608-4f2a-ace6-f5a4513a30cf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.348363 Oct 13 08:38:46.867096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 821/1590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:46 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:46.872614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:46.873740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:46.882085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.882790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.883402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:46.884367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:46.885139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:46.885730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.006582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.020164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.030649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.038003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.040797 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ee7a4c7-2058-4cd5-b440-2b5c3faf5cbf tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1469 microversion: 2.1 time: 0.372515 Oct 13 08:38:47.056016 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 770/1591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:46 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:47.062121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4394c2d3-f741-4eaa-b1dd-782354adb5b1 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.189393 Oct 13 08:38:47.062835 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 822/1592] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:46 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:47.101508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:47.102121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:47.113771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.114304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.114722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.115434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.115891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.116316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.164802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:47.171414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:47.194019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.194545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.194980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.200657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.201144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.201582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.444770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.455699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.456897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-522bd1e0-f00e-4ccf-842b-82d4057705ed tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.359197 Oct 13 08:38:47.464511 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 771/1593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:47 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:47.471014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d25a6d2-a6b9-4caf-8370-8f066297fc23 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.303933 Oct 13 08:38:47.476600 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 823/1594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:47 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:47.570758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd01630-b038-41bb-a84c-179de465ec18", "tag": "2ac65194-62c6-432b-9379-43a28688197e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:47.597564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.598855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.599299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.617157 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] Creating event network-changed:2ac65194-62c6-432b-9379-43a28688197e for instance fcd01630-b038-41bb-a84c-179de465ec18 on n-h2-858384-11 Oct 13 08:38:47.631840 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0ef048e8-ec77-428c-a6bf-7bbab5695a52 req-d5bc6b26-c2f4-4ede-b1de-a38caead2b76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064934 Oct 13 08:38:47.632284 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 772/1595] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:47.682606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:47.684578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:47.696256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.696938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.697890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.698879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.699754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.700198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.729887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:47.803515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:47.894697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:47.895760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:47.908079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.909085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.909590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.911164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:47.912060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:47.912900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:47.916280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:47.944152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-be556fd0-ee46-4561-8c32-e5aa1874bbe5 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.266162 Oct 13 08:38:47.944741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 824/1596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:47 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:48.068971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:48.069777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:48.080145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.081071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.081811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.082834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.083456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.084221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.125703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.135737 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a04c9914-6616-480e-a5a4-c8ae56eefab0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.250032 Oct 13 08:38:48.136633 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 773/1597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:47 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:48.150727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:48.151391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:48.175185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.175704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.176760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.181448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.182114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.182653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.293242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.309632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.313467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.338490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:48.348383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.354819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f91a7910-c33a-4113-96af-635069a26301 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.200651 Oct 13 08:38:48.357038 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 774/1598] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:48 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:48.382694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c43d375d-f8be-445b-90de-2aa52c483a01 tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1469 microversion: 2.1 time: 0.319556 Oct 13 08:38:48.390233 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 825/1599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:48 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:48.518548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:48.519193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:48.524033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:48.524789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:48.530975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.532294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.533426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.536066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.536848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.537702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.546217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.546770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.547217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.547973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:48.548462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:48.552977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:48.565206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:48.853332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:48.887287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c86bd79a-d238-4012-9601-6ad04e75f57c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.372888 Oct 13 08:38:48.890856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 826/1600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:48 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:48.992539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.000989 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf654772-a4c7-40a7-b99e-31943e5b992c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.491050 Oct 13 08:38:49.006820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 775/1601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:48 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:49.038756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.041889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:49.065409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.066207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.067395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.068308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.068933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.069528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.302873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53766550d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.304692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.305184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.305631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.349090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.349602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.354798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.372018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.372773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.373367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.386379 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ccf0e87-8567-41a2-90fd-36d0d1177cf0 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.492851 Oct 13 08:38:49.387308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 827/1602] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:49.393106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.393962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:49.401253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.402119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.402824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.404172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.404854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.405899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.647121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.661145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba82fb31-b89d-4067-8714-b19b70262783 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.271590 Oct 13 08:38:49.662778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 828/1603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:49.669186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.670245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:49.688629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.689126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.689570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.690292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.696388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.699171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.784532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.825647 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00dd3e89-9c5b-4ea0-9b60-7d805692ad38 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.799827 Oct 13 08:38:49.828095 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 776/1604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:49.842379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f5376b60940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.846836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.849026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.850842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.891725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.918710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.928593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:49.929240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.930765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.932317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.950762 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7ab4d13-7cf7-47d4-ae17-dc204ede8605 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.283947 Oct 13 08:38:49.952798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 829/1605] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:49.976070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:49.978694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:49.979426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:49.980138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:49.980580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:49.988077 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e5ab85e-fea0-4b45-97e9-a64c3cf1d880 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1510 microversion: 2.1 time: 0.156695 Oct 13 08:38:49.988944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 777/1606] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:49.993289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.005869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.009962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.010779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.013416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.013874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.046710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.048975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:50.056447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.057780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.058596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.059751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.061531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.062253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.179000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:50.187910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4607cac9-7334-4f07-919f-513a71c2cc7f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1427 microversion: 2.1 time: 0.232702 Oct 13 08:38:50.198621 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 830/1607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1427 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:50.208395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53765e3ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.213680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.216385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.217039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.254504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.258117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.258301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.291963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.292522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.293227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.319700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b045603f-3a54-4008-a3ae-5db850f2965a tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.127781 Oct 13 08:38:50.320418 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 831/1608] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.324814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.326673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:50.339776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.340281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.340715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.341429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.341880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.342373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.549083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:50.558198 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-81a9e043-ab3f-4827-9b61-37166275a62e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.236838 Oct 13 08:38:50.559483 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 832/1609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:50.571196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53765d3040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.573583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.575678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.576592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.606294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.607082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.607745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.618040 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-544742b8-d4f9-4759-ac58-7f03047ae329 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.057301 Oct 13 08:38:50.619068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 833/1610] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.623774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5fe5f5-2da0-4798-a903-0566d82403a8", "name": "network-vif-deleted", "tag": "b7fb8f3e-661e-4cde-8fae-04792608d2e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:50.638239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.638842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.639343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.639493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:50.651319 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] Creating event network-vif-deleted:b7fb8f3e-661e-4cde-8fae-04792608d2e2 for instance ad5fe5f5-2da0-4798-a903-0566d82403a8 on n-h2-858384-11 Oct 13 08:38:50.655082 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-26813f3b-fda1-464c-b302-aafc6d6c20b8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.632850 Oct 13 08:38:50.659871 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-529f9cab-ca65-45fd-a54f-13ecd09c46c9 req-af3ac14f-1ff0-436b-a21d-73236dfb16ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036133 Oct 13 08:38:50.660824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 834/1611] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.665826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b399a811-36a3-47e1-9d5a-545c4a8418c5 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f5376671e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.667648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b399a811-36a3-47e1-9d5a-545c4a8418c5 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.668190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b399a811-36a3-47e1-9d5a-545c4a8418c5 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.668689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b399a811-36a3-47e1-9d5a-545c4a8418c5 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.670581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 778/1612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:49 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:50.687486 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b399a811-36a3-47e1-9d5a-545c4a8418c5 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.025360 Oct 13 08:38:50.688114 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 835/1613] 10.222.0.23 () {58 vars in 1179 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.688537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.689147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:50.697915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.698805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.699352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.700100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.700619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.701218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.705047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53765e3670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.707349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.707846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.708472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.725302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.725796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.726359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.740126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.740617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.741058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.748387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b87282ce-8007-499a-a3e3-0dee17eb0f73 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.050308 Oct 13 08:38:50.755792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 836/1614] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.763640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53765729d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.778054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.794584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.795301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.812946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.813693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.815156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.824804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bda90c8c-2f48-454c-86a5-23b8d4affb89 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.067335 Oct 13 08:38:50.838886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 837/1615] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.846631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f53765d3310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.850080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.850826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.851447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.868456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.869519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.870122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.878145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64e5ce76-a363-43bd-b6ce-c63ba983d407 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 762 microversion: 2.1 time: 0.037544 Oct 13 08:38:50.888997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 838/1616] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/os-hypervisors/2 => generated 762 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:50.902235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:50.903010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:50.919061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.919550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.921525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.922162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:50.922647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:50.923091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:50.997953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.010879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3041f1fa-3f80-420b-9c86-f927a761cf28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.327010 Oct 13 08:38:51.021621 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 779/1617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:51.021621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Calling method '.version_select at 0x7f5376c8a8b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:51.022632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.024164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.024819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.089672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.090166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.090643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.114720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.115200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.119239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.181738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.200321 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfb207f0-eda2-40e5-91f6-4c0eea65339e tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.304961 Oct 13 08:38:51.201510 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 839/1618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:50 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:51.206851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:51.208592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:51.215334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.217283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.217999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.219028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.219707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.220384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.308704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.321069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.323422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.331050 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfe38f42-216c-4629-932e-68d10591281e tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.127687 Oct 13 08:38:51.332695 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 840/1619] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:51 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:51.351038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:51.351950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:51.366524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.369267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.370433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.371187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.371798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.372232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.458898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.470571 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7a81d88-5495-47e2-abca-6427dcede44b tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1427 microversion: 2.1 time: 0.136531 Oct 13 08:38:51.473921 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 841/1620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:51 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:51.585139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:51.585766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:51.592200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.592701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.593152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.593856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.594308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.594765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.786019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.795314 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a5fa715-a833-4a88-a18c-0eac454d0bda tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.214781 Oct 13 08:38:51.798454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 842/1621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:51 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:51.801567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:51.802249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:51.808540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.809105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.809615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.810386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:51.810973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:51.811471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:51.828873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:51.987490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:51.995952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5df24af4-c363-44be-83a5-00cf71579487 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.198675 Oct 13 08:38:51.996714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 843/1622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:51 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:52.044185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:52.045070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:52.061421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.061913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.062352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.063089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.063545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.064209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.247573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.256110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0fd1e118-4506-49c3-8101-6d3a719ec178 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.217460 Oct 13 08:38:52.256691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 844/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:52 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:52.273021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:52.273641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:52.281617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.282107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.282577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.283284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.283726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.284145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.446615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.455061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0c212d7-b042-431b-a885-2e29d7951c14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.197368 Oct 13 08:38:52.456127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 845/1624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:52 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:52.461876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:52.463269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:52.474361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.477594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.479393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.480207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.480702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.481188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.578500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.585682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.587169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.599716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03c25c9b-4eb7-46f5-a42d-99916114a214 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.142773 Oct 13 08:38:52.600620 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 846/1625] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:52 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:52.611088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:52.611709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:52.618517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.619109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.619675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.620500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.621026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.621462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.710321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:52.720392 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd6468ee-e7ec-4645-8c98-9714a275dacb tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1427 microversion: 2.1 time: 0.111140 Oct 13 08:38:52.721402 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 847/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:52 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:52.819982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:52.820728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:52.827519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.828103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.828668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.829411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:52.829937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:52.830719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:52.998303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.014471 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50a91bd2-5636-4bab-a4c6-8cc80b217cc3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.197750 Oct 13 08:38:53.018476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 848/1627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:52 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:53.020912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:53.021524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:53.048668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.049241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.049806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.053098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.053578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.054007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.231962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.241713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25aa2f58-3582-434e-985e-ae56b8d7a419 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.224683 Oct 13 08:38:53.242606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 849/1628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:53 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:53.283859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:53.284904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:53.292207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.292697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.293130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.293833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.294800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.295114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.508695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.519286 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f55a3d3e-7853-404b-9365-4eda896f8544 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.239413 Oct 13 08:38:53.520739 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 850/1629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:53 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:53.527683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:53.528306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:53.534983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.536037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.536462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.537467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.537936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.538367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.752327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.764138 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-391dfbd3-360c-4929-beb2-4a5c55ad1fc6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.242184 Oct 13 08:38:53.765705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 851/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:53 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:53.771981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:53.772834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:53.779809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.780590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.781500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.782388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.783038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.783611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.872937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.885392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.886886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:53.897193 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09557975-af55-4a62-b08d-f04d467ea3cc tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.126378 Oct 13 08:38:53.898396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 852/1631] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:53 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:53.905611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:53.906495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:53.914276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.914809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.915263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.916012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.916733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.917155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.980942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:53.981693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:53.982276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:53.982963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lazy-loading 'fault' on Instance uuid ad5fe5f5-2da0-4798-a903-0566d82403a8 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:54.051378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:54.062861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0c06e3e-f339-46d5-87fc-5b7aada00b3f tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1304 microversion: 2.1 time: 0.163305 Oct 13 08:38:54.064110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 853/1632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:53 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:54.068809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:54.069496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:54.087777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.088458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.088972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.089908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.090521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.091024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.289399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:54.315635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-271e9c4d-2e78-473e-979e-fda58d59386a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.245044 Oct 13 08:38:54.315635 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 854/1633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:54 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:54.317868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:54.317868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:54.323950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.324278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.326143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.326903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.327406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.328403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.584879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:54.605285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e13f236-d501-444f-82a4-95e6a4db0995 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.292642 Oct 13 08:38:54.606650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 855/1634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:54 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:54.624226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:54.625715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:54.646705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.658887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.659461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.660266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.660726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.661423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.861876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:54.871528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7131da7e-f525-48ff-8150-12fa0cb3978a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.250879 Oct 13 08:38:54.872210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 856/1635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:54 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:54.876884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:54.877537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:54.884647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.885170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.885612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:54.886307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:54.886797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:54.887202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.091143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.109835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e3f7ed8-c228-4a65-99f9-752ac0e37a63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.236523 Oct 13 08:38:55.118585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 857/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:54 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:55.124315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:55.125442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:55.132696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.133622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.149269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.151704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.155020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.155735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.265587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.279878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.281320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.287995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7b8d457-ab48-478c-9179-e23e530ca360 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.167537 Oct 13 08:38:55.299679 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 858/1637] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:55 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:55.304843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:55.306760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:55.321292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.322593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.323497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.327242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.327920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.328635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.368871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.369853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.370613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.371362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lazy-loading 'fault' on Instance uuid ad5fe5f5-2da0-4798-a903-0566d82403a8 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:38:55.377093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:55.452326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1765243aa04484fb46f41db48beac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415617a067b44660b1e29f33c12110e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.465095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83768975-a9fe-4a41-9479-26790d5808dc tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 200 len: 1304 microversion: 2.1 time: 0.164289 Oct 13 08:38:55.465934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 859/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:55 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:55.471276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:55.472188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:55.478423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:38:55.480771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.481537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.482197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.483279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.483956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.484712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.762179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:55.785530 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f552d871-87f0-4340-9b95-cea6c7426717 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.317997 Oct 13 08:38:55.802569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 860/1639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:55 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:55.807776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:55.819218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:55.827272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.828318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.830255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:55.831586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:55.843023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:55.843598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.040586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.053568 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25ef1c01-779d-4bd5-b907-bffcb1d04ef3 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.249183 Oct 13 08:38:56.067079 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 861/1640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:55 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:56.076935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:56.085115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:56.097038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.098390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.098883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.099607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.100065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.100489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.331506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.343415 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16837ac5-a442-4959-9140-aea2706b91ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.274486 Oct 13 08:38:56.345277 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 862/1641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:56 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:56.357846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "name": "network-vif-unplugged", "status": "completed", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:56.372926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.373545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.374079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.399466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] Creating event network-vif-unplugged:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h1-858384-11 Oct 13 08:38:56.415075 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-835eab1d-e16e-4fd2-8f85-3b4310c51ad2 req-d85a893d-5eb1-46de-acaa-e4080e9e5acb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068194 Oct 13 08:38:56.415833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 863/1642] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:56.436218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:56.439253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:56.452658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.453115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.453568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.454295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.454728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.455163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.708722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.723473 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84cb520a-2091-477b-8eb4-4f18a11867e1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.303317 Oct 13 08:38:56.739516 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 864/1643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:56 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:56.746530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:56.747151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:56.754349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.754872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.755313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.756036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.756495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.756935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.857986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.870029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.871490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:56.876864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fc22be9-7f4e-4ad4-b2f8-c1fe7c2d1eb4 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.135869 Oct 13 08:38:56.902043 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 865/1644] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:56 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:56.907472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:56.908212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] [instance: ad5fe5f5-2da0-4798-a903-0566d82403a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:56.914372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.914888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.915319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.916018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.916462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.916878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.930763 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] HTTP exception thrown: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Request method failure captured: Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 HTTP/1.1 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83ixSJJey0N1AACDM0zkNdz0Z605TWl7jn5y5ZSWGoYLUS9jMaCALXxy33B426T2S7jzdjm7zqzR00tP-JRVtbKrBApLArMiIhC2AcogffXMqDENKGuobPv7OKS6oMnwWRm0zS7y6JaHkhQ9Ec1CBnm8-IVy5vD7Rt2DAbHnDWGWcQ Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:38:56.932427 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415617a067b44660b1e29f33c12110e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415617a067b44660b1e29f33c12110e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 415617a067b44660b1e29f33c12110e9 Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminTestJSON-1930737308 Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e1765243aa04484fb46f41db48beac54 Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminTestJSON-1930737308-project Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. Oct 13 08:38:56.933915 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ad5fe5f5-2da0-4798-a903-0566d82403a8'} Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:38:56.934758 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. Oct 13 08:38:56.936085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:38:56.937283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] Returning 404 to user: Instance ad5fe5f5-2da0-4798-a903-0566d82403a8 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:38:56.937283 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15a9be46-8a25-4a80-b335-6ea7f7bb30db tempest-ServersAdminTestJSON-1930737308 tempest-ServersAdminTestJSON-1930737308-project] 10.222.0.23 "GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8" status: 404 len: 111 microversion: 2.1 time: 0.030693 Oct 13 08:38:56.937283 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 866/1645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:56 2022] GET /compute/v2.1/servers/ad5fe5f5-2da0-4798-a903-0566d82403a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:38:56.940919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:56.940919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:56.946138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.946763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.947206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:56.948011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:56.948514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:56.948940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.127742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:57.138760 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f45519ce-581b-49c3-9e70-4458b0e9faa7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.202681 Oct 13 08:38:57.139701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 867/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:56 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:57.144268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd01630-b038-41bb-a84c-179de465ec18", "name": "network-vif-plugged", "status": "completed", "tag": "2ac65194-62c6-432b-9379-43a28688197e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:57.154945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.155515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.156103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.169410 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] Creating event network-vif-plugged:2ac65194-62c6-432b-9379-43a28688197e for instance fcd01630-b038-41bb-a84c-179de465ec18 on n-h2-858384-11 Oct 13 08:38:57.174517 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-be5ae2b0-8d88-4a98-b5b5-d0eb9155a876 req-5b4890e1-8a99-49c1-a939-5ecc60b6c16b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033991 Oct 13 08:38:57.176583 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 868/1647] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:57.181521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:57.182330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:57.189416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.190020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.190704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.191290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.191662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.192084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.329735 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eac5f7af-8636-4813-a2a0-8e6943b975b9 tempest-HypervisorAdminTestJSON-920049228 tempest-HypervisorAdminTestJSON-920049228-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 6.315431 Oct 13 08:38:57.331410 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 780/1648] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:38:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 6318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:57.375087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:57.376138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:57.389575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.390455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.391609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.392684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.393953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.395378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.781657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:57.790936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfbb0d2e-6e8d-4587-b5ae-7647299fce9e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.613730 Oct 13 08:38:57.798855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 869/1649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:57 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:57.805917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:57.809563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:57.817402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.817891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.818332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:57.819170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:57.819802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:57.820231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.037939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.049591 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d02aad0-1a3e-4fbd-bada-72a3e85d0e14 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.248883 Oct 13 08:38:58.052135 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 870/1650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:57 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:58.058084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:58.058890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:58.067927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.068773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.069300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.070595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.071616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.072125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.113219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.128329 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99d61acc-596b-44b3-9c96-c78c47380aa1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.761671 Oct 13 08:38:58.131736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 781/1651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:57 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:58.163921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:58.164802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:58.174624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.177460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.179916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.181610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.183124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.185333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.203526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.215768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.217830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.231165 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22c26003-794b-4e67-8b3f-8be1615d7e7c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.177460 Oct 13 08:38:58.232707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 871/1652] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:58 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:58.384664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:58.394681 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb9e0be9-6fa9-4f83-a932-650c2db47617 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.236017 Oct 13 08:38:58.407569 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 782/1653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:58 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:58.433674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:38:58.444703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.445192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.445652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.460971 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] Creating event network-changed:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h1-858384-11 Oct 13 08:38:58.466548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-45e99bba-4865-439d-96b5-0b8980a1fc4a req-56bd25aa-5da5-491a-90a2-068a26d31a86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036485 Oct 13 08:38:58.467382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 872/1654] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:38:58.814643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:58.815504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:58.822929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.823505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.824247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:58.825423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:58.826138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:58.826824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.073702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.075697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:59.077659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:59.089169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.089755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.090131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e0dbab6b-afa8-4abd-9d29-c6facf90baa1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1317 microversion: 2.1 time: 0.274459 Oct 13 08:38:59.090673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.091090 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 783/1655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:58 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:59.091566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.092587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.093103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.158030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:59.159059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:59.174339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.177511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.178981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.181102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.182756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.184186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.405958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.416254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e06ad02-a336-4448-82eb-8281282864fd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.345631 Oct 13 08:38:59.434694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 873/1656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:59 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:38:59.454959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:59.455827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:59.475035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.475556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.476014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.476725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.484343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.486586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.581520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.597157 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e9371fb-c4f0-4031-9526-ea09e0d1426c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.445688 Oct 13 08:38:59.612205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 784/1657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:59 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:38:59.615863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.623655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:38:59.625054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:38:59.631905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.632651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.633336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.634443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:38:59.635122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:38:59.635800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:38:59.640077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.642750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.659719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-641bd35c-ce37-4998-bc7f-f0e0243ba5db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.219328 Oct 13 08:38:59.660456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 874/1658] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:38:59 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:38:59.874598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:38:59.886135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e722651-1d18-4865-acb3-4a21d6547ca0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1540 microversion: 2.1 time: 0.272237 Oct 13 08:38:59.886762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 785/1659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:38:59 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1540 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:00.119294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:00.119938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:00.127135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.127972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.128896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.129801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.130441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.131040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.295834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:00.308186 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb739ae7-91b4-4ae4-9a7c-00d8067cf3c0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1466 microversion: 2.1 time: 0.192593 Oct 13 08:39:00.316797 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 875/1660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:00 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:00.332534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:00.333425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:00.340651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.341138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.341564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.342573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.343251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.343626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.443144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:00.443860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:00.461504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.465759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.469942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.470959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.476570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.477394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.521396 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-678d01ba-ca09-4296-9adf-9e7aceacf7c1 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1619 microversion: 2.1 time: 0.193743 Oct 13 08:39:00.521974 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 786/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:00 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1619 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:00.625699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:00.627057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:00.634938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.639028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.645550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:00.646584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:00.647336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:00.647915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:01.133565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.149114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5640f985-111a-4b81-812a-b965d461dfa8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.525195 Oct 13 08:39:01.152054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 787/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:00 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:39:01.162782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:01.163775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:01.194007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:01.194815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:01.195619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:01.196874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:01.197575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:01.198275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:01.345423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.358842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.364588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.374901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8f60302-0f75-4263-8954-319216f6f528 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.221400 Oct 13 08:39:01.378201 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 788/1663] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:01 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:01.394986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-715028565", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["cb726935-3fe0-4a8d-b3c7-0d230b45e5ac"]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:01.487807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:01.509052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.522667 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f090e4b-f080-42b7-9129-e13ada9a337d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 1.085169 Oct 13 08:39:01.523842 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 876/1664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:00 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:01.528874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:01.529748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:01.537187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:01.538018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:01.539316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:01.540336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:01.541025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:01.541674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:01.820932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:01.831004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1b01100-d8d4-4ebd-bdfa-29a50ca0ed2d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1539 microversion: 2.1 time: 0.305424 Oct 13 08:39:01.833519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 877/1665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:01 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1539 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:02.077744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-022c688d-0c31-4f8a-a2a2-2bc308b6f65f tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f53765134c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.153039 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-022c688d-0c31-4f8a-a2a2-2bc308b6f65f tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9" status: 200 len: 371 microversion: 2.1 time: 0.216693 Oct 13 08:39:02.154095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 878/1666] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:39:01 2022] GET /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:02.167485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Action: 'update', calling method: .version_select at 0x7f53764f7b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:02.226381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:02.226910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:02.228207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:02.228663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:02.229219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:02.247597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.249080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.249952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.250901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.251054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.251645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.251771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.252096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.252497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.252883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.253711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.254774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.283213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:02.290836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:02.307821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:02.311865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:02.335854 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-98ffadc7-d6a3-47e3-92d3-a88e090c7b32 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9" status: 200 len: 328 microversion: 2.1 time: 0.173014 Oct 13 08:39:02.336518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 879/1667] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:02 2022] PUT /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9 => generated 328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:39:02.350342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.358245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:02.372177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.372669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.373111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.373819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.375757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3890a80e-c0e7-4062-a078-18904b358da7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996109 Oct 13 08:39:02.378477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 789/1668] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:02.384733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5735b1ff-f37b-46a4-bec9-53008aa68be0 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.385103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.385576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.409166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:02.413638 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5735b1ff-f37b-46a4-bec9-53008aa68be0 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9" status: 202 len: 0 microversion: 2.1 time: 0.033569 Oct 13 08:39:02.416813 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 790/1669] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:39:02 2022] DELETE /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:39:02.427260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51591f4b-de54-482c-92e9-edcb473616ee tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.427767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51591f4b-de54-482c-92e9-edcb473616ee tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:02.508443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51591f4b-de54-482c-92e9-edcb473616ee tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:02.521721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51591f4b-de54-482c-92e9-edcb473616ee tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1216 microversion: 2.1 time: 0.103435 Oct 13 08:39:02.523729 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 791/1670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:02.530164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.531771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:02.538049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.538845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.539589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.540534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.542112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.542806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.692299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:02.710145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:02.712535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:02.728084 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38cc0704-d58f-4091-931a-65c5e8b97585 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.201932 Oct 13 08:39:02.729804 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 792/1671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:02.742280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f82f1410-3040-48c2-967b-4a0b4566333c tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f537ab03700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.865288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:02.879493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f82f1410-3040-48c2-967b-4a0b4566333c tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9" status: 200 len: 371 microversion: 2.1 time: 0.147727 Oct 13 08:39:02.895918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5ffe2f5-0f92-46c5-96cb-799a1bcd52e3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.549865 Oct 13 08:39:02.918606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 793/1672] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/os-quota-sets/22792ba893d941a787aa8bfcb370b1e9 => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:02.918606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.928051 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 880/1673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:02.938316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:02.939436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:02.945741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:02.972828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.974314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.975299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.975540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.977734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.978788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.979833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.980908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:02.982901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.985244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:02.985975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:02.986607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.396905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:03.412565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4dc228e1-e59e-49e7-80f6-5e04ad623625 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1539 microversion: 2.1 time: 0.491815 Oct 13 08:39:03.426469 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 881/1674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1539 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:03.426469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21f9fc90-9a7b-4449-903a-9f46b59acb3c tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f53764ddaf0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:03.520156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:03.531071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6408033d-d2df-4a12-baf5-c3a9a0758916 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.617969 Oct 13 08:39:03.531664 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 794/1675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:02 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:03.553645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:03.554750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:03.610815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:03.634499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:03.635215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:03.635834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.637282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:03.638668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:03.639276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.671864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:03.828122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:03.864726 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21f9fc90-9a7b-4449-903a-9f46b59acb3c tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67/defaults" status: 200 len: 371 microversion: 2.1 time: 0.449683 Oct 13 08:39:03.865421 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 882/1676] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:39:03 2022] GET /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67/defaults => generated 371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:03.869119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67b0b593-2ebe-4b83-a83c-e14aeb4d0ee1 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1220 microversion: 2.1 time: 0.307246 Oct 13 08:39:03.887836 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 795/1677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:03 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1220 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:03.900612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:03.901242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:03.904072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca", "name": "network-vif-unplugged", "status": "completed", "tag": "2b02ad32-7aa5-4a2e-803d-aa110cd56d87"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:03.915201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:03.915684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:03.916120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.921528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:03.922068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:03.922534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.928267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:03.929162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:03.929599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:03.962077 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Creating event network-vif-unplugged:2b02ad32-7aa5-4a2e-803d-aa110cd56d87 for instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca on n-h1-858384-11 Oct 13 08:39:03.979088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:39:03.992180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-55e42467-b109-4d3e-ac9b-148e9003762e req-edbbb8bc-a23e-4a56-8d3c-43016dea4ab4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101130 Oct 13 08:39:03.994351 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 796/1678] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:04.005307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:04.006919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:04.027071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.027572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.028015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.029628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.030112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.030583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.113676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:04.126003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:04.131814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:04.157387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85f30315-f762-4f85-82f0-24b99867c94d tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1546 microversion: 2.91 time: 0.290181 Oct 13 08:39:04.160622 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 883/1679] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:03 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1546 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:04.361339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Action: 'update', calling method: .version_select at 0x7f5376521040>, body: {"quota_set": {"ram": "5120"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:04.561240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:04.572479 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cde213e3-107a-4a93-adad-dde55aaa9774 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.576599 Oct 13 08:39:04.572996 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 797/1680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:03 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:04.581357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.582144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.582831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.583885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.584048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:04.584518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.584647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:04.585125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.602346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.603191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.612770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.614445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.616844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.617469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.680110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03e052a9-1da9-4b77-96b2-af044c1c453a tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f" status: 200 len: 328 microversion: 2.1 time: 0.321647 Oct 13 08:39:04.681895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 884/1681] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:04 2022] PUT /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f => generated 328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:04.688299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:04.689548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:04.698068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.698771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.699163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.700289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:04.700994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:04.701755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:04.893305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:04.911663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8246b526-85e0-4a1c-813b-e654e3657a7c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.228454 Oct 13 08:39:04.912634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 885/1682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:04 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:04.918101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f5377037670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.024001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.025538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.026142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.027367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.028350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.029204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.060489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87ce93db-20fb-423c-a6a6-8774907c488b tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f/detail" status: 200 len: 916 microversion: 2.1 time: 0.145388 Oct 13 08:39:05.061722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 886/1683] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:39:04 2022] GET /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f/detail => generated 916 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:05.099656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.100676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.115044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.117585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.118753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.125645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.127169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.127822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.128537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.130713 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fb239732-8af7-4922-9695-372305fad520 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1471 microversion: 2.1 time: 0.551242 Oct 13 08:39:05.131344 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 798/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:04 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:05.187482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.187912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.197766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.198263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.198730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.199436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.199884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.200306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.288789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.301657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-483d967d-7e7e-4ca3-9d82-55b2d54e89ec tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1268 microversion: 2.1 time: 0.224378 Oct 13 08:39:05.302973 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 887/1685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:05.366336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Action: 'update', calling method: .version_select at 0x7f53765724c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:05.474497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.475077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.475662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.476549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.477242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.477924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.480885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.494314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.496024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.508007 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1898006-75de-48db-b094-3895f693421a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1533 microversion: 2.91 time: 0.324829 Oct 13 08:39:05.509447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:05.525337 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 799/1686] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1533 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:39:05.549680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.550196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.551028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.551951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.553576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.554583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.556335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.557048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.564706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.568365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.569135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.570836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.582986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.583845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.646233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4a7de7c-d251-4f53-99b4-439c7d546824 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f?user_id=4ec623aaeb384b809d825f95b2054d77" status: 200 len: 328 microversion: 2.1 time: 0.284844 Oct 13 08:39:05.646955 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 888/1687] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 08:39:05 2022] PUT /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f?user_id=4ec623aaeb384b809d825f95b2054d77 => generated 328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:05.658442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.659538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.667124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.668126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.669052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.670165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.671091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.671734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.752424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] Lazy-loading 'services' on Instance uuid acb0950b-f7ff-4624-801b-9e24968e4760 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:39:05.795056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-44141390-1d2f-4bd5-855c-621bbff7ccca tempest-UnshelveToHostMultiNodesTest-971707128 tempest-UnshelveToHostMultiNodesTest-971707128-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1940 microversion: 2.91 time: 0.242024 Oct 13 08:39:05.795959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 800/1688] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1940 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:05.828863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fe97307-1af5-47be-93ba-1e8edb942d8d tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f537663adc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.855722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:05.873501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6fe52e0-a4c6-4eab-8d68-318013c27661 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.220199 Oct 13 08:39:05.874705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 889/1689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:05.879689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.880399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.895502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.896124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.896662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.897474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.898342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.899571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.932924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:39:05.948850 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fe97307-1af5-47be-93ba-1e8edb942d8d tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f?user_id=4ec623aaeb384b809d825f95b2054d77" status: 200 len: 370 microversion: 2.1 time: 0.151498 Oct 13 08:39:05.949691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 801/1690] 10.222.0.23 () {58 vars in 1323 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/os-quota-sets/21c59b13c4224985b11cc6e0f961423f?user_id=4ec623aaeb384b809d825f95b2054d77 => generated 370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:05.954996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:05.956189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:05.977596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.979779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.980725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:05.983381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:05.984476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:05.985494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.085481 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96e699e7-d72d-4062-9aa4-0ebec28c323c tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 204 len: 0 microversion: 2.91 time: 0.209031 Oct 13 08:39:06.092056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 890/1691] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:39:05 2022] DELETE /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:39:06.100524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:06.101312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:06.109080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.109568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.110069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.110868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.111322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.111745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.218886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.231505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.232482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.238193 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b00bcba6-6be7-495f-b102-0fb7a85426db tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.144481 Oct 13 08:39:06.258159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 891/1692] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:06 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:06.258159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:06.258159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:06.258159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.258159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.258928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.258928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.258928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.258928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.542065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.552819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.560195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c62c2342-1a9f-400d-a117-02bf512893d4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.608957 Oct 13 08:39:06.560836 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 802/1693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:05 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:06.565869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:06.574101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:06.587721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af54fe53-2216-43d4-adb0-77bceb559e49 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1468 microversion: 2.1 time: 0.345390 Oct 13 08:39:06.588566 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 892/1694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:06 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:06.594475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.594990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.595442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.596164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.596637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.597046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.610675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56f88f18-d13b-4d9f-8916-96610072a1f5 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Calling method '.version_select at 0x7f5376513040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:06.887087 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56f88f18-d13b-4d9f-8916-96610072a1f5 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67/defaults" status: 200 len: 371 microversion: 2.1 time: 0.282618 Oct 13 08:39:06.895547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 893/1695] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:39:06 2022] GET /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67/defaults => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:06.901042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:06.901650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:06.908598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.909094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.909533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.911034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:06.911503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:06.911932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:06.953475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:06.969740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-219486b4-06e1-4ab3-b521-fef786a8fdbb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1274 microversion: 2.1 time: 0.407544 Oct 13 08:39:06.975404 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 803/1696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:06 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:06.990341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Action: 'update', calling method: .version_select at 0x7f537663aa60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:07.017290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.018099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.018923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.021677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.022324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.026028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.078506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:07.092373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:07.165605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.166021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.174028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.176033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.178244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.179283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.353083 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d82027c4-75ae-433f-a402-c27df1320bcb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca/action" status: 202 len: 0 microversion: 2.1 time: 0.455637 Oct 13 08:39:07.354194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 894/1697] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:39:06 2022] POST /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:39:07.368457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:07.369280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:07.391041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.397999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.399555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.402957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.403583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.404739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.639930 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bf34064-fafe-4fc5-b77a-e137aaebfd81 tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67" status: 200 len: 329 microversion: 2.1 time: 0.663348 Oct 13 08:39:07.653360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 804/1698] 10.222.0.23 () {60 vars in 1263 bytes} [Thu Oct 13 08:39:06 2022] PUT /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67 => generated 329 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:07.658618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:07.665569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:07.674533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.680516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.681448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.682382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.683801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.685416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.877095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:07.896201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:07.897555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97e7be5f5c4c475bbeb5f5574017608b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a19941eca624bb5b3640528e7aa6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:07.904107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d965952b-219b-47e7-9c28-9cbe90165f69 tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 200 len: 1539 microversion: 2.91 time: 0.249366 Oct 13 08:39:07.907746 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 805/1699] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:07 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 1539 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:07.929066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:07.929709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:07.951057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.952576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.954855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:07.956035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:07.956739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:07.957005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:08.178896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:08.182604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:08.201416 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e16b642-6d48-4147-8249-ea8aec8413c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.842975 Oct 13 08:39:08.213997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 895/1700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:07 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:08.247786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:08.248806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:08.274723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:08.275328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:08.275859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:08.276673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:08.277286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:08.277724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:08.536313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:08.574396 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-090d30ae-b892-405c-be6a-3d860b662fb2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1467 microversion: 2.1 time: 0.663634 Oct 13 08:39:08.595445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 806/1701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:07 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1467 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:08.610004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Action: 'update', calling method: .version_select at 0x7f537aac0c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:08.799141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:08.820313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f039f075-1e87-413f-92ab-da2155554885 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.604918 Oct 13 08:39:08.839650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 896/1702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:08 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:08.852835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:08.862084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:08.883327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:08.887144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:08.895319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:08.901852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:08.902794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:08.903486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.111034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.111577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.111957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.112793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.121605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.122068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.449693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=19,nova_api:UPDATE=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:09.602726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:09.610958 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69ce13db-0ade-4bd0-9c56-ecde17de7bc8 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.769724 Oct 13 08:39:09.611544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 897/1703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:08 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:09.658255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:09.661975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] [instance: acb0950b-f7ff-4624-801b-9e24968e4760] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:09.689692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.690322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.690791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.691556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.692015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.692439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.747890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] HTTP exception thrown: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Request method failure captured: Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 HTTP/1.1 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83hzYqDymKi4ii4XmT2RyYdsTo1lK1khIxvteljMZL7b6yurI1DEnU4d28Qfv5f06WRd7jnaOKy0upa8Ss-unAmvtCYU7VwSrHX51XrYkHXBMI41ovK7y0ZCkriqi27KOzYkn2ABIqpKqcraOOFOoLxom27wIeBhJoRI3_mWRbOkbs Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.91 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 6a19941eca624bb5b3640528e7aa6615 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1210525890 Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:39:09.758362 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6a19941eca624bb5b3640528e7aa6615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6a19941eca624bb5b3640528e7aa6615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6a19941eca624bb5b3640528e7aa6615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6a19941eca624bb5b3640528e7aa6615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1210525890 Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 6a19941eca624bb5b3640528e7aa6615 Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1210525890 Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-UnshelveToHostMultiNodesTest-1210525890-project Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 97e7be5f5c4c475bbeb5f5574017608b Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1210525890-project Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. Oct 13 08:39:09.759968 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'acb0950b-f7ff-4624-801b-9e24968e4760'} Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:09.760760 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. Oct 13 08:39:09.762062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:09.763238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] Returning 404 to user: Instance acb0950b-f7ff-4624-801b-9e24968e4760 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:09.763238 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c52c015-d447-448b-8925-621d3889515a tempest-UnshelveToHostMultiNodesTest-1210525890 tempest-UnshelveToHostMultiNodesTest-1210525890-project] 10.222.0.23 "GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760" status: 404 len: 111 microversion: 2.91 time: 0.122555 Oct 13 08:39:09.784119 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 898/1704] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:09 2022] GET /compute/v2.1/servers/acb0950b-f7ff-4624-801b-9e24968e4760 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:39:09.803185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:09.803827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:09.838104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.843127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.843653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.844404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.844872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.852455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.882449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d374a010-930e-444f-adb5-ea26d5dd0cdc tempest-QuotasAdminTestJSON-1122345320 tempest-QuotasAdminTestJSON-1122345320-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67" status: 200 len: 329 microversion: 2.1 time: 1.283337 Oct 13 08:39:09.883664 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 807/1705] 10.222.0.23 () {60 vars in 1263 bytes} [Thu Oct 13 08:39:08 2022] PUT /compute/v2.1/os-quota-sets/48a37396864b4afb9de21492a50bae67 => generated 329 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:09.895895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:09.898866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:09.911771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.917663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.918380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:09.919379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:09.920077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:09.920784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:10.856314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:10.869363 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1482e072-26ea-4e4f-9ef8-946fdf38e366 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 1.082130 Oct 13 08:39:10.869961 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 899/1706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:09 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:10.898596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:10.907208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:10.925614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:10.929001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:10.941549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:10.959152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:10.960275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:10.960934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:10.961467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:10.968911 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f01934c0-80ff-440e-9e3d-3942da94e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1467 microversion: 2.1 time: 1.071174 Oct 13 08:39:10.969966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 808/1707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:09 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1467 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:10.983928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:10.986526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:11.013199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:11.013692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:11.014124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:11.014864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:11.025790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:11.026243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:11.387395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:11.396513 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5d4831e-1025-4764-8e6f-e893ee33d58d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.422029 Oct 13 08:39:11.397200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 809/1708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:10 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:11.480946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:11.490967 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b644a13-9b4f-46d1-bb1f-96a6dff12e07 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.612058 Oct 13 08:39:11.492586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17056bd5-ec05-4c20-81df-d385b5cde907", "tag": "2e536c2b-39db-43db-bbff-14690bc69b0b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:11.514803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:11.514803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:11.515013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:11.515650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 900/1709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:10 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:11.544069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] Creating event network-changed:2e536c2b-39db-43db-bbff-14690bc69b0b for instance 17056bd5-ec05-4c20-81df-d385b5cde907 on n-h2-858384-11 Oct 13 08:39:11.561631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ea754dcc-e3df-4d06-ab63-8079964d4b9b req-07bf9fde-c56f-4f04-b012-c2fd53f8bfb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072493 Oct 13 08:39:11.562457 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 810/1710] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:39:11.855842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2109119723", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "31ab6cfd-c0f3-4111-b8a2-4e38788505cb"}], "block_device_mapping_v2": [{"uuid": "ba31239a-54f3-4dee-9e53-0934289ecd04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:11.898748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:11.899563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:11.907048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:11.907663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:11.908205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:11.909176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:11.909809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:11.910331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:12.020697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] validate_networks() for [('31ab6cfd-c0f3-4111-b8a2-4e38788505cb', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:12.328714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:12.339344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc4f8d0d-e6de-41d7-b5ae-8f4b38350719 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.446583 Oct 13 08:39:12.355819 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 811/1711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:11 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:39:12.368113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:12.370147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:12.397492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:12.399654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:12.400857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:12.403602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:12.405061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:12.405656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:12.646557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:12.646990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:12.647467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:12.647927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:12.648344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:12.690577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:12.692533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:12.693001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:12.710442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:12.711626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:12.712077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:12.805878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:12.816641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:12.817601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Getting quotas for user c09ea2313b3343579cb75d16d8f220ee and project bce8c77c716d424abb6b86181e409501. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:12.830211 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-904ac544-e0a3-4bd5-a936-47500b79bbe4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1467 microversion: 2.1 time: 0.473210 Oct 13 08:39:12.834108 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 812/1712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:12 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1467 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:12.945988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:12.950035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba31239a-54f3-4dee-9e53-0934289ecd04',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:13.211009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbdf7ad0-fccd-4911-af00-f7eb3dc64e7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.359829 Oct 13 08:39:13.220202 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 901/1713] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:39:13.230708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:13.238471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:13.253283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:13.255080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:13.257688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:13.258696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:13.260201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:13.260791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:13.389972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1546933197", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:13.514289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] validate_networks() for [('3ddc3bf1-9e91-4eab-a288-de516cfd8fbb', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:13.586198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:13.597039 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-545e0dd8-72cb-4b5f-9e7f-d47cb2cfd55d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.372941 Oct 13 08:39:13.599966 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 902/1714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:13 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:13.606159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:13.607198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:13.619345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:13.620609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:13.620609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:13.621002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:13.621509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:13.621937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:13.813614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:13.825702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06650366-46e5-4a3d-862a-a9649e6dbd51 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.223485 Oct 13 08:39:13.828360 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 903/1715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:13 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:13.846724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:13.848117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:13.970949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:13.978959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:13.980540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:13.981823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2198b638-f8fe-4143-ae4f-06089b1bea76 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1104 microversion: 2.25 time: 0.150611 Oct 13 08:39:13.982399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 904/1716] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:13 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1104 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:13.999343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:14.000062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:14.007147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.011114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.011830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.012786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.013435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.014063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.308050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:14.327716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41d86b6c-fd19-4bd1-80dd-d02211d07a78 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.332479 Oct 13 08:39:14.329860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 905/1717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:13 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:14.360313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:14.361946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:14.376053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.377336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.378053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.379865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.380410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.380962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.632824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:14.661124 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee8f38d7-ad41-4895-b2fe-0740a61bf480 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1533 microversion: 2.1 time: 0.329622 Oct 13 08:39:14.674439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 906/1718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:14 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1533 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:14.674439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:14.674439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:14.688985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:14.689682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:14.689930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:14.690395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:14.690920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:14.699145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.700136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.704455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.706082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.707837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.709450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.709948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.710391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.711151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.711610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.712037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.713000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.767987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Getting quotas for project 2b2cf37e0f3b4d63a95f7254a13b54e1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:14.783826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Getting quotas for user 6c80df12b5d942c89bae1c87e269f8bb and project 2b2cf37e0f3b4d63a95f7254a13b54e1. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:14.816713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:14.819572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:14.934479 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aaa70052-c86a-4d14-a6d5-8a3885f85d6e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085388 Oct 13 08:39:14.935416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 813/1719] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:14.947810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:14.953598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:14.971536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.972112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.972562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:14.973474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:14.974166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:14.974802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:15.243837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:15.256143 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fe2da7b-acbd-4e77-86e6-4164a214fcda tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.319520 Oct 13 08:39:15.257020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 814/1720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:14 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:15.263166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45d2df63-1631-49fa-a1f2-59ef27554df1 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:15.264018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45d2df63-1631-49fa-a1f2-59ef27554df1 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:15.417518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45d2df63-1631-49fa-a1f2-59ef27554df1 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:15.427463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45d2df63-1631-49fa-a1f2-59ef27554df1 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1224 microversion: 2.1 time: 0.167865 Oct 13 08:39:15.445810 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 815/1721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:15 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:15.452000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:15.452973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:15.462439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:15.463353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:15.464133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:15.465125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:15.465971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:15.466616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:15.610298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:15.614035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:15.625022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:15.627369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:15.638620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f09d8ad4-5fe9-4191-b656-b7a2d34d3b95 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1251 microversion: 2.25 time: 0.181694 Oct 13 08:39:15.640468 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 816/1722] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:15 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1251 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:15.656916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:15.657825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:15.677262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:15.678247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:15.679230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:15.681988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:15.684034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:15.684858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.058976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:16.070270 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ccaf01e3-8971-4421-a0ce-b2831cad4bb7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.428054 Oct 13 08:39:16.076695 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 817/1723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:15 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:16.096721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:16.098197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:16.110915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.111716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.112359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.113348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.114188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.114842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.315391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:16.338635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58a2a4e8-6e86-48f2-9982-44149c1b1553 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 1.672176 Oct 13 08:39:16.339814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 907/1724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:14 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:16.346612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:16.347745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:16.361573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.362340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.363564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.364558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.365216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.365867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.471355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:16.482786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a370957-00b3-47ef-bf5e-26d6bf8d18f2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1533 microversion: 2.1 time: 0.404509 Oct 13 08:39:16.486019 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 818/1725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:16 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1533 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:16.503744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:16.504619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:16.525975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.526882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.528765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.529685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.533649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.534333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.780096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:16.780891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:16.795910 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-70be6f46-18c0-43d9-adc8-6a7f2ff1875d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1276 microversion: 2.1 time: 0.304760 Oct 13 08:39:16.797191 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4d7edb4b-c431-46cf-9460-d7c9fefa58b4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.453747 Oct 13 08:39:16.816334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 908/1726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:16 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:16.818793 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 819/1727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:16 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:16.840560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:16.850538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:16.866527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.867026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.867467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:16.868177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:16.868816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:16.869412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:17.072460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:17.083013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:17.084470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:17.094860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b21fab95-a848-415b-ad7d-a7e8f53aab50 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1251 microversion: 2.25 time: 0.275785 Oct 13 08:39:17.095490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 909/1728] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:16 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1251 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:17.100062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:17.100681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:17.119420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:17.119973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:17.120432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:17.121178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:17.124912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:17.126641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:17.365597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:17.366186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:17.376184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:17.376541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:17.376984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:17.377698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:17.378222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:17.378680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:17.947336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:17.955789 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-692d513d-fdf8-4d2f-ab82-68670867541c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1499 microversion: 2.1 time: 0.859427 Oct 13 08:39:17.963597 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 820/1729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:17 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1499 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:18.212204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:18.223561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-167fe4e7-ff89-4474-a9b6-7454ea1baae5 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.862349 Oct 13 08:39:18.239811 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 910/1730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:17 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:39:18.272045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:18.273712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:18.295495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:18.300346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.301240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.302798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.305684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.307020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.308239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.404282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:18.424783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.426742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.430215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.431155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.431706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.432139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.485904 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e136eb8-d96c-4113-8c7a-3a7c140a60ba tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.514184 Oct 13 08:39:18.495787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 821/1731] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:39:17 2022] GET /compute/v2.1/os-services => generated 949 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:18.502076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:18.503202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:18.519908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.521623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.522316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.523454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.529019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.529719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.885112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:18.911285 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a03e8c4a-330c-4e55-9acc-1f890b385bd1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1717 microversion: 2.1 time: 0.413855 Oct 13 08:39:18.917624 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 822/1732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:18 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1717 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:18.922946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:18.928377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:18.945004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.947271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.963351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:18.964419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:18.965222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:18.965822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.131714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.154513 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-24c96cb6-adef-4883-86bd-71bd657d60e2 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1284 microversion: 2.1 time: 0.224877 Oct 13 08:39:19.155502 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 823/1733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:18 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:19.161093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:19.167421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:19.185925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.186811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.196347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.197402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.200083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.200722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.301478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.316541 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b14cd6f4-0c83-44c3-8960-4f0cafbcd2a2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1533 microversion: 2.1 time: 1.073205 Oct 13 08:39:19.333038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 911/1734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:18 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1533 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:19.350615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:19.363717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.365619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.366234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.371434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.375075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.380953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.452084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-618a6a8a-2f2f-4c77-9291-ead4b88b0aae tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-858384-11" status: 200 len: 581 microversion: 2.1 time: 0.117675 Oct 13 08:39:19.457920 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 912/1735] 10.222.0.23 () {58 vars in 1174 bytes} [Thu Oct 13 08:39:19 2022] GET /compute/v2.1/os-services?host=n-d-858384-11 => generated 581 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:19.468322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:19.474732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:19.489826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.490768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.491433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.492856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.493542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.494474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.649752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.667245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.670697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.673715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ab1d7f2-bc92-4fb2-b3cd-22c9283674b3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1293 microversion: 2.25 time: 0.516938 Oct 13 08:39:19.678476 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 824/1736] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:19 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1293 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:19.702397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:19.703582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:19.711712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.712551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.713219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.714674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.715357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.716007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.937368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:19.951623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6920dfc8-bed8-4c17-adb8-37534bf6a686 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.271002 Oct 13 08:39:19.959592 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 825/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:19 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:19.967091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:19.976396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.977325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.978161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:19.979295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:19.979952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:19.980581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.036301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2caeac47-8814-4902-914f-dc57ce01a57e tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.075602 Oct 13 08:39:20.037552 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 826/1738] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:39:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:20.051158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:20.059480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:20.062841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=78,nova_api:INSERT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:20.072882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.073851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.074628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.075590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.076250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.077088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.387728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:20.400161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-49824dfb-ebec-461b-957b-a0cc18bf6355 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1707 microversion: 2.1 time: 0.360790 Oct 13 08:39:20.400606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 827/1739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:20 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1707 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:20.402372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:20.414960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3343582a-630b-461d-b7f6-670e60861fe3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 200 len: 1476 microversion: 2.1 time: 0.955340 Oct 13 08:39:20.422103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 913/1740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:19 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 1476 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:20.429700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:20.437541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:20.440783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:20.441149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.441757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.442331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.453454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.453948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.454395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.459415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.461622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.462306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.463345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.464438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.465105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.518161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0fe56d42-d3b0-40be-8c85-3b35d0b7d0e8 tempest-ServicesAdminTestJSON-1541020522 tempest-ServicesAdminTestJSON-1541020522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.101423 Oct 13 08:39:20.521590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 828/1741] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:39:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:20.533764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:20.535316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:20.547918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.550295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.550978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.551834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.552559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.553260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.575575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:20.595086 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1825858e-8457-4a2e-b039-506709e27c18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1282 microversion: 2.1 time: 0.167370 Oct 13 08:39:20.599577 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 914/1742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:20 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:20.847161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:20.855071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb206bb6-42ce-483c-bdee-4d2c4906fac3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1526 microversion: 2.1 time: 0.332230 Oct 13 08:39:20.862719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 829/1743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:20 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:20.868253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Action: 'update', calling method: .version_select at 0x7f537abf0670>, body: {"quota_set": {"ram": "5120"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:20.869441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1a734e5-5980-4cfe-a556-bb70ee36a145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '.version_select at 0x7f537ab03550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:20.873400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1a734e5-5980-4cfe-a556-bb70ee36a145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.874238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1a734e5-5980-4cfe-a556-bb70ee36a145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.875207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1a734e5-5980-4cfe-a556-bb70ee36a145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.898122 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1a734e5-5980-4cfe-a556-bb70ee36a145 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3532 microversion: 2.1 time: 0.033660 Oct 13 08:39:20.907811 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 830/1744] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:39:20 2022] GET /compute/v2.1/os-migrations => generated 3532 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:20.931220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1097842760"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:20.934321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:20.952910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.954184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.954960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:20.956172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:20.957313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:20.958637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.233833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.234813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.236820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.239707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.242277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.242959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.364197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21ba7335-f4ec-43fe-acfb-26d513b8870b tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7" status: 200 len: 148 microversion: 2.57 time: 0.763106 Oct 13 08:39:21.365398 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 915/1745] 10.222.0.23 () {62 vars in 1303 bytes} [Thu Oct 13 08:39:20 2022] PUT /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7 => generated 148 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:39:21.376776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:21.393045 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d64b204d-5917-461a-9946-bddfd55e8f2f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b/action" status: 202 len: 0 microversion: 2.1 time: 0.471654 Oct 13 08:39:21.394243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 831/1746] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:39:20 2022] POST /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:39:21.395342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:21.414657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.415301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.420123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.422357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.426516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.427664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.480447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:21.598198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f51160-5f0d-4b85-a628-0194d8f61795", "tag": "1efdc19f-e051-499b-9ab1-0b30431e4c19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:21.610887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.611789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.612641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.631653 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] Creating event network-changed:1efdc19f-e051-499b-9ab1-0b30431e4c19 for instance a1f51160-5f0d-4b85-a628-0194d8f61795 on n-h1-858384-11 Oct 13 08:39:21.638522 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-dbf005b1-91d8-49f7-b608-1398a71b1f50 req-457057b2-88ce-48a7-9498-da437c8e7187 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230608 Oct 13 08:39:21.639853 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 832/1747] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:21.646834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:21.648055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:21.654948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.655915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.656906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.658065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.659072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.659775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.901917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:21.918209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:21.921488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:21.923433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-63c32693-5c4e-45e0-b1e7-f7ac39d43d1b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1293 microversion: 2.25 time: 0.556515 Oct 13 08:39:21.924657 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 916/1748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:21 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1293 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:21.931930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:21.934095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:21.962177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.963277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.964414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.965140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:21.966459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:21.967057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:21.983867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:22.002679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8cc5a4e2-2dc6-47c1-9a87-49dc25f20cc7 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1526 microversion: 2.1 time: 0.354402 Oct 13 08:39:22.004274 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 833/1749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:21 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1526 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:22.009446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.010052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:22.030754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.031509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.032139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.033170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.033796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.034285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.243184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:22.252341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-622abaaf-3061-4a88-a1ce-0776e460981f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.246094 Oct 13 08:39:22.266683 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 834/1750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:22 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:22.266683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca", "name": "network-vif-plugged", "status": "completed", "tag": "2b02ad32-7aa5-4a2e-803d-aa110cd56d87"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:22.269740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.270207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.270663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.287700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] Creating event network-vif-plugged:2b02ad32-7aa5-4a2e-803d-aa110cd56d87 for instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca on n-h1-858384-11 Oct 13 08:39:22.293193 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-005b6d89-b036-4d33-81f3-be50caf25517 req-9159c1db-ea61-4ea2-8996-4be7b147d06c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038359 Oct 13 08:39:22.294672 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 835/1751] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:22.310124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Calling method '.version_select at 0x7f537aa37550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.441884 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99543c87-2210-4353-b316-4f2ec6d24994 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1860 microversion: 2.1 time: 0.515564 Oct 13 08:39:22.458697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 917/1752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:21 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1860 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:22.463634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c7076145-e26f-434e-8e58-beb841bbefd1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537abb15e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.556076 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c7076145-e26f-434e-8e58-beb841bbefd1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.111449 Oct 13 08:39:22.566732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 918/1753] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:22 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:22.572867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.573850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:22.582733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.583482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.585309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.588143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.589428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.591310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.822434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.823354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.824157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.825176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.825825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.826597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.840884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:22.866743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-932a0ab8-147e-4fb8-80aa-625ff715bc4c tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7/detail" status: 200 len: 463 microversion: 2.57 time: 0.564353 Oct 13 08:39:22.868658 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 836/1754] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Oct 13 08:39:22 2022] GET /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7/detail => generated 463 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:39:22.876320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5204116-2fe6-4f66-bfa5-f78519441893 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.890016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f5204116-2fe6-4f66-bfa5-f78519441893 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] HTTP exception thrown: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5204116-2fe6-4f66-bfa5-f78519441893 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Request method failure captured: Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/flavors/df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 HTTP/1.1 Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83mFTwjez1K_eDRh6LWzlF1M6M8-X9o3P9GeSRmJdgu6rZSHwAPwxANxGqTh53vkBi5wawywNyKdbJaxXEiU7_D_sX1if3gijk8CeG5vBk6CHPp4jp6dVJ12Akv-rQSwpZ2VuzK3bE1Zbi_VF9ygbHBA-Cpiby8fvc0IhEYbJzsGYw Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bcf3f0eb48244598a8d29911f2a4ae6c Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MigrationsAdminTest-108143415 Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:39:22.900038 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcf3f0eb48244598a8d29911f2a4ae6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcf3f0eb48244598a8d29911f2a4ae6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcf3f0eb48244598a8d29911f2a4ae6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcf3f0eb48244598a8d29911f2a4ae6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MigrationsAdminTest-108143415 Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bcf3f0eb48244598a8d29911f2a4ae6c Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MigrationsAdminTest-108143415 Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MigrationsAdminTest-108143415-project-admin Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: dec1894ad3634352b78498c20407d5f6 Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MigrationsAdminTest-108143415-project-admin Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: exception: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. Oct 13 08:39:22.901541 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'df4afcb6-48a7-4f4c-b007-c2dc9d4587a6'} Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:22.903175 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. Oct 13 08:39:22.904527 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:39:22.905649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5204116-2fe6-4f66-bfa5-f78519441893 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Returning 404 to user: Flavor df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:22.905649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f5204116-2fe6-4f66-bfa5-f78519441893 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/df4afcb6-48a7-4f4c-b007-c2dc9d4587a6" status: 404 len: 109 microversion: 2.1 time: 0.030890 Oct 13 08:39:22.905649 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 837/1755] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:39:22 2022] DELETE /compute/v2.1/flavors/df4afcb6-48a7-4f4c-b007-c2dc9d4587a6 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:39:22.909866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:22.910615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:22.933035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.934303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.934990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:22.936018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:22.936943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:22.937633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:23.317369 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7cee28e7-1bea-41d7-8851-191464f14716 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1860 microversion: 2.1 time: 0.414104 Oct 13 08:39:23.319346 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 838/1756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:22 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1860 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:23.324890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:23.325720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:23.334055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:23.334572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:23.335201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:23.336121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:23.336749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:23.337661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:23.547450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:23.559277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:23.560733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:23.562013 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f16714d-2a4b-48a3-a58c-1659965c87d5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1293 microversion: 2.25 time: 0.241576 Oct 13 08:39:23.571169 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 839/1757] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:23 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1293 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:23.579276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-188883441", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:23.625162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:23.639071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a64b061-086b-410a-9982-97e178f640ca tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 1.070794 Oct 13 08:39:23.643017 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 919/1758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:22 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:23.657808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Action: 'update', calling method: .version_select at 0x7f537abb1160>, body: {"quota_set": {"ram": "2048"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:23.677535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:24.171110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:24.171765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:24.172536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:24.173156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:24.174156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:24.191348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.207393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.208469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.210203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.211653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.213961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.265457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:24.277718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Getting quotas for user 51786b86408246ec87981e7d0c3c52e3 and project 94738ef816be4153a9572d23fa8b0f28. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:24.294826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.295268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.295717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.296449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.299645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.301292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.311002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:24.313870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:24.371250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.371873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.372939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.373928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.375957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.376619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.419302 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bdd3ca30-572a-41f1-b733-f95e0c6e2747 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845500 Oct 13 08:39:24.420025 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 840/1759] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:24.426323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:24.427184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:24.460678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.461181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.461615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.469800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.470500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.471511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.507085 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c49cf6a0-1e07-44d7-888f-755ac7e783e6 tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7?user_id=f298942ed4404092bdbf15af4359405b" status: 200 len: 148 microversion: 2.57 time: 0.862844 Oct 13 08:39:24.518866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 920/1760] 10.222.0.23 () {62 vars in 1384 bytes} [Thu Oct 13 08:39:23 2022] PUT /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7?user_id=f298942ed4404092bdbf15af4359405b => generated 148 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:39:24.531922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:24.534283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:24.552140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.553085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.553721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.554649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.555277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.557904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.746058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lazy-loading 'services' on Instance uuid f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:39:24.788598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:24.798129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a12fc5cf-54f2-4b84-a8d0-221f3b19763f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.377123 Oct 13 08:39:24.798736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 841/1761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:24 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:24.835426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf12d20f-2f4e-45a5-9715-a95ea706ec28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537a9f8790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:24.876422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5334e899-3845-4704-a60f-b49d814f557d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments/f4874e04-08f1-438a-81f5-479134c341ed" status: 202 len: 0 microversion: 2.1 time: 0.355099 Oct 13 08:39:24.881291 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 921/1762] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:39:24 2022] DELETE /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments/f4874e04-08f1-438a-81f5-479134c341ed => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:39:24.888098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17056bd5-ec05-4c20-81df-d385b5cde907", "name": "network-vif-plugged", "status": "completed", "tag": "2e536c2b-39db-43db-bbff-14690bc69b0b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:24.901030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.902584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.903393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.917852 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] Creating event network-vif-plugged:2e536c2b-39db-43db-bbff-14690bc69b0b for instance 17056bd5-ec05-4c20-81df-d385b5cde907 on n-h2-858384-11 Oct 13 08:39:24.930495 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ae5b67f1-8bad-4b13-9252-9c38fe6d99b1 req-c4ae5266-f2fc-4653-b92c-4b97dfa6f3e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047000 Oct 13 08:39:24.933109 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 922/1763] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:24.949588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf12d20f-2f4e-45a5-9715-a95ea706ec28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.130026 Oct 13 08:39:24.950483 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 842/1764] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:24 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:24.957608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:24.961581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1de051e7-d9c0-4ecf-852f-ece58d2b33c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:24.962330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1de051e7-d9c0-4ecf-852f-ece58d2b33c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:24.969162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:24.969921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:24.970444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:24.994914 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] Creating event network-changed:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:39:25.006851 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ea1f3aa9-41f9-4f33-9281-4ae42076b147 req-e9294725-fa73-46cf-8dda-b8982905b99f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054343 Oct 13 08:39:25.007462 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 843/1765] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:25.015993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b1e0499-f533-4aef-b6e8-b94965e0debe tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] Calling method '.version_select at 0x7f537aa37550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:25.292827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1de051e7-d9c0-4ecf-852f-ece58d2b33c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:25.301529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1de051e7-d9c0-4ecf-852f-ece58d2b33c3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1212 microversion: 2.1 time: 0.367158 Oct 13 08:39:25.307661 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 923/1766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:24 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1212 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:25.329332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:25.339873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:25.370525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:25.371009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:25.371466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:25.374771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:25.375283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:25.375723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:25.577139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=99 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:25.626432 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b1e0499-f533-4aef-b6e8-b94965e0debe tempest-QuotasAdminTestV257-48745213 tempest-QuotasAdminTestV257-48745213-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7?user_id=f298942ed4404092bdbf15af4359405b" status: 200 len: 190 microversion: 2.57 time: 0.617185 Oct 13 08:39:25.640527 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 844/1767] 10.222.0.23 () {60 vars in 1364 bytes} [Thu Oct 13 08:39:25 2022] GET /compute/v2.1/os-quota-sets/a148a9f55fd04d1abcf5d0a799e175e7?user_id=f298942ed4404092bdbf15af4359405b => generated 190 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:39:25.649953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:25.651867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:25.666599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:25.667470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:25.668314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:25.674053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:25.676044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:25.676761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.031923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.053660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.057338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.061242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa736ff9-7d11-4f76-8cb1-159567627a8e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1293 microversion: 2.25 time: 0.752317 Oct 13 08:39:26.063129 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 924/1768] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:25 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1293 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:26.079240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:26.082644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:26.094026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.094854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.097769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.100831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.101470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.105728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.175700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b3dd145-eb71-40c6-b3db-adb900f7acab tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110545 Oct 13 08:39:26.176672 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 925/1769] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:26 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:26.191196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:26.192737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:26.205315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.207814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.208793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.209523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.215531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.217080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.312464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.321673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eaf4092e-3960-4db0-869c-f01d9111e9ef tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 0.678457 Oct 13 08:39:26.328559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 845/1770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:25 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:26.341987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afc36d52-8362-45e1-8a1f-83791605e64d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa37e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:26.433781 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afc36d52-8362-45e1-8a1f-83791605e64d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.103081 Oct 13 08:39:26.434656 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 846/1771] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:26 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:26.456773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:26.459566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:26.467074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.467774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.468389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.469248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.469871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.471275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:26.558746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.571764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5be2fc61-3e8e-48a8-b1d1-fb777d5cce8e tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.393616 Oct 13 08:39:26.574014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 926/1772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:26 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:26.596227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:26.605007 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc59c041-3476-4599-a73e-b391ee8ee3d2 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1208 microversion: 2.1 time: 0.157733 Oct 13 08:39:26.610884 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 847/1773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:26 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1208 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:26.954435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93157e5-04e7-4922-9b38-81e0aa31372b", "name": "network-vif-plugged", "status": "completed", "tag": "d8b032df-6ee5-4303-b419-04dff11a0421"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:26.977253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:26.978048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:26.979622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.007479 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] Creating event network-vif-plugged:d8b032df-6ee5-4303-b419-04dff11a0421 for instance d93157e5-04e7-4922-9b38-81e0aa31372b on n-h1-858384-11 Oct 13 08:39:27.020826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3c662fbc-6fcd-41e6-8118-34ed5160a901 req-82fbe90e-cb25-4df0-8817-360f74246146 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070591 Oct 13 08:39:27.021689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 927/1774] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:27.091170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.092131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:27.103824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.104661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.108716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.109797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.110508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.111198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.191679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.194642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:27.201795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.202627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.203285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.204214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.208699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.209395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.277282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c4a8f6b-e18a-47bf-ac55-a7dfcc45bd35 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090499 Oct 13 08:39:27.281217 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 928/1775] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:27.361918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.362955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:27.383385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.385242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.385970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.387282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.390203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.390931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.763802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:27.772795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:27.778959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:27.780481 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cde78c7-2887-425f-aaa0-49655541e98d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 0.693079 Oct 13 08:39:27.803821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 848/1776] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:27.810497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b3ed259-980c-4972-96e9-2140309c33cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa14e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.898592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b3ed259-980c-4972-96e9-2140309c33cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.092139 Oct 13 08:39:27.900914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 849/1777] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:27.913061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.914192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:27.927307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.927802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.930053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.932500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.933151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.936081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.946721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:27.958960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e4c6fe9-779d-4dd5-9167-192807f09d90 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 0.598802 Oct 13 08:39:27.961375 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 929/1778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:27.974387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:27.974387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:27.985714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.986496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.987232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:27.993490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:27.994213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:27.994965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:28.147820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:28.160587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ddf63ed-7a9a-4b51-92f0-b11551e9322d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1264 microversion: 2.1 time: 0.193980 Oct 13 08:39:28.162981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 930/1779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:28.297544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:28.301486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:28.325482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:28.326753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:28.328212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:28.331855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:28.332915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:28.352590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:28.429071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:28.450138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d118512-9049-4484-b986-4b605128ddeb tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1316 microversion: 2.1 time: 0.545032 Oct 13 08:39:28.460612 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 850/1780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:27 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:28.490512 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-791d468e-f508-4ce4-bb9c-ff4b9175939c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199080 Oct 13 08:39:28.497149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 931/1781] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:28 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:39:28.916546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc1825bb-c9e1-4f8b-b985-9dc28327e732 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537ac08e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:29.012853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc1825bb-c9e1-4f8b-b985-9dc28327e732 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.081519 Oct 13 08:39:29.013558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 932/1782] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:28 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:29.045667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:29.049188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:29.083750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:29.085499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:29.087034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:29.089992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:29.091197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:29.092771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:29.249214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:29.253756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:29.263450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:29.264927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:29.265595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:29.271824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:29.277893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:29.279025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.188368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:30.219706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02625c9f-c6a7-4f4f-b1f4-4d74f08b7e2c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 1.204656 Oct 13 08:39:30.228794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 933/1783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:29 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:30.250897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:30.255606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:30.301657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.303926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.308775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.311195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.318956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.321634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.396827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:30.440671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:30.456275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:30.472458 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1a3d876-55ad-4bf9-ae91-30c879b53f5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 1.664624 Oct 13 08:39:30.483434 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 851/1784] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:28 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:30.513344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:30.515144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:30.533048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.533856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.535363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.537219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.537886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.538553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.725581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:30.742680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0afa6f1a-4ed1-4001-b346-b659cffc0034 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1270 microversion: 2.1 time: 0.511225 Oct 13 08:39:30.755506 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 934/1785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:30 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1270 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:30.779684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:30.782585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:30.791394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.792148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.792844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.793811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:30.794528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:30.795195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:30.876266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7425e31-70d2-4cf6-8aad-3610a6348fde tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118693 Oct 13 08:39:30.882855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 935/1786] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:30 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:30.894277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4743c28-b44e-446a-ab5f-3d1a98286ee8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376513a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:30.986640 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4743c28-b44e-446a-ab5f-3d1a98286ee8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.101910 Oct 13 08:39:30.987658 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 936/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:30 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:31.256489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:31.258228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:31.276472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:31.287230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:31.287994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:31.290802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:31.291617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:31.292342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:31.681791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:31.693981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c4860b3-8c48-43e9-bca2-fe45ca3a024d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1466 microversion: 2.1 time: 1.205312 Oct 13 08:39:31.698733 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 852/1788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:30 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1466 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:31.707655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:31.717209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:31.741830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:31.743267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:31.743951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:31.744917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:31.745596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:31.747169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.341565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:32.344372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:32.362719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4c92e1b-6576-4911-a6f2-0f54211cec5e tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 1.112661 Oct 13 08:39:32.365841 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 937/1789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:31 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:39:32.388917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:32.392035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:32.418798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.419208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.419646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.420367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.420913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.421242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.847251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0868611b-33cc-4e4a-8dcd-e7e74f80f663 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1619 microversion: 2.1 time: 0.476665 Oct 13 08:39:32.847915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 938/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:32 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1619 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:32.862361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:32.863247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:32.891360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.891873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.892302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.893219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.893947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.894562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.897416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:32.912375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:32.927683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:32.931149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1344a6c6-854f-4796-942b-d1b1c8155cdc tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 1.231085 Oct 13 08:39:32.935544 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 853/1791] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:31 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:32.948931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:32.952458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:32.973186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.983765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.989540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:32.992233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:32.993848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:32.994381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:33.095281 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c450d651-0659-4d6b-a3b8-0e24b94f023c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158353 Oct 13 08:39:33.102738 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 854/1792] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:32 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:33.113852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea744f9a-26c6-42fd-9df9-b6c28a80d38e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376eb7160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:33.214109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea744f9a-26c6-42fd-9df9-b6c28a80d38e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.109668 Oct 13 08:39:33.217333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 855/1793] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:33 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:33.231102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-252790276", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cb726935-3fe0-4a8d-b3c7-0d230b45e5ac"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:33.351262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:33.797666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:33.811005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-13696ca5-da22-48a4-a45b-a31aceed62ac tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.959759 Oct 13 08:39:33.811944 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 939/1794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:32 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:33.819675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:33.822646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:33.838205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:33.841016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:33.844006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:33.845516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:33.849289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:33.850030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.238745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:34.363407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:34.385949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25fd2ccf-0a03-4cc4-9799-3eec712a3118 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 0.572891 Oct 13 08:39:34.387198 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 940/1795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:33 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:34.403894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:34.420540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:34.441669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=25 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:34.447441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.448066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.448688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.449500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.451059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.456611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.581960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:34.582376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:34.582880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:34.583287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:34.583696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:34.603234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.609210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.609840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.613458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.613990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.614444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.677796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:34.688295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Getting quotas for user e3d326ddd0764f2fb25a8aa48a228d63 and project de2e046db1d74ba093a06ec9e17c31a5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:34.717401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:34.724140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:34.812249 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad2b0867-7bde-44f3-8561-1eb03c5d1ffd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593592 Oct 13 08:39:34.819779 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 856/1796] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:34.830579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:34.834219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:34.857405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.858174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.858899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.860002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:34.860679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:34.861366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:34.964265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-03f80049-acda-42db-8fd2-3c1b3eb38aed tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142954 Oct 13 08:39:34.976525 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 857/1797] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:34 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:34.992842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:34.994687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-017e5d18-ab29-4505-807e-5ceaf68fed4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa00280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:35.009164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:35.015474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:35.017265 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8e8f237-51a7-4c3b-87c7-c1022e9897f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 0.617297 Oct 13 08:39:35.020439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 941/1798] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:34 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:35.053248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:35.071660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:35.072588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:35.073206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:35.093561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-017e5d18-ab29-4505-807e-5ceaf68fed4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.115079 Oct 13 08:39:35.094397 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 858/1799] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:34 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:35.099201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a72cb513-25b4-4baf-a4a8-b8e50954e954 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:35.104999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a72cb513-25b4-4baf-a4a8-b8e50954e954 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:35.116768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] Creating event network-changed:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:39:35.123052 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b0fda3ac-403e-484a-afeb-145d0c292cc8 req-e8bcfb21-1063-49bc-ad00-ff9dfd089e16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101229 Oct 13 08:39:35.124230 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 942/1800] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:35.135920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:35.137878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:35.156030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:35.156839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:35.157530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:35.158517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:35.159755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:35.160405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:35.238809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a72cb513-25b4-4baf-a4a8-b8e50954e954 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:35.252319 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a72cb513-25b4-4baf-a4a8-b8e50954e954 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1216 microversion: 2.1 time: 0.156569 Oct 13 08:39:35.255656 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 859/1801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:35 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:35.298028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=62 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:35.523800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e91fe99-bfac-4a6b-a9c0-1524305b9797 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Calling method '.version_select at 0x7f537a99f820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:35.682338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e91fe99-bfac-4a6b-a9c0-1524305b9797 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 371 microversion: 2.1 time: 0.419897 Oct 13 08:39:35.683596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 860/1802] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:39:35 2022] GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:35.690325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:35.691935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:35.702624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:35.703978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:35.704630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:35.707062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:35.707686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:35.708336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:35.880985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:35.898076 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5da78e84-5107-40a3-8fe5-2fdd7deef95e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.771707 Oct 13 08:39:35.900030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 943/1803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:35 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:35.922108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f5376517d30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:36.049903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:36.061700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f585bd45-ccef-4ba4-bf19-c0d51c6ee5ba tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 0.374053 Oct 13 08:39:36.062613 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 861/1804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:35 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:36.088122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:36.090732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:36.092765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:36.119339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.120017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.124353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.125238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.125648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.126079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.127243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.132249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.135514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.136565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.139963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.143798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.192107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:36.268930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a97861d0-c5c7-4606-8ec6-dfbee8fcbad8 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 328 microversion: 2.1 time: 0.367585 Oct 13 08:39:36.269589 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 944/1805] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:35 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 328 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:36.279773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:36.283096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:36.302268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.302826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.303277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.304006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.304459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.304892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.305586 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1eaefe9-33e5-480e-88f2-312e58815d37 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.241063 Oct 13 08:39:36.310647 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 862/1806] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:39:36 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3/os-volume_attachments => generated 25 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:39:36.338092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e2ce781-77e8-4400-9ea3-c9de3f32aede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537a99fdc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:36.476172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e2ce781-77e8-4400-9ea3-c9de3f32aede tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1414 microversion: 2.1 time: 0.164055 Oct 13 08:39:36.476978 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 863/1807] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:36 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:36.491604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:36.500923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:36.546731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.551000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.554208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.557405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.560937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.565946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.656128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:36.670391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:36.673660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:36.676816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09326cd3-82bf-4f65-a232-b59e0d98bbbb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 0.403732 Oct 13 08:39:36.680827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 945/1808] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:36 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:36.705449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:36.719596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0fe38df-fc29-4d3b-9481-0d73c9b31cd9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1268 microversion: 2.1 time: 0.241442 Oct 13 08:39:36.734998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 864/1809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:36 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:36.798457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1802281917", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:36.902309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "name": "network-vif-plugged", "status": "completed", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:36.920540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:36.938125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:36.942950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:36.943896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:36.974932 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] Creating event network-vif-plugged:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:39:36.990044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-32a90ff1-c304-4309-9867-614e8c6d691a req-1f08a798-cd12-452d-8b47-d7e84986a758 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253449 Oct 13 08:39:36.993136 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 865/1810] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:37.138998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-262652499", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "ab2d0432-22c2-4e94-a25e-3539564c7afd"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:37.323384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] validate_networks() for [('ab2d0432-22c2-4e94-a25e-3539564c7afd', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:37.379103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:37.380279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:37.381211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:37.381884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:37.382502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:37.444184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:37.447585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:37.448350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:37.449497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:37.453473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:37.458344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:37.520441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:37.531655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for user 475ada985df0407f96fbd192ed95d323 and project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:37.572614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.utils [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] cores quota exceeded for 427ed962605a4d1b89c2fd1291e3d291, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127030) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 13 08:39:37.573657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Request method failure captured: Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 145 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87Fkk23e9pwmlpJ-qGSkR3pFxOcpAdhFdnMTbd2nd4xa61C0YI9czMn_Xf5A_naZOwLbRyKaUdGihk3BhxofBw8RTmbqEjoif0A0VL5lZms4x_7dbcSuW0DsZljfeM8wD_bCWqpNnBc5Olmyknmgvw9dZ86aeldX8u5aPofV3QJiac Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:39:37.615742 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 475ada985df0407f96fbd192ed95d323 Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1802281917", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} Oct 13 08:39:37.617396 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1802281917', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452'}}} Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 13 08:39:37.618511 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:37.619903 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.621553 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 13 08:39:37.623161 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:37.624951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:37.626125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee9c8db1-c455-444e-a6a0-245438078004 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.943127 Oct 13 08:39:37.631794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 946/1811] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 949 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:39:37.637441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:37.638264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:37.653361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:37.668941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:37.672190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:37.673384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:37.674661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:37.677137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.295157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:38.304407 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68183025-6f70-40ea-8ba9-76c753115712 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.671367 Oct 13 08:39:38.304968 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 947/1812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:37 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:38.338884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:38.341096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:38.360590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.361373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.363292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.364611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.367082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.367713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.472080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:38.472559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:38.472957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:38.473362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:38.473766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:38.488330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.489083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.489517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.490240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.490713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.491127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.508279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:38.534103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Getting quotas for project a95bfc5f5faf4f5eabe4898240643be0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:38.541951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Getting quotas for user 4a13b393175b41c187ed4152cc68fcde and project a95bfc5f5faf4f5eabe4898240643be0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:38.576418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:38.583685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:38.661594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:38.688347 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3562764-9b93-4d1e-85a6-62898f552f5f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686427 Oct 13 08:39:38.689680 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 866/1813] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:38.695327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75eb00da-6ff4-4aec-be4d-2b68d5331139 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa000d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:38.726182 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eae57a85-ba39-40db-8ce5-7104b39b7a87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1324 microversion: 2.1 time: 0.404826 Oct 13 08:39:38.756696 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 948/1814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:38 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:38.764060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f53764d4670>, body: {"quota_set": {"cores": 20}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:38.911082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.915350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.916098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:38.917361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:38.919583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:38.920027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:39.067522 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80e5dcdd-d97a-4578-a6c4-2ade2e5322d5 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 329 microversion: 2.1 time: 0.301966 Oct 13 08:39:39.074604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 949/1815] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:38 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 329 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:39.084490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:39.085115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:39.094357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:39.094890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:39.095336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:39.096038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:39.097076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:39.105062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.213476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:40.231160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:40.233082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:40.236218 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62c3d6c9-0ae3-44d6-b23e-80456c514f52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 1.160074 Oct 13 08:39:40.237975 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 950/1816] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:39 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:40.249194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:40.251925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:40.277253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.278186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.284692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.287673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.288410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.291141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.474626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:40.507956 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68b3132e-2c65-4842-9270-b64ae3bd4c17 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1274 microversion: 2.1 time: 0.252659 Oct 13 08:39:40.507956 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 951/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:40 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:40.513705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:40.514333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:40.521378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.521867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.522303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.523034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.523477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.523900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.655452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:40.668825 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8687ef1d-f941-40b3-841e-ba56f9a2e959 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1283 microversion: 2.1 time: 0.160966 Oct 13 08:39:40.671065 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 952/1818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:40 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1283 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:40.676921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f51160-5f0d-4b85-a628-0194d8f61795", "name": "network-vif-plugged", "status": "completed", "tag": "1efdc19f-e051-499b-9ab1-0b30431e4c19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:40.687040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.687777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.688363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.709563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] Creating event network-vif-plugged:1efdc19f-e051-499b-9ab1-0b30431e4c19 for instance a1f51160-5f0d-4b85-a628-0194d8f61795 on n-h1-858384-11 Oct 13 08:39:40.723667 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c5a0f90f-7534-44a3-86c4-930a4f07a8dd req-c2b974a6-d4c5-4247-8761-8b45cb77cb1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051157 Oct 13 08:39:40.729693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 953/1819] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:40.740848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbd6ff52-86bf-4639-b27d-44fc22d099a0 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Calling method '.version_select at 0x7f537ab25670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:40.908461 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbd6ff52-86bf-4639-b27d-44fc22d099a0 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 371 microversion: 2.1 time: 0.175701 Oct 13 08:39:40.918076 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 954/1820] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:39:40 2022] GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:40.930052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:40.931301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:40.938605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.939310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.940796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:40.941698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:40.942316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:40.942945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:41.293896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:41.306136 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f32ef9e-b71d-4c9c-9993-26d58abe7fd5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.385049 Oct 13 08:39:41.310977 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 955/1821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:40 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:41.323258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:41.324140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:41.336747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:41.339436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:41.340951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:41.344258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:41.345091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:41.345695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:41.792849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:41.801800 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0389a454-da84-41f5-bfb8-49ac67ee4e32 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1519 microversion: 2.1 time: 0.489227 Oct 13 08:39:41.811726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 956/1822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:41 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:41.820646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f537ac0bee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:41.972297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:41.974602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:41.975362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:41.977896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:41.981713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:41.983167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:42.184732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19191129-885e-47f7-9d23-1475696711cf tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 328 microversion: 2.1 time: 0.372087 Oct 13 08:39:42.187861 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 957/1823] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:41 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 328 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:42.224811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:42.225603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:42.244055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:42.252860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:42.253402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:42.254181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:42.259583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:42.260087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:42.814567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:42.830566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:42.838757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:42.844441 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94077416-4df1-4c13-a702-3a4462022195 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1281 microversion: 2.25 time: 0.655398 Oct 13 08:39:42.849558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 958/1824] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:42 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1281 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:42.857894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:42.858550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:42.871002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:42.871503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:42.875422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:42.876225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:42.876695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:42.878786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:42.919659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:43.970205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:43.979844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7cd80e08-1eb8-4142-96bd-ef2eca1e0a8a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1316 microversion: 2.1 time: 1.129143 Oct 13 08:39:43.985313 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 959/1825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:42 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1316 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:44.017158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:44.031796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:44.046236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:44.047333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:44.048739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:44.049737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:44.051255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:44.053453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:44.401292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:44.412953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-804391d7-f7bd-4a39-8718-100b20a8d628 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.413269 Oct 13 08:39:44.415076 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 960/1826] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:43 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:44.420996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6fbb6da9-d4d9-402e-b842-c0454147760c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'create', calling method: .version_select at 0x7f537abb1a60>, body: {"pool": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:46.860469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6fbb6da9-d4d9-402e-b842-c0454147760c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.444202 Oct 13 08:39:46.863309 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 961/1827] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:39:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:46.870921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-262191760", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:48.352802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75eb00da-6ff4-4aec-be4d-2b68d5331139 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1423 microversion: 2.1 time: 9.661068 Oct 13 08:39:48.354732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:48.362864 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 867/1828] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:38 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1423 bytes in 9672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:48.367684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:48.368325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:48.378976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.379466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.379898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.380607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.381054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.381480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.508937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:48.545788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:48.556158 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1f360b3-d8a2-4ba3-9eea-8c02018b4478 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.192087 Oct 13 08:39:48.557119 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 868/1829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:48 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:48.561847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-plugged", "status": "completed", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:48.571628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.572100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.572527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.584825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=19 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:48.587286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] Creating event network-vif-plugged:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:39:48.592554 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-7e335d67-3fa6-452c-b21c-45f451fbb3a4 req-510e2e16-d9ec-441f-b141-f2a63e397402 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Oct 13 08:39:48.593139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 869/1830] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:48.600390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:48.601286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:48.606361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:48.607257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:48.607857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:48.608388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:48.608916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:48.612518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.613017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.613454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.614172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.614657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.615084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.619766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.620621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.621122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.622067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.622622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.623119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.642068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:48.647659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for user 475ada985df0407f96fbd192ed95d323 and project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:48.660914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.utils [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] instances quota exceeded for 427ed962605a4d1b89c2fd1291e3d291, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127030) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 13 08:39:48.661617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Request method failure captured: Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 144 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87Fkk23e9pwmlpJ-qGSkR3pFxOcpAdhFdnMTbd2nd4xa61C0YI9czMn_Xf5A_naZOwLbRyKaUdGihk3BhxofBw8RTmbqEjoif0A0VL5lZms4x_7dbcSuW0DsZljfeM8wD_bCWqpNnBc5Olmyknmgvw9dZ86aeldX8u5aPofV3QJiac Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:39:48.664541 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 475ada985df0407f96fbd192ed95d323 Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-262191760", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} Oct 13 08:39:48.665925 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-262191760', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452'}}} Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 13 08:39:48.666919 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:48.668193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.669557 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 13 08:39:48.671544 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:48.677952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:48.679011 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8505fc0-ffa8-4677-a14c-c61371b72858 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.813434 Oct 13 08:39:48.679614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 962/1831] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:46 2022] POST /compute/v2.1/servers => generated 119 bytes in 1815 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:39:48.685997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b0defc-7c70-4e53-affb-e4ec35ea7d01", "tag": "46b34fb2-d49a-44ad-83ea-21e5281276bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:48.700683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.702048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.703046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.717570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] Creating event network-changed:46b34fb2-d49a-44ad-83ea-21e5281276bb for instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 on n-h1-858384-11 Oct 13 08:39:48.728944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-818c1482-e239-4bb4-a7cb-68bc0b82be09 req-90f3c6c9-ed7a-4147-b22d-fa3abd7c9187 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044964 Oct 13 08:39:48.730238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 963/1832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:48.738158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:48.739938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:48.749863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.750780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.752056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.755266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.755997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.756761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.854024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:48.865782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:48.868199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:48.869739 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99690137-dd4e-42dc-b5a6-f01042acc2ab tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1476 microversion: 2.25 time: 0.275318 Oct 13 08:39:48.871285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 870/1833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:48 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:48.939298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:48.949846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.950326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.950788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.959789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:48.963234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] Creating event network-changed:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:39:48.968105 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3f2d570b-cf70-4aab-bb2b-dce9aae96791 req-ed3b13c7-770a-4114-938f-13a61ea1114a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095450 Oct 13 08:39:48.968907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a929b26-929d-4d2f-a157-4d5e7a1289ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1316 microversion: 2.1 time: 0.236944 Oct 13 08:39:48.969068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 871/1834] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:48.970337 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 964/1835] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:48 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:48.974272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:48.975082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:48.976909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1223268386", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:48.981437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.981912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.982344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:48.983125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:48.983579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:48.984265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:49.068498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] validate_networks() for [('3ddc3bf1-9e91-4eab-a288-de516cfd8fbb', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:49.175123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:49.187046 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79af9368-954e-4b03-bd34-77dcab2503c8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.216584 Oct 13 08:39:49.189082 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 872/1836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:48 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:49.194341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c084904-afdf-42d2-8b02-caf17c23b24c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aac04c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:49.251489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c084904-afdf-42d2-8b02-caf17c23b24c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 200 len: 1423 microversion: 2.1 time: 0.061129 Oct 13 08:39:49.261850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 873/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:39:49 2022] GET /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:49.269531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f537aa07d30>, body: {"quota_set": {"instances": 10}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:49.355351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:49.356537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:49.357161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:49.358115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:49.358786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:49.359397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:49.423109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-376b66ba-ee8e-429b-8a60-fb0b7f2b9354 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 329 microversion: 2.1 time: 0.159805 Oct 13 08:39:49.423696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 874/1838] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:49 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:49.436288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:49.437057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:49.445298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:49.446131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:49.446923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:49.447860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:49.448902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:49.449533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.033747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid a1f51160-5f0d-4b85-a628-0194d8f61795 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:39:50.072370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba3fade6-05ab-4eb6-a47b-ed85ead44b91 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1971 microversion: 2.25 time: 0.644613 Oct 13 08:39:50.074576 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 875/1839] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:49 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1971 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:50.084738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c2245cd-9164-4765-8620-cf0eebe063a4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537a9a4b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:50.194922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:50.195406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:50.195815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:50.196231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:50.196650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:50.200094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:50.210280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.210818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.211322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.212019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.212482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.212936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.233619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Getting quotas for project 2b2cf37e0f3b4d63a95f7254a13b54e1. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:50.238495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Getting quotas for user 6c80df12b5d942c89bae1c87e269f8bb and project 2b2cf37e0f3b4d63a95f7254a13b54e1. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:50.250614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:50.253627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:50.325033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b74b77c1-8a72-4b93-96a6-1cbeb1fa2a25 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352879 Oct 13 08:39:50.335683 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 965/1840] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:50.343094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce4a7da3-2803-4f97-a278-878f71f622c1 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Calling method '.version_select at 0x7f537abc6dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:50.462691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce4a7da3-2803-4f97-a278-878f71f622c1 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 371 microversion: 2.1 time: 0.125498 Oct 13 08:39:50.463604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 966/1841] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 08:39:50 2022] GET /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:50.469708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:50.470326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:50.498095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.498213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.498670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.499662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.500305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.501099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.741661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:50.749700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18f270bd-5661-4d43-a0d9-aae3ff4b8632 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1312 microversion: 2.1 time: 0.284701 Oct 13 08:39:50.750304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 967/1842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:50 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:50.758118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:50.758804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:50.773909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.774426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.774858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.775567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.776021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.776454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.881367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c2245cd-9164-4765-8620-cf0eebe063a4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 204 len: 0 microversion: 2.1 time: 0.805689 Oct 13 08:39:50.881925 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 876/1843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:50 2022] DELETE /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:39:50.890276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:50.891334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:50.899477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.900328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.901386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:50.902388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:50.903133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:50.904097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.050397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:51.062635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0867f640-e7b9-4009-a661-5cdb14a1b23a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1316 microversion: 2.1 time: 0.311182 Oct 13 08:39:51.063484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 968/1844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:50 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:51.069999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:51.070701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:51.078480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.079028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.079678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.081226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.081744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.082234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.122352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid a1f51160-5f0d-4b85-a628-0194d8f61795 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:39:51.142452 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d2b5410-243b-4416-800a-5d6a148a18ce tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1971 microversion: 2.25 time: 0.256016 Oct 13 08:39:51.144452 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 877/1845] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:50 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1971 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:51.149347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:51.150295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:51.157679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.159277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.159948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.161005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.161941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.162845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.257741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:51.271545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56f4194a-3db7-4dfd-8b33-0b512a3551c6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1228 microversion: 2.1 time: 0.125057 Oct 13 08:39:51.274566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 878/1846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:51 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1228 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:51.278815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:51.288964 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4dfd6ce6-c206-47f3-b6ee-0478774bb1cd tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.224092 Oct 13 08:39:51.289746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 969/1847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:51 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:51.294359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:51.295124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:51.301658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f537a9f8b80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:51.304371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.304962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.305602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.307144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.307816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.308310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.343881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:39:51.406440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.407010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.407517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.408283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.408978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.409405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.433889 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f8d3897-76e6-4055-b199-d4cd90decfc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 204 len: 0 microversion: 2.1 time: 0.142810 Oct 13 08:39:51.444519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 970/1848] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:39:51 2022] DELETE /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:39:51.451387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:51.456148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.456924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.457676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.459130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.459977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.461255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.481771 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-edf9b6ca-9326-44fb-9add-95979a71a70b tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 325 microversion: 2.1 time: 0.205886 Oct 13 08:39:51.483200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 879/1849] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:51 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:51.506047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c06e806d-8128-4785-b484-064ea8139104 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.059465 Oct 13 08:39:51.514074 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 971/1850] 10.222.0.23 () {60 vars in 1217 bytes} [Thu Oct 13 08:39:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:39:51.524657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": "auto"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:51.528615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:51.539716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.539716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.539716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.539716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.540141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.540141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.545468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1396194171", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:51.569037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'flavor' on Instance uuid a1f51160-5f0d-4b85-a628-0194d8f61795 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:39:51.595289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127031) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:39:51.620285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:51.892332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:51.893359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:51.894490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:51.895242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:51.896236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:51.911913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.913513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.914171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.915268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:51.916199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:51.916798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:51.942881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:51.947486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Getting quotas for user 475ada985df0407f96fbd192ed95d323 and project 427ed962605a4d1b89c2fd1291e3d291. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:51.962001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.utils [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] ram quota exceeded for 427ed962605a4d1b89c2fd1291e3d291, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127030) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 13 08:39:51.962873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Request method failure captured: Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 145 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87Fkk23e9pwmlpJ-qGSkR3pFxOcpAdhFdnMTbd2nd4xa61C0YI9czMn_Xf5A_naZOwLbRyKaUdGihk3BhxofBw8RTmbqEjoif0A0VL5lZms4x_7dbcSuW0DsZljfeM8wD_bCWqpNnBc5Olmyknmgvw9dZ86aeldX8u5aPofV3QJiac Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:39:51.965643 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 475ada985df0407f96fbd192ed95d323 Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1396194171", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} Oct 13 08:39:51.967387 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1396194171', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452'}}} Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 13 08:39:51.968351 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:51.969756 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.972050 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 13 08:39:51.974691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:51.976395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:51.977475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a735a43-9983-434b-a781-bf2e8e46fc26 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.436811 Oct 13 08:39:51.978666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 972/1851] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:51 2022] POST /compute/v2.1/servers => generated 110 bytes in 438 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:39:51.984191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1195921839", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:52.089987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:39:52.569182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:39:52.569799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:39:52.570069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:39:52.570526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:39:52.570940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:39:52.580258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.581088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.581529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.582280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.582767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.583192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.600876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:39:52.604745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:39:52.617273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:39:52.619723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:39:52.668287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26cdec41-97e8-4f28-a1fe-878d664c834d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688036 Oct 13 08:39:52.675601 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 973/1852] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:39:52.675601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:52.675601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:52.681705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.682269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.682839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.683623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.684685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.684685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.828498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:52.838666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f625eccd-d2bc-46af-91f0-0e4d80e051f4 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1462 microversion: 2.1 time: 0.167158 Oct 13 08:39:52.840186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 974/1853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:52 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1462 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:52.846892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b0defc-7c70-4e53-affb-e4ec35ea7d01", "name": "network-vif-plugged", "status": "completed", "tag": "46b34fb2-d49a-44ad-83ea-21e5281276bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:52.857360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.857844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.858573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.873544 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] Creating event network-vif-plugged:46b34fb2-d49a-44ad-83ea-21e5281276bb for instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 on n-h1-858384-11 Oct 13 08:39:52.878679 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b130a563-818d-4a63-93ee-03822cc176e8 req-2de2d6f2-cecb-4e31-820c-896471969871 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Oct 13 08:39:52.879274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 975/1854] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:52.884673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Action: 'update', calling method: .version_select at 0x7f537ac0b040>, body: {"quota_set": {"ram": 51200}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:52.957464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.957950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.958949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:52.962853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:52.963245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:52.963687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.025692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-635d4da5-f1f1-4b21-92f5-f021c206fde2 tempest-QuotasAdminNegativeTest-101663085 tempest-QuotasAdminNegativeTest-101663085-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 200 len: 329 microversion: 2.1 time: 0.144946 Oct 13 08:39:53.026648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 976/1855] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:52 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 329 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:53.031750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:53.032696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:53.042359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.043040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.043647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.044538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.045176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.045780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.225772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:53.234555 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e40654b-64ba-4941-83d6-3efb0cbff794 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1316 microversion: 2.1 time: 0.206548 Oct 13 08:39:53.235130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 977/1856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:53 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:53.250127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:53.250826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:53.258154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.258762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.259275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.260041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.260608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.261096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.384465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:53.399275 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41d0f2d3-f103-4a99-8503-8db1dbb5a475 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1276 microversion: 2.1 time: 0.162193 Oct 13 08:39:53.400119 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 978/1857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:53 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:53.420705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:53.421321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:53.448143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.449453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.450657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.452274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.453503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.454579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.850770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:53.864790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8fe44240-1aac-42fe-a86d-24de5b3d4a45 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.453245 Oct 13 08:39:53.867094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 979/1858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:53 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:53.872725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:53.873909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:53.885761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.886765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.887448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:53.888726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:53.889445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:53.890744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.043679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:54.054449 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd6b9028-61d5-4461-9c4f-94a547fa6dfc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1260 microversion: 2.1 time: 0.185965 Oct 13 08:39:54.055398 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 980/1859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:53 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:54.064769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:54.065548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:54.074363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.075529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.076380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.077637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.078091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.078747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.406394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:54.417244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48f1234f-ceaa-45d1-b8db-15175ae4a234 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1615 microversion: 2.1 time: 0.360683 Oct 13 08:39:54.422838 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 981/1860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:54 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1615 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:54.430940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c31d904-fdf1-4749-ab6b-f03ced619ab7 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Action: 'update', calling method: .version_select at 0x7f537ab25c10>, body: {"quota_set": {"ram": 0}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:54.447483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c31d904-fdf1-4749-ab6b-f03ced619ab7 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '475ada985df0407f96fbd192ed95d323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427ed962605a4d1b89c2fd1291e3d291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c31d904-fdf1-4749-ab6b-f03ced619ab7 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Request method failure captured: Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 HTTP/1.1 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 25 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87Fkk23e9pwmlpJ-qGSkR3pFxOcpAdhFdnMTbd2nd4xa61C0YI9czMn_Xf5A_naZOwLbRyKaUdGihk3BhxofBw8RTmbqEjoif0A0VL5lZms4x_7dbcSuW0DsZljfeM8wD_bCWqpNnBc5Olmyknmgvw9dZ86aeldX8u5aPofV3QJiac Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:39:54.456337 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/427ed962605a4d1b89c2fd1291e3d291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 427ed962605a4d1b89c2fd1291e3d291 Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1272481748 Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 475ada985df0407f96fbd192ed95d323 Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-QuotasAdminNegativeTest-1272481748-project Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: {"quota_set": {"ram": 0}} Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 13 08:39:54.457974 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '427ed962605a4d1b89c2fd1291e3d291', 'body': {'quota_set': {'ram': 0}}} Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:39:54.459018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:54.460345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c31d904-fdf1-4749-ab6b-f03ced619ab7 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c31d904-fdf1-4749-ab6b-f03ced619ab7 tempest-QuotasAdminNegativeTest-1272481748 tempest-QuotasAdminNegativeTest-1272481748-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291" status: 403 len: 116 microversion: 2.1 time: 0.033799 Oct 13 08:39:54.461716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 982/1861] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:39:54 2022] PUT /compute/v2.1/os-quota-sets/427ed962605a4d1b89c2fd1291e3d291 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:39:54.470615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57245aae-d136-49c4-9e67-f34f886d6e2b tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795/action" status: 202 len: 0 microversion: 2.25 time: 2.954619 Oct 13 08:39:54.472670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:54.474136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:54.474564 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 880/1862] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:39:51 2022] POST /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795/action => generated 0 bytes in 2959 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:39:54.479400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93157e5-04e7-4922-9b38-81e0aa31372b", "name": "network-vif-deleted", "tag": "d8b032df-6ee5-4303-b419-04dff11a0421"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:54.483927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.483927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.484608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.485328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.486618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.487465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.513127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.513615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.514064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.540827 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] Creating event network-vif-deleted:d8b032df-6ee5-4303-b419-04dff11a0421 for instance d93157e5-04e7-4922-9b38-81e0aa31372b on n-h1-858384-11 Oct 13 08:39:54.554257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-09650a7d-54ad-40e0-9096-e09663e13478 req-17a9f470-9a60-4656-8dc7-166b2f908cda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078286 Oct 13 08:39:54.555118 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 881/1863] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:54.561113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:54.571451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:54.590518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.591484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.593855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.595700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.596427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.597133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.757394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:54.758736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:54.768514 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-381bbc28-065b-4754-9a5d-6aa888b12e3c tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1276 microversion: 2.1 time: 0.211716 Oct 13 08:39:54.770702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b303e8a-0261-4316-8def-8b21081fa32d tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1316 microversion: 2.1 time: 0.311115 Oct 13 08:39:54.771400 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 983/1864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:54 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:54.781279 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 882/1865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:54 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:54.793585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:54.794312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:54.798040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:54.798763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:54.804026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.804634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.805217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.808724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.808724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.809457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.819985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.820791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.821420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.822299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:54.822951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:54.823542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:54.878734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dec1894ad3634352b78498c20407d5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf3f0eb48244598a8d29911f2a4ae6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:54.892047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: 9900ef64-6643-4731-a77c-7616ae962172] flavor_id is None. Assuming migration. {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 13 08:39:54.892866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 08:39:55.109821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:55.122944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:55.129441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:55.130692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6589ad71-51d7-41fa-a425-3655155f1ae2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.347557 Oct 13 08:39:55.131262 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 883/1866] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:54 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:55.144401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:55.145225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:55.152089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:55.152824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:55.153253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:55.154198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:55.154851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:55.155491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:55.411246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-058d0b49-0d69-4582-8500-c514027cad94 tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172/action" status: 202 len: 0 microversion: 2.1 time: 0.620974 Oct 13 08:39:55.412197 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 984/1867] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:39:54 2022] POST /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:39:55.422629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "name": "network-vif-plugged", "status": "completed", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}, {"server_uuid": "d93157e5-04e7-4922-9b38-81e0aa31372b", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b032df-6ee5-4303-b419-04dff11a0421"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:55.466507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:55.471094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:55.471994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:55.472939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:55.964755 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Creating event network-vif-plugged:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:39:55.965561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] Creating event network-vif-unplugged:d8b032df-6ee5-4303-b419-04dff11a0421 for instance d93157e5-04e7-4922-9b38-81e0aa31372b on n-h1-858384-11 Oct 13 08:39:55.976356 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7b0e95cd-a075-4d9a-9836-7c6ba42e9585 req-91b53add-0ac2-4f04-b92c-a14593ea2472 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.562723 Oct 13 08:39:55.980345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 985/1868] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:55.987206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:55.987973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:55.996205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:55.996711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:55.997143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:55.997858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:55.998316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:55.998773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.004723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:56.020792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f197334-27f8-45f1-9b1d-9960c39528b0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.884608 Oct 13 08:39:56.040093 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 884/1869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:55 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:56.045933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:56.047179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:56.054452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.055647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.056331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.057310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.058156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.058912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.321674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:56.346170 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdf0abd0-967f-4c15-906e-6b943e7f3840 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1266 microversion: 2.1 time: 0.362500 Oct 13 08:39:56.366626 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 986/1870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:55 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:56.375322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:56.393072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:56.414269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.417716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.421638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.424607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.428666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.431432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.587174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:56.602720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05ba8482-f9b5-4bcd-a223-3645f53bdf69 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1471 microversion: 2.1 time: 0.559512 Oct 13 08:39:56.617771 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 885/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:56 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1471 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:56.639393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:56.641560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:56.656166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.657858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.660290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:56.661935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:56.664161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:56.664829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.062371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.072711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-887fd6b6-2e9d-4aa1-8f4a-bdd791bfde1f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1466 microversion: 2.1 time: 0.704589 Oct 13 08:39:57.077865 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 987/1872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:56 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1466 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:57.093047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.093747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.124413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.130000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.130570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.131440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.131933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.138239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.268812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.277888 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3e3e3cb-0a8c-411b-a556-1a4c108024f0 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.652140 Oct 13 08:39:57.295538 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 886/1873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:56 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:57.304369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.305350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.316888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.318590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.319479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.320869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.321341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.321768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.326787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:39:57.501400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.522127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.524003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.525599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52f5d8f3-4146-47b8-9c16-1d9b3a2fc601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.446450 Oct 13 08:39:57.556232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 988/1874] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:57 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:57.562710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.563720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.573340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.584892 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04a33c8e-0156-4197-b06d-7d0073a861aa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1331 microversion: 2.1 time: 0.286445 Oct 13 08:39:57.586196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 887/1875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:57 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1331 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:57.591913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.592977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.596270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.599000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.600010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.601298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.601780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.602215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.609277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.610289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.611095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.611873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.612331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.612757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.840567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:57.849787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac87898d-0b2f-4706-9689-9b235b09f3a0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.261970 Oct 13 08:39:57.850182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 888/1876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:57 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:57.879295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.880187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.886362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.887100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.887692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.888698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.889308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.890122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.917914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c38f55f2-90e9-4183-83f2-d5367eac05c0 tempest-ServersOnMultiNodesTest-45361405 tempest-ServersOnMultiNodesTest-45361405-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1619 microversion: 2.1 time: 0.360214 Oct 13 08:39:57.936562 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 989/1877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:57 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1619 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:57.962049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:57.962544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:57.974727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.975232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.975675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:57.976398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:57.976857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:57.977287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.060707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:39:58.176321 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49a3616c-d4a6-4239-a15c-b5d4645608c6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 204 len: 0 microversion: 2.1 time: 0.222573 Oct 13 08:39:58.177160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 990/1878] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:39:57 2022] DELETE /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:39:58.195537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:58.196341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:58.198625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.202875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.203376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.203815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.204533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.209211 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98d66f1f-3811-466d-8573-f12d0eceae1a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1471 microversion: 2.1 time: 0.334580 Oct 13 08:39:58.209872 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 889/1879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:57 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:58.211100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.211565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.304637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:58.305260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:58.319176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.319675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.320345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.324526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.326521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.327171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.496116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.510123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f181cf02-26fa-402d-bc0c-2a807a4c765c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1472 microversion: 2.1 time: 0.326484 Oct 13 08:39:58.527004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 991/1880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:58 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:58.561862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:58.562854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:58.583850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.584415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.584867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.591910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.592830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.596884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.839003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.851305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.853609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.855203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cac8e4f7-09ac-4a22-b6f2-63854eb84601 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.297782 Oct 13 08:39:58.856199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 992/1881] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:39:58 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:39:58.861940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:58.862790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:58.871519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.872393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.872994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.873877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.874660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.875898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.887554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:58.899314 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d37c313f-8f3a-45f2-be23-9b6f1571026f tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.598761 Oct 13 08:39:58.902481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 890/1882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:58 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:58.914911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced4b146-e702-4698-91c8-317b023a51d8", "tag": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:58.938047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:58.940806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:58.942112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:58.964338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] Creating event network-changed:4450a6dd-a5f6-46a1-b208-557cc2fab9c3 for instance ced4b146-e702-4698-91c8-317b023a51d8 on n-h1-858384-11 Oct 13 08:39:58.982578 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-27a1e745-1154-486f-9644-ede6c0c96a69 req-3e98e6ab-bc85-4d64-956e-0842b3b7a09c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078517 Oct 13 08:39:58.987936 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 891/1883] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:39:58.998228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:59.000150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:59.013140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.016101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.021333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:59.023061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.023772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.024392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:59.222645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:59.233942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4aae247-8d14-4703-9273-420f32e8ce8d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1536 microversion: 2.1 time: 0.376207 Oct 13 08:39:59.251262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 993/1884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:58 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1536 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:59.265103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:59.265728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:59.282256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.285992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.286490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:59.287430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.288041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.288625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:59.485192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:59.497777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd472e30-0250-4a26-a4e0-4a5bc439b063 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1471 microversion: 2.1 time: 0.244859 Oct 13 08:39:59.498577 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 994/1885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:59 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:59.509498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c08b0af-8af4-49b3-b97e-d1996cff748d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'create', calling method: .version_select at 0x7f537ab539d0>, body: {"pool": "e0c42a02-80b3-424e-a571-99b0953fb6b4"} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:39:59.588917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:39:59.597372 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-facca247-dcfb-4b64-a571-c863b73c5a45 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.607966 Oct 13 08:39:59.600780 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 892/1886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:58 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:39:59.617489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:39:59.618371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:39:59.625625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.628029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.631668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:39:59.632618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:39:59.633410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:39:59.634079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:00.501009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:00.516706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-481fb6f1-521d-44ac-9cef-1e8c755ba367 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1472 microversion: 2.1 time: 0.910979 Oct 13 08:40:00.518953 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 893/1887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:39:59 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1472 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:00.530813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:00.532327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:00.546581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:00.548539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:00.551212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:00.552322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:00.553023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:00.554690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:01.279742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:01.289101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:01.297232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:01.298532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c74c8177-d0c2-45bc-8524-76c9906a27ae tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.777809 Oct 13 08:40:01.299869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 894/1888] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:00 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:01.329855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:01.330663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:01.350305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:01.352310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:01.352957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:01.353415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:01.354220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:01.354703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:01.358542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:01.422578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:01.475454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:02.131209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:02.141342 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8768967-3d18-411d-acd6-f1ae9b498c5a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.819788 Oct 13 08:40:02.145792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 895/1889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:01 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:02.159576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:02.170283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:02.181307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:02.182094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:02.183518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:02.184485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:02.185126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:02.185745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:02.784174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:02.793165 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f930d930-3f0a-44a2-abb4-8a6063c0a1b3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.646011 Oct 13 08:40:02.797336 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 896/1890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:02 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:02.809000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:02.810154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:02.826760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:02.827622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:02.828318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:02.829265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:02.830555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:02.833052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:02.974514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=20 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:03.020223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=66 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:03.086763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.102176 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-359e61d6-0150-453b-9eee-7c475adf2606 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.301496 Oct 13 08:40:03.103076 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 897/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:02 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:03.107870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd594a67-d6c0-41e1-acfe-771e300d9d2a", "tag": "0a8fc691-4fb4-47e1-9616-4d5e67db36cf"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:03.135027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.140966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.141466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.174824 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] Creating event network-changed:0a8fc691-4fb4-47e1-9616-4d5e67db36cf for instance fd594a67-d6c0-41e1-acfe-771e300d9d2a on n-h2-858384-11 Oct 13 08:40:03.204679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f525ffb7-d9d4-45bc-8ce4-48bc307c188d req-4f4c1ab3-9ebc-42d3-8898-399a281008b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100163 Oct 13 08:40:03.206185 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 898/1892] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:03.230781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:03.232575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:03.248249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.249099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.249744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.250736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.251398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.252834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.342083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.352731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54085148-febf-42e8-b917-9ebb1aa84e0f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 200 len: 1430 microversion: 2.1 time: 0.143969 Oct 13 08:40:03.353568 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 899/1893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:03 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 1430 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:03.358875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:03.359874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:03.368335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.369339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.369973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.371086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.371733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.372670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.599798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c08b0af-8af4-49b3-b97e-d1996cff748d tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.099286 Oct 13 08:40:03.600928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 995/1894] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:39:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:03.610209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:03.614388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:03.628662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.629714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.632315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.634567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.635380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.636065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.767139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.781745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.789318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.795800 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76ad1032-2ffb-426b-bc64-d1c73525b674 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.440701 Oct 13 08:40:03.797759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 900/1895] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:03 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:03.817297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: .version_select at 0x7f5378f05940>, body: {"addFloatingIp": {"address": "172.25.6.215"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:03.821715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:03.834246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.834778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.850619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.851784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.852276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.852805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.944486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:03.953010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db2bab44-f702-4cb7-9b6d-e2355b3c0694 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.349823 Oct 13 08:40:03.953582 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 996/1896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:03 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:03.963402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:03.966927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:03.979604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.980240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.980533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:03.981251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:03.981712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:03.982138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:04.071699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:04.072370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquired lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:04.222571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:04.225296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:04.234941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b083234-1e67-4da9-858a-8e85369e6118 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.277246 Oct 13 08:40:04.235549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 997/1897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:03 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:04.247440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:04.247440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:04.257675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:04.258584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:04.259287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:04.260273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:04.260985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:04.261671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:04.462625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:04.475853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3be5fe44-c676-4850-a41a-332387d8bc3d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.238706 Oct 13 08:40:04.476694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 998/1898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:04 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:04.507819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-753682907", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "855f3368-1207-411b-b46e-0f9d164fb505"}], "block_device_mapping_v2": [{"uuid": "a272ffb6-caed-45a3-8c29-81cf687c276b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:04.622953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] validate_networks() for [('855f3368-1207-411b-b46e-0f9d164fb505', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:40:05.098581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:40:05.099171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:40:05.100055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:40:05.100996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:40:05.101523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:40:05.113912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.114726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.115570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.116630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.118803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.119476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.199628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:05.205122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Getting quotas for user c6b6dd069e4f4c57a9f41197a2cc25d5 and project 2bf01803eff94643b4ce733ab410ffcc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:40:05.310800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:40:05.314106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a272ffb6-caed-45a3-8c29-81cf687c276b',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:40:05.482270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8758fdde-1611-46d0-8244-d365cf6b96a2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989687 Oct 13 08:40:05.483370 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 999/1899] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:40:05.490000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:05.491281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 01b0defc-7c70-4e53-affb-e4ec35ea7d01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:05.499508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.500310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.500941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.502456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.503130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.503745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.530885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 HTTP/1.1 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:05.534570 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. Oct 13 08:40:05.536049 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '01b0defc-7c70-4e53-affb-e4ec35ea7d01'} Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:05.536869 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. Oct 13 08:40:05.540554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:05.542466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:05.543003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad6ccc3f-f9b0-450d-91e4-ab6b9fc8872c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01" status: 404 len: 111 microversion: 2.1 time: 0.058455 Oct 13 08:40:05.545346 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1000/1900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:05 2022] GET /compute/v2.1/servers/01b0defc-7c70-4e53-affb-e4ec35ea7d01 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:05.556683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:05.558697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:05.566672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.567168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.567603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.568313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.568768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.569195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.766059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:05.778238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:05.780377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:05.781917 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f271f03-8b4d-4281-ab32-49cb8949c59c tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.237115 Oct 13 08:40:05.782694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1001/1901] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:05 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:05.816499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:05.817519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:05.828709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.829563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.830230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:05.831638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:05.832671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:05.833671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.117856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:06.126720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd7d9e7c-cecc-4a19-a3f3-2ff2637731df tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.323609 Oct 13 08:40:06.127803 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1002/1902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:05 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:06.143812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b0defc-7c70-4e53-affb-e4ec35ea7d01", "name": "network-vif-deleted", "tag": "46b34fb2-d49a-44ad-83ea-21e5281276bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:06.170804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.171612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.172077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.227910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] Creating event network-vif-deleted:46b34fb2-d49a-44ad-83ea-21e5281276bb for instance 01b0defc-7c70-4e53-affb-e4ec35ea7d01 on n-h1-858384-11 Oct 13 08:40:06.235380 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-950ed546-1cbf-4495-b6fe-0b5f4d70ce7a req-a932b8ce-3121-48a5-8e7a-6573ddcf573c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106179 Oct 13 08:40:06.237139 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1003/1903] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:06.244545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:06.245580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:06.258033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.258869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.259492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.260380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.261010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.261627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.505540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:06.532856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5633dd06-254f-4ace-930f-00d6714a373d tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.291185 Oct 13 08:40:06.534591 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1004/1904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:06 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:06.541931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:06.546638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:06.567263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.568052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.569852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.570819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.573588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.574203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.731819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:06.743329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f82731a5-58fa-4189-90bc-19336674f7de tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1102 microversion: 2.1 time: 0.206461 Oct 13 08:40:06.775324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1005/1905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:06 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1102 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:06.801858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:06.803912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:06.840666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.841395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.841395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:06.842146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:06.842712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:06.843239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.027112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.037206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48ea4dbc-c686-44f7-bcad-9d8981895463 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.260354 Oct 13 08:40:07.055487 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1006/1906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:06 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:07.065972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:07.066837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:07.076670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.077445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.077817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.078699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.079170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.079602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.124952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:07.234642 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f2e1e0d-39eb-4f19-a9bf-690dba043386 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 204 len: 0 microversion: 2.1 time: 0.175107 Oct 13 08:40:07.235732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1007/1907] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:07 2022] DELETE /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:07.243784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:07.245195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:07.254727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.256321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.256944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.259353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.260136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.261838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.463061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.471796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.473236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.474414 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de5ffbfe-d181-42d7-a0f8-1492e9cdca80 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.236649 Oct 13 08:40:07.474986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1008/1908] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:07 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:07.479376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:07.479992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:07.485728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.486464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.487113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.487835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.488483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.488907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.624882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.632624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a48cd470-7231-4024-a0bf-58d722d5ab18 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.156607 Oct 13 08:40:07.633207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1009/1909] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:07 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:07.643338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:07.644232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:07.665577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.666386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.667049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.668071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.668965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.669658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.842748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:07.854764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41d06664-e9b3-4077-ba9a-0d87f92ff193 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1472 microversion: 2.1 time: 0.220235 Oct 13 08:40:07.855564 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1010/1910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:07 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:07.861027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:07.862522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:07.869013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.869646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.870096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:07.870897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:07.871521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:07.872185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.070305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.085079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79094c0a-3d20-4573-b215-84884e7e17a0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.222358 Oct 13 08:40:08.086109 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1011/1911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:07 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:08.091125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:08.091976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:08.116315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.116898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.117217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.118821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.119598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.120431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.204350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.214216 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1419b2c6-87c8-4f4e-93ed-7912b16dbb18 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1168 microversion: 2.1 time: 0.126513 Oct 13 08:40:08.215417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1012/1912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:08 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1168 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:08.220444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:08.221244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:08.228150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.228847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.229442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.230309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.230942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.231557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.244656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Building network info cache for instance {{(pid=127031) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:08.409026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.424164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-24392567-6951-46a7-9419-5b329ef83d6e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.201611 Oct 13 08:40:08.425180 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1013/1913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:08 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:08.434890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:08.456495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.456977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.459870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.489436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] Creating event network-changed:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:40:08.501470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c173015d-e85a-4c1a-b7ce-037bb028e641 req-cc667992-14a7-46d9-85a7-9be070bbea24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074982 Oct 13 08:40:08.505585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1014/1914] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:08.517754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:08.518569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:08.535365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.538518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.538972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.539694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.540150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.542077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.580041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:08.802906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.813607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.821276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:08.822939 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77b59942-9a63-4a83-9a30-23c55757bd98 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.316224 Oct 13 08:40:08.847222 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1015/1915] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:08 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:08.860464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:08.862371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:08.875678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.876173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.884697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:08.885588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:08.886078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:08.886548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.129201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:09.139274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc69fba6-04ec-4ecd-b780-15fc4428d9b6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.288433 Oct 13 08:40:09.140202 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1016/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:08 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:09.146884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:09.147545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:09.155936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.156429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.165315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.166327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.167185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.167284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.330320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:09.340659 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c560834-3cc6-4691-bcd8-0d30d97281db tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1472 microversion: 2.1 time: 0.199294 Oct 13 08:40:09.341572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1017/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:09 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:09.346813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:09.349052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:09.359955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.360448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.365075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.365914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.366595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.367038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.591400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:09.602560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-453c2455-3f87-40de-bad7-35ebb424fd7a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.259922 Oct 13 08:40:09.603459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1018/1918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:09 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:09.608297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:09.608915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:09.617036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.617530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.617964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.618695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.619148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.619570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.716996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:09.729644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99853d59-c5b5-48bc-b9d8-e442e08b6735 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1168 microversion: 2.1 time: 0.124452 Oct 13 08:40:09.730714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1019/1919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:09 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1168 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:09.737175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:09.737920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:09.745742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.746319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.746780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.747482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.748100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.749015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.942301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:09.951435 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb1916d4-9326-4e67-8487-35fd2344c032 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.219596 Oct 13 08:40:09.952611 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1020/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:09 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:09.958425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced4b146-e702-4698-91c8-317b023a51d8", "name": "network-vif-plugged", "status": "completed", "tag": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:09.968699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:09.969180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:09.969609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:09.983368 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] Creating event network-vif-plugged:4450a6dd-a5f6-46a1-b208-557cc2fab9c3 for instance ced4b146-e702-4698-91c8-317b023a51d8 on n-h1-858384-11 Oct 13 08:40:09.989383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-71742547-20b9-4b20-85bb-5802aa95832c req-e4d202fd-7d40-4f72-9c21-f428387c3cf2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035453 Oct 13 08:40:09.990349 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1021/1921] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:09.995816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:09.996524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:10.005189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.005689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.006181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.006928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.007495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.007928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.240164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:10.248920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:10.250357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:10.257793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e83cf5f-0ee7-44fc-9440-fdfb012f1cc5 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.266038 Oct 13 08:40:10.258423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1022/1922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:09 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:10.276350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:10.279039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:10.291211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:10.301593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.302102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.302685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.303426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.303888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.304320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.645971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:10.659768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b0ed8b1-4ce3-4a9b-9615-c905634a74e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1324 microversion: 2.1 time: 0.400044 Oct 13 08:40:10.660656 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1023/1923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:10 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:10.668425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:10.679989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:10.701242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.702082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.702806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.703832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:10.704724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:10.705425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:10.968886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:10.982754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75accc10-9507-428c-9f5e-691ea9e5f65b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1472 microversion: 2.1 time: 0.316897 Oct 13 08:40:10.983601 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1024/1924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:10 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:11.002174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:11.003219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:11.013291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.014067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.014720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:11.015684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.020166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.020818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:11.355207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Updating instance_info_cache with network_info: [{"id": "81ee0f20-6261-4cea-a5dd-041c6ebab29d", "address": "fa:16:3e:47:3d:fa", "network": {"id": "ab2d0432-22c2-4e94-a25e-3539564c7afd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1886475218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a95bfc5f5faf4f5eabe4898240643be0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap81ee0f20-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:11.377371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Releasing lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:11.378589 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5b7d192-ed5f-46ca-9d8c-d0100e52b86e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 202 len: 0 microversion: 2.1 time: 7.579263 Oct 13 08:40:11.382353 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 901/1925] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:03 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 0 bytes in 7581 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:11.394644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:11.395191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:11.403996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.404891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.405582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:11.407483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.408923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.409719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:11.542214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:11.558104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4eabce0b-64fa-4bd0-9719-93eb51172073 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1168 microversion: 2.1 time: 0.176674 Oct 13 08:40:11.559798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 902/1926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:11 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1168 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:11.571509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:11.574076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:11.591252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.595046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.596160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:11.597337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:11.599737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:11.600295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:12.259935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:12.270827 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5918ca44-2ac4-4ab6-83d5-e28476904617 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.708487 Oct 13 08:40:12.273423 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 903/1927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:11 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:12.275861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:12.288018 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f654e117-a4df-41df-85f3-3639094e1070 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 1.303160 Oct 13 08:40:12.295387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1025/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:10 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:12.309137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8d330d5-1ee7-4dfc-a7d0-d886ffeaf802 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'create', calling method: .version_select at 0x7f53765190d0>, body: {"pool": "e0c42a02-80b3-424e-a571-99b0953fb6b4"} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:12.314555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:12.315216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:12.332435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:12.335726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:12.336627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:12.338855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:12.340854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:12.341633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:12.353132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:12.796783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:12.825924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:12.827790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:12.829092 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64724262-cd10-444c-831b-3903675f3505 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.552058 Oct 13 08:40:12.864623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 904/1929] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:12 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:12.891361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:12.894607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:12.915525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:12.918772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:12.920033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:12.921793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:12.924008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:12.924964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.234859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:13.247508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0884fc4-33a7-416c-bc68-5a5c0b73ba47 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 200 len: 1520 microversion: 2.1 time: 0.379134 Oct 13 08:40:13.248518 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 905/1930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:12 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:13.259563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17056bd5-ec05-4c20-81df-d385b5cde907", "name": "network-vif-deleted", "tag": "2e536c2b-39db-43db-bbff-14690bc69b0b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:13.292212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.293148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.293810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.339055 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] Creating event network-vif-deleted:2e536c2b-39db-43db-bbff-14690bc69b0b for instance 17056bd5-ec05-4c20-81df-d385b5cde907 on n-h2-858384-11 Oct 13 08:40:13.346708 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a2ce32e1-ddfe-469e-8de8-a3344ad53f2f req-f498b0ad-acf1-4e76-90dc-4e99d5138240 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094387 Oct 13 08:40:13.348581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 906/1931] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:13.357676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:13.358520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:13.369507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.370270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.371149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.372168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.373034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.373763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.438231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.439550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.440242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.440910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lazy-loading 'fault' on Instance uuid 17056bd5-ec05-4c20-81df-d385b5cde907 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:13.512595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:13.525492 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4dbc78d6-54d7-4d41-bc06-eaef424dc336 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 200 len: 1306 microversion: 2.1 time: 0.175264 Oct 13 08:40:13.526612 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 907/1932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:13 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 1306 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:13.531362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd594a67-d6c0-41e1-acfe-771e300d9d2a", "name": "network-vif-plugged", "status": "completed", "tag": "0a8fc691-4fb4-47e1-9616-4d5e67db36cf"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:13.557598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.558474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.559155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.590069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] Creating event network-vif-plugged:0a8fc691-4fb4-47e1-9616-4d5e67db36cf for instance fd594a67-d6c0-41e1-acfe-771e300d9d2a on n-h2-858384-11 Oct 13 08:40:13.599221 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f3878787-d5bc-41a3-9fe4-cf1bab699e92 req-b5ee59c8-eff6-40c0-8e4d-fe27a444d60a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070808 Oct 13 08:40:13.601202 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 908/1933] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:13.610439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:13.612263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:13.630699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.631460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.632314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.633206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:13.633827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:13.634773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:13.981527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:13.996166 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27b05d51-08ef-4658-b4e0-c7a7a9b4be00 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1210 microversion: 2.1 time: 0.391508 Oct 13 08:40:13.997924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 909/1934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:13 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1210 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:14.011428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.118"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:14.034051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:14.055860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:14.057680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:14.058801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:14.061256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:14.062285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:14.065402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:14.119410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:14.119835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquired lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:15.152226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:15.215123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:15.227184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8d330d5-1ee7-4dfc-a7d0-d886ffeaf802 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.930680 Oct 13 08:40:15.228514 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1026/1935] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:40:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:15.233664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:15.234589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:15.252135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.252762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.253318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.254183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.254760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.255291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.451686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:15.460417 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-decb75e0-de25-4d3d-9ab1-55fdb8375f93 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1308 microversion: 2.1 time: 0.230534 Oct 13 08:40:15.461000 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1027/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:15 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:15.474681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:15.475909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:15.482282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.483593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.484234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.485126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.485953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.486581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.685302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:15.696431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-412e07f3-c778-485b-a487-c2a45fba6ffd tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.232430 Oct 13 08:40:15.697770 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1028/1937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:15 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:15.704506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:15.705443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:15.713676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.714602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.715286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.716307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.717126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.717784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.935718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:15.946807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:15.948380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:15.949645 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce52b801-b911-42c5-9b3d-12d34802ba68 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.249944 Oct 13 08:40:15.950509 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1029/1938] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:15 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:15.955706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:15.956602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 17056bd5-ec05-4c20-81df-d385b5cde907] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:15.963624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.964134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.965176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.965929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:15.966397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:15.966859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:15.984752 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 HTTP/1.1 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:15.987055 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. Oct 13 08:40:15.988441 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '17056bd5-ec05-4c20-81df-d385b5cde907'} Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:15.989235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. Oct 13 08:40:15.990564 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:15.991821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance 17056bd5-ec05-4c20-81df-d385b5cde907 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:15.991821 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7453675c-5d7b-4eb5-9d3b-f4233c23b6f0 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907" status: 404 len: 111 microversion: 2.1 time: 0.037079 Oct 13 08:40:15.992565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1030/1939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:15 2022] GET /compute/v2.1/servers/17056bd5-ec05-4c20-81df-d385b5cde907 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:15.998003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:15.999038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:16.007137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:16.007962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:16.008569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:16.009464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:16.010100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:16.011545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:16.191884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:16.202348 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2268011c-6fc7-4c48-ab22-f175b7136150 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1210 microversion: 2.1 time: 0.208439 Oct 13 08:40:16.203635 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1031/1940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:15 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:16.223910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: .version_select at 0x7f5378f05940>, body: {"addFloatingIp": {"address": "172.25.6.25"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:16.227744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:16.235658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:16.237202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:16.238222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:16.239496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:16.239979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:16.240799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:16.317667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:16.318065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquired lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:16.441004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Building network info cache for instance {{(pid=127031) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:16.851644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4.", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:40:16.852246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Releasing lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:16.852805 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.852805 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Request method failure captured: Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action HTTP/1.1 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 45 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87ImFWfFj4xcmy1brWywvigV3RIEs50DcE5YENSgC_s-QOBC6Q0tvy_AwJj6U87n9gqjkil0S8J4akgFzG_y5-L4LKKOagIMKtcSnzsRBIRxtJZBdxiK2xHcTjwX8gP1dExOC2v3iOhdDNDFL6jDpJLSPdsPif0aGngr5R2aR8gc-E Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:16.855052 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4a13b393175b41c187ed4152cc68fcde Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: {"addFloatingIp": {"address": "172.25.6.25"}} Oct 13 08:40:16.856473 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '19f284a8-c4dd-4b1d-af12-91d0a6fc694a', 'body': {'addFloatingIp': {'address': '172.25.6.25'}}} Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.857982 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:40:16.859184 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.861847 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.864127 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Returning 400 to user: Cannot associate floating IP 172.25.6.25 (3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e) with port 81ee0f20-6261-4cea-a5dd-041c6ebab29d using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network e0c42a02-80b3-424e-a571-99b0953fb6b4. Oct 13 08:40:16.867157 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-52debf16-6ef0-4f77-8f61-67057466f34f'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:16.869981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a1280073-8afb-40bc-8348-bfac4de68ec8 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 400 len: 381 microversion: 2.1 time: 0.651085 Oct 13 08:40:16.869981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1032/1941] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:16 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 381 bytes in 652 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:40:16.869981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8b162b-28d9-4ce6-991e-4635698868d5", "tag": "57980b93-8481-47df-a105-363dfd4c0e88"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:16.879052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:16.880299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:16.880740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:16.896484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] Creating event network-changed:57980b93-8481-47df-a105-363dfd4c0e88 for instance 8d8b162b-28d9-4ce6-991e-4635698868d5 on n-h1-858384-11 Oct 13 08:40:16.903684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0c64aa31-23e6-4a12-86d2-044087deb70b req-2bd86364-195b-4e65-b039-cc6c6bc26372 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041230 Oct 13 08:40:16.904063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1033/1942] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:17.081853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1304670176", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "48d21247-c279-46a5-af39-ba637e6edd7e"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:17.145246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] validate_networks() for [('48d21247-c279-46a5-af39-ba637e6edd7e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:40:17.714703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:40:17.715301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:40:17.715601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:40:17.716018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:40:17.716432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:40:17.728931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:17.729752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:17.730467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:17.731732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:17.732363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:17.733072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:17.756239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Getting quotas for project 9c6e04832f194172aacf67b86121a577. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:17.761457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Getting quotas for user 8469651ecf4d45e88f6879a83db0d9af and project 9c6e04832f194172aacf67b86121a577. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:40:17.803676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:40:17.806914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:40:17.897140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eabde22c-c720-4f31-8ce2-3c2ab8e631ec tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991546 Oct 13 08:40:17.899806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1034/1943] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:40:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:40:17.911632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:17.913139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:17.946712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:17.947912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:17.948878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:17.951078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:17.953143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:17.953733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:17.964236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Updating instance_info_cache with network_info: [{"id": "79bd3729-0c62-4a5c-bb33-7d89f598c293", "address": "fa:16:3e:53:97:53", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79bd3729-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:17.984116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Releasing lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:17.985378 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d1482f6e-f11b-4e6b-aa0a-836150bc49d8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action" status: 202 len: 0 microversion: 2.1 time: 3.985758 Oct 13 08:40:17.987254 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 910/1944] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:13 2022] POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action => generated 0 bytes in 3989 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:18.002223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:18.003314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:18.008172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:18.019409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.020171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.020742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.021564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.022668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.029897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.063829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:18.171236 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-55e52ff0-6c77-4d61-81aa-139606116518 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 204 len: 0 microversion: 2.1 time: 0.268053 Oct 13 08:40:18.179334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1035/1945] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:17 2022] DELETE /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:18.187141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:18.188746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:18.200673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.201649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.202436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.205145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.206653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.207523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.265490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:18.279686 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d8ebbd6b-9818-4450-b760-1ed6c04262a1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1489 microversion: 2.1 time: 0.291028 Oct 13 08:40:18.281711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 911/1946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:17 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1489 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:18.293809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7537a270-99f2-4ac4-85c5-a69b95adc1cb tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '.version_select at 0x7f53760c28b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:18.457933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:18.468068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbcd5d7a-22cc-48a9-b7f8-9ec08d0a9855 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1476 microversion: 2.1 time: 0.286363 Oct 13 08:40:18.469290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1036/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:18 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:18.483317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:18.486077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:18.503891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.504741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.505216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.508175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.508825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.509921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.744364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:18.761812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:18.764131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:18.765767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-152afe0e-6cd8-462e-8057-cb1dcb681b59 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.295208 Oct 13 08:40:18.767554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1037/1948] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:18 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:18.964787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:18.965502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:18.974788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.975832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.976469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:18.977453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:18.978019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:18.978534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.531128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7537a270-99f2-4ac4-85c5-a69b95adc1cb tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e" status: 202 len: 0 microversion: 2.1 time: 1.246187 Oct 13 08:40:19.532799 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 912/1949] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:40:18 2022] DELETE /compute/v2.1/os-floating-ips/3ea83d74-6460-4fa1-a7df-ddbdb95c8c0e => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:19.538180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:19.541429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:19.555629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.556543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.557308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.558322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.559259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.560010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.613250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:19.632840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dfda1d82-1149-48f6-bb5d-dc8b841fe8dc tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1198 microversion: 2.1 time: 0.863822 Oct 13 08:40:19.646172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1038/1950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:18 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1198 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:19.646172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.118"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:19.651844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:19.662994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.663533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.664449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.665939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.666545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.666891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.671879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:19.683233 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-076a6477-7c95-400d-92a9-d97e158ad3e1 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1268 microversion: 2.1 time: 0.148272 Oct 13 08:40:19.684509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 913/1951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:19 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:19.698006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:19.699458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquired lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:19.703994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:19.704951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:19.716351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.717573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.718257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.719357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.720238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.721006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.931063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:19.941353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec316ad8-8cba-4470-988f-14da81d99c66 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 200 len: 1472 microversion: 2.1 time: 0.255397 Oct 13 08:40:19.941954 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 914/1952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:19 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:19.946534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:19.947065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:19.953013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.953494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.954103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.955046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:19.955500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:19.956601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:19.983286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lazy-loading 'flavor' on Instance uuid fd594a67-d6c0-41e1-acfe-771e300d9d2a {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:20.071377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-390c9a20-fd0f-4cd4-969d-3dfe5d40c38b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.128044 Oct 13 08:40:20.072019 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 915/1953] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:19 2022] POST /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:20.078003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}, {"server_uuid": "a1f51160-5f0d-4b85-a628-0194d8f61795", "name": "network-vif-unplugged", "status": "completed", "tag": "1efdc19f-e051-499b-9ab1-0b30431e4c19"}, {"name": "network-changed", "server_uuid": "a1f51160-5f0d-4b85-a628-0194d8f61795", "tag": "1efdc19f-e051-499b-9ab1-0b30431e4c19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:20.089528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:20.090032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:20.090508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:20.103856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Creating event network-changed:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:40:20.104367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Creating event network-vif-unplugged:1efdc19f-e051-499b-9ab1-0b30431e4c19 for instance a1f51160-5f0d-4b85-a628-0194d8f61795 on n-h1-858384-11 Oct 13 08:40:20.104865 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] Creating event network-changed:1efdc19f-e051-499b-9ab1-0b30431e4c19 for instance a1f51160-5f0d-4b85-a628-0194d8f61795 on n-h1-858384-11 Oct 13 08:40:20.112024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-50221822-1585-4e90-ac84-d153c5ce8bcd req-85af3ba9-3f46-433c-a04e-ae12ea6d9d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.037925 Oct 13 08:40:20.112638 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 916/1954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:20.117957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:20.118519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:20.124576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:20.125062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:20.125544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:20.126210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:20.126736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:20.127172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:20.544009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:20.575417 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f9df36b7-73be-44ea-abc6-34368f5114c6 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1475 microversion: 2.1 time: 0.461563 Oct 13 08:40:20.577940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 917/1955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:20 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:20.591487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: .version_select at 0x7f5378f05a60>, body: {"removeFloatingIp": {"address": "172.25.6.215"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:21.403955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:21.413781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:21.414728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:21.415335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:21.417078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:21.417926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:21.419384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:22.021560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:22.022141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquired lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:22.121979 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.network.neutron [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] re-assign floating IP 172.25.6.118 from instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c Oct 13 08:40:22.173294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Building network info cache for instance {{(pid=127030) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:23.828100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Updating instance_info_cache with network_info: [{"id": "79bd3729-0c62-4a5c-bb33-7d89f598c293", "address": "fa:16:3e:53:97:53", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79bd3729-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:23.845816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Building network info cache for instance {{(pid=127030) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:24.362174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Building network info cache for instance {{(pid=127031) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:24.853784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Updating instance_info_cache with network_info: [{"id": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3", "address": "fa:16:3e:fc:f4:67", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4450a6dd-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:24.872017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Releasing lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:24.873803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-274deca8-e1e1-46e0-99ab-1c4f6cf87f89 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8/action" status: 202 len: 0 microversion: 2.1 time: 5.235782 Oct 13 08:40:24.874577 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1039/1956] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:19 2022] POST /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8/action => generated 0 bytes in 5237 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:24.898594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:24.899352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:24.905916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:24.906418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:24.907070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:24.909101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:24.911044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:24.915755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.474566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:25.493573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:25.503202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:25.504931 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dac7a082-cd5a-4b15-825f-5ce573e9e32e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.625494 Oct 13 08:40:25.518988 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1040/1957] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:24 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:25.529854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:25.530828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:25.537905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.538904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.539527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.540457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.541170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.541773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.699430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Updating instance_info_cache with network_info: [{"id": "81ee0f20-6261-4cea-a5dd-041c6ebab29d", "address": "fa:16:3e:47:3d:fa", "network": {"id": "ab2d0432-22c2-4e94-a25e-3539564c7afd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1886475218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a95bfc5f5faf4f5eabe4898240643be0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap81ee0f20-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:25.725904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Releasing lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:25.728237 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5248c975-babb-4148-b101-753adaf1af2e tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 202 len: 0 microversion: 2.1 time: 5.146562 Oct 13 08:40:25.730127 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 918/1958] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:20 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 0 bytes in 5151 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:25.752565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:25.753751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:25.768983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.770575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.771833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.777175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.778432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.779950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.908389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:25.918237 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8abbb77c-5164-41d7-8ac0-692c29635ab5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 200 len: 1480 microversion: 2.1 time: 0.397759 Oct 13 08:40:25.918874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1041/1959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:25 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 1480 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:25.928006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:25.939280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:25.947937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.948436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.948877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:25.949598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:25.950057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:25.950523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.063408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:26.073346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7780c815-79b9-465d-ac60-3f10a0051541 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1198 microversion: 2.1 time: 0.341601 Oct 13 08:40:26.080950 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 919/1960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:25 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1198 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:26.095911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:26.097807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: fcd01630-b038-41bb-a84c-179de465ec18] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:26.105213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.105911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.106344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.117145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.117635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.118079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.120892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:26.123105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:26.131481 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dfabfd2c-44ff-4cc0-84ad-45c5387db3bb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1316 microversion: 2.1 time: 0.209097 Oct 13 08:40:26.132080 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1042/1961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:25 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:26.137083 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. Oct 13 08:40:26.138067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:26.138905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 HTTP/1.1 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:26.139307 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. Oct 13 08:40:26.141172 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fcd01630-b038-41bb-a84c-179de465ec18'} Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:26.142832 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. Oct 13 08:40:26.144426 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.145818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance fcd01630-b038-41bb-a84c-179de465ec18 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:26.145818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e38d733-469a-4742-b3cc-60be3b25ba30 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18" status: 404 len: 111 microversion: 2.1 time: 0.058417 Oct 13 08:40:26.145818 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 920/1962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:26 2022] GET /compute/v2.1/servers/fcd01630-b038-41bb-a84c-179de465ec18 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:26.150580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:26.154520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.155218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.155869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.156955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.158634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.159303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.163887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.164382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.164962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.184034 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] Creating event network-changed:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:40:26.189844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d4b39ea5-4e52-464a-9d13-a074796a78d1 req-488f1abb-5c03-4cfc-af87-a4d502c9469d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043307 Oct 13 08:40:26.191580 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 921/1963] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:26.197898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-unplugged", "status": "completed", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}, {"server_uuid": "fcd01630-b038-41bb-a84c-179de465ec18", "name": "network-vif-deleted", "tag": "2ac65194-62c6-432b-9379-43a28688197e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:26.212622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.213108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.213545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.229777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Creating event network-vif-unplugged:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h2-858384-11 Oct 13 08:40:26.230762 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Creating event network-vif-deleted:2ac65194-62c6-432b-9379-43a28688197e for instance fcd01630-b038-41bb-a84c-179de465ec18 on n-h2-858384-11 Oct 13 08:40:26.237474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] Instance 9900ef64-6643-4731-a77c-7616ae962172 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:40:26.251531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d1527c13-f2f0-4969-9d08-1eb7583ece37 req-47157f0a-a25b-4526-ac74-2e1ea5744b2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.057769 Oct 13 08:40:26.252483 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 922/1964] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:26.257995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.118"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:26.310673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:26.318778 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79b8e480-554e-4d2d-9a2a-1b07f8818f50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1473 microversion: 2.1 time: 0.185614 Oct 13 08:40:26.319655 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1043/1965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:26 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:26.325017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c10cf1e6-3be9-4379-bf97-5b9d66c08558 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '.version_select at 0x7f5376612af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:26.491468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:26.498357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.499027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.499569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.500574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.501170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.501674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.725533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] HTTP exception thrown: Floating IP 172.25.6.118 is not associated with instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c. Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Request method failure captured: Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action HTTP/1.1 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 49 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR86vBgBby5dYRAHWU3g_IeC94r_2kEXozaZBAaypYAJCNfIgXx4fNwD6nQ3A0IpgSxwxKJsvTDUU5L_7Xn45mSNTs2jSJbEH9t0-uXLN1j09eLG_vXip2j6UYwJ9TO2XT01uvcYZ5swgikQR86A3dHEO-nyisEutOJLb5Ffo603SoFc Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:26.727511 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6c80df12b5d942c89bae1c87e269f8bb Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: {"removeFloatingIp": {"address": "172.25.6.118"}} Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:40:26.729273 n-d-858384-11 devstack@n-api.service[127031]: exception: Floating IP 172.25.6.118 is not associated with instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c. Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b210ff6d-0782-485d-8c1d-0ad5e376ad2c', 'body': {'removeFloatingIp': {'address': '172.25.6.118'}}} Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.118 is not associated with instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c. Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.730757 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.118 is not associated with instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c. Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Returning 409 to user: Floating IP 172.25.6.118 is not associated with instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9456c029-3046-4360-a45b-c37732ef9e87 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action" status: 409 len: 146 microversion: 2.1 time: 0.476053 Oct 13 08:40:26.732504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 923/1966] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:26 2022] POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action => generated 146 bytes in 478 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:40:26.739840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-94846081"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:26.742643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:26.750558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.751685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.752197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.752974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:26.753648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:26.754285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:26.997354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-246854c5-c7de-44f3-89ea-403c63780806 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.261267 Oct 13 08:40:26.998317 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 924/1967] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:26 2022] POST /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:40:27.004496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.005295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.012060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.012541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.012967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.013656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.014098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.014538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.047267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:27.110274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c10cf1e6-3be9-4379-bf97-5b9d66c08558 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2bc8d660-c308-4c20-a05a-e0ff35e98b1c" status: 202 len: 0 microversion: 2.1 time: 0.789397 Oct 13 08:40:27.114186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1044/1968] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:40:26 2022] DELETE /compute/v2.1/os-floating-ips/2bc8d660-c308-4c20-a05a-e0ff35e98b1c => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:27.127896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.128647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.135979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.136677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.137413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.138296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.138933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.139525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.149403 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-389c4363-d303-4abf-a8b8-fe84868f46ed tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 204 len: 0 microversion: 2.1 time: 0.149332 Oct 13 08:40:27.150626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 925/1969] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:26 2022] DELETE /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:27.159379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.118"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:27.277376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.285365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.286561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.288061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.289494 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7bcd76b5-f1bf-4770-a2bb-0fa5e0acdab0 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.174346 Oct 13 08:40:27.290152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1045/1970] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:27 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:27.292541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.293021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.293454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.294376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.294529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8b162b-28d9-4ce6-991e-4635698868d5", "name": "network-vif-plugged", "status": "completed", "tag": "57980b93-8481-47df-a105-363dfd4c0e88"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:27.294855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.295276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.306049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.306889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.307558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.319188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] Creating event network-vif-plugged:57980b93-8481-47df-a105-363dfd4c0e88 for instance 8d8b162b-28d9-4ce6-991e-4635698868d5 on n-h1-858384-11 Oct 13 08:40:27.324405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-da36d907-1ce2-405c-a03a-295d51699af2 req-f6bc335d-b7f4-4f4a-af70-e8d4bbc02741 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Oct 13 08:40:27.324992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1046/1971] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:27.330026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca5889a4-6fd1-42f7-92e5-f3759fd45092 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53765a0040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.373880 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca5889a4-6fd1-42f7-92e5-f3759fd45092 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.047719 Oct 13 08:40:27.374468 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1047/1972] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:27 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:27.379215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.379924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.386505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.386778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.387217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.387923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.388473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.388907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.502176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:27.502620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquired lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:27.519867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.527775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7544b967-0ce4-4d35-8b0c-e749b9d76680 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1198 microversion: 2.1 time: 0.152362 Oct 13 08:40:27.528342 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1048/1973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:27 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1198 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f98c4ef7-684f-4add-8608-9a1f0c7e7745 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f98c4ef7-684f-4add-8608-9a1f0c7e7745 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Request method failure captured: Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action HTTP/1.1 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 34 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87ImFWfFj4xcmy1brWywvigV3RIEs50DcE5YENSgC_s-QOBC6Q0tvy_AwJj6U87n9gqjkil0S8J4akgFzG_y5-L4LKKOagIMKtcSnzsRBIRxtJZBdxiK2xHcTjwX8gP1dExOC2v3iOhdDNDFL6jDpJLSPdsPif0aGngr5R2aR8gc-E Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:27.538678 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4a13b393175b41c187ed4152cc68fcde Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: {"addFloatingIp": {"address": ""}} Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:40:27.540406 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '19f284a8-c4dd-4b1d-af12-91d0a6fc694a', 'body': {'addFloatingIp': {'address': ''}}} Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi '' Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:27.541456 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:40:27.550143 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f98c4ef7-684f-4add-8608-9a1f0c7e7745 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f98c4ef7-684f-4add-8608-9a1f0c7e7745 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 400 len: 142 microversion: 2.1 time: 0.009666 Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1049/1974] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:27 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:40:27.552291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.553179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.554743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.555228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.555659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.556368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.556818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.557240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.690734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.701410 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f4bc28a-55a5-4aa0-875c-9ae1157eb35b tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1316 microversion: 2.1 time: 0.160971 Oct 13 08:40:27.702157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1050/1975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:27 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:27.708591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.709569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.718684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.719355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.720534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.721258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.721718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.722151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.747160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:27.750129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:27.775189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:27.776126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:27.828095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c036a9be-d6ce-443e-acb7-ff17bef9c505 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 204 len: 0 microversion: 2.1 time: 0.124496 Oct 13 08:40:27.828691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1051/1976] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:27 2022] DELETE /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:27.834567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:27.835593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:27.842028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.842571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.843015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.843757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:27.844203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:27.844668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:27.977575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:27.987884 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c811cf39-62cd-4bb9-a499-1635552f0338 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1473 microversion: 2.1 time: 0.157478 Oct 13 08:40:27.988487 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1052/1977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:27 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1473 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:28.004341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:28.007334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:28.013871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.014371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.014872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.015597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.016055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.016483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.047630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:28.048131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquired lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:28.150508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Releasing lock "refresh_cache-19f284a8-c4dd-4b1d-af12-91d0a6fc694a" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:28.151106 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] HTTP exception thrown: floating IP not found Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Request method failure captured: Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action HTTP/1.1 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 41 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87ImFWfFj4xcmy1brWywvigV3RIEs50DcE5YENSgC_s-QOBC6Q0tvy_AwJj6U87n9gqjkil0S8J4akgFzG_y5-L4LKKOagIMKtcSnzsRBIRxtJZBdxiK2xHcTjwX8gP1dExOC2v3iOhdDNDFL6jDpJLSPdsPif0aGngr5R2aR8gc-E Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:28.152782 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4a13b393175b41c187ed4152cc68fcde Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:40:28.154471 n-d-858384-11 devstack@n-api.service[127030]: exception: floating IP not found Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '19f284a8-c4dd-4b1d-af12-91d0a6fc694a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:28.155484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 13 08:40:28.156779 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.158155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Returning 404 to user: floating IP not found {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:28.158155 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bf8345e-93e3-46ee-902d-91140a6baac0 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 404 len: 67 microversion: 2.1 time: 0.154713 Oct 13 08:40:28.158155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1053/1978] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:27 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 67 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:40:28.169183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:28.169827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:28.176244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.176736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.177537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.178254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.178730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.179158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.372466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:28.380877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42cf3b02-874c-40b9-986e-4351b804a898 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 200 len: 1475 microversion: 2.1 time: 0.225135 Oct 13 08:40:28.381456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1054/1979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:28 2022] GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 1475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:28.385967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11864043-ac97-4dc7-85b8-3b074e58587b tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Action: 'action', calling method: .version_select at 0x7f5378f05a60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:28.439258 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-11864043-ac97-4dc7-85b8-3b074e58587b tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11864043-ac97-4dc7-85b8-3b074e58587b tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Request method failure captured: Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action HTTP/1.1 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 44 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87ImFWfFj4xcmy1brWywvigV3RIEs50DcE5YENSgC_s-QOBC6Q0tvy_AwJj6U87n9gqjkil0S8J4akgFzG_y5-L4LKKOagIMKtcSnzsRBIRxtJZBdxiK2xHcTjwX8gP1dExOC2v3iOhdDNDFL6jDpJLSPdsPif0aGngr5R2aR8gc-E Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:28.441575 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4a13b393175b41c187ed4152cc68fcde Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:40:28.443631 n-d-858384-11 devstack@n-api.service[127030]: exception: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '19f284a8-c4dd-4b1d-af12-91d0a6fc694a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:28.444853 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 13 08:40:28.446302 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:28.447712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11864043-ac97-4dc7-85b8-3b074e58587b tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:28.447712 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11864043-ac97-4dc7-85b8-3b074e58587b tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action" status: 404 len: 88 microversion: 2.1 time: 0.060854 Oct 13 08:40:28.449183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1055/1980] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:28 2022] POST /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a/action => generated 88 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:40:28.453367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced4b146-e702-4698-91c8-317b023a51d8", "tag": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3"}, {"name": "network-changed", "server_uuid": "da3335e3-480e-4857-a4fd-876a44e8f1be", "tag": "2555fbeb-68bc-4af1-8b38-a381e1ee9e19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:28.466811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.467298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.467735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.480874 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Creating event network-changed:4450a6dd-a5f6-46a1-b208-557cc2fab9c3 for instance ced4b146-e702-4698-91c8-317b023a51d8 on n-h1-858384-11 Oct 13 08:40:28.481385 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] Creating event network-changed:2555fbeb-68bc-4af1-8b38-a381e1ee9e19 for instance da3335e3-480e-4857-a4fd-876a44e8f1be on n-h1-858384-11 Oct 13 08:40:28.488487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2f617b6e-9152-4c5b-9be8-d202e2fc3bbb req-6e6fd0c7-08bb-431f-9777-14227531954d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038836 Oct 13 08:40:28.489086 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1056/1981] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:28.493977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}, {"name": "network-changed", "server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:28.505688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.506167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.506664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.523270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Creating event network-changed:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h2-858384-11 Oct 13 08:40:28.523941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Creating event network-changed:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:40:28.529710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] Instance 9900ef64-6643-4731-a77c-7616ae962172 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:40:28.545080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4ff5d0c7-e671-49d1-bc7d-4b42eaeb5cb2 req-810b25bd-65bf-47e0-91ef-0f89b17b2bf3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054581 Oct 13 08:40:28.545892 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1057/1982] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:28.547207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Building network info cache for instance {{(pid=127031) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:28.551652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:28.552355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:28.559560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.559999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.560424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.561415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.562073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.562380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.729373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:28.740465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:28.742069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:28.749872 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cd5f3fa-f338-4f76-b961-3dbb03e5d370 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.202952 Oct 13 08:40:28.752798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1058/1983] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:28 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:28.763380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2abb9eef-af28-4c84-9009-92d62fe5a339 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53765a0820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:28.860212 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2abb9eef-af28-4c84-9009-92d62fe5a339 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.106228 Oct 13 08:40:28.878694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1059/1984] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:28 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:28.884586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:28.885027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:28.898660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.899164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.899670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.900398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:28.900854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:28.901286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:28.950512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:29.068378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-032aeb8e-be58-4f00-ba22-5135ad008134 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 204 len: 0 microversion: 2.1 time: 0.188250 Oct 13 08:40:29.070873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1060/1985] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:28 2022] DELETE /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:29.084171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.084889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.091356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.091849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.092289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.093008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.093465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.093893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.243926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:29.252241 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4896052a-c415-4208-8b8c-2c29f84bca11 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1198 microversion: 2.1 time: 0.179541 Oct 13 08:40:29.267252 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1061/1986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:29 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1198 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:29.273438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.274061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.280236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.280724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.281164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.281876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.282918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.283419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.311962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Updating instance_info_cache with network_info: [{"id": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3", "address": "fa:16:3e:fc:f4:67", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4450a6dd-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:29.331332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Releasing lock "refresh_cache-ced4b146-e702-4698-91c8-317b023a51d8" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:29.332278 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80505c74-3bd6-456f-8981-aa7e7a4d2e5d tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8/action" status: 202 len: 0 microversion: 2.1 time: 2.180071 Oct 13 08:40:29.332924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 926/1987] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:27 2022] POST /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8/action => generated 0 bytes in 2182 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:29.340755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.342018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.360042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.360836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.363564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.365152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.367020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.367616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.633122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:29.643023 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe1d5177-661f-42f1-b3d9-6eb6837e5bbe tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1473 microversion: 2.1 time: 0.308814 Oct 13 08:40:29.643916 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 927/1988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:29 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1473 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:29.649070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.649679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.657982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.658833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.659466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.660680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.661145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.661574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.764903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:29.777247 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8d3b64f-4f4d-4941-b4d2-d1ca3577042d tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1316 microversion: 2.1 time: 0.508637 Oct 13 08:40:29.777850 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1062/1989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:29 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:29.790916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.791707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.797472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:29.799123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.799833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.801855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.802886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.803677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.804309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.830443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:29.846850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:29.848842 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96e4f0ab-ec2e-4a53-8c0e-edc56578f7d5 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1542 microversion: 2.1 time: 0.203736 Oct 13 08:40:29.849610 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 928/1990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:29 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1542 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:29.858363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:29.859300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:29.868454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.869484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.870242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:29.871329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:29.872092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:29.872905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.006316 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8d871a6-7120-4ee1-9288-e3e718e411a8 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 204 len: 0 microversion: 2.1 time: 0.225864 Oct 13 08:40:30.015065 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1063/1991] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:29 2022] DELETE /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:30.021730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:30.022872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:30.030753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.031578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.032345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.033928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.035201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.036290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.158014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:30.166583 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cff3d18e-0610-4bd9-a6c1-4ab4279939ab tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 200 len: 1475 microversion: 2.1 time: 0.312194 Oct 13 08:40:30.167845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 929/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:29 2022] GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:30.173722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da9477c8-6b75-4c74-a6f2-6bd62b04257c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa14ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:30.225345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da9477c8-6b75-4c74-a6f2-6bd62b04257c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.055793 Oct 13 08:40:30.225932 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 930/1993] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:30 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:30.230623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.118"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:30.232990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:30.240688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.241179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.241625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.242333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.242827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.243255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.268960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:30.269395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquired lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:30.292221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:30.302017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:30.303673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:30.304914 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1bc90b2b-7983-45c8-abaa-a4494d312c5d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.288223 Oct 13 08:40:30.305742 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1064/1994] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:30 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:30.328671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:30.329435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:30.335802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.336356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.336865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.337640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.338440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.338626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.572266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:30.583868 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cde3c4c3-8e4a-4181-807a-e2a14db78b73 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1380 microversion: 2.1 time: 0.266735 Oct 13 08:40:30.584846 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1065/1995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:30 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1380 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:30.608337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e2c187-9fa4-4db0-986b-b99ac19b653b", "name": "network-vif-deleted", "tag": "ab68af6b-b5f2-448e-907d-790ed2c631d4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:30.619107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.619941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.620523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.632839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] Creating event network-vif-deleted:ab68af6b-b5f2-448e-907d-790ed2c631d4 for instance 96e2c187-9fa4-4db0-986b-b99ac19b653b on n-h1-858384-11 Oct 13 08:40:30.637756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-382202af-4dc5-410a-8684-073ba3e9dfaa req-dd6c28e9-2dda-4344-b4e0-fad710d31eff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038241 Oct 13 08:40:30.638356 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1066/1996] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:30.644426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced4b146-e702-4698-91c8-317b023a51d8", "tag": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:30.654249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.654911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.655303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.667606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] Creating event network-changed:4450a6dd-a5f6-46a1-b208-557cc2fab9c3 for instance ced4b146-e702-4698-91c8-317b023a51d8 on n-h1-858384-11 Oct 13 08:40:30.672941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-51ba5572-4204-4f6c-833d-a84c54876c66 req-f177765b-4355-4b3a-8fad-90061631d7ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033125 Oct 13 08:40:30.673691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1067/1997] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:30.678977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:30.679706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:30.688091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.688612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.689037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.690243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.690769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.691143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.848054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:30.851291 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8dcd1837-921d-4861-aca0-8110fc806e81 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1533 microversion: 2.1 time: 0.175824 Oct 13 08:40:30.852006 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1068/1998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:30 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1533 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:30.857063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:30.857774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:30.867031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.867669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.868219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:30.869572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:30.870370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:30.871091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:31.078975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:31.088069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4eaecd4d-d0ee-4401-a574-fe4f9a7fdcee tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1470 microversion: 2.1 time: 0.234928 Oct 13 08:40:31.088883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1069/1999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:30 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:31.094533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:31.095916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:31.102695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:31.103077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:31.103685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:31.104559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:31.105194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:31.105782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:31.257591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:31.268710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f96fd3da-86f2-4191-9872-e9fd06ecd1cb tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1316 microversion: 2.1 time: 0.178444 Oct 13 08:40:31.269746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1070/2000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:31 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:31.294297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:31.295076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:31.302982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:31.303819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:31.304541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:31.306014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:31.306777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:31.307378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:31.705019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Building network info cache for instance {{(pid=127031) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:32.048366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:32.057767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b490ac07-f3ba-405b-862e-c5c0428e254f tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1542 microversion: 2.1 time: 0.766941 Oct 13 08:40:32.066792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1071/2001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:31 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1542 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:32.078752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:32.079746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:32.086286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.087227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.087697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.088620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.089394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.090025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.455382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ba96484-f184-46d4-84c6-a7b7bf372e7c tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1533 microversion: 2.1 time: 0.386176 Oct 13 08:40:32.458653 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1072/2002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:32 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1533 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:32.466244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3335e3-480e-4857-a4fd-876a44e8f1be", "name": "network-vif-plugged", "status": "completed", "tag": "2555fbeb-68bc-4af1-8b38-a381e1ee9e19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:32.485395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.486505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.487640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.504953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] Creating event network-vif-plugged:2555fbeb-68bc-4af1-8b38-a381e1ee9e19 for instance da3335e3-480e-4857-a4fd-876a44e8f1be on n-h1-858384-11 Oct 13 08:40:32.511123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ca0df166-6781-404b-bafc-a3d57779aeac req-5a34653e-f6a3-4938-961d-9bc5bd115083 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050885 Oct 13 08:40:32.513384 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1073/2003] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:32.535626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:32.537904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:32.559399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.560373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.561123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.568180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.570800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.571287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.767528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0fd90326-7d37-44b9-9089-ce5adecebdfb tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "POST /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172/action" status: 202 len: 0 microversion: 2.1 time: 0.248317 Oct 13 08:40:32.768448 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1074/2004] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:32 2022] POST /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:32.773712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:32.774587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 96e2c187-9fa4-4db0-986b-b99ac19b653b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:32.781760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.782458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.782997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.783840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.784401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.784925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.816798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b HTTP/1.1 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:32.818578 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. Oct 13 08:40:32.821586 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '96e2c187-9fa4-4db0-986b-b99ac19b653b'} Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:32.823406 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. Oct 13 08:40:32.825332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:32.827079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance 96e2c187-9fa4-4db0-986b-b99ac19b653b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:32.827079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a433c027-fa0e-4afd-a56c-3fddc660b75f tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b" status: 404 len: 111 microversion: 2.1 time: 0.051512 Oct 13 08:40:32.827079 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1075/2005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:32 2022] GET /compute/v2.1/servers/96e2c187-9fa4-4db0-986b-b99ac19b653b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:32.831414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05dc0666-d720-4425-896e-53596469ac17 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53765a0b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:32.883718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05dc0666-d720-4425-896e-53596469ac17 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.058961 Oct 13 08:40:32.892866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1076/2006] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:32 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:32.893993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:32.894912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:32.902607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.903104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.903550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:32.904263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:32.904723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:32.905286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.399404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:33.417143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:33.421975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:33.423620 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eeabf5ec-572c-483b-be16-3ffad1ee4cdb tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.534802 Oct 13 08:40:33.434602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1077/2007] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:32 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:33.434602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:33.434602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:33.447846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.447846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.447846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.447846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.448378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.448801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.788820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:33.800685 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-246b828a-974d-4013-99ac-88435e08a856 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1316 microversion: 2.1 time: 0.373817 Oct 13 08:40:33.801467 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1078/2008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:33 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:33.809993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:33.813809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.814295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.814761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.815492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.815941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.817451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.853217 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-236c65a6-bf54-4009-aab5-c2e18db9026e tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050832 Oct 13 08:40:33.853849 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1079/2009] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 08:40:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:33.871540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:33.872150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:33.890307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.890950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.892021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:33.892738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:33.894457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:33.894457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.243004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:34.255154 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a407864-7850-4a9d-9728-dc6cafcc079a tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.387414 Oct 13 08:40:34.255741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1080/2010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:33 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:34.260683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:34.261474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:34.277041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.277664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.279103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.280150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.280689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.281187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.473324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:34.484502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f45bd56-1017-48bb-8b56-58877f7cf666 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1475 microversion: 2.1 time: 0.227243 Oct 13 08:40:34.486390 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1081/2011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:34 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:34.491604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:34.503066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.503954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.504815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.535010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] Creating event network-changed:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:40:34.541870 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e1447eb4-b510-475a-8199-0d0333567ca9 req-356b150c-3b09-4d41-a65e-64aa3b357670 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053557 Oct 13 08:40:34.543166 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1082/2012] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:34.550484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:34.551934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:34.553653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Updating instance_info_cache with network_info: [{"id": "79bd3729-0c62-4a5c-bb33-7d89f598c293", "address": "fa:16:3e:53:97:53", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79bd3729-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:34.560264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.561311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.561974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.562911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.564282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.564881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.571751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Releasing lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:34.572887 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a28c1c3-ff47-438c-a175-81bfe441d4e6 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action" status: 202 len: 0 microversion: 2.1 time: 4.345990 Oct 13 08:40:34.573580 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 931/2013] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:30 2022] POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action => generated 0 bytes in 4347 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:34.580976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-11", "block_migration": false, "disk_over_commit": false}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:34.586726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:34.588913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:34.595135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.595750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.596556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.597326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.597969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.598430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.606701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.607525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.608154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.608914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lazy-loading 'fault' on Instance uuid 19f284a8-c4dd-4b1d-af12-91d0a6fc694a {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:34.641089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lazy-loading 'flavor' on Instance uuid 8d8b162b-28d9-4ce6-991e-4635698868d5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:34.658028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a13b393175b41c187ed4152cc68fcde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95bfc5f5faf4f5eabe4898240643be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:34.667035 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8a9e5ae-0703-43ab-b55c-48a69f5c71b9 tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 200 len: 1321 microversion: 2.1 time: 0.122347 Oct 13 08:40:34.667556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Going to try to live migrate instance to n-h2-858384-11 {{(pid=127031) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 08:40:34.668110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1083/2014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:34 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 1321 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:34.673937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eef1ec5f-f5f8-4c27-abdc-cbc8aa9366af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376696700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:34.736879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eef1ec5f-f5f8-4c27-abdc-cbc8aa9366af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.067197 Oct 13 08:40:34.746444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1084/2015] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:34 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:34.762504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "name": "network-vif-deleted", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:34.794116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.794878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.795089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.846387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] Creating event network-vif-deleted:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:40:34.863144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8109a501-bda3-4495-9674-404a173b746f req-b3f2a33e-6673-44e1-a3d7-280b76c96964 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121573 Oct 13 08:40:34.865851 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1085/2016] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:34.881061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:34.882637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:34.897941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.900610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.901060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:34.901781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:34.903216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:34.904316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:35.289700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:35.301396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:35.302871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:35.306610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9891872-2487-42e8-ad78-937483c19798 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.438810 Oct 13 08:40:35.311370 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1086/2017] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:34 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:35.316874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f284a8-c4dd-4b1d-af12-91d0a6fc694a", "name": "network-vif-unplugged", "status": "completed", "tag": "81ee0f20-6261-4cea-a5dd-041c6ebab29d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:35.340697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:35.349751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:35.349751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:35.373383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] Creating event network-vif-unplugged:81ee0f20-6261-4cea-a5dd-041c6ebab29d for instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a on n-h2-858384-11 Oct 13 08:40:35.381538 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-26d13c38-de0f-47a2-8a58-b3869bd02343 req-56b10b63-0101-41ae-bf1a-df8b7c546948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068830 Oct 13 08:40:35.382777 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1087/2018] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:35.389711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7cbf541c-71a5-4bbb-8e1a-6a8d2a5584b4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '.version_select at 0x7f53765e3550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:35.637164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7cbf541c-71a5-4bbb-8e1a-6a8d2a5584b4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/a5aa5d5b-8b1d-4907-8e7f-cc08d6080d7b" status: 200 len: 184 microversion: 2.1 time: 0.252785 Oct 13 08:40:35.638302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1088/2019] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:40:35 2022] GET /compute/v2.1/os-floating-ips/a5aa5d5b-8b1d-4907-8e7f-cc08d6080d7b => generated 184 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:35.643468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:35.644291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:35.654078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:35.664908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:35.665591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:35.668216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:35.669289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:35.670061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.008551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:36.017905 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a0e652a5-9196-4b60-bbd3-7cd2c6c7d308 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1504 microversion: 2.1 time: 0.378212 Oct 13 08:40:36.034737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1089/2020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:35 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:36.042211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:36.043097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:36.063815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:36.067927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:36.068907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.075067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:36.076083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:36.076792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.100386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:36.658169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:36.666835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9fec0c6b-ad9b-43a1-84e1-79eb4fb56114 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.630874 Oct 13 08:40:36.671141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1090/2021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:36 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:36.679459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:36.680297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:36.686696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:36.687300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:36.687809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.689267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:36.689808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:36.690303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.722634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:36.723195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:36.723702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:36.724338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lazy-loading 'fault' on Instance uuid 48e231d1-10c1-4162-a6e3-8e42aaf1166b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:36.768842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:36.777254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c9216fe-2743-417d-b56b-a5dc929a4be7 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 200 len: 1309 microversion: 2.1 time: 0.104852 Oct 13 08:40:36.777837 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1091/2022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:36 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:36.788235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.118"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:37.007775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:37.013804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.014441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.014784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.015495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.015948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.016379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.305346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:40:37.305750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquired lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:40:37.458607 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-877ecb16-37cb-42bb-a606-fa1d67922c00 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5/action" status: 202 len: 0 microversion: 2.1 time: 2.881544 Oct 13 08:40:37.459338 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 932/2023] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:34 2022] POST /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5/action => generated 0 bytes in 2885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:37.465380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:37.466454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] [instance: 19f284a8-c4dd-4b1d-af12-91d0a6fc694a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:37.477230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.477726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.478161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.478944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.479350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.479771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.485135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:37.497773 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] HTTP exception thrown: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Request method failure captured: Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a HTTP/1.1 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR87ImFWfFj4xcmy1brWywvigV3RIEs50DcE5YENSgC_s-QOBC6Q0tvy_AwJj6U87n9gqjkil0S8J4akgFzG_y5-L4LKKOagIMKtcSnzsRBIRxtJZBdxiK2xHcTjwX8gP1dExOC2v3iOhdDNDFL6jDpJLSPdsPif0aGngr5R2aR8gc-E Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:37.499476 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a95bfc5f5faf4f5eabe4898240643be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a95bfc5f5faf4f5eabe4898240643be0 Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087 Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4a13b393175b41c187ed4152cc68fcde Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:37.501118 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '19f284a8-c4dd-4b1d-af12-91d0a6fc694a'} Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:37.501918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. Oct 13 08:40:37.503895 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:37.506387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] Returning 404 to user: Instance 19f284a8-c4dd-4b1d-af12-91d0a6fc694a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:37.506387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dbbcb2b5-a729-48b1-9111-a4b1910a0eaa tempest-FloatingIPsAssociationNegativeTestJSON-513309087 tempest-FloatingIPsAssociationNegativeTestJSON-513309087-project] 10.222.0.23 "GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a" status: 404 len: 111 microversion: 2.1 time: 0.040376 Oct 13 08:40:37.514299 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 933/2024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:37 2022] GET /compute/v2.1/servers/19f284a8-c4dd-4b1d-af12-91d0a6fc694a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:37.521030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b752c63-a457-48f2-847e-3c545fb9d234 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537609f700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:37.576182 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b752c63-a457-48f2-847e-3c545fb9d234 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.060476 Oct 13 08:40:37.577114 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 934/2025] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:37 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:37.582589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:37.583149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:37.589885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.590375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.590841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.591543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.591991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.592408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.617920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:37.716727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8a06921-c1cc-4542-86f0-5bf1ab11f889 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 204 len: 0 microversion: 2.1 time: 0.138168 Oct 13 08:40:37.717393 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 935/2026] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:37 2022] DELETE /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:37.723594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:37.724619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:37.732437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.732923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.733353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.734050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.734696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.734995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.943912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:37.952300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:37.953744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:37.955489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ff873fd-587f-4f86-90fb-cadab00ca763 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1486 microversion: 2.25 time: 0.236697 Oct 13 08:40:37.956057 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 936/2027] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:37 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:37.960925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced4b146-e702-4698-91c8-317b023a51d8", "name": "network-vif-deleted", "tag": "4450a6dd-a5f6-46a1-b208-557cc2fab9c3"}, {"server_uuid": "48e231d1-10c1-4162-a6e3-8e42aaf1166b", "name": "network-vif-deleted", "tag": "82e568ee-646c-4b9b-9668-f8ae1e883443"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:37.971637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:37.972439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:37.973111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:37.986564 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Creating event network-vif-deleted:4450a6dd-a5f6-46a1-b208-557cc2fab9c3 for instance ced4b146-e702-4698-91c8-317b023a51d8 on n-h1-858384-11 Oct 13 08:40:37.987111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] Creating event network-vif-deleted:82e568ee-646c-4b9b-9668-f8ae1e883443 for instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b on n-h2-858384-11 Oct 13 08:40:38.009150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8942bec9-2787-437a-9cb1-6d24b066cd5e req-5cc54aa7-d470-4ce3-b213-e2645cb82a92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050819 Oct 13 08:40:38.010077 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 937/2028] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:38.014569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Building network info cache for instance {{(pid=127030) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:40:38.017183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-plugged", "status": "completed", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:38.036448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.037224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.037850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.056389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Creating event network-vif-plugged:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h2-858384-11 Oct 13 08:40:38.062676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] Instance 9900ef64-6643-4731-a77c-7616ae962172 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:40:38.076863 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a96882e7-9368-4b33-b8e2-3b3603f56eef req-04f0dd3a-5e14-4431-a895-2335894329de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065369 Oct 13 08:40:38.082572 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 938/2029] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:38.088503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:38.089478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:38.098459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.099240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.100501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.101510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.102142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.102815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.397751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:38.409206 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fa8bcc2-a1a5-40a2-85c4-1cb0a55dcd49 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.322389 Oct 13 08:40:38.410668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 939/2030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:38 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:38.420031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:38.420655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:38.441070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.441501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.443565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.444327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.446978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.447628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.783234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Updating instance_info_cache with network_info: [{"id": "79bd3729-0c62-4a5c-bb33-7d89f598c293", "address": "fa:16:3e:53:97:53", "network": {"id": "3ddc3bf1-9e91-4eab-a288-de516cfd8fbb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-580766153-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b2cf37e0f3b4d63a95f7254a13b54e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79bd3729-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:40:38.795903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:38.801879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Releasing lock "refresh_cache-b210ff6d-0782-485d-8c1d-0ad5e376ad2c" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:40:38.803695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7697a04c-4218-41c6-b9a9-5d459693f914 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action" status: 202 len: 0 microversion: 2.1 time: 2.024112 Oct 13 08:40:38.806836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1092/2031] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:40:36 2022] POST /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c/action => generated 0 bytes in 2026 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:40:38.812113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eba594fb-9f50-4378-8606-0276e01eb1fa tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.401214 Oct 13 08:40:38.817516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:38.819038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:38.829281 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 940/2032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:38 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:38.836814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.837461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.838044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.841816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.842562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.843395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.852287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:38.852914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 48e231d1-10c1-4162-a6e3-8e42aaf1166b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:38.861802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.863286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.863991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:38.865959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:38.869515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:38.871910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.089948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:39.099548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2722a8ea-27ed-4293-9077-752d78a13a0a tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1510 microversion: 2.1 time: 0.291380 Oct 13 08:40:39.111186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1093/2033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:38 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:39.123420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:39.136021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.136835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.137459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.151281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] Creating event network-changed:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:40:39.157082 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e0b189e6-8701-4b9b-92f6-37a465584d5a req-b3eed5ac-3c19-4c4c-92a9-124fff868779 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044218 Oct 13 08:40:39.162160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1094/2034] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:39.168663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e54e043c-7a6f-45a5-8ee3-c5f77be70dbf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376949310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:39.254143 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e54e043c-7a6f-45a5-8ee3-c5f77be70dbf tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.090380 Oct 13 08:40:39.256195 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1095/2035] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:39 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:39.270898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:39.271528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:39.280784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.281597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.282865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.284337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.284991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.285606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.333442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] HTTP exception thrown: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Request method failure captured: Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 HTTP/1.1 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR86vBgBby5dYRAHWU3g_IeC94r_2kEXozaZBAaypYAJCNfIgXx4fNwD6nQ3A0IpgSxwxKJsvTDUU5L_7Xn45mSNTs2jSJbEH9t0-uXLN1j09eLG_vXip2j6UYwJ9TO2XT01uvcYZ5swgikQR86A3dHEO-nyisEutOJLb5Ffo603SoFc Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:39.337932 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6c80df12b5d942c89bae1c87e269f8bb Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.339837 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ced4b146-e702-4698-91c8-317b023a51d8'} Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:39.340861 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.343172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.345485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Returning 404 to user: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:39.345485 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83533f5f-ff93-42ac-8798-e9accb6fcff4 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 404 len: 111 microversion: 2.1 time: 0.087027 Oct 13 08:40:39.345982 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1096/2036] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:39 2022] DELETE /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:39.357423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:39.375095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:39.412269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.412770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.413213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.413936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.414391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.424283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.516994 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b HTTP/1.1 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:39.524423 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. Oct 13 08:40:39.526220 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '48e231d1-10c1-4162-a6e3-8e42aaf1166b'} Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:39.527265 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. Oct 13 08:40:39.529618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.532841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance 48e231d1-10c1-4162-a6e3-8e42aaf1166b could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:39.532841 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-92a10f45-b8a2-42d6-9768-6aabe15526e2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b" status: 404 len: 111 microversion: 2.1 time: 0.695151 Oct 13 08:40:39.533526 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 941/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:38 2022] GET /compute/v2.1/servers/48e231d1-10c1-4162-a6e3-8e42aaf1166b => generated 111 bytes in 704 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:39.558873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:39.568056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: ced4b146-e702-4698-91c8-317b023a51d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:39.601289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.601826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.602262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.603025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.603482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.603907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.640901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] HTTP exception thrown: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Request method failure captured: Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 HTTP/1.1 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR86vBgBby5dYRAHWU3g_IeC94r_2kEXozaZBAaypYAJCNfIgXx4fNwD6nQ3A0IpgSxwxKJsvTDUU5L_7Xn45mSNTs2jSJbEH9t0-uXLN1j09eLG_vXip2j6UYwJ9TO2XT01uvcYZ5swgikQR86A3dHEO-nyisEutOJLb5Ffo603SoFc Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:39.648943 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6c80df12b5d942c89bae1c87e269f8bb Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.650874 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ced4b146-e702-4698-91c8-317b023a51d8'} Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:39.651856 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. Oct 13 08:40:39.653437 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:39.654743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Returning 404 to user: Instance ced4b146-e702-4698-91c8-317b023a51d8 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:39.654743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b342537-a771-4ab5-91d6-50450d33a193 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8" status: 404 len: 111 microversion: 2.1 time: 0.116176 Oct 13 08:40:39.654743 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 942/2038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:39 2022] GET /compute/v2.1/servers/ced4b146-e702-4698-91c8-317b023a51d8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:39.659586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:39.660190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:39.690535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.691506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.692208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.693297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:39.693925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:39.694547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:39.941950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:39.952144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:39.961522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:39.967469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-60203dca-d422-4da2-9473-61d33cbfb5a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1476 microversion: 2.25 time: 0.618609 Oct 13 08:40:39.970505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1097/2039] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:39 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1476 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:39.996868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c03c28ad-52ec-4c4b-beb7-cc979d2135a2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:40.071218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:40.083100 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c03c28ad-52ec-4c4b-beb7-cc979d2135a2 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/91b07ecc-4a74-4159-9fe9-d5a96f4c6c8b" status: 204 len: 0 microversion: 2.1 time: 0.107112 Oct 13 08:40:40.086693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1098/2040] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:40:39 2022] DELETE /compute/v2.1/os-server-groups/91b07ecc-4a74-4159-9fe9-d5a96f4c6c8b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:40.094136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61200f1d-05f2-4854-8fee-b60cd7197e80 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.438776 Oct 13 08:40:40.095248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 943/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:39 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:40.109535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:40.110257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-489258a7-5c0a-4e93-b62e-5c08904b467a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '.version_select at 0x7f537667c940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:40.112496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:40.134828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:40.137336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:40.137962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:40.140687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:40.144069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:40.144711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.193139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:41.221715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59a643ef-f470-49c4-9427-db383edc889e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 1.123344 Oct 13 08:40:41.226341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 944/2042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:40 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:41.246681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c7cb368-f587-4b83-aa34-e26f0ce50c42 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '.version_select at 0x7f53760c2790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:41.253290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c7cb368-f587-4b83-aa34-e26f0ce50c42 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.255980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c7cb368-f587-4b83-aa34-e26f0ce50c42 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.256847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c7cb368-f587-4b83-aa34-e26f0ce50c42 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.293236 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c7cb368-f587-4b83-aa34-e26f0ce50c42 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 5363 microversion: 2.25 time: 0.065420 Oct 13 08:40:41.294539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 945/2043] 10.222.0.23 () {60 vars in 1184 bytes} [Thu Oct 13 08:40:41 2022] GET /compute/v2.1/os-migrations => generated 5363 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:41.306943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:41.307716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:41.324204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.324995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.327350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.330674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.332455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.333126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.406812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:41.619622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-055eb808-f8f2-48c5-b30c-43eed106a4bd tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 204 len: 0 microversion: 2.1 time: 0.323487 Oct 13 08:40:41.623093 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 946/2044] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:41 2022] DELETE /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:41.647918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:41.651440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:41.659129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.660111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.665236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.666600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.667467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.668137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.735604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:41.736729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:41.737400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:41.738242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lazy-loading 'fault' on Instance uuid da3335e3-480e-4857-a4fd-876a44e8f1be {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:42.499912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469651ecf4d45e88f6879a83db0d9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6e04832f194172aacf67b86121a577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:42.510251 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fff03a8-4a27-48a2-b140-21bd7493e54f tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 200 len: 1306 microversion: 2.1 time: 0.884328 Oct 13 08:40:42.514304 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 947/2045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:41 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 1306 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:42.534581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d3d70bcf-5de0-453e-b43e-0e5717fddb53 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53760c23a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:42.663787 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-489258a7-5c0a-4e93-b62e-5c08904b467a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/a5aa5d5b-8b1d-4907-8e7f-cc08d6080d7b" status: 202 len: 0 microversion: 2.1 time: 2.575568 Oct 13 08:40:42.664479 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1099/2046] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:40:40 2022] DELETE /compute/v2.1/os-floating-ips/a5aa5d5b-8b1d-4907-8e7f-cc08d6080d7b => generated 0 bytes in 2577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:40:42.673988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd594a67-d6c0-41e1-acfe-771e300d9d2a", "name": "network-vif-plugged", "status": "completed", "tag": "0a8fc691-4fb4-47e1-9616-4d5e67db36cf"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:42.682814 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d3d70bcf-5de0-453e-b43e-0e5717fddb53 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.164137 Oct 13 08:40:42.692622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.693540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.694210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.707245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] Creating event network-vif-plugged:0a8fc691-4fb4-47e1-9616-4d5e67db36cf for instance fd594a67-d6c0-41e1-acfe-771e300d9d2a on n-h2-858384-11 Oct 13 08:40:42.713396 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1e4cf8b0-2055-4dac-b371-021662f4d370 req-178708ef-1f68-4b49-a51b-bb8c53923c95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047381 Oct 13 08:40:42.714619 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1100/2047] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:42.721016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:42.722270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:42.725294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 948/2048] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:42 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:42.730025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.730945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.731555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.732770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.733420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.734135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.755470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3335e3-480e-4857-a4fd-876a44e8f1be", "name": "network-vif-deleted", "tag": "2555fbeb-68bc-4af1-8b38-a381e1ee9e19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:42.818342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.819413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.822112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.852590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] Creating event network-vif-deleted:2555fbeb-68bc-4af1-8b38-a381e1ee9e19 for instance da3335e3-480e-4857-a4fd-876a44e8f1be on n-h1-858384-11 Oct 13 08:40:42.858365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1ebd466d-f298-478b-9a64-77713fda5ad5 req-c4ff7c12-ad63-4769-8212-a3872d34b883 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125980 Oct 13 08:40:42.859390 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 949/2049] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:42.868960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:42.869796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:42.881378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.881927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.882372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.883307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.883834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.884487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.955314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:42.968094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7177634-04e7-4644-bb3a-7d6b9589ab91 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.251939 Oct 13 08:40:42.968674 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1101/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:42 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:42.973780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:42.974590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:42.982216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.983034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.983781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:42.986167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:42.986883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:42.989534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.073590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:43.190444 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96187f88-98ce-4010-8df1-9abf8bf73123 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 204 len: 0 microversion: 2.1 time: 0.220005 Oct 13 08:40:43.194879 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1102/2051] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:42 2022] DELETE /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:43.201450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.202281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.212353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.213230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.213832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.214821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.215878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.216670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.295769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] Lazy-loading 'services' on Instance uuid a1f51160-5f0d-4b85-a628-0194d8f61795 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:43.313814 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d0416a6-98d6-4ead-a94c-674e6c670211 tempest-LiveAutoBlockMigrationV225Test-2068873350 tempest-LiveAutoBlockMigrationV225Test-2068873350-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1971 microversion: 2.25 time: 0.452561 Oct 13 08:40:43.326729 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 950/2052] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:42 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1971 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:43.341972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-unplugged", "status": "completed", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:43.362280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.368913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.369291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.389996 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Creating event network-vif-unplugged:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:40:43.404787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] Instance 9900ef64-6643-4731-a77c-7616ae962172 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:40:43.419726 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2540374a-82c3-4004-b8c2-361b9991f909 req-b7d236c1-f714-4027-ae69-f6f0695e2f46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090962 Oct 13 08:40:43.421320 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 951/2053] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:43.427043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:43.430513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.431611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.437973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51817b6e-2f2f-44fe-8edc-93c1dc685195 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.241614 Oct 13 08:40:43.438749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.439831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.440503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.441740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.442432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.443085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.451171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1103/2054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:43.460044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.460737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.472095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:43.473539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.474039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.474526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.475333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.475862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.476245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.479366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:43.489995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:43.649546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f79afff0-054c-4f18-87ec-aa4ee1241d34 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 204 len: 0 microversion: 2.1 time: 0.225516 Oct 13 08:40:43.650486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 952/2055] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:43 2022] DELETE /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:43.659493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.660092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.666789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.668456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.669054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.670016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.670516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.670946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.690637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:43.700690 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f560c9b1-dcb9-4985-b7f0-7e095eabd4cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1474 microversion: 2.1 time: 0.248554 Oct 13 08:40:43.701879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:43.702350 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1104/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1474 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:43.708126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.708814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.715062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.715634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.716143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.716938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.717939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.717939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.733230 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be HTTP/1.1 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:43.736625 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:43.738615 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'da3335e3-480e-4857-a4fd-876a44e8f1be'} Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:43.740189 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:43.743155 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:43.744640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:43.744640 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce26c581-c0e7-4d1b-84de-8beaf962d7dc tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 404 len: 111 microversion: 2.1 time: 0.034503 Oct 13 08:40:43.744640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1105/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:43.748690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.749313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.755550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.756354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.757337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.758086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.758981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.759124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:43.827378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:43.894394 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de793b91-4dee-4832-a904-f4cbe2f321b7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 204 len: 0 microversion: 2.25 time: 0.241971 Oct 13 08:40:43.895251 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 953/2058] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:40:43 2022] DELETE /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:40:43.900556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-42b5a979-5aa8-403c-8a17-3ef320c1b05a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53760c2ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:43.972878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-42b5a979-5aa8-403c-8a17-3ef320c1b05a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.075219 Oct 13 08:40:43.974830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 954/2059] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:43.978584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:43.980457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1635618129", "metadata": {"image_type": "test"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:43.984840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:43.987116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d767cfeb-cf32-4c52-a8de-e65086fae877 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1525 microversion: 2.1 time: 0.242310 Oct 13 08:40:43.987714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1106/2060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:43.997618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:43.998758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:43.999427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.000369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.001546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.002574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.017577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.018191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.022067 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be/action HTTP/1.1 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 112 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:44.025021 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1635618129", "metadata": {"image_type": "test"}}} Oct 13 08:40:44.026558 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'da3335e3-480e-4857-a4fd-876a44e8f1be', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1635618129', 'metadata': {'image_type': 'test'}}}} Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.027532 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.028820 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.031840 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.031840 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.031840 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.031840 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.031840 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.034089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.037962 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9f7256a5-9703-4277-968e-9a22324944fd tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "POST /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be/action" status: 404 len: 111 microversion: 2.1 time: 0.061901 Oct 13 08:40:44.038920 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 955/2061] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Oct 13 08:40:43 2022] POST /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:44.047435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.047939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.048379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.049088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.049544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.049885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.050020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.050646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.060513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.061058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.061504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.062655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.063699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.064345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.232008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:44.243338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:44.245189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:44.247860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87307e21-87bc-424f-b470-dc3ad27fee18 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1482 microversion: 2.25 time: 0.237114 Oct 13 08:40:44.249075 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1107/2062] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:43 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1482 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:44.254838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-327503473", "metadata": {"image_type": "test"}}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:44.257550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Failed to fetch instance by id tempest-invalid-1372798431 {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:40:44.258057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance tempest-invalid-1372798431 could not be found. Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/tempest-invalid-1372798431/action HTTP/1.1 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 111 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:44.259613 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-327503473", "metadata": {"image_type": "test"}}} Oct 13 08:40:44.261358 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance tempest-invalid-1372798431 could not be found. Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'tempest-invalid-1372798431', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-327503473', 'metadata': {'image_type': 'test'}}}} Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1372798431 could not be found. Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.262215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1372798431 could not be found. Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1372798431 could not be found. Oct 13 08:40:44.263658 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.267095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance tempest-invalid-1372798431 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.268187 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1728124-60e4-4277-97bb-2553151b14e5 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-1372798431/action" status: 404 len: 101 microversion: 2.1 time: 0.017952 Oct 13 08:40:44.268827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1108/2063] 10.222.0.23 () {60 vars in 1249 bytes} [Thu Oct 13 08:40:44 2022] POST /compute/v2.1/servers/tempest-invalid-1372798431/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:44.280928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1345520194"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:44.283527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:40:44.284022 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 57 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:44.285676 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-test-snap-1345520194"}} Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:44.287506 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1345520194'}}} Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.288391 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.290210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.292906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.292906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-33cdbebc-6cdd-4328-8cef-637f50a673b7 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011653 Oct 13 08:40:44.295245 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1109/2064] 10.222.0.23 () {60 vars in 1275 bytes} [Thu Oct 13 08:40:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:44.301462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-640019982"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:44.304215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:40:44.305217 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 56 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:44.307171 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-test-snap-640019982"}} Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:44.308690 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-640019982'}}} Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.309699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 13 08:40:44.311091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.314645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.315820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-429e888b-33f2-4031-ba58-a139d4eef95e tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019671 Oct 13 08:40:44.320740 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1110/2065] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Oct 13 08:40:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:44.327554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.328173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.335064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.335628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.336143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.336914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.337479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.337969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.361913 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be HTTP/1.1 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:44.363846 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.365583 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'da3335e3-480e-4857-a4fd-876a44e8f1be'} Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.366684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.368084 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.371442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.372635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bb59fd4-2dea-4511-89c8-d9d19a045086 tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 404 len: 111 microversion: 2.1 time: 0.049719 Oct 13 08:40:44.373718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1111/2066] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:44 2022] DELETE /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:40:44.388758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.391750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] [instance: da3335e3-480e-4857-a4fd-876a44e8f1be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.398522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.399362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.400023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.400999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.401675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.402321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.417061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] HTTP exception thrown: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.421365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Request method failure captured: Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be HTTP/1.1 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR87vhdFA9fv963KMnWD3zITVQkvE4kIBbO3R2YCwBO9UyJYEmLTI4RjcN_T6Z8A00G9VDvvzk-5EfeKMuI-4kfzhHfzi1mWazMrTTx2c2Yc8GTif-iV2Y0KL7k4tc7efzfxO2a9KOT00y8xn-uSwD7NpkowWvhaOz1mPnef2jb-sImg Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:44.426353 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c6e04832f194172aacf67b86121a577"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c6e04832f194172aacf67b86121a577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c6e04832f194172aacf67b86121a577 Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1320888547 Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8469651ecf4d45e88f6879a83db0d9af Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesNegativeTestJSON-1320888547-project Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.427965 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'da3335e3-480e-4857-a4fd-876a44e8f1be'} Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:44.428790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. Oct 13 08:40:44.430369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:44.436934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] Returning 404 to user: Instance da3335e3-480e-4857-a4fd-876a44e8f1be could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:44.436934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-779c6688-e6fb-44ef-96da-2e926d31ce0c tempest-ImagesNegativeTestJSON-1320888547 tempest-ImagesNegativeTestJSON-1320888547-project] 10.222.0.23 "GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be" status: 404 len: 111 microversion: 2.1 time: 0.050972 Oct 13 08:40:44.436934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1112/2067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:44 2022] GET /compute/v2.1/servers/da3335e3-480e-4857-a4fd-876a44e8f1be => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:44.439241 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9af9b6ee-cf38-4ebe-b514-02aa8a31c5f6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.398643 Oct 13 08:40:44.440194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 956/2068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:44 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:44.464487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.465176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.472064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.472765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.473304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.474243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.475596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.476143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.727602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:44.728831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:44.736925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.737778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.738471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.739539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:44.740216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:44.740856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:44.824471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:44.848721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58ba8dfa-2f0a-421e-8c84-bd97cb1fc89f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.391355 Oct 13 08:40:44.849704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1113/2069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:44 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:44.989670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d77d1206-8c69-4476-a5a3-73a980afcbbd tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376678e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:45.077105 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d77d1206-8c69-4476-a5a3-73a980afcbbd tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.077957 Oct 13 08:40:45.079248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1114/2070] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:44 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:40:45.093623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:45.095912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:45.118625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:45.119223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:45.119725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:45.120513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:45.121040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:45.121541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:45.127002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:45.718491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:45.726747 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ee1875e9-2d0c-4d0d-aac7-b7f6dba17253 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1474 microversion: 2.1 time: 1.004970 Oct 13 08:40:45.731245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 957/2071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:44 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1474 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:40:45.744526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:45.746314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:45.765655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:45.768086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:45.773368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:45.774472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:45.775132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:45.775830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:46.132262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:46.140124 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-207f4410-218e-482d-b465-26277d9b4906 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1525 microversion: 2.1 time: 1.059558 Oct 13 08:40:46.150757 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1115/2072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:45 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1525 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:46.155950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:46.176795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:46.177325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:46.178953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:46.200531 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Creating event network-changed:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:40:46.207751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] Instance 9900ef64-6643-4731-a77c-7616ae962172 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 08:40:46.220013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3e65f95a-5419-405c-9292-dd159c172bc1 req-8f4f4dad-aa74-4692-a049-c34098cad00b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067367 Oct 13 08:40:46.221324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1116/2073] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:46.227019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:46.228073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:46.235705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:46.236592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:46.237315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:46.238265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:46.238972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:46.239640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:46.702627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:46.720312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c36cf42e-08e2-493a-a612-bca96f4ab0c2 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.496945 Oct 13 08:40:46.721890 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1117/2074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:46 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:46.747648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:46.748269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:46.775063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:46.775558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:46.776006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:46.786557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:46.787265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:46.787724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.210343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:47.227321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:47.228918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:47.230234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-501dc554-b44f-4187-834e-4a5ca0323d30 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1482 microversion: 2.25 time: 1.495548 Oct 13 08:40:47.231171 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 958/2075] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:45 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1482 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:47.236160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c14c3408-74bb-4b25-81eb-62acc729ced8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537609ff70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:47.316530 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c14c3408-74bb-4b25-81eb-62acc729ced8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.084181 Oct 13 08:40:47.326752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 959/2076] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:47 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:47.340497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:47.342832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:47.372371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.372874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.373314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.374029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.374617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.375041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.390769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:47.404847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ddcb70dc-fd89-466e-a725-3473eb1030ea tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.660488 Oct 13 08:40:47.405833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1118/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:46 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:47.418338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:47.418986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:47.452241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.452911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.455796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.457666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.460076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.460862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.682724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:47.699411 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2145baa2-bead-42a4-9b76-7fc43b1c2e51 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1483 microversion: 2.1 time: 0.292428 Oct 13 08:40:47.700846 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1119/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:47 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1483 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:47.744250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:47.745152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:47.755723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.763073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.763528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:47.764271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:47.764732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:47.765174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:48.992500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.004956 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eabbf3b7-b4ba-459e-a9af-b48e6e0a2bac tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.264529 Oct 13 08:40:49.011453 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1120/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:47 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:49.025113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:49.038001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:49.076633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.086986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.087549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.088387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.088938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.089473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.321095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.336275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.342724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.343421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.347103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a811feef-fa8f-4bc3-8a07-95daac1a29b6 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.334169 Oct 13 08:40:49.352067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1121/2080] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:49 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:49.362498 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c75e9fd0-b3f0-43c0-b789-52834669174b tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1474 microversion: 2.1 time: 2.040620 Oct 13 08:40:49.368583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e18db58-c002-4c2a-ad78-e0a1a2af5b7e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376d0b280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:49.374842 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 960/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:47 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1474 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:49.393949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b210ff6d-0782-485d-8c1d-0ad5e376ad2c", "name": "network-vif-deleted", "tag": "79bd3729-0c62-4a5c-bb33-7d89f598c293"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:49.467626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.468025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.468455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.484644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e18db58-c002-4c2a-ad78-e0a1a2af5b7e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.125316 Oct 13 08:40:49.492367 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1122/2082] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:49 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:49.501710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:49.509260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:49.520280 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] Creating event network-vif-deleted:79bd3729-0c62-4a5c-bb33-7d89f598c293 for instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c on n-h1-858384-11 Oct 13 08:40:49.529674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.531430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.533055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.538071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.551605 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b50594f2-c5c3-49eb-a0f1-4bd111834651 req-4c2c11e9-6f1d-462e-8143-1bf87dfb15f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159653 Oct 13 08:40:49.552125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.555059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.558741 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 961/2083] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:49.570852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:49.576671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:49.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.597375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.600703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.602009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.603824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.606541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.698905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.699818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.700570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:49.701231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lazy-loading 'fault' on Instance uuid b210ff6d-0782-485d-8c1d-0ad5e376ad2c {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:49.826513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:49.854601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6255ed4-5b47-4d26-bb6f-03fbe538cea9 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1314 microversion: 2.1 time: 0.291380 Oct 13 08:40:49.857723 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 962/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:49 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:49.880891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed7230-49a3-4df6-a262-e345916ead82", "name": "network-vif-deleted", "tag": "f8cede54-70ed-417a-95b6-f164d1529923"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:49.934704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:49.935200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:49.935629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.003022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] Creating event network-vif-deleted:f8cede54-70ed-417a-95b6-f164d1529923 for instance c4ed7230-49a3-4df6-a262-e345916ead82 on n-h2-858384-11 Oct 13 08:40:50.009834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8e512895-df6e-4ded-8e15-22acb32c0abb req-6a87972e-f097-4e3c-90d2-440e98451de3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147235 Oct 13 08:40:50.016951 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 963/2085] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:50.035567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:50.036906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:50.061789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.067075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.067649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.068775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.087568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.089591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.160556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.187294 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af6e7e83-80a1-4733-81ef-e1ac0d94b679 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1469 microversion: 2.1 time: 0.688840 Oct 13 08:40:50.193484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1123/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:49 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1469 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:50.383527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:50.385176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:50.406068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.408910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.409368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.410112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.426773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.428157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.510142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.531261 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e169ea6d-e042-4f8d-b867-75a2201c083f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.502352 Oct 13 08:40:50.545509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 964/2087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:50 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:50.556360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:50.560378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:50.585078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.585887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.586558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.587498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.588132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.588725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.708294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.709064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.709667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.710338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lazy-loading 'fault' on Instance uuid 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:50.718819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.734268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.742114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.746149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5c5fd49a-0e5c-43e8-867d-57b9ab61af7e tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.369863 Oct 13 08:40:50.759542 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1124/2088] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:50 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:50.794008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bbb2b16-f7ab-4390-9942-763b538fb036 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53771343a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:50.848547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:50.869384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-504ba2bd-118b-43a6-9e8f-1947f49dd45a tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 200 len: 1308 microversion: 2.1 time: 0.320429 Oct 13 08:40:50.890544 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 965/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:50 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:50.898961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:50.901486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:50.923157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.924141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.926349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.928084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.929000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.930704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.961288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bbb2b16-f7ab-4390-9942-763b538fb036 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.200241 Oct 13 08:40:50.963347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1125/2090] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:50 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:50.991493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:50.992221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:50.992826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:50.993448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lazy-loading 'fault' on Instance uuid b210ff6d-0782-485d-8c1d-0ad5e376ad2c {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:40:51.157631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c80df12b5d942c89bae1c87e269f8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2cf37e0f3b4d63a95f7254a13b54e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:51.194050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed41a0b5-b8c2-45c7-8366-f253c541a97a tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 200 len: 1314 microversion: 2.1 time: 0.301459 Oct 13 08:40:51.199688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 966/2091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:50 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:51.570197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:51.570986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:51.584522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:51.595075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:51.595673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:51.597248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:51.601875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:51.603999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:51.777162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:51.777825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:51.810810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:51.811257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:51.811709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:51.812448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:51.813467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:51.821655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.341541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:52.355249 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-abc28cda-ca33-41c6-ac30-c0291612dc85 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.789526 Oct 13 08:40:52.373113 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 967/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:51 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:52.387512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f51160-5f0d-4b85-a628-0194d8f61795", "name": "network-vif-deleted", "tag": "1efdc19f-e051-499b-9ab1-0b30431e4c19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:52.402610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:52.421303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.421783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.425608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.429944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c45890c9-1d28-4b15-ae1f-38a6675f96f5 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1462 microversion: 2.1 time: 1.213457 Oct 13 08:40:52.433980 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1126/2093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:51 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1462 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:52.445379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:52.448237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:52.464100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] Creating event network-vif-deleted:1efdc19f-e051-499b-9ab1-0b30431e4c19 for instance a1f51160-5f0d-4b85-a628-0194d8f61795 on n-h2-858384-11 Oct 13 08:40:52.466399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.467433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.468124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.470445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.471198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.471894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.493820 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-45fbb823-b259-4201-a678-39fbd1dca736 req-e0c745fb-3d22-4e41-851e-f92853b7bbb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119337 Oct 13 08:40:52.494852 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 968/2094] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:52.509655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:52.509820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:52.536915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.537406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.537845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.543436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.543975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.554290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.594976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:52.597241 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa HTTP/1.1 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:40:52.600647 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. Oct 13 08:40:52.602274 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '176cd4f6-ef1e-48ed-8ffb-e7740993b2fa'} Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:52.603330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. Oct 13 08:40:52.606096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.608424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:52.608424 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ba2e979-1296-4ce2-b78d-0f418aa124d6 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa" status: 404 len: 111 microversion: 2.1 time: 0.109916 Oct 13 08:40:52.608424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 969/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:52 2022] GET /compute/v2.1/servers/176cd4f6-ef1e-48ed-8ffb-e7740993b2fa => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:52.617010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:52.620603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:52.623673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-590376f2-ef91-4f73-a9da-22994093f239 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537a9f0820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:52.625052 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12a85bce-0c46-4ee2-b8e3-df015d7d64a8 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.188892 Oct 13 08:40:52.626298 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1127/2096] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:52 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:52.639205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "176cd4f6-ef1e-48ed-8ffb-e7740993b2fa", "name": "network-vif-deleted", "tag": "601614ad-4798-4fcb-a597-dd06bf562d8d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:52.662859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.663794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.664532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.719133 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] Creating event network-vif-deleted:601614ad-4798-4fcb-a597-dd06bf562d8d for instance 176cd4f6-ef1e-48ed-8ffb-e7740993b2fa on n-h2-858384-11 Oct 13 08:40:52.731068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-308ac398-04ce-4cf6-95d2-204c93c4135c req-d9bfef68-6aa2-42eb-8312-03b2e2a1586e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099224 Oct 13 08:40:52.736288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1128/2097] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:52.745531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:52.754248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] [instance: b210ff6d-0782-485d-8c1d-0ad5e376ad2c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:52.766000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.770755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.772247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.774705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.777185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.777714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.800033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] HTTP exception thrown: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Request method failure captured: Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c HTTP/1.1 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR86vBgBby5dYRAHWU3g_IeC94r_2kEXozaZBAaypYAJCNfIgXx4fNwD6nQ3A0IpgSxwxKJsvTDUU5L_7Xn45mSNTs2jSJbEH9t0-uXLN1j09eLG_vXip2j6UYwJ9TO2XT01uvcYZ5swgikQR86A3dHEO-nyisEutOJLb5Ffo603SoFc Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:52.802223 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b2cf37e0f3b4d63a95f7254a13b54e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2b2cf37e0f3b4d63a95f7254a13b54e1 Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1773554209 Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6c80df12b5d942c89bae1c87e269f8bb Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1773554209-project Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. Oct 13 08:40:52.804036 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b210ff6d-0782-485d-8c1d-0ad5e376ad2c'} Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:52.805339 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. Oct 13 08:40:52.806912 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:52.813528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] Returning 404 to user: Instance b210ff6d-0782-485d-8c1d-0ad5e376ad2c could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:52.814836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50e3787b-bb9a-49c0-8932-34ae08a07e65 tempest-FloatingIPsAssociationTestJSON-1773554209 tempest-FloatingIPsAssociationTestJSON-1773554209-project] 10.222.0.23 "GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c" status: 404 len: 111 microversion: 2.1 time: 0.076172 Oct 13 08:40:52.815957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1129/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:52 2022] GET /compute/v2.1/servers/b210ff6d-0782-485d-8c1d-0ad5e376ad2c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:52.821414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:52.823251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:52.829892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.830690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.831560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:52.833425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:52.834075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:52.834762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:53.873488 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7b7d964-3dc6-4480-9c8f-94071691f2bf tempest-MigrationsAdminTest-108143415 tempest-MigrationsAdminTest-108143415-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1615 microversion: 2.1 time: 1.056123 Oct 13 08:40:53.876637 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1130/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:52 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1615 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:53.898523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:53.902188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: c4ed7230-49a3-4df6-a262-e345916ead82] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:53.920242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:53.921071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:53.921797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:53.924197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:53.925749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:53.926528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:53.978589 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 HTTP/1.1 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:40:53.991144 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. Oct 13 08:40:53.992912 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c4ed7230-49a3-4df6-a262-e345916ead82'} Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:40:53.993901 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. Oct 13 08:40:53.995647 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:40:53.997691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance c4ed7230-49a3-4df6-a262-e345916ead82 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:40:53.997691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64cc369d-2c4c-4268-bc7d-54e78511f0cf tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82" status: 404 len: 111 microversion: 2.1 time: 0.114789 Oct 13 08:40:53.998714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1131/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:53 2022] GET /compute/v2.1/servers/c4ed7230-49a3-4df6-a262-e345916ead82 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:40:54.004150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.015296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:54.021671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-590376f2-ef91-4f73-a9da-22994093f239 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 1.407647 Oct 13 08:40:54.023805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.024489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.027185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.027728 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 970/2101] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:52 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:54.028404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.030624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.031272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.044304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.051199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:54.086234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:54.092129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.094114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.107074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.109496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.111000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.112068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.129963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:54.293905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:54.309467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:54.312644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:54.316452 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3a2f558b-e034-4773-b30c-dda2b5ae97f9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.284471 Oct 13 08:40:54.317796 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 971/2102] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:54 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:54.333981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.336135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:54.359414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.363100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.365749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.367239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.368599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.370795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.412392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:54.528144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:54.546024 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1de8ca9-4ee9-408d-ae59-27bd4183f9cf tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.546137 Oct 13 08:40:54.550969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1132/2103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:53 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:54.571923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-435f3091-8987-4eb1-90a4-a3f62062aaa0 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f53769c4dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.670813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-435f3091-8987-4eb1-90a4-a3f62062aaa0 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61" status: 200 len: 637 microversion: 2.1 time: 0.115770 Oct 13 08:40:54.671966 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1133/2104] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:54 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61 => generated 637 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:54.678339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cf1318b-c123-47e0-82d8-83eed4a774af tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.704310 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ab73364-6a41-4741-bb12-04ed5d557f6c tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 204 len: 0 microversion: 2.1 time: 0.383549 Oct 13 08:40:54.708645 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 972/2105] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:54 2022] DELETE /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:54.718553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cf1318b-c123-47e0-82d8-83eed4a774af tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/5791035c-43d5-499c-a80c-e0ef13bd1007" status: 204 len: 0 microversion: 2.1 time: 0.045229 Oct 13 08:40:54.720283 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1134/2106] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:40:54 2022] DELETE /compute/v2.1/os-server-groups/5791035c-43d5-499c-a80c-e0ef13bd1007 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:54.723871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e3aa783-c467-4e85-a7db-d3bafbaafa6b tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f53760c2790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:54.726198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:54.726866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:54.733714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.734597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.735221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.736109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:54.736739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:54.737648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:54.848036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1e3aa783-c467-4e85-a7db-d3bafbaafa6b tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:54.858197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1e3aa783-c467-4e85-a7db-d3bafbaafa6b tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:40:55.140638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:55.165951 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-733cadde-51e1-405c-877e-2fb4368e3a21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1468 microversion: 2.1 time: 0.440557 Oct 13 08:40:55.168634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1135/2107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:54 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:55.189989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:55.193690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:55.221695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.223041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.226708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:55.230539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.232389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.234573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:55.317693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:40:55.464773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:40:55.578510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85207ca4-0c4b-4e08-86c5-046f3e50ad77 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 204 len: 0 microversion: 2.1 time: 0.402730 Oct 13 08:40:55.579138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1136/2108] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:40:55 2022] DELETE /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:55.594182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18aeb46a-078a-4aea-b36e-89c66d946d71 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376dad670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:55.624923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e3aa783-c467-4e85-a7db-d3bafbaafa6b tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.914485 Oct 13 08:40:55.626141 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 973/2109] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:40:54 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:55.641439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:55.647340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:55.663113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.663987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.664648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:55.665434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.665897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.666327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:55.692813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18aeb46a-078a-4aea-b36e-89c66d946d71 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.106153 Oct 13 08:40:55.702083 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1137/2110] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:55 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:55.708041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:55.709066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:55.718053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.718890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.720434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:55.721393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:55.722272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:55.723113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.065393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.067179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.082921 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-63f7aaed-6edd-4ea0-8f37-3c1878358765 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.378137 Oct 13 08:40:56.086983 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1138/2111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:55 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:56.096414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:56.097475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:56.112487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.114195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:56.114648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.115959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:56.115959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.117644 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4529e1a8-fded-4bdb-b11f-1bbe7c5c0a96 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.483929 Oct 13 08:40:56.118341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:56.118722 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 974/2112] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:55 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:56.121024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:56.121855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.124575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc1df60f-20a4-499f-ab6d-733988cb97f2 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f5376094820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:56.442366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.471558 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7e8bc39-a6b8-4d10-ad07-67a22764e3dc tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1472 microversion: 2.1 time: 0.382421 Oct 13 08:40:56.475088 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1139/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:56 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:56.483121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:56.490183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:56.509607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:56.511009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:56.512123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.514339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:56.515600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:56.518528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.675565 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc1df60f-20a4-499f-ab6d-733988cb97f2 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "DELETE /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.554482 Oct 13 08:40:56.676171 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 975/2114] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Oct 13 08:40:56 2022] DELETE /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_version => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:40:56.681164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-plugged", "status": "completed", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:56.709225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:56.709709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:56.710144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:56.745159 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] Creating event network-vif-plugged:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:40:56.756532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c6e64908-e07c-410c-ab27-4f31c8f82c61 req-bb6a1751-2fd9-410b-84c4-b4ddd47d8c7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079066 Oct 13 08:40:56.760494 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 976/2115] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:56.773431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb75e7c9-53a6-4b08-bb10-b791b057375e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f5376094e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:56.835267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb75e7c9-53a6-4b08-bb10-b791b057375e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 37 microversion: 2.1 time: 0.073424 Oct 13 08:40:56.841196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 977/2116] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:40:56 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 37 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:56.851197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e50e4505-1426-493f-977b-d84a693af92d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53760c2dc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:56.877764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:56.893530 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49dc9142-03bc-42ba-b855-b8957bf8e42f tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1468 microversion: 2.1 time: 0.416061 Oct 13 08:40:56.924537 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1140/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:56 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:56.943080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a9349d8-8ebf-4652-ad6f-6847e35646bf tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f5376d08b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:56.947538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e50e4505-1426-493f-977b-d84a693af92d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.104785 Oct 13 08:40:56.948152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 978/2118] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:56 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:57.018953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1a9349d8-8ebf-4652-ad6f-6847e35646bf tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:57.023336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1a9349d8-8ebf-4652-ad6f-6847e35646bf tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:40:57.133715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:57.134648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:57.167254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:57.182235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:57.186926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:57.189510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:57.191479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:57.195725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:57.715483 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1a9349d8-8ebf-4652-ad6f-6847e35646bf tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.789645 Oct 13 08:40:57.716675 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1141/2119] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:40:56 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:57.725609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:57.735135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:57.765308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:57.767397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:57.771894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:57.773067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:57.773806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:57.774449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:57.944937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:57.963590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:57.965468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:57.971807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a020d45a-0de5-45a4-bc10-45ec81e0dc53 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.248691 Oct 13 08:40:57.972550 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1142/2120] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:57 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:57.996844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:57.997570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:58.004371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:58.005221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:58.005887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:58.006883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:58.007580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:58.008311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:58.288205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:58.299412 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63b9398f-1ce5-4c2e-b21c-0b03812fcb22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.190617 Oct 13 08:40:58.310029 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 979/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:57 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:58.327949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b6868e1-02ac-4ccc-8768-e1ff3752b575 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f53760c2ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:58.432639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b6868e1-02ac-4ccc-8768-e1ff3752b575 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.121359 Oct 13 08:40:58.434012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 980/2122] 10.222.0.23 () {58 vars in 1290 bytes} [Thu Oct 13 08:40:58 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_distro => generated 33 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:58.452357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:58.455986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:58.474587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:58.475080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:58.475516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:58.476227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:58.476681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:58.480804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:58.615003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:58.630383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d5f8391-5016-4053-bec7-a5cce58a2ae9 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1472 microversion: 2.1 time: 0.638208 Oct 13 08:40:58.636172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1143/2123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:57 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:58.647755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3edbae6-6452-4b87-85c5-5b551d3cf679 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376949550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:58.768649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3edbae6-6452-4b87-85c5-5b551d3cf679 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.129018 Oct 13 08:40:58.770640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1144/2124] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:40:58 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:58.792614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b08de7cb-403b-46f6-8e86-387b0e396d2c tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f5376696940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:58.887727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b08de7cb-403b-46f6-8e86-387b0e396d2c tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:58.913389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b08de7cb-403b-46f6-8e86-387b0e396d2c tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:40:59.232254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:59.246075 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a033075e-a46e-44fc-8297-3a0635385b50 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1468 microversion: 2.1 time: 0.802520 Oct 13 08:40:59.260455 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 981/2125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:58 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1468 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:40:59.282708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb726935-3fe0-4a8d-b3c7-0d230b45e5ac", "name": "network-vif-deleted", "tag": "8c5f10eb-b7a2-4817-85f1-c15720da15ec"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:59.299765 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b08de7cb-403b-46f6-8e86-387b0e396d2c tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.526335 Oct 13 08:40:59.299978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:59.302095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1145/2126] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:40:58 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:59.312993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:59.316270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:59.324401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:59.325296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:59.361576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] Creating event network-vif-deleted:8c5f10eb-b7a2-4817-85f1-c15720da15ec for instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac on n-h1-858384-11 Oct 13 08:40:59.387699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:59.388209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:59.397611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:59.402969 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c3ea48fe-4687-4436-8364-50b1121c094a req-36e0bd3f-6491-4003-84f7-3ea829f1ce5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121321 Oct 13 08:40:59.403819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:59.405360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 982/2127] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:40:59.405716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:59.406186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:59.421215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d635f6ac-6024-49f1-857b-c4d2839aee45 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f53760c23a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:59.516940 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d635f6ac-6024-49f1-857b-c4d2839aee45 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.106836 Oct 13 08:40:59.517792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 983/2128] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:40:59 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:40:59.541190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:40:59.542151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:40:59.564924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:59.565414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:59.575133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:59.576185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:40:59.576826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:40:59.577421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:40:59.705446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:59.720933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:59.725779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:40:59.731767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83fc40af-cb4f-4bd1-87a8-31a1fd134c4b tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.425033 Oct 13 08:40:59.735434 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1146/2129] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:40:59 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:40:59.752404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a4fe4a6-8323-4641-9109-a8cc5e39e22e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f53769c4550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:40:59.868329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a4fe4a6-8323-4641-9109-a8cc5e39e22e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:40:59.881414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0a4fe4a6-8323-4641-9109-a8cc5e39e22e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:00.123157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:00.131876 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e7862d7-32af-4d9e-aeec-d126af8eec86 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.607122 Oct 13 08:41:00.132571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 984/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:40:59 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:00.146591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:00.147206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:00.186578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.193784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.195237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.196171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.200007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.200246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.379171 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a4fe4a6-8323-4641-9109-a8cc5e39e22e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.639538 Oct 13 08:41:00.383265 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1147/2131] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:40:59 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:00.401328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9900ef64-6643-4731-a77c-7616ae962172", "name": "network-vif-deleted", "tag": "39248227-63dd-4d7f-97b0-1582f148dcfa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:00.406205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.407898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.409364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.410014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lazy-loading 'fault' on Instance uuid cb726935-3fe0-4a8d-b3c7-0d230b45e5ac {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:00.424204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:00.433856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.434906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.435774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.480532 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] Creating event network-vif-deleted:39248227-63dd-4d7f-97b0-1582f148dcfa for instance 9900ef64-6643-4731-a77c-7616ae962172 on n-h1-858384-11 Oct 13 08:41:00.497491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-08071d35-b695-4b8d-8d5c-6acd68d01802 req-37c3c963-14f1-4736-b109-96f7e93b5c2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111892 Oct 13 08:41:00.500284 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1148/2132] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:00.515905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07240968-5a32-445d-b1b9-4a271b639e3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53765723a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:00.559485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d326ddd0764f2fb25a8aa48a228d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2e046db1d74ba093a06ec9e17c31a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:00.571861 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09fef558-9197-4160-9e04-9aee1aebd02c tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 200 len: 1306 microversion: 2.1 time: 0.436428 Oct 13 08:41:00.572809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 985/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:00 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 1306 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:00.585516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:00.592496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:00.611720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07240968-5a32-445d-b1b9-4a271b639e3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.106859 Oct 13 08:41:00.614747 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1149/2134] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:00 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:00.639592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e5d8928-6ed4-408c-8b87-9ad21cac8f61 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f5376865700>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:00.640270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.647447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.648061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.651191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.653639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.654105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.738696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:00.739474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:00.740116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:00.740740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lazy-loading 'fault' on Instance uuid 9900ef64-6643-4731-a77c-7616ae962172 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:00.762512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9e5d8928-6ed4-408c-8b87-9ad21cac8f61 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:00.778041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9e5d8928-6ed4-408c-8b87-9ad21cac8f61 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:01.208425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:01.237090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea954c38-2d89-42bd-a76a-1cd36fd40e82 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 200 len: 1302 microversion: 2.1 time: 0.662585 Oct 13 08:41:01.241652 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 986/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:00 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 1302 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:01.254529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:01.262526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:01.290687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.293017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.294033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.298759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.299930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.301979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.492157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:01.506680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:01.509205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:01.511378 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd08090f-0610-4cff-82ee-6676e4bf949d tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.267273 Oct 13 08:41:01.512959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 987/2136] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:01 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:01.524123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:01.526379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:01.550532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.551487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.552258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.553801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.554620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.555590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.724645 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e5d8928-6ed4-408c-8b87-9ad21cac8f61 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 64 microversion: 2.1 time: 1.108177 Oct 13 08:41:01.726660 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1150/2137] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:00 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 64 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:01.740629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:01.742674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] [instance: cb726935-3fe0-4a8d-b3c7-0d230b45e5ac] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:01.760127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.762979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.765180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.769310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:01.770005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:01.771442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:01.817251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] HTTP exception thrown: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Request method failure captured: Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac HTTP/1.1 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR84si91zMlBElRXtJIh2Vul0ze859f_sI7ot_ffOG8pSsZn0i005zAtEcPoA35fJnIG6BZ97pGJ_SnazGZ7wBLWXfSwslb7-1BDXKpHfwSm0IVtD3M5DV-8xsBGvIto9Kw49V36yhQXI9BrSBFPIL9xCScIHaOYbu7gX2flOROAivQM Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:01.821130 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de2e046db1d74ba093a06ec9e17c31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de2e046db1d74ba093a06ec9e17c31a5 Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2065275996 Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e3d326ddd0764f2fb25a8aa48a228d63 Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersOnMultiNodesTest-2065275996-project Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. Oct 13 08:41:01.823242 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cb726935-3fe0-4a8d-b3c7-0d230b45e5ac'} Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:01.824342 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. Oct 13 08:41:01.826308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:01.831282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] Returning 404 to user: Instance cb726935-3fe0-4a8d-b3c7-0d230b45e5ac could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:01.834115 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf1edfe9-2169-407c-8512-14eb75044681 tempest-ServersOnMultiNodesTest-2065275996 tempest-ServersOnMultiNodesTest-2065275996-project] 10.222.0.23 "GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac" status: 404 len: 111 microversion: 2.1 time: 0.105975 Oct 13 08:41:01.836182 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1151/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:01 2022] GET /compute/v2.1/servers/cb726935-3fe0-4a8d-b3c7-0d230b45e5ac => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:01.850335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8e191a9-6412-4442-8a40-61178683570b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376f0ae50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:01.952890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8e191a9-6412-4442-8a40-61178683570b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.113898 Oct 13 08:41:01.961433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1152/2139] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:01 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:01.969340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df376f1f-984d-4833-a89f-f1eaefd547ba tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f5376865550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:02.100525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df376f1f-984d-4833-a89f-f1eaefd547ba tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 64 microversion: 2.1 time: 0.137639 Oct 13 08:41:02.101315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1153/2140] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:01 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 64 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:02.112386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54c66bcc-f2a6-40fd-855c-fccb44520ac4 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f53768651f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:02.143369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:02.157668 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39dbc26a-9fa3-40b8-b441-b1950a0f8b22 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.643318 Oct 13 08:41:02.159764 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 988/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:01 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:02.266241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:02.267053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 9900ef64-6643-4731-a77c-7616ae962172] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:02.282997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-54c66bcc-f2a6-40fd-855c-fccb44520ac4 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:02.291684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.292204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.292654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.300314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.300842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.301254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.305051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-54c66bcc-f2a6-40fd-855c-fccb44520ac4 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:02.379099 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] HTTP exception thrown: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Request method failure captured: Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 HTTP/1.1 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83lgdkQ5xzbi28JgubX5aMHNIBGsJlLvGYRE0l606BeFbWXCoExYsmCmqSgFqD7X13qX83PLAya7KEAxqfIpKkAJNEc70bSrYDIV_R1WxLAu-P8DU2Rw8fzJu3hYGh4KIwQk5x-rs9n_VgQNtidE3rJev6IGohK8i5jiNx4hJ3C4wM Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:02.380943 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 51786b86408246ec87981e7d0c3c52e3 Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. Oct 13 08:41:02.382796 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '9900ef64-6643-4731-a77c-7616ae962172'} Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:02.383770 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. Oct 13 08:41:02.385202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:02.386607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Returning 404 to user: Instance 9900ef64-6643-4731-a77c-7616ae962172 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:02.388998 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c84fc68-bf35-4356-a70f-eed6cb618704 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172" status: 404 len: 111 microversion: 2.1 time: 0.122405 Oct 13 08:41:02.397540 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 989/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:02 2022] GET /compute/v2.1/servers/9900ef64-6643-4731-a77c-7616ae962172 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:02.413032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:02.413695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:02.440448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.441022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.441609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.442309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.448600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.450337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.542633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:02.724126 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b99ccae2-226b-4eb7-b9c8-c32bbab84fe0 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 204 len: 0 microversion: 2.1 time: 0.321433 Oct 13 08:41:02.726450 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 990/2143] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:02 2022] DELETE /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:02.744860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:02.748152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:02.767433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.770699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.772029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.773730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:02.782531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:02.786141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:02.947056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:02.951411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:02.965327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:02.966914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:02.973259 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-313ca1d2-43e0-4b8a-8814-56fa2dc98a04 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.245183 Oct 13 08:41:02.976589 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 991/2144] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:02 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:03.055719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:03.056590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:03.103034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:03.104429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:03.105677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:03.106522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:03.108237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:03.111481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:03.291323 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54c66bcc-f2a6-40fd-855c-fccb44520ac4 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 1.181982 Oct 13 08:41:03.292603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1154/2145] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:02 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:03.306155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc05f87b-9913-4638-a92a-86bc3761012e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376865b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:03.391220 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc05f87b-9913-4638-a92a-86bc3761012e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.097125 Oct 13 08:41:03.394463 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1155/2146] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:03 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:03.400153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:03.400799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:03.414235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:03.415070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:03.416172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:03.417691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:03.418367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:03.420927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:03.593469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:03.614375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8b5bc3b-f179-46f9-8a25-30b98f10e1a3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1532 microversion: 2.1 time: 0.623026 Oct 13 08:41:03.617474 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 992/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:02 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1532 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:03.647801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d180f2b3-2af4-4c06-b011-fb69c4ee9553 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update', calling method: .version_select at 0x7f537a9f0430>, body: {"meta": {"os_version": "alt"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:03.756209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d180f2b3-2af4-4c06-b011-fb69c4ee9553 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:03.769464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d180f2b3-2af4-4c06-b011-fb69c4ee9553 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:04.052340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:04.071317 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f664027-ba50-4596-84a8-f8ac61112066 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.675642 Oct 13 08:41:04.094609 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1156/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:03 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:04.124471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:04.134383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:04.169779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:04.170274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:04.170751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:04.171497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:04.172595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:04.173043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:04.408715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:04.418030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:04.419658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:04.421008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7524ee0c-1e7d-46fc-adef-f38bcc0c6648 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.309622 Oct 13 08:41:04.439789 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1157/2149] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:04 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:04.464541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce634290-8feb-440c-8254-f7d6ab83b1a2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376949a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:04.488367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d180f2b3-2af4-4c06-b011-fb69c4ee9553 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.867021 Oct 13 08:41:04.493781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 993/2150] 10.222.0.23 () {60 vars in 1313 bytes} [Thu Oct 13 08:41:03 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata/os_version => generated 31 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:04.502329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b3775ec-c9c7-459c-a19c-f0b5255bf9cd tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f537aac7e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:04.631607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce634290-8feb-440c-8254-f7d6ab83b1a2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.190259 Oct 13 08:41:04.632518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1158/2151] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:04 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:04.641659 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b3775ec-c9c7-459c-a19c-f0b5255bf9cd tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 58 microversion: 2.1 time: 0.146594 Oct 13 08:41:04.645335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:04.646286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:04.647560 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 994/2152] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:04 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 58 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:04.655115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae40d7e1-9597-4f01-8d6a-46647f64ce6e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'update_all', calling method: .version_select at 0x7f537a99f670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:04.663140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:04.663928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:04.671024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:04.673442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:04.674190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:04.674918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:04.757053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ae40d7e1-9597-4f01-8d6a-46647f64ce6e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:04.774438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ae40d7e1-9597-4f01-8d6a-46647f64ce6e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:05.267543 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae40d7e1-9597-4f01-8d6a-46647f64ce6e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 61 microversion: 2.1 time: 0.618737 Oct 13 08:41:05.268664 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 995/2153] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:04 2022] PUT /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 61 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:05.277689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:05.282327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:05.295460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:05.300426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:05.301245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:05.301882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:05.302825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:05.303449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:05.304040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:05.311959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9926d24e-19e6-4a01-b354-2a936c16e809 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1532 microversion: 2.1 time: 0.671195 Oct 13 08:41:05.326428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1159/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:04 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1532 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:05.326428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3909fd76-428b-4a0a-8022-d315bca0d61e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Action: 'create', calling method: .version_select at 0x7f5376e495e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:05.409551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3909fd76-428b-4a0a-8022-d315bca0d61e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:05.418734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3909fd76-428b-4a0a-8022-d315bca0d61e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Getting quotas for user 788f088a8e794522b7f7ac5791c53f40 and project 4122d3faf8d74e3cb0e9e8492e99fb0b. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:06.038221 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3909fd76-428b-4a0a-8022-d315bca0d61e tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "POST /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 85 microversion: 2.1 time: 0.721745 Oct 13 08:41:06.038925 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1160/2155] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Oct 13 08:41:05 2022] POST /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 85 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:06.048678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:06.057960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:06.069036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:06.073196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:06.073743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:06.074601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:06.075146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:06.077146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:06.218187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:06.227905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:06.252348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:06.256393 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cbb1696-8d0c-4099-8b57-2c96465559e2 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1266 microversion: 2.25 time: 0.216380 Oct 13 08:41:06.260293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1161/2156] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:06 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:06.267559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ea84b79-4f62-40eb-88d7-5a6fe2e4715a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376ec2310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:06.317406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:06.330166 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1b8c8cd-0e15-408b-b600-774fd519124c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.060191 Oct 13 08:41:06.333445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 996/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:05 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:06.379359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ea84b79-4f62-40eb-88d7-5a6fe2e4715a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1438 microversion: 2.1 time: 0.118010 Oct 13 08:41:06.380129 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1162/2158] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:06 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:06.414691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fff3b764-2e9e-498f-a626-3e8a19da93e1 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] Calling method '.version_select at 0x7f5376ef74c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:06.533752 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fff3b764-2e9e-498f-a626-3e8a19da93e1 tempest-ImagesMetadataTestJSON-1103958102 tempest-ImagesMetadataTestJSON-1103958102-project] 10.222.0.23 "GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata" status: 200 len: 85 microversion: 2.1 time: 0.152490 Oct 13 08:41:06.534339 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1163/2159] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:06 2022] GET /compute/v2.1/images/9279c25c-45dd-4736-bf87-1472668f3a61/metadata => generated 85 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:41:06.552705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:06.553347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:06.581833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:06.582622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:06.583272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:06.584267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:06.584915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:06.585529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:06.752341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-33d87d32-6295-4d2e-9195-70a7bafd54be tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.416127 Oct 13 08:41:06.752877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 997/2160] 10.222.0.23 () {58 vars in 1128 bytes} [Thu Oct 13 08:41:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 08:41:06.762110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10d046dd-3257-40ee-a723-cda8ed7c5fdf tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Calling method '.version_select at 0x7f537aac7940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:06.953903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-10d046dd-3257-40ee-a723-cda8ed7c5fdf tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] HTTP exception thrown: Image not found. Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10d046dd-3257-40ee-a723-cda8ed7c5fdf tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Request method failure captured: Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88hDQzMAlBLEBMVwafZZe6lukXvu35N-oT0NSxcmb4V2CnqKhY7VEae6WMii4lk61Hws6qXOhtJPUROQo1bnWvGVpBMQt7hqSDYz9BgdyZa0J_mdYfg1ekOllGdgl5SmlIniE26N6hutVmr2ifAoCJoYWdb68PHrHyq32NygE1YPiE Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:06.973916 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0593862b5e334ac59a488f559653b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 107a2f7ae8934413ad214ea5a8b43d59 Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '-1'} Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:06.975838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.977080 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:06.978751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:06.980406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10d046dd-3257-40ee-a723-cda8ed7c5fdf tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:06.981606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10d046dd-3257-40ee-a723-cda8ed7c5fdf tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.221862 Oct 13 08:41:06.982458 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 998/2161] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 08:41:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:06.999296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a5371b1-9dff-4ca5-a4fd-f7d09ec75780 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Calling method '.version_select at 0x7f537aac71f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.085322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6a5371b1-9dff-4ca5-a4fd-f7d09ec75780 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] HTTP exception thrown: Image not found. Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a5371b1-9dff-4ca5-a4fd-f7d09ec75780 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Request method failure captured: Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/a19ad6cd-d038-43b9-b21c-9005fb3f93aj HTTP/1.1 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88hDQzMAlBLEBMVwafZZe6lukXvu35N-oT0NSxcmb4V2CnqKhY7VEae6WMii4lk61Hws6qXOhtJPUROQo1bnWvGVpBMQt7hqSDYz9BgdyZa0J_mdYfg1ekOllGdgl5SmlIniE26N6hutVmr2ifAoCJoYWdb68PHrHyq32NygE1YPiE Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:07.087569 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0593862b5e334ac59a488f559653b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 107a2f7ae8934413ad214ea5a8b43d59 Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'a19ad6cd-d038-43b9-b21c-9005fb3f93aj'} Oct 13 08:41:07.089074 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a19ad6cd-d038-43b9-b21c-9005fb3f93aj to delete Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.090098 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a19ad6cd-d038-43b9-b21c-9005fb3f93aj could not be found. Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:07.091446 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:07.092809 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.097815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a5371b1-9dff-4ca5-a4fd-f7d09ec75780 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:07.099411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a5371b1-9dff-4ca5-a4fd-f7d09ec75780 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/a19ad6cd-d038-43b9-b21c-9005fb3f93aj" status: 404 len: 62 microversion: 2.1 time: 0.111031 Oct 13 08:41:07.100263 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 999/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:06 2022] DELETE /compute/v2.1/images/a19ad6cd-d038-43b9-b21c-9005fb3f93aj => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:41:07.112491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9514da78-f472-4e5c-ac09-547ffec4f2a5 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Calling method '.version_select at 0x7f537a9a4940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.118241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:07.135032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d9d12f1-4701-434d-b698-f88a48709b14 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 200 len: 1532 microversion: 2.1 time: 0.590547 Oct 13 08:41:07.137419 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1164/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:06 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 1532 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:07.169715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9514da78-f472-4e5c-ac09-547ffec4f2a5 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] HTTP exception thrown: Image not found. Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9514da78-f472-4e5c-ac09-547ffec4f2a5 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Request method failure captured: Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/fab74e10-a9a0-43a8-abfc-e563616826551 HTTP/1.1 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88hDQzMAlBLEBMVwafZZe6lukXvu35N-oT0NSxcmb4V2CnqKhY7VEae6WMii4lk61Hws6qXOhtJPUROQo1bnWvGVpBMQt7hqSDYz9BgdyZa0J_mdYfg1ekOllGdgl5SmlIniE26N6hutVmr2ifAoCJoYWdb68PHrHyq32NygE1YPiE Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:07.172505 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0593862b5e334ac59a488f559653b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 107a2f7ae8934413ad214ea5a8b43d59 Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fab74e10-a9a0-43a8-abfc-e563616826551'} Oct 13 08:41:07.174052 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fab74e10-a9a0-43a8-abfc-e563616826551 to delete Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.174994 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fab74e10-a9a0-43a8-abfc-e563616826551 could not be found. Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:07.176274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:07.180852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.185141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9514da78-f472-4e5c-ac09-547ffec4f2a5 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:07.186277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9514da78-f472-4e5c-ac09-547ffec4f2a5 tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/fab74e10-a9a0-43a8-abfc-e563616826551" status: 404 len: 62 microversion: 2.1 time: 0.080415 Oct 13 08:41:07.188985 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1000/2164] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:07 2022] DELETE /compute/v2.1/images/fab74e10-a9a0-43a8-abfc-e563616826551 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:07.208722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1b6e830-5a45-4636-bf70-d9c7b960397c tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Calling method '.version_select at 0x7f53765a00d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.257686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a1b6e830-5a45-4636-bf70-d9c7b960397c tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] HTTP exception thrown: Image not found. Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1b6e830-5a45-4636-bf70-d9c7b960397c tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Request method failure captured: Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/tempest-invalid-1680361543 HTTP/1.1 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88hDQzMAlBLEBMVwafZZe6lukXvu35N-oT0NSxcmb4V2CnqKhY7VEae6WMii4lk61Hws6qXOhtJPUROQo1bnWvGVpBMQt7hqSDYz9BgdyZa0J_mdYfg1ekOllGdgl5SmlIniE26N6hutVmr2ifAoCJoYWdb68PHrHyq32NygE1YPiE Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:07.261428 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0593862b5e334ac59a488f559653b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 107a2f7ae8934413ad214ea5a8b43d59 Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'tempest-invalid-1680361543'} Oct 13 08:41:07.263068 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1680361543 to delete Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.263962 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1680361543 could not be found. Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:07.267400 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1b6e830-5a45-4636-bf70-d9c7b960397c tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:07.271935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a1b6e830-5a45-4636-bf70-d9c7b960397c tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1680361543" status: 404 len: 62 microversion: 2.1 time: 0.072999 Oct 13 08:41:07.274457 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1165/2165] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Oct 13 08:41:07 2022] DELETE /compute/v2.1/images/tempest-invalid-1680361543 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:07.280712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60da9ff1-c980-4ec1-906a-5aa217c2ac8e tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Calling method '.version_select at 0x7f537a9a4ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.294183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.295172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:07.306305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:07.307236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:07.307942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:07.308917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:07.309613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:07.310298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:07.329762 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-60da9ff1-c980-4ec1-906a-5aa217c2ac8e tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] HTTP exception thrown: Image not found. Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60da9ff1-c980-4ec1-906a-5aa217c2ac8e tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Request method failure captured: Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/9fb1aef7-4352-44a8-a7f4-c16d22e2907f HTTP/1.1 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88hDQzMAlBLEBMVwafZZe6lukXvu35N-oT0NSxcmb4V2CnqKhY7VEae6WMii4lk61Hws6qXOhtJPUROQo1bnWvGVpBMQt7hqSDYz9BgdyZa0J_mdYfg1ekOllGdgl5SmlIniE26N6hutVmr2ifAoCJoYWdb68PHrHyq32NygE1YPiE Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:07.332632 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0593862b5e334ac59a488f559653b8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0593862b5e334ac59a488f559653b8c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 0593862b5e334ac59a488f559653b8c5 Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554 Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 107a2f7ae8934413ad214ea5a8b43d59 Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1096792554-project Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '9fb1aef7-4352-44a8-a7f4-c16d22e2907f'} Oct 13 08:41:07.334181 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9fb1aef7-4352-44a8-a7f4-c16d22e2907f to delete Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.335707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9fb1aef7-4352-44a8-a7f4-c16d22e2907f could not be found. Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:07.338284 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60da9ff1-c980-4ec1-906a-5aa217c2ac8e tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:07.341451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60da9ff1-c980-4ec1-906a-5aa217c2ac8e tempest-ImagesDeleteNegativeTestJSON-1096792554 tempest-ImagesDeleteNegativeTestJSON-1096792554-project] 10.222.0.23 "DELETE /compute/v2.1/images/9fb1aef7-4352-44a8-a7f4-c16d22e2907f" status: 404 len: 62 microversion: 2.1 time: 0.058071 Oct 13 08:41:07.343669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1001/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:07 2022] DELETE /compute/v2.1/images/9fb1aef7-4352-44a8-a7f4-c16d22e2907f => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:07.360109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.361087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:07.380567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:07.381105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:07.381554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:07.388779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:07.389445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:07.389898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:07.408892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:07.409825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:07.410453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:07.411071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lazy-loading 'fault' on Instance uuid a1f51160-5f0d-4b85-a628-0194d8f61795 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:07.548397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:07.571471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:07.587110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:07.601312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b843532-e75a-4a31-824a-8594532f805f tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 200 len: 1271 microversion: 2.25 time: 0.314694 Oct 13 08:41:07.605749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1166/2167] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:07 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 1271 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:07.627980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f47a5bb8-bf2f-4116-95a5-090be5043a0c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376fad820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:07.753982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f47a5bb8-bf2f-4116-95a5-090be5043a0c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1447 microversion: 2.1 time: 0.138469 Oct 13 08:41:07.757714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1167/2168] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:07 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:08.400734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:08.447361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1aa36e97-a300-4ae9-8184-241488452af7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.088729 Oct 13 08:41:08.449461 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1002/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:07 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:08.471616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca", "name": "network-vif-deleted", "tag": "2b02ad32-7aa5-4a2e-803d-aa110cd56d87"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:08.476458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f18f73a7-e3f2-42be-b673-8276992e82dd tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.500662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f18f73a7-e3f2-42be-b673-8276992e82dd tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.727125 Oct 13 08:41:08.502502 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1168/2170] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:08.514573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d307091-a77e-4802-9282-2e4f602ac1e4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5377299af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.518106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:08.521673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:08.524255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:08.588159 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] Creating event network-vif-deleted:2b02ad32-7aa5-4a2e-803d-aa110cd56d87 for instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca on n-h1-858384-11 Oct 13 08:41:08.611799 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bf0e607f-32af-49de-9b48-d723c5906c64 req-f1daf953-072f-4175-9fce-28428681f3e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157517 Oct 13 08:41:08.616459 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d307091-a77e-4802-9282-2e4f602ac1e4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 200 len: 1447 microversion: 2.1 time: 0.111318 Oct 13 08:41:08.616982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1003/2171] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:08.617114 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1169/2172] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:08.636457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea938640-9d61-488c-9d16-be4c2aa13dfc tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.641718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.651648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:08.676030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:08.681446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:08.681913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:08.683883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:08.686505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:08.689805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:08.693190 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea938640-9d61-488c-9d16-be4c2aa13dfc tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.062761 Oct 13 08:41:08.696084 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1170/2173] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:08.704652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.712188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: a1f51160-5f0d-4b85-a628-0194d8f61795] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:08.728480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:08.731956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:08.735754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:08.736942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:08.738039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:08.741499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:08.741715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] HTTP exception thrown: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Request method failure captured: Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca HTTP/1.1 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR83lgdkQ5xzbi28JgubX5aMHNIBGsJlLvGYRE0l606BeFbWXCoExYsmCmqSgFqD7X13qX83PLAya7KEAxqfIpKkAJNEc70bSrYDIV_R1WxLAu-P8DU2Rw8fzJu3hYGh4KIwQk5x-rs9n_VgQNtidE3rJev6IGohK8i5jiNx4hJ3C4wM Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:08.744703 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 51786b86408246ec87981e7d0c3c52e3 Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. Oct 13 08:41:08.746476 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca'} Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:08.747964 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. Oct 13 08:41:08.751114 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.754067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Returning 404 to user: Instance 7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:08.754067 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c4c0196-8e51-435d-b5d6-b707121e77be tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca" status: 404 len: 111 microversion: 2.1 time: 0.125732 Oct 13 08:41:08.772161 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1004/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/servers/7ad58eff-2f40-4e2d-b4e7-89bd87c4d6ca => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:08.784808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] HTTP exception thrown: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Request method failure captured: Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 HTTP/1.1 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82HyLaqKaA2SUPBraHq6XrnxvUNBLNWwMNu4PEpujOQxdSekreTeTL-0rAfEzqaQZDN4AJp3vvd4bCH2svlNNe2MFMjjzfMrOEhtU3bBhkMuSlblvQNMNGnpvS_sNHn69d-1q3Dh90KU_M9VSeVVBSxdXxPjlhrLvoEeOBg02gq_T8 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.25 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:08.786730 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bce8c77c716d424abb6b86181e409501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c09ea2313b3343579cb75d16d8f220ee Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. Oct 13 08:41:08.788451 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a1f51160-5f0d-4b85-a628-0194d8f61795'} Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:08.789333 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. Oct 13 08:41:08.790724 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:08.793365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Returning 404 to user: Instance a1f51160-5f0d-4b85-a628-0194d8f61795 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:08.793778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a534044-1088-46f2-bde0-f115f1620861 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aa54f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.794889 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc6ffb7e-f472-485b-8ddd-a9d6fac6faaa tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795" status: 404 len: 111 microversion: 2.25 time: 0.097542 Oct 13 08:41:08.798444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1171/2175] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/servers/a1f51160-5f0d-4b85-a628-0194d8f61795 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:08.813110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e7d424a-fcde-4ed0-b0cd-ef63d9a2d514 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.845701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e7d424a-fcde-4ed0-b0cd-ef63d9a2d514 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045525 Oct 13 08:41:08.849727 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1172/2176] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:08.863075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1601357-00c7-4d87-a04b-406842e65f39 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '.version_select at 0x7f5376696280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.913836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1601357-00c7-4d87-a04b-406842e65f39 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960283656" status: 202 len: 0 microversion: 2.1 time: 0.055234 Oct 13 08:41:08.915357 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1173/2177] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960283656 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:41:08.946042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61c598e3-d1dd-434e-86eb-35b17bd1a965 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:08.988128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61c598e3-d1dd-434e-86eb-35b17bd1a965 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065704 Oct 13 08:41:08.988832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1174/2178] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:09.004118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1538587e-4532-4eb4-afc1-8502c93d7a31 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.094163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1538587e-4532-4eb4-afc1-8502c93d7a31 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.093384 Oct 13 08:41:09.095317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1175/2179] 10.222.0.23 () {58 vars in 1165 bytes} [Thu Oct 13 08:41:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:09.113010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f9e6fb5-4d4b-4081-ba6a-5d94cdf86450 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.146665 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f9e6fb5-4d4b-4081-ba6a-5d94cdf86450 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034868 Oct 13 08:41:09.147311 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1176/2180] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:41:09.160320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b04382ae-fa4e-4deb-982d-a6f991e701fe tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.223602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b04382ae-fa4e-4deb-982d-a6f991e701fe tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.067823 Oct 13 08:41:09.229559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1177/2181] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:09.246803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-98db595b-f18a-471b-b49e-98f891a0adcb tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.272610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-98db595b-f18a-471b-b49e-98f891a0adcb tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030356 Oct 13 08:41:09.277955 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1178/2182] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:09.294704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-071cc3bc-b81a-4160-a498-65e0363908c1 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.315763 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-071cc3bc-b81a-4160-a498-65e0363908c1 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026113 Oct 13 08:41:09.317293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1179/2183] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:09.329841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2461f79-7133-42a4-94da-2a62508873b4 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.487176 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2461f79-7133-42a4-94da-2a62508873b4 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.161268 Oct 13 08:41:09.498095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1180/2184] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:09.505199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.529189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:09.541351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:09.544693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:09.545880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:09.551323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:09.564712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:09.565384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:09.857766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:09.871001 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e99a7b5b-98c6-4bfb-8f5b-279463ad5080 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.379681 Oct 13 08:41:09.873163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1181/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:09.895213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90e42b47-bc8b-44b9-afd3-a0853ac0ca80 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:09.927702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90e42b47-bc8b-44b9-afd3-a0853ac0ca80 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037112 Oct 13 08:41:09.935100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1182/2186] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:09.963813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00a9fac7-6835-4ac3-be95-28f0382078aa tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.023563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00a9fac7-6835-4ac3-be95-28f0382078aa tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.083118 Oct 13 08:41:10.048003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1183/2187] 10.222.0.23 () {58 vars in 1144 bytes} [Thu Oct 13 08:41:09 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:10.068915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-535f9322-a577-4572-aa41-f133afda03dd tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.077408 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-535f9322-a577-4572-aa41-f133afda03dd tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017742 Oct 13 08:41:10.088731 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1184/2188] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:10.098059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7145778e-7fca-47fd-aa2a-17e9c81e7503 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.127455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7145778e-7fca-47fd-aa2a-17e9c81e7503 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.036873 Oct 13 08:41:10.139194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1185/2189] 10.222.0.23 () {58 vars in 1148 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:10.148559 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a534044-1088-46f2-bde0-f115f1620861 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 204 len: 0 microversion: 2.1 time: 1.373407 Oct 13 08:41:10.149189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1005/2190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:08 2022] DELETE /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 0 bytes in 1376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:10.158248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.158849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:10.164897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0bbf962a-5755-45fc-b360-191ff70f8db4 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.195769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:10.196276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:10.196726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:10.197444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:10.199715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:10.208733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:10.225908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0bbf962a-5755-45fc-b360-191ff70f8db4 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.085527 Oct 13 08:41:10.227996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1186/2191] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:10.242107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd1f6221-a0ec-4b2f-baa4-73f60e3cffa9 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.261826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd1f6221-a0ec-4b2f-baa4-73f60e3cffa9 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025134 Oct 13 08:41:10.269017 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1187/2192] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:41:10.280924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96ad5e01-2ffc-4cbf-b523-7d65b6182c0d tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.282434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:10.342832 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96ad5e01-2ffc-4cbf-b523-7d65b6182c0d tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.060436 Oct 13 08:41:10.343523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1188/2193] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:10.357920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d738390-f313-406a-83fa-fb39b444fff5 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.404809 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d738390-f313-406a-83fa-fb39b444fff5 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051324 Oct 13 08:41:10.408230 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1189/2194] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:10.435723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-646a74e0-6e48-4fc5-8465-62b5d5202086 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.474015 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-986baed7-aa6b-40b1-8d55-fe1358818ae9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 204 len: 0 microversion: 2.1 time: 0.320237 Oct 13 08:41:10.474942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-646a74e0-6e48-4fc5-8465-62b5d5202086 tempest-FlavorsV2TestJSON-1497529120 tempest-FlavorsV2TestJSON-1497529120-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045284 Oct 13 08:41:10.476861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1006/2195] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:10 2022] DELETE /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:41:10.477307 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1190/2196] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:10.806745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-354260790", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:10.898689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:10.899314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:10.920280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:10.920854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:10.921310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:10.926190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:10.926802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:10.927226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:10.950877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:41:11.313625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:11.333654 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fba9134c-0aec-44cc-baef-34a61a523ca8 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.437615 Oct 13 08:41:11.360262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1191/2197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:10 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:11.376577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:11.379209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:11.396319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:11.397833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:11.400946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:11.401919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:11.402587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:11.404796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:11.462649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:11.472320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:11.577636 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eac5df40-1644-4ea2-ae95-8608c745e83b tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "DELETE /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 204 len: 0 microversion: 2.1 time: 0.215164 Oct 13 08:41:11.579182 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1192/2198] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:11 2022] DELETE /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:12.122586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-029fed2f-bc90-4f66-a5b9-265eb0c6395c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f5376f0aee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFE8zydUDusXT8lEeOhzTELx5kmVcPwctIhPRyJ8WZlu362YyS+vS8NXTuyJIv+JGzCgoG6yXslwVqeE4NOgFjsOauze2/wtIGFncOSwLOAk9/oNMZ4aficD8dIIxbxIA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-029fed2f-bc90-4f66-a5b9-265eb0c6395c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 257 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:12.138703 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:12.140683 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFE8zydUDusXT8lEeOhzTELx5kmVcPwctIhPRyJ8WZlu362YyS+vS8NXTuyJIv+JGzCgoG6yXslwVqeE4NOgFjsOauze2/wtIGFncOSwLOAk9/oNMZ4aficD8dIIxbxIA=="}} Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFE8zydUDusXT8lEeOhzTELx5kmVcPwctIhPRyJ8WZlu362YyS+vS8NXTuyJIv+JGzCgoG6yXslwVqeE4NOgFjsOauze2/wtIGFncOSwLOAk9/oNMZ4aficD8dIIxbxIA=='}}} Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.141809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:12.144022 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:41:12.146279 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:41:12.151023 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 13 08:41:12.151023 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.151023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-029fed2f-bc90-4f66-a5b9-265eb0c6395c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:12.151476 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-029fed2f-bc90-4f66-a5b9-265eb0c6395c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.569756 Oct 13 08:41:12.152573 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1193/2199] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:11 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 572 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:12.162450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:12.163647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:12.169927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:12.174196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.175019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.175622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.176504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.177270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.177881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.366736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:12.377112 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c0e1142-29b9-4f8c-86d8-3b36ebbdb065 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1469 microversion: 2.1 time: 0.222855 Oct 13 08:41:12.378112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1194/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:12 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:12.389148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:41:12.390359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:41:12.391417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:41:12.392487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:41:12.393162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:41:12.405424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f5376696790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-847347624", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:12.421002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.425288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.426193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.428524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.428999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.429432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.462860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:12.472233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for user a2f0d5d536744e56b1cfc466e33a507e and project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:12.486516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:12.495925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:12.513579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:12.521088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:41:12.525278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 2166 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-847347624", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:12.533887 n-d-858384-11 devstack@n-api.service[127030]: exception: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-847347624', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:12.536963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-944420f7-d172-42e5-b042-34a7bd383c0b tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.156068 Oct 13 08:41:12.541949 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1195/2201] 10.222.0.23 () {60 vars in 1160 bytes} [Thu Oct 13 08:41:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:41:12.553264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:12.625665 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-063bd7bf-019d-4865-8a9f-4422d88e08b8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822285 Oct 13 08:41:12.629220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1007/2202] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:41:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:41:12.643502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:12.644553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:12.655787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.657090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.658377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.659557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:12.660187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:12.660810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:12.880429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2156cade-ef06-49f3-a02b-56c5ce9c7e5c tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Calling method '.version_select at 0x7f5376f9ad30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:12.915172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2156cade-ef06-49f3-a02b-56c5ce9c7e5c tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2156cade-ef06-49f3-a02b-56c5ce9c7e5c tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/db73b8cc-1044-46d2-83e8-3e7cb2b61721/metadata/os_distro HTTP/1.1 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': 'db73b8cc-1044-46d2-83e8-3e7cb2b61721', 'id': 'os_distro'} Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db73b8cc-1044-46d2-83e8-3e7cb2b61721 Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:12.921799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db73b8cc-1044-46d2-83e8-3e7cb2b61721 could not be found. Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2156cade-ef06-49f3-a02b-56c5ce9c7e5c tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2156cade-ef06-49f3-a02b-56c5ce9c7e5c tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "DELETE /compute/v2.1/images/db73b8cc-1044-46d2-83e8-3e7cb2b61721/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.386161 Oct 13 08:41:12.927675 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1196/2203] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Oct 13 08:41:12 2022] DELETE /compute/v2.1/images/db73b8cc-1044-46d2-83e8-3e7cb2b61721/metadata/os_distro => generated 62 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:12.934066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd594a67-d6c0-41e1-acfe-771e300d9d2a", "name": "network-vif-unplugged", "status": "completed", "tag": "0a8fc691-4fb4-47e1-9616-4d5e67db36cf"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:13.009714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:13.013267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:13.016393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:13.057756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] Creating event network-vif-unplugged:0a8fc691-4fb4-47e1-9616-4d5e67db36cf for instance fd594a67-d6c0-41e1-acfe-771e300d9d2a on n-h2-858384-11 Oct 13 08:41:13.083982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d0cd5a35-01e9-4a5b-8841-eccfbb9612f2 req-ff361602-7344-4632-8838-e4037bc437fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155331 Oct 13 08:41:13.085679 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1197/2204] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:13.101303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c23b24-fe5c-4fbd-ba30-15f5fcda116c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f5377134f70>, body: {"keypair": {"name": "tempest-keypair-1610006907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/w/c4vRo1TDtfyKRxpzQjGwgwk3aNLNbzAZsnH97OCaI49gIK5+OoKg7FAD24pBWBarpcQ6NzDjDYLrI6mg6DB2OG+dF/ftKA2glzpAF+jre0DBuWi/191Mqgjc2xvBw=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:13.147794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-05c23b24-fe5c-4fbd-ba30-15f5fcda116c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:13.160814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-05c23b24-fe5c-4fbd-ba30-15f5fcda116c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for user a2f0d5d536744e56b1cfc466e33a507e and project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:13.222605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05c23b24-fe5c-4fbd-ba30-15f5fcda116c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133630 Oct 13 08:41:13.225236 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1198/2205] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:13.237968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8fdc2350-5fc1-430f-96a2-74f3af41c88a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:13.239623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8fdc2350-5fc1-430f-96a2-74f3af41c88a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:13.380379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8fdc2350-5fc1-430f-96a2-74f3af41c88a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:13.393705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8fdc2350-5fc1-430f-96a2-74f3af41c88a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1207 microversion: 2.1 time: 0.165907 Oct 13 08:41:13.394477 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1199/2206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:13 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1207 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:13.432113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f368df5-68b5-4511-a73e-3446c22e5667 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Calling method '.version_select at 0x7f5376ff38b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:13.473877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4f368df5-68b5-4511-a73e-3446c22e5667 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f368df5-68b5-4511-a73e-3446c22e5667 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/images/3572a59a-af4c-4742-bd03-b3374afda606/metadata/os_version HTTP/1.1 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': '3572a59a-af4c-4742-bd03-b3374afda606', 'id': 'os_version'} Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3572a59a-af4c-4742-bd03-b3374afda606 Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:13.481780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3572a59a-af4c-4742-bd03-b3374afda606 could not be found. Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:13.488862 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.496356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f368df5-68b5-4511-a73e-3446c22e5667 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:13.500015 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f368df5-68b5-4511-a73e-3446c22e5667 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "GET /compute/v2.1/images/3572a59a-af4c-4742-bd03-b3374afda606/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.104395 Oct 13 08:41:13.501844 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1200/2207] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Oct 13 08:41:13 2022] GET /compute/v2.1/images/3572a59a-af4c-4742-bd03-b3374afda606/metadata/os_version => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:13.528463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f53765a04c0>, body: {"keypair": {"name": "tempest-keypair-1610006907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlBpCeGFTdMDzzaxmM2Gjve7bZELTyASCtIlKpZeqv/orgPwK+vfD3dZj10mEZagzIYiQ4w5ETvn1w4WRZpU8oaWS1bRpvT+V079pF1Ns3+NCb+8q1eXYoKRySF5bk64A=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:13.583245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:13.593360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:13.599506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82c565b3-fd5e-4e87-8491-20cd5132565d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.968705 Oct 13 08:41:13.615309 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1008/2208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:12 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:13.622335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:13.622850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:13.642700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for user a2f0d5d536744e56b1cfc466e33a507e and project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:13.645893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:13.646431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:13.653131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:13.656928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:13.659222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:13.659684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:13.728727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] HTTP exception thrown: Key pair 'tempest-keypair-1610006907' already exists. Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 273 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "tempest-keypair-1610006907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlBpCeGFTdMDzzaxmM2Gjve7bZELTyASCtIlKpZeqv/orgPwK+vfD3dZj10mEZagzIYiQ4w5ETvn1w4WRZpU8oaWS1bRpvT+V079pF1Ns3+NCb+8q1eXYoKRySF5bk64A=="}} Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: exception: Key pair 'tempest-keypair-1610006907' already exists. Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1610006907', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlBpCeGFTdMDzzaxmM2Gjve7bZELTyASCtIlKpZeqv/orgPwK+vfD3dZj10mEZagzIYiQ4w5ETvn1w4WRZpU8oaWS1bRpvT+V079pF1Ns3+NCb+8q1eXYoKRySF5bk64A=='}}} Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a2f0d5d536744e56b1cfc466e33a507e-tempest-keypair-1610006907' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 13 08:41:13.778940 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi session.flush() Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result.read() Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 13 08:41:13.784812 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a2f0d5d536744e56b1cfc466e33a507e-tempest-keypair-1610006907' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 13, 8, 41, 13, 695412), 'updated_at': None, 'name': 'tempest-keypair-1610006907', 'user_id': 'a2f0d5d536744e56b1cfc466e33a507e', 'fingerprint': '2b:fc:d8:14:8c:d8:f2:cf:a0:c3:77:7a:21:7b:11:36', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlBpCeGFTdMDzzaxmM2Gjve7bZELTyASCtIlKpZeqv/orgPwK+vfD3dZj10mEZagzIYiQ4w5ETvn1w4WRZpU8oaWS1bRpvT+V079pF1Ns3+NCb+8q1eXYoKRySF5bk64A==', 'type': 'ssh'}] Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi keypair.create() Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._create() Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1610006907' already exists. Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 13 08:41:13.792789 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1610006907' already exists. Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1610006907' already exists. Oct 13 08:41:13.799347 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.803880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 409 to user: Key pair 'tempest-keypair-1610006907' already exists. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:13.805506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0763e8ca-e217-4097-8941-f0e04a724dad tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.298393 Oct 13 08:41:13.811419 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1201/2209] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:13 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 309 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:13.829540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82a54c32-cdfb-4dbd-8e46-ec03dc750ead tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Calling method '.version_select at 0x7f53769d7f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:13.931989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-82a54c32-cdfb-4dbd-8e46-ec03dc750ead tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82a54c32-cdfb-4dbd-8e46-ec03dc750ead tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/images/0d08bf10-68e4-49a7-b892-73988e07f59f/metadata HTTP/1.1 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': '0d08bf10-68e4-49a7-b892-73988e07f59f'} Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0d08bf10-68e4-49a7-b892-73988e07f59f Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:13.939528 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0d08bf10-68e4-49a7-b892-73988e07f59f could not be found. Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:13.945466 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:13.952357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82a54c32-cdfb-4dbd-8e46-ec03dc750ead tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:13.957388 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82a54c32-cdfb-4dbd-8e46-ec03dc750ead tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "GET /compute/v2.1/images/0d08bf10-68e4-49a7-b892-73988e07f59f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.139545 Oct 13 08:41:13.960567 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1202/2210] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:13 2022] GET /compute/v2.1/images/0d08bf10-68e4-49a7-b892-73988e07f59f/metadata => generated 62 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:13.982907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95c5c381-5f91-4a60-be7c-102bb75bd8f8 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Calling method '.version_select at 0x7f53769c4af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:14.033709 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95c5c381-5f91-4a60-be7c-102bb75bd8f8 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610006907" status: 202 len: 0 microversion: 2.1 time: 0.071080 Oct 13 08:41:14.036526 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1203/2211] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:41:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610006907 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:41:14.056125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1818340e-46a9-4761-aeab-5fb1aae15919 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Action: 'update_all', calling method: .version_select at 0x7f53768689d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.122624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1818340e-46a9-4761-aeab-5fb1aae15919 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1818340e-46a9-4761-aeab-5fb1aae15919 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/images/400c113c-fb3b-49f5-bf81-ca9b22342496/metadata HTTP/1.1 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 57 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': '400c113c-fb3b-49f5-bf81-ca9b22342496', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 400c113c-fb3b-49f5-bf81-ca9b22342496 Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:14.126426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 400c113c-fb3b-49f5-bf81-ca9b22342496 could not be found. Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1818340e-46a9-4761-aeab-5fb1aae15919 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1818340e-46a9-4761-aeab-5fb1aae15919 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "PUT /compute/v2.1/images/400c113c-fb3b-49f5-bf81-ca9b22342496/metadata" status: 404 len: 62 microversion: 2.1 time: 0.091591 Oct 13 08:41:14.134221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1204/2212] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:14 2022] PUT /compute/v2.1/images/400c113c-fb3b-49f5-bf81-ca9b22342496/metadata => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:14.162335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-631bb880-a980-4450-9ebf-101eacdab523 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f5376874820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDKuH+qjNU917nO7NFiKKszRFBwNvclGrGW9MFPS5y9P/x+XhQc+HTZluRdzckhnBKRVATTP0fUrs3UFPZJdjFrmLVjwGiLa9RJos3jBOdRSIzFwcl4Bi5Nv8gDDxQThg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-631bb880-a980-4450-9ebf-101eacdab523 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 247 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDKuH+qjNU917nO7NFiKKszRFBwNvclGrGW9MFPS5y9P/x+XhQc+HTZluRdzckhnBKRVATTP0fUrs3UFPZJdjFrmLVjwGiLa9RJos3jBOdRSIzFwcl4Bi5Nv8gDDxQThg=="}} Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDKuH+qjNU917nO7NFiKKszRFBwNvclGrGW9MFPS5y9P/x+XhQc+HTZluRdzckhnBKRVATTP0fUrs3UFPZJdjFrmLVjwGiLa9RJos3jBOdRSIzFwcl4Bi5Nv8gDDxQThg=='}}} Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi '' Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:41:14.175858 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-631bb880-a980-4450-9ebf-101eacdab523 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.184129 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-631bb880-a980-4450-9ebf-101eacdab523 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.042411 Oct 13 08:41:14.190025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1205/2213] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:14 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:14.199590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af61c1e7-75b5-4296-8b06-4ec44a15ee1d tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Action: 'update', calling method: .version_select at 0x7f5376f9a940>, body: {"meta": {"os_distro": "alt"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.233928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:14.248318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e8d5828-9fe2-496f-87b6-439cd585ce21 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1469 microversion: 2.1 time: 0.630586 Oct 13 08:41:14.250781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1009/2214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:13 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:14.261912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f537aa07700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-192636912", "public_key": " "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.275995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-af61c1e7-75b5-4296-8b06-4ec44a15ee1d tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af61c1e7-75b5-4296-8b06-4ec44a15ee1d tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/images/f23b91a4-e1ff-4f3f-8d76-2953a89593da/metadata/os_distro HTTP/1.1 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 30 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: {"meta": {"os_distro": "alt"}} Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': 'f23b91a4-e1ff-4f3f-8d76-2953a89593da', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f23b91a4-e1ff-4f3f-8d76-2953a89593da Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:14.288000 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f23b91a4-e1ff-4f3f-8d76-2953a89593da could not be found. Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:14.294121 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.301180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af61c1e7-75b5-4296-8b06-4ec44a15ee1d tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.304246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af61c1e7-75b5-4296-8b06-4ec44a15ee1d tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "PUT /compute/v2.1/images/f23b91a4-e1ff-4f3f-8d76-2953a89593da/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.115492 Oct 13 08:41:14.305497 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1206/2215] 10.222.0.23 () {60 vars in 1310 bytes} [Thu Oct 13 08:41:14 2022] PUT /compute/v2.1/images/f23b91a4-e1ff-4f3f-8d76-2953a89593da/metadata/os_distro => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:14.320314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16bfa732-875b-43bc-8e1d-6958bd8c83f7 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Action: 'create', calling method: .version_select at 0x7f53769d7550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.324859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:14.330103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for user a2f0d5d536744e56b1cfc466e33a507e and project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:14.396719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-16bfa732-875b-43bc-8e1d-6958bd8c83f7 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] HTTP exception thrown: Image not found. Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16bfa732-875b-43bc-8e1d-6958bd8c83f7 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Request method failure captured: Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/images/b8ccfa81-99a6-4cef-bd7d-c17d33067077/metadata HTTP/1.1 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 57 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88o3o-zQfEMFTKFqvD7_em4Nuu6_Ww6V8KvHPjrKkik15_RmhLHMiWRexbU_6fUWcZohXleNeW08xKCQDxzbtVcrfWzXkCcSaAEoCJS5plVtTMzXsR66IAYb_jWnxT5JLG6GrUqWCc2mg-BO-BNB6DJZo8RFMPbj-H9WvkWpIvx68Q Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc3bccaeb1040aaacc9982fe271a6a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc3bccaeb1040aaacc9982fe271a6a0 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-44559832 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 34800827daf64059ad542778aab6abb5 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-44559832-project Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'image_id': 'b8ccfa81-99a6-4cef-bd7d-c17d33067077', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b8ccfa81-99a6-4cef-bd7d-c17d33067077 Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:41:14.400160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b8ccfa81-99a6-4cef-bd7d-c17d33067077 could not be found. Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:41:14.408393 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.414291 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.415717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16bfa732-875b-43bc-8e1d-6958bd8c83f7 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 94 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-192636912", "public_key": " "}} Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: exception: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-192636912', 'public_key': ' '}}} Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.416273 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.424004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3252d9f6-1076-4c7d-9cf2-846350d0742f tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.165914 Oct 13 08:41:14.428649 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1010/2216] 10.222.0.23 () {60 vars in 1158 bytes} [Thu Oct 13 08:41:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:41:14.429406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16bfa732-875b-43bc-8e1d-6958bd8c83f7 tempest-ImagesMetadataNegativeTestJSON-44559832 tempest-ImagesMetadataNegativeTestJSON-44559832-project] 10.222.0.23 "POST /compute/v2.1/images/b8ccfa81-99a6-4cef-bd7d-c17d33067077/metadata" status: 404 len: 62 microversion: 2.1 time: 0.105140 Oct 13 08:41:14.430785 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1207/2217] 10.222.0.23 () {60 vars in 1281 bytes} [Thu Oct 13 08:41:14 2022] POST /compute/v2.1/images/b8ccfa81-99a6-4cef-bd7d-c17d33067077/metadata => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:41:14.440437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:14.444649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:14.445979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65d4250a-9209-48d6-9e00-5c71605ee0f9 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f5376fdf8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAu43jc49GDWX2ZVAXsGGEtRMyc+wGO5VQADR3uNCfdIi0Ix2ohjjrrqjh3sXcwQI4cFQA58l3UuVFoyks1Qy7UWqJYFCUaTp+cPoZ6duKGUxBQi7H4bn6xVLMbCJAkLg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65d4250a-9209-48d6-9e00-5c71605ee0f9 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 507 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAu43jc49GDWX2ZVAXsGGEtRMyc+wGO5VQADR3uNCfdIi0Ix2ohjjrrqjh3sXcwQI4cFQA58l3UuVFoyks1Qy7UWqJYFCUaTp+cPoZ6duKGUxBQi7H4bn6xVLMbCJAkLg=="}} Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAu43jc49GDWX2ZVAXsGGEtRMyc+wGO5VQADR3uNCfdIi0Ix2ohjjrrqjh3sXcwQI4cFQA58l3UuVFoyks1Qy7UWqJYFCUaTp+cPoZ6duKGUxBQi7H4bn6xVLMbCJAkLg=='}}} Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 13 08:41:14.461655 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.465780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65d4250a-9209-48d6-9e00-5c71605ee0f9 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.468765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:14.469181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:14.469612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:14.469900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65d4250a-9209-48d6-9e00-5c71605ee0f9 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.035503 Oct 13 08:41:14.470313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:14.470794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:14.471282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:14.478232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1208/2218] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:14 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:14.486447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Action: 'create', calling method: .version_select at 0x7f53769d41f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2059211610", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:14.541640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:14.553692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Getting quotas for user a2f0d5d536744e56b1cfc466e33a507e and project bd47a6842a8240f5adb08c5d04c3b7c7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:14.602244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 118 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2059211610", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: exception: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2059211610', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 13 08:41:14.608715 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 13 08:41:14.615910 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.621692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.622959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb9d8152-b169-4c8f-ac62-35da1e16625c tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.143661 Oct 13 08:41:14.624013 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1209/2219] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 13 08:41:14.632842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:14.633725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:14.643698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:14.644633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:14.645692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:14.646806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:14.647494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:14.648525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:14.748067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:14.760809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5a412b4-4351-4037-b738-38f6aa1e7a49 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1259 microversion: 2.1 time: 0.332083 Oct 13 08:41:14.762281 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1011/2220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:14 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:14.768298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0ac431a-7386-41c9-a348-815970454555 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Calling method '.version_select at 0x7f537aa07af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:14.785570 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d0ac431a-7386-41c9-a348-815970454555 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0ac431a-7386-41c9-a348-815970454555 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Request method failure captured: Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1900687742 HTTP/1.1 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88nEuKAnZnHYL4Zveu8K9hMihBvWPUd5s8uJtl208ynlqUxjlvD_OVb3xjrWgJ7k8sStxN5ngl3Ycp8tmgTYi-Fe1hDvbOYslFXrOPfRpWpZSlWSg9aR_ocYruW5VHFEjE7w2JjumgsbftqS8MC7LWr30IYZiJ0IZhHUcJf8Z9ZTYo Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd47a6842a8240f5adb08c5d04c3b7c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bd47a6842a8240f5adb08c5d04c3b7c7 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1506621335 Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1506621335-project Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: exception: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'tempest-keypair-non-existent-1900687742'} Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.788899 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e Oct 13 08:41:14.794138 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:14.799532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0ac431a-7386-41c9-a348-815970454555 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1900687742 not found for user a2f0d5d536744e56b1cfc466e33a507e {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:14.801004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0ac431a-7386-41c9-a348-815970454555 tempest-KeyPairsNegativeTestJSON-1506621335 tempest-KeyPairsNegativeTestJSON-1506621335-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1900687742" status: 404 len: 145 microversion: 2.1 time: 0.037317 Oct 13 08:41:14.802130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1012/2221] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1900687742 => generated 145 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:15.003161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:15.011742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-889d4ee7-0419-4a1d-bf51-f0cb58cb6da6 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.386410 Oct 13 08:41:15.035889 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1210/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:14 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:15.290022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:15.291389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:15.303243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:15.303988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:15.304599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:15.306299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:15.306979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:15.307715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:15.794361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:15.795014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:15.812755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:15.816051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:15.818678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:15.820780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:15.822699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:15.824944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:16.023015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:16.032836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af25e227-1b07-464c-8e1f-d3d0c009a842 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1265 microversion: 2.1 time: 0.244782 Oct 13 08:41:16.040793 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1211/2223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:15 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:16.050013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:16.054883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:16.070488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:16.070987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:16.071426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:16.072143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:16.072595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:16.073030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:16.715349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:16.724943 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26d70964-d626-4642-ad5a-d656b036420d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.679063 Oct 13 08:41:16.735115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1212/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:16 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:16.882840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:16.892825 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08b9a55b-88e7-4812-afdc-2bf96e529296 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1469 microversion: 2.1 time: 1.621726 Oct 13 08:41:16.897158 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1013/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:15 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1469 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:17.064497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:17.065123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:17.083065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.083561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.083998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:17.084716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.085168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.085593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:17.325556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:17.341574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93a922e0-de21-42d1-8954-db9b751b40c4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1265 microversion: 2.1 time: 0.281440 Oct 13 08:41:17.343864 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1213/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:17 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:17.759611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:17.760701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:17.773796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.782234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.782751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:17.784565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.785063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.785507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:17.918608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:17.919357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:17.929764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.930267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.930752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:17.941610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:17.942114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:17.945968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.011657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:19.025263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-78ae8b68-0205-4a7a-8b12-90f02b5acae3 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1427 microversion: 2.1 time: 1.110701 Oct 13 08:41:19.044600 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1214/2227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:17 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1427 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:19.068967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:19.076365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:19.117690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.119597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.121867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.136379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.138197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.138987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.252809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:19.267205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2550f618-db63-44cb-a1ae-79b7859e80e5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1265 microversion: 2.1 time: 0.220864 Oct 13 08:41:19.268120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1215/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:19 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:19.286618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd594a67-d6c0-41e1-acfe-771e300d9d2a", "name": "network-vif-deleted", "tag": "0a8fc691-4fb4-47e1-9616-4d5e67db36cf"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:19.303720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.307147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.310073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.370649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] Creating event network-vif-deleted:0a8fc691-4fb4-47e1-9616-4d5e67db36cf for instance fd594a67-d6c0-41e1-acfe-771e300d9d2a on n-h2-858384-11 Oct 13 08:41:19.381863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c3445e1c-6d0e-48a1-a20a-68472c511a98 req-484ad2e2-f8ea-4636-83cf-c45a77e5c988 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112422 Oct 13 08:41:19.385692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1216/2229] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:19.454799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:19.474697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4e2d79a-2cb7-4cc6-99d8-786f40321fc7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.712437 Oct 13 08:41:19.479915 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1014/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:17 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:19.497518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:19.513286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:19.539342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.539856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.544516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.545338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.545821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.546258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.634582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:19.798029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Calling method '.version_select at 0x7f537ab22d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:19.818482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=43 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:19.825164 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f007d7b-7cc1-41b4-b3c1-36f25a709906 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 204 len: 0 microversion: 2.25 time: 0.342257 Oct 13 08:41:19.826109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1015/2231] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:19 2022] DELETE /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:41:19.831449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.832921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.837367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.840045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.840807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.842328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.896331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da1f76d5-267c-4139-99c4-8559f2008c32 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.506022 Oct 13 08:41:19.897071 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1217/2232] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 13 08:41:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:19.902357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:19.904815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:19.949005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.950089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.951917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.953471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:19.957231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b08a85f-f5ff-4a82-876d-e83a0c3007ec tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f537aac79d0>, body: {"keypair": {"name": "tempest-keypair-1376717263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUBic/EJmQmdoy7Z48R5RMmt9+C+6Ft0lpOdWtQtodyHVfH5jk4Q9542Z8WuwL10JyqWTvDSyRJ+Jmev3SZDUh5ZGt8wXFpIt+G0Ale6UlZDlHNxurUZuQmWTEVPd118Q=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:19.960401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:19.961413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:19.987047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7b08a85f-f5ff-4a82-876d-e83a0c3007ec tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:20.001165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7b08a85f-f5ff-4a82-876d-e83a0c3007ec tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:20.070816 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b08a85f-f5ff-4a82-876d-e83a0c3007ec tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.235024 Oct 13 08:41:20.071451 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1016/2233] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:20.083426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1075362736", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:20.230821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:41:20.382738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:20.391404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:20.392767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:20.393979 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5ce2071-e11c-49d9-b3d0-76772c5a2a31 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1731 microversion: 2.25 time: 0.495653 Oct 13 08:41:20.410718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1218/2234] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:19 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1731 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:20.411941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:20.412572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:20.419053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:20.419743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:20.420365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:20.421936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:20.422740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:20.423353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:20.489866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:20.491579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:20.493270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:20.498237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lazy-loading 'fault' on Instance uuid 688aabbd-0274-4749-88e1-91a4f421063e {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:20.557263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:20.565769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce9eb27b-70cd-456d-ba1a-a63e596a6f15 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 200 len: 1303 microversion: 2.1 time: 0.157956 Oct 13 08:41:20.567184 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1219/2235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:20 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:20.572084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62cc3709-e377-42ec-a1b7-a4305b5cae7c tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376e471f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:20.581196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62cc3709-e377-42ec-a1b7-a4305b5cae7c tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1376717263" status: 200 len: 513 microversion: 2.2 time: 0.012675 Oct 13 08:41:20.582465 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1220/2236] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Oct 13 08:41:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1376717263 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:20.587605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:20.588584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:20.599578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:20.600440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:20.604318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:20.605682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:20.606397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:20.607094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:20.944974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:20.957391 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c10e6725-7db6-415d-b604-49b9eacbca4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.373478 Oct 13 08:41:20.958003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1221/2237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:20 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:20.991249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:20.992072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:21.004782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:21.008430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:21.009000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:21.010939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:21.011608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:21.014007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:21.420895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:21.433503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba0b69e3-1b1d-44cf-926d-94ec8f9289f4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.450978 Oct 13 08:41:21.440682 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1222/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:20 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:21.448220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-274a0e76-f8c3-4201-b822-67aabd8ee0a6 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f53769c4af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:21.515936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-274a0e76-f8c3-4201-b822-67aabd8ee0a6 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376717263" status: 204 len: 0 microversion: 2.2 time: 0.073711 Oct 13 08:41:21.520956 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1223/2239] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Oct 13 08:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376717263 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:21.623825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=27 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:21.629713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Getting quotas for project 9b0e2a25b39545cdb2cfd27d95e4b979. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:21.637798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb84dc34-2a8d-4d1f-9d48-962082aa5335 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Action: 'create', calling method: .version_select at 0x7f53768741f0>, body: {"keypair": {"name": "tempest-keypair-397902749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx+94KPppYknG2/gdjeZ7WT1FhZtuJqAo4/2jxJv3JR9C28KlLSeHn7d8Y4P427BzOG4J9Bz9F2isUT4qdKDl9zhNIkuR938hz0lG0MuNpjWj8ME/uadrxEa+1/IYbZnQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:21.644866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Getting quotas for user 8a374237f7724f70bf82d89435b3fe9f and project 9b0e2a25b39545cdb2cfd27d95e4b979. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:21.679254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 13 08:41:21.680241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eb84dc34-2a8d-4d1f-9d48-962082aa5335 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for project d3a5ffa0659444f3aec43a22913ae33f. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Request method failure captured: Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 1752 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88uP5l-Rx3imffXyIcOi_sCr9_tskC1mTAMPr2kXKMavtgnpB4B_7wN8M5FA0QjZMRhK6q1Ljo230FDSmX6stoQgsw45vRcR0PQbq09Rs30goewkDVoAHSIZcpydcssZFTVUhoep7fibqZCPFVgTgna_9nkPeAFF0JoZgyk6bJr8_k Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9b0e2a25b39545cdb2cfd27d95e4b979 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871075299 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b0e2a25b39545cdb2cfd27d95e4b979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9b0e2a25b39545cdb2cfd27d95e4b979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b0e2a25b39545cdb2cfd27d95e4b979"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9b0e2a25b39545cdb2cfd27d95e4b979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1871075299 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9b0e2a25b39545cdb2cfd27d95e4b979 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871075299 Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8a374237f7724f70bf82d89435b3fe9f Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1075362736", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:41:21.691756 n-d-858384-11 devstack@n-api.service[127031]: exception: Maximum number of metadata items exceeds 128 Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1075362736', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:21.694778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 13 08:41:21.698538 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:21.699829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eb84dc34-2a8d-4d1f-9d48-962082aa5335 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for user 370856659f3c48ab8af5f76a3e04217a and project d3a5ffa0659444f3aec43a22913ae33f. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:21.699945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:21.701523 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-188d9241-5315-4826-b8d1-ae43a24779f3 tempest-AbsoluteLimitsNegativeTestJSON-1871075299 tempest-AbsoluteLimitsNegativeTestJSON-1871075299-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.627720 Oct 13 08:41:21.706930 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1017/2240] 10.222.0.23 () {60 vars in 1148 bytes} [Thu Oct 13 08:41:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 1634 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:41:21.717462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:21.718501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:21.738914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:21.740714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:21.741443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:21.743810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:21.744054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:21.744656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:21.746071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:21.782253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb84dc34-2a8d-4d1f-9d48-962082aa5335 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259349 Oct 13 08:41:21.784988 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1224/2241] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:41:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:21.795004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83c4749b-dedc-4b7b-8ac0-fa83e257ef91 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f537ac12310>, body: {"keypair": {"name": "tempest-keypair-920494345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5sGRfTGhjEg4/FLaF1WZeq2OuT6UqaHL5Z9Xdjw90O8OdV0tE3cXHPvBAbDQ+8Hld5WtdkOJ/uz/uzcZ3BAPeSuATShXv6BY+g6VyP/i5JgbQXvyE9mbIB1wnCivX5DQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:21.831930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-83c4749b-dedc-4b7b-8ac0-fa83e257ef91 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:21.840638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-83c4749b-dedc-4b7b-8ac0-fa83e257ef91 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:21.892369 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83c4749b-dedc-4b7b-8ac0-fa83e257ef91 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.104356 Oct 13 08:41:21.900422 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1225/2242] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:21.904854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688aabbd-0274-4749-88e1-91a4f421063e", "name": "network-vif-deleted", "tag": "726caec6-e242-477e-8e2c-c40daf8b82a5"}, {"server_uuid": "8d8b162b-28d9-4ce6-991e-4635698868d5", "name": "network-vif-unplugged", "status": "completed", "tag": "57980b93-8481-47df-a105-363dfd4c0e88"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:21.931010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:21.931470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:21.931916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:21.962205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Creating event network-vif-deleted:726caec6-e242-477e-8e2c-c40daf8b82a5 for instance 688aabbd-0274-4749-88e1-91a4f421063e on n-h2-858384-11 Oct 13 08:41:21.962761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] Creating event network-vif-unplugged:57980b93-8481-47df-a105-363dfd4c0e88 for instance 8d8b162b-28d9-4ce6-991e-4635698868d5 on n-h1-858384-11 Oct 13 08:41:21.985004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0903ba53-be7b-48e1-a37b-5faa2fa35cf1 req-1639ed51-df4d-4e91-8099-d6b38870bad3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.086553 Oct 13 08:41:21.988205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1226/2243] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:22.016266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:22.017193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: 688aabbd-0274-4749-88e1-91a4f421063e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:22.037968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.039596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.040642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.041765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.042474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.043103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.069841 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] HTTP exception thrown: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Request method failure captured: Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e HTTP/1.1 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83lgdkQ5xzbi28JgubX5aMHNIBGsJlLvGYRE0l606BeFbWXCoExYsmCmqSgFqD7X13qX83PLAya7KEAxqfIpKkAJNEc70bSrYDIV_R1WxLAu-P8DU2Rw8fzJu3hYGh4KIwQk5x-rs9n_VgQNtidE3rJev6IGohK8i5jiNx4hJ3C4wM Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 51786b86408246ec87981e7d0c3c52e3 Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '688aabbd-0274-4749-88e1-91a4f421063e'} Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:22.071938 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. Oct 13 08:41:22.077313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:22.079532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Returning 404 to user: Instance 688aabbd-0274-4749-88e1-91a4f421063e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:22.080736 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-833a6a92-50e8-44a1-81e7-271d6940d66e tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e" status: 404 len: 111 microversion: 2.1 time: 0.089285 Oct 13 08:41:22.082306 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1227/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:21 2022] GET /compute/v2.1/servers/688aabbd-0274-4749-88e1-91a4f421063e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:22.089368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad64a470-3b08-4c21-99de-1621f39a7e96 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f53769d4e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:22.135277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad64a470-3b08-4c21-99de-1621f39a7e96 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920494345" status: 204 len: 0 microversion: 2.2 time: 0.051531 Oct 13 08:41:22.140450 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1228/2245] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Oct 13 08:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920494345 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:22.152168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:22.152891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:22.173100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.173608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.174048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.174807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.175243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.175662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.425070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:22.433668 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05c51559-9c52-4b49-8b10-553fda61e779 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.291550 Oct 13 08:41:22.447022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1229/2246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:22 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:22.447022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:22.447022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:22.456780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.458105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:22.459634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.469474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.471731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.475986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.480495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.556543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:22.564234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:22.736579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd06d09d-d067-4f19-897a-d34eece3d9b1 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 204 len: 0 microversion: 2.1 time: 0.296957 Oct 13 08:41:22.739150 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1230/2247] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:22 2022] DELETE /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:22.755555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ffdd1cb2-4d38-4f5d-94da-d07d38934295 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f53769d4040>, body: {"keypair": {"name": "tempest-keypair-454172804", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:22.793344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ffdd1cb2-4d38-4f5d-94da-d07d38934295 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:22.809480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ffdd1cb2-4d38-4f5d-94da-d07d38934295 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:22.894344 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ffdd1cb2-4d38-4f5d-94da-d07d38934295 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.151689 Oct 13 08:41:22.896322 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1231/2248] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:22 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:22.908649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:22.913006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:22.932933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.934250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.936405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:22.937223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:22.946451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:22.947201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:23.449585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:23.461175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6be3ab1d-8a9e-40de-bdfc-46cf23c0aaea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.561959 Oct 13 08:41:23.462059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1232/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:22 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:23.477142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:23.484416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:23.485375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:23.486187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:23.490442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:23.492558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:23.493298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:23.493972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:23.494970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:23.495908 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8cdf350b-c31e-4848-bacb-e43c87b49981 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1731 microversion: 2.25 time: 1.786584 Oct 13 08:41:23.496076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:23.497216 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1018/2250] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:21 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1731 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:23.509946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a43a000d-570d-4c22-aa5b-bbddb0553865 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537a9a4ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:23.512150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:23.558151 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a43a000d-570d-4c22-aa5b-bbddb0553865 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454172804" status: 204 len: 0 microversion: 2.2 time: 0.059423 Oct 13 08:41:23.558940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1019/2251] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Oct 13 08:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454172804 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:23.573371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:23.574181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:23.585406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:23.586047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:23.586647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:23.588702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:23.589291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:23.589843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:24.137312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:24.147144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7db372b2-db69-4c20-b697-fb4f1ccd58ab tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1469 microversion: 2.1 time: 0.666766 Oct 13 08:41:24.166757 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1233/2252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:23 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:24.172034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc0b5dd2-1ed8-4c5c-ad47-20e833ff0212 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f5376f9ad30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-689650141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCR7LU+RYQSn6dYzYAxXaklA7S1L4+t0Bl1fN6LOfjKru0XS++8S06m+r2MQWcorXJUT5z4Bu+6yuD80EKxBcSfHgSd0DwsDIpv++fYGK4+5lLi1UDnQa3bgVtuQ7wOloQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:24.216230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fc0b5dd2-1ed8-4c5c-ad47-20e833ff0212 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:24.216523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:24.229228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fc0b5dd2-1ed8-4c5c-ad47-20e833ff0212 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:24.238043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54c47d76-093d-4ec1-bcf9-c6e5f1f502a3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.676296 Oct 13 08:41:24.239902 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1020/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:23 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:24.264930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8b162b-28d9-4ce6-991e-4635698868d5", "tag": "57980b93-8481-47df-a105-363dfd4c0e88"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:24.292308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:24.292677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:24.293115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:24.299301 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc0b5dd2-1ed8-4c5c-ad47-20e833ff0212 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.131089 Oct 13 08:41:24.300285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1234/2254] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:24.310958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:24.314066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8f6d921-4921-46c3-93e0-d8402893a5fe tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f537ab223a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1483719884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg3vlKB12l2X1VJONb4JpAjGnQmU0yuh8/8OsPtsPWvtV0djpbJ1q585vqpOEtzJ7a8m+vct1JVtXT2zit19u+8bHVdwIWlkfUYmGiqFJqDJIOqi5gMaC1gobjXo/NX0g=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:24.320557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] Creating event network-changed:57980b93-8481-47df-a105-363dfd4c0e88 for instance 8d8b162b-28d9-4ce6-991e-4635698868d5 on n-h1-858384-11 Oct 13 08:41:24.326191 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bcbd211b-e193-467d-88fb-52b17db566a3 req-439860f7-c771-49d9-bcb1-ba71af35730c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082440 Oct 13 08:41:24.327418 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1021/2255] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:24.365341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d8f6d921-4921-46c3-93e0-d8402893a5fe tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:24.374156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d8f6d921-4921-46c3-93e0-d8402893a5fe tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:24.454144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8f6d921-4921-46c3-93e0-d8402893a5fe tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.143398 Oct 13 08:41:24.455995 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1235/2256] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 13 08:41:24.470453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1f60536-d4e2-41d8-bfbc-bb513673c6e5 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f537a9f0670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1010644211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiOud80OzK+wZ5UheGUflNnTurVuu8nqq9eMxk4N9CvgwuC0bPD6YjXjGGrIi20KfLPHW897OJgjyIJI587yW0s/qcrWtlbzCVbm8T0BjZE0Cf9K2dH9m+EhVzRzV6fqQ=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:24.485136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:24.485760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:24.495597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:24.506639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:24.507272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:24.508055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:24.508531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:24.508970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:24.561316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a1f60536-d4e2-41d8-bfbc-bb513673c6e5 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:24.574542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a1f60536-d4e2-41d8-bfbc-bb513673c6e5 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:24.629750 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1f60536-d4e2-41d8-bfbc-bb513673c6e5 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.163999 Oct 13 08:41:24.636360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1022/2257] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:24.646477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:24.647318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:24.661091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:24.663975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:24.665074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:24.670296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:24.671066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:24.672238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:25.105351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:25.121234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b1cbbe1-2917-4ae7-8a2f-1358fab7966b tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.639931 Oct 13 08:41:25.125788 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1236/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:24 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:25.138634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bdf19a6-ea81-4ff3-8dd5-d2355f1affb0 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376868310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:25.148967 n-d-858384-11 devstack@n-api.service[127030]: WARNING oslo_db.sqlalchemy.utils [None req-5bdf19a6-ea81-4ff3-8dd5-d2355f1affb0 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:41:25.165682 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bdf19a6-ea81-4ff3-8dd5-d2355f1affb0 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.036806 Oct 13 08:41:25.169220 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1237/2259] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Oct 13 08:41:25 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:25.183908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:25.186350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:25.201030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:25.201525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:25.201963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:25.208089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:25.210709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:25.211162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:25.972054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:25.991856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:25.994443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:25.995964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c93722d-3a1c-48e5-b4fa-921a392a1334 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1731 microversion: 2.25 time: 1.358563 Oct 13 08:41:25.997268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1023/2260] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:24 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1731 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:26.007961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-173bc024-9598-47cd-86a6-1b9498d19583 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537aa07280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.072282 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-173bc024-9598-47cd-86a6-1b9498d19583 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1010644211" status: 204 len: 0 microversion: 2.2 time: 0.073539 Oct 13 08:41:26.073394 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1024/2261] 10.222.0.23 () {60 vars in 1321 bytes} [Thu Oct 13 08:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1010644211 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:26.087070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.087731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:26.123387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:26.125634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:26.126219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:26.127004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:26.127469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:26.127902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:26.309181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:26.354502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-55434dcf-8e2c-480d-85e4-aa1e0edf9d48 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1469 microversion: 2.1 time: 1.182792 Oct 13 08:41:26.355147 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1238/2262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:25 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1469 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:26.373499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-116af005-e1ad-427c-8618-2080f02f0cf1 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376fdf820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.438920 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-116af005-e1ad-427c-8618-2080f02f0cf1 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1483719884" status: 204 len: 0 microversion: 2.2 time: 0.078221 Oct 13 08:41:26.440389 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1239/2263] 10.222.0.23 () {60 vars in 1321 bytes} [Thu Oct 13 08:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1483719884 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:26.448001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.448874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:26.460704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:26.461836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:26.463292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:26.464964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:26.466126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:26.467361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:26.477046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:26.497904 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c97a83bd-b803-4a4d-838d-2a6b0124ea58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.418921 Oct 13 08:41:26.500525 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1025/2264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:26 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:26.522967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-720fdd08-258f-493c-9b61-e7e82c2d662e tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376c40310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.588102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-720fdd08-258f-493c-9b61-e7e82c2d662e tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-689650141" status: 204 len: 0 microversion: 2.2 time: 0.086029 Oct 13 08:41:26.600359 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1026/2265] 10.222.0.23 () {60 vars in 1318 bytes} [Thu Oct 13 08:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-689650141 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:26.621557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e29265-dfc5-4037-b844-0eb5dcc0f712", "tag": "54095bae-3efe-4867-a8d0-7f1cc1b76ebb"}, {"server_uuid": "cc3ea45e-e780-4f5e-a697-aa0c04f04987", "name": "network-vif-deleted", "tag": "187bfa5c-680f-42a2-aaf9-ed3a7774ab5d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:26.685727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:26.686348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:26.686971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:26.704049 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Creating event network-changed:54095bae-3efe-4867-a8d0-7f1cc1b76ebb for instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 on n-h1-858384-11 Oct 13 08:41:26.704868 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] Creating event network-vif-deleted:187bfa5c-680f-42a2-aaf9-ed3a7774ab5d for instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 on n-h2-858384-11 Oct 13 08:41:26.723670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d5b6e648-b814-4f5b-a76c-146431c8b0bd req-dccf8a10-8b43-4f6f-aeaa-555f21337718 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.121117 Oct 13 08:41:26.725332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1027/2266] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:26.748381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4099d7fe-64ba-4357-ade7-0cbb09675128 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f5376e7dd30>, body: {"keypair": {"name": "tempest-keypair-1944580158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVzsHVst1SN5ZZslxJaQXCis9YovjJZKvBjllQ7ZzjahHPzGoIMLmfgkarLduzB8KDqvo76uUoJP4FO0inO0Bl9lq4FQ1pqQh64ift94FUVUZVU+Q2QuaB/VN0Vp1+mVw=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:26.793645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4099d7fe-64ba-4357-ade7-0cbb09675128 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:26.812356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4099d7fe-64ba-4357-ade7-0cbb09675128 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:26.859575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:26.896826 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4099d7fe-64ba-4357-ade7-0cbb09675128 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.167316 Oct 13 08:41:26.899490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1028/2267] 10.222.0.23 () {62 vars in 1199 bytes} [Thu Oct 13 08:41:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 13 08:41:26.910922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-41254c6f-0a60-4ea3-a99b-bc54dd8b15d7 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376c401f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.926123 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-41254c6f-0a60-4ea3-a99b-bc54dd8b15d7 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1944580158" status: 200 len: 513 microversion: 2.2 time: 0.020869 Oct 13 08:41:26.927369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1029/2268] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Oct 13 08:41:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1944580158 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:41:26.943104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cea1ae67-9eb4-4002-9df3-d7132f1fa094 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537a9f3670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:26.951127 n-d-858384-11 devstack@n-api.service[127031]: WARNING oslo_db.sqlalchemy.utils [None req-cea1ae67-9eb4-4002-9df3-d7132f1fa094 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:41:26.961444 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cea1ae67-9eb4-4002-9df3-d7132f1fa094 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.025884 Oct 13 08:41:26.963062 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1030/2269] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Oct 13 08:41:26 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:26.987253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-211ec2fe-9acf-4818-877e-9bb23071cd05 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537aa07280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:27.041738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-211ec2fe-9acf-4818-877e-9bb23071cd05 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944580158" status: 204 len: 0 microversion: 2.2 time: 0.065195 Oct 13 08:41:27.043309 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1031/2270] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Oct 13 08:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944580158 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:27.065087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:27.065964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:27.079856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:27.080464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:27.081878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:27.082751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:27.083412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:27.084608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:27.154790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:27.155732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:27.156587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:27.157311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lazy-loading 'fault' on Instance uuid cc3ea45e-e780-4f5e-a697-aa0c04f04987 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:27.336517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:27.354720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:27.360606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:27.363600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10f22922-851a-4228-90df-3e8e8a78db7a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 200 len: 1376 microversion: 2.25 time: 0.318702 Oct 13 08:41:27.365609 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1032/2271] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:27 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 1376 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:27.387681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Action: 'create', calling method: .version_select at 0x7f5376d6d430>, body: {"keypair": {"name": "tempest-keypair-1016941706", "type": "x509"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:27.430507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:27.440416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:27.477495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.processutils [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4ykx9tx_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4ykx9tx_/temp.key -subj /CN=64eb323dc01d40d1981e56b53f934808 -extensions v3_req_client {{(pid=127031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 13 08:41:27.496061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:27.505777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38877f7f-21a0-47aa-9e65-90be9d1eea13 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 1.063946 Oct 13 08:41:27.516953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1240/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:26 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:27.528833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:27.532388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:27.557748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:27.558855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:27.559494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:27.563110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:27.563791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:27.564425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.210539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:28.228160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e811e35-3278-4b8c-9bb2-9727aaa63d46 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1469 microversion: 2.1 time: 0.703854 Oct 13 08:41:28.230444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1241/2273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:27 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1469 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:28.237068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:28.237921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:28.255615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.256696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.257954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.260089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.260947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.261613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.534461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:28.547837 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8050c31-dff2-4338-adc8-fe7d92192642 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.315552 Oct 13 08:41:28.550485 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1242/2274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:28 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:28.577851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.processutils [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4ykx9tx_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4ykx9tx_/temp.key -subj /CN=64eb323dc01d40d1981e56b53f934808 -extensions v3_req_client" returned: 0 in 1.102s {{(pid=127031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 13 08:41:28.579402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.processutils [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4ykx9tx_/temp.key -password pass: {{(pid=127031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 13 08:41:28.583832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:28.584632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: cc3ea45e-e780-4f5e-a697-aa0c04f04987] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:28.601843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.604411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.605160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.607750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.609382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.610118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.641834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.processutils [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4ykx9tx_/temp.key -password pass:" returned: 0 in 0.062s {{(pid=127031) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 13 08:41:28.657413 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] HTTP exception thrown: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Request method failure captured: Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 HTTP/1.1 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82HyLaqKaA2SUPBraHq6XrnxvUNBLNWwMNu4PEpujOQxdSekreTeTL-0rAfEzqaQZDN4AJp3vvd4bCH2svlNNe2MFMjjzfMrOEhtU3bBhkMuSlblvQNMNGnpvS_sNHn69d-1q3Dh90KU_M9VSeVVBSxdXxPjlhrLvoEeOBg02gq_T8 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.25 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bce8c77c716d424abb6b86181e409501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c09ea2313b3343579cb75d16d8f220ee Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cc3ea45e-e780-4f5e-a697-aa0c04f04987'} Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. Oct 13 08:41:28.661816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:28.669541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Returning 404 to user: Instance cc3ea45e-e780-4f5e-a697-aa0c04f04987 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:28.675718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e762ad1-e443-4624-96a2-6b7daf73cc52 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987" status: 404 len: 111 microversion: 2.25 time: 0.122657 Oct 13 08:41:28.691426 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1243/2275] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:28 2022] GET /compute/v2.1/servers/cc3ea45e-e780-4f5e-a697-aa0c04f04987 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:28.697251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:28.697872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:28.720342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.726272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.726841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.727690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:28.730775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:28.731327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:28.732799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:41:28.747446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Getting quotas for user 64eb323dc01d40d1981e56b53f934808 and project fd4c54adc96a47558f5e24a100b56cd7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:41:28.785676 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1705e19-ccd3-4f60-80e0-0a52c0337651 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.410402 Oct 13 08:41:28.788751 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1033/2276] 10.222.0.23 () {62 vars in 1198 bytes} [Thu Oct 13 08:41:27 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1422 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:28.822379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-36851dfc-c571-4a85-aa89-3ae335e4d8a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '.version_select at 0x7f537aa8c820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:28.902265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-36851dfc-c571-4a85-aa89-3ae335e4d8a9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103736582" status: 204 len: 0 microversion: 2.25 time: 0.110372 Oct 13 08:41:28.917702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1034/2277] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 08:41:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103736582 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:41:28.930178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69744329-2c38-4194-9dc0-5b8f301e2fb0 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f5376e7d820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:28.957795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69744329-2c38-4194-9dc0-5b8f301e2fb0 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1016941706" status: 200 len: 1534 microversion: 2.2 time: 0.038026 Oct 13 08:41:28.964815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1035/2278] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Oct 13 08:41:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1016941706 => generated 1534 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:29.225206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] Calling method '.version_select at 0x7f537aaa2ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:29.254297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:29.267789 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8211e64f-eee2-403d-b0a5-6b7239f42a3a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.575226 Oct 13 08:41:29.268368 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1244/2279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:28 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:29.290927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-031d40ae-70c7-478b-aac2-17005762e874 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537ab25040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:29.299748 n-d-858384-11 devstack@n-api.service[127030]: WARNING oslo_db.sqlalchemy.utils [None req-031d40ae-70c7-478b-aac2-17005762e874 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:41:29.305845 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-031d40ae-70c7-478b-aac2-17005762e874 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.021534 Oct 13 08:41:29.307022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1245/2280] 10.222.0.23 () {60 vars in 1177 bytes} [Thu Oct 13 08:41:29 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:29.312402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa50ffa-2f84-4c1f-90b8-0e51800c6221", "name": "network-vif-deleted", "tag": "b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:29.324520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.325234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.326383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.342690 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] Creating event network-vif-deleted:b7bc577c-6c4d-47f9-8f3b-1f3559aa70bb for instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 on n-h2-858384-11 Oct 13 08:41:29.351462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f6b35c7f-ccf5-4756-9e95-3a768d351f41 req-1e83edab-ba80-48c9-b463-913c960b340a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042949 Oct 13 08:41:29.352297 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1246/2281] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:29.361553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:29.362537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:29.372266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.373571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.374282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.376638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.377589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.378344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.447494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:29.455601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.457254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.457976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.458790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lazy-loading 'fault' on Instance uuid cfa50ffa-2f84-4c1f-90b8-0e51800c6221 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:41:29.571646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51786b86408246ec87981e7d0c3c52e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94738ef816be4153a9572d23fa8b0f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:29.584331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e4132ea-1677-49d7-be46-f321000f0c45 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 200 len: 1303 microversion: 2.1 time: 0.230336 Oct 13 08:41:29.584849 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1247/2282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:29 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:29.606078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a47d8b3c-1287-4b46-9fb7-9087cb9b8dd9 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] Calling method '.version_select at 0x7f537ab22160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:29.649055 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a47d8b3c-1287-4b46-9fb7-9087cb9b8dd9 tempest-KeyPairsV22TestJSON-361132633 tempest-KeyPairsV22TestJSON-361132633-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016941706" status: 204 len: 0 microversion: 2.2 time: 0.060857 Oct 13 08:41:29.651815 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1248/2283] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Oct 13 08:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016941706 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:29.659904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:29.660530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:29.687681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.688226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.689243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.689954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:29.690483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:29.690912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:29.739224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 could not be found", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:41:29.741108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] HTTP exception thrown: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] Request method failure captured: Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-floating-ips/1f63c8a3-2bdc-4943-86da-e8036b9d01f7 HTTP/1.1 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR884hDrTkii4RoU-Gp3D70Cs6ZJwGcxspGMHF4yDqvdMMmba57fiQUzX8EJvc6c9sltFy8e9DgevbKF8axUh9r9AkhyXyApa0i3OFsNUzdPdOz_HLw4FgPhIZPCjeI6yPtJsc-OJNhEd0dSwbL0c8SYqT36BzfiekJXE0yPmaxyWMeo Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 20c0197315d646889e0c4b0a955c6b53 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1688700737 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20c0197315d646889e0c4b0a955c6b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20c0197315d646889e0c4b0a955c6b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20c0197315d646889e0c4b0a955c6b53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20c0197315d646889e0c4b0a955c6b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1688700737 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 20c0197315d646889e0c4b0a955c6b53 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1688700737 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 91f5fbb0caaf44f68fbd1a113e5c45dc Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: exception: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '1f63c8a3-2bdc-4943-86da-e8036b9d01f7'} Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:41:29.753179 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 could not be found Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-767c7c31-cb9d-462e-a46b-cc54e546a3e9'] Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7. Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] Returning 404 to user: Floating IP not found for ID 1f63c8a3-2bdc-4943-86da-e8036b9d01f7 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-347fe625-712a-475b-bbfe-24d7b878bc6e tempest-FloatingIPDetailsNegativeTestJSON-1688700737 tempest-FloatingIPDetailsNegativeTestJSON-1688700737-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/1f63c8a3-2bdc-4943-86da-e8036b9d01f7" status: 404 len: 111 microversion: 2.1 time: 0.790155 Oct 13 08:41:29.764577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1036/2284] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:41:28 2022] GET /compute/v2.1/os-floating-ips/1f63c8a3-2bdc-4943-86da-e8036b9d01f7 => generated 111 bytes in 792 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:29.867159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:30.175958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:30.185272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28802eca-080e-4dbc-9c9d-e7e19101b9fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.531673 Oct 13 08:41:30.188599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1249/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:29 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:30.305588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:30.306902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:30.323767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:30.324517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:30.325485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:30.328163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:30.328803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:30.329409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:30.608727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:30.609894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] [instance: cfa50ffa-2f84-4c1f-90b8-0e51800c6221] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:30.616707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:30.617425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:30.618054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:30.618964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:30.619593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:30.620207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:30.636368 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] HTTP exception thrown: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Request method failure captured: Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 HTTP/1.1 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR83lgdkQ5xzbi28JgubX5aMHNIBGsJlLvGYRE0l606BeFbWXCoExYsmCmqSgFqD7X13qX83PLAya7KEAxqfIpKkAJNEc70bSrYDIV_R1WxLAu-P8DU2Rw8fzJu3hYGh4KIwQk5x-rs9n_VgQNtidE3rJev6IGohK8i5jiNx4hJ3C4wM Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94738ef816be4153a9572d23fa8b0f28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 94738ef816be4153a9572d23fa8b0f28 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-MigrationsAdminTest-1453460842 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 51786b86408246ec87981e7d0c3c52e3 Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-MigrationsAdminTest-1453460842-project Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cfa50ffa-2f84-4c1f-90b8-0e51800c6221'} Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:30.638545 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. Oct 13 08:41:30.644444 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:30.646605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] Returning 404 to user: Instance cfa50ffa-2f84-4c1f-90b8-0e51800c6221 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:30.647662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-015d49bb-3106-481f-bef4-18f238f2f268 tempest-MigrationsAdminTest-1453460842 tempest-MigrationsAdminTest-1453460842-project] 10.222.0.23 "GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221" status: 404 len: 111 microversion: 2.1 time: 0.042817 Oct 13 08:41:30.649161 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1250/2286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:30 2022] GET /compute/v2.1/servers/cfa50ffa-2f84-4c1f-90b8-0e51800c6221 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:41:30.848657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:30.883619 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-643f1a4c-d01b-45f4-8d99-5217cf6b7311 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.590877 Oct 13 08:41:30.899948 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1037/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:30 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:31.110560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:31.110967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:31.118341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.118863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.119300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.119999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.132149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.140355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.214943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:31.216012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:31.232525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.235243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.237890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.241989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.244604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.246026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.292751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:31.430090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-138900c0-4d58-4554-a218-65585a77ff2a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 204 len: 0 microversion: 2.25 time: 0.323110 Oct 13 08:41:31.431493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1251/2288] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:31 2022] DELETE /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:41:31.444023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:31.448004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:31.459322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.460111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.460723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.462302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.463040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.463633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.824128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:31.830191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:31.851704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:31.871440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:31.873158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87e27b39-a854-4030-b5a0-236808279836 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1548 microversion: 2.25 time: 0.436247 Oct 13 08:41:31.873872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1252/2289] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:31 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1548 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:31.910755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:31.911389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:31.924634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.925135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.925603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:31.926277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:31.933894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:31.934502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:32.150336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:32.160641 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9821ea3-fefe-4488-a2af-69c17dc4b174 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.256831 Oct 13 08:41:32.161230 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1253/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:31 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:32.239312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:32.262711 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3205454-30a0-4526-9d7c-00ec1823eb00 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 1.051839 Oct 13 08:41:32.265444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1038/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:31 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:32.901408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:32.902175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:32.918130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:32.919556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:32.921433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:32.923478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:32.923954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:32.925551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:33.184045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:33.185119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:33.209460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:33.210559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:33.211895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:33.212900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:33.214937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:33.215937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:33.408732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:33.426221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:33.432308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:33.435484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f2c16b4-ff97-435e-a3ca-0181cee4631a tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1548 microversion: 2.25 time: 0.538660 Oct 13 08:41:33.438636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1254/2292] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:32 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1548 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:33.461562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:33.462433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:33.476268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:33.477014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:33.478259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:33.480141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:33.481143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:33.482179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:34.148090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:34.158064 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-def4b3e6-0d1f-40a9-97fd-5355f8e0785c tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.978492 Oct 13 08:41:34.161782 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1039/2293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:33 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:34.357114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:34.365855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8bb0eb56-49a0-4c9a-a5d6-2cbf941e9ebc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.925484 Oct 13 08:41:34.372317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1255/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:33 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:34.467982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:34.468612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:34.479995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:34.481607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:34.483190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:34.484277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:34.484779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:34.485164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.145646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5dea53-e2ce-46bd-9b5f-a1c92c84de59", "name": "network-vif-deleted", "tag": "10e40049-79d3-4179-b381-ed58724b5472"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:35.170780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=21 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:35.182655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:35.203310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:35.204273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:35.207429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.210660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:35.212114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:35.225327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fbdefa4-3abe-4300-b5ab-22b6aa187ff9 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 200 len: 1548 microversion: 2.25 time: 0.759179 Oct 13 08:41:35.228262 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1040/2295] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:34 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 1548 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:35.263571 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] Creating event network-vif-deleted:10e40049-79d3-4179-b381-ed58724b5472 for instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 on n-h2-858384-11 Oct 13 08:41:35.263858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:35.265221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:35.293648 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-989dbbab-3c88-4482-9794-3f9cbe9b64c2 req-f05ca241-1050-4e24-838f-6e00c672d6d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150346 Oct 13 08:41:35.302951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1256/2296] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:35.340388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:35.345262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.063s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:35.351843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.355580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:35.367243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:35.367706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.406199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:35.407006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:35.434069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:35.438612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:35.439714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.448146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:35.450264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:35.452813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:35.811356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:35.822299 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ecc0b27-62c4-413b-8a5a-f3efd6a6c6c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 0.425572 Oct 13 08:41:35.827067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1257/2297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:35 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:36.092736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:36.105110 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8593d9c0-3d73-4fed-a538-ec154927e997 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1390 microversion: 2.1 time: 0.872476 Oct 13 08:41:36.118986 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1041/2298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:35 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1390 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:36.256494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:36.257719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:36.274684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.277716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.279129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.281291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.285381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.286360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.309974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] HTTP exception thrown: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Request method failure captured: Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 HTTP/1.1 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82HyLaqKaA2SUPBraHq6XrnxvUNBLNWwMNu4PEpujOQxdSekreTeTL-0rAfEzqaQZDN4AJp3vvd4bCH2svlNNe2MFMjjzfMrOEhtU3bBhkMuSlblvQNMNGnpvS_sNHn69d-1q3Dh90KU_M9VSeVVBSxdXxPjlhrLvoEeOBg02gq_T8 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.25 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bce8c77c716d424abb6b86181e409501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c09ea2313b3343579cb75d16d8f220ee Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '3b5dea53-e2ce-46bd-9b5f-a1c92c84de59'} Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. Oct 13 08:41:36.312036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. Oct 13 08:41:36.317260 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:36.319544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Returning 404 to user: Instance 3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:36.320863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04a8d44d-4de5-4ade-a4da-d22f004e0d01 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59" status: 404 len: 111 microversion: 2.25 time: 0.069047 Oct 13 08:41:36.321999 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1258/2299] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:36 2022] GET /compute/v2.1/servers/3b5dea53-e2ce-46bd-9b5f-a1c92c84de59 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:36.331497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:36.333027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:36.344455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.345182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.346060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.347037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.347745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.348329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.382078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:36.551430 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6bc8c98c-1a21-40df-b042-52bea9695ca7 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 204 len: 0 microversion: 2.25 time: 0.224771 Oct 13 08:41:36.553433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1042/2300] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:41:36 2022] DELETE /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:41:36.563933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:36.565389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:36.581464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.583607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.584960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.589340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.591023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.592527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.857064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:36.858488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:36.875721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.887077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.888334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:36.891860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:36.895712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:36.900252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:37.360739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:37.372410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:37.379997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:37.381547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35ead1de-1623-451c-b2dd-a7dd444b4088 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1563 microversion: 2.25 time: 0.823553 Oct 13 08:41:37.406546 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1259/2301] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:36 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1563 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:37.413900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e29265-dfc5-4037-b844-0eb5dcc0f712", "name": "network-vif-plugged", "status": "completed", "tag": "54095bae-3efe-4867-a8d0-7f1cc1b76ebb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:37.428364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:37.429123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:37.429732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:37.446602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] Creating event network-vif-plugged:54095bae-3efe-4867-a8d0-7f1cc1b76ebb for instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 on n-h1-858384-11 Oct 13 08:41:37.455873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2fbe18a4-d118-44a6-b064-29d3f272b977 req-a08c835f-6a7d-41fb-8adf-170908b35d75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047024 Oct 13 08:41:37.456937 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1260/2302] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:37.464966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:37.466295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:37.477019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:37.478252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:37.491209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:37.493921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:37.496580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:37.501261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.120184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:38.134035 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-269315ab-6f24-477b-9116-ad34662c78d7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1380 microversion: 2.1 time: 0.674472 Oct 13 08:41:38.134991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1261/2303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:37 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1380 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:38.160956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3aecc6c9-cde5-4c3f-9528-938663da8efa tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '.version_select at 0x7f5375e25160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:38.167384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aecc6c9-cde5-4c3f-9528-938663da8efa tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:38.170807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aecc6c9-cde5-4c3f-9528-938663da8efa tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:38.171352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aecc6c9-cde5-4c3f-9528-938663da8efa tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.194639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3aecc6c9-cde5-4c3f-9528-938663da8efa tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1957 microversion: 2.1 time: 0.037752 Oct 13 08:41:38.207546 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1262/2304] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:41:38 2022] GET /compute/v2.1/os-migrations => generated 1957 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:38.214605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:38.215508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:38.230581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:38.232896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:38.233534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.235282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:38.237160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:38.237685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.513153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:38.523088 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cc60250-d659-4786-b1c7-9ae5d0e47109 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1307 microversion: 2.1 time: 1.670576 Oct 13 08:41:38.532373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1043/2305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:36 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1307 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:38.585164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47e8282a-33ec-4772-b950-94da024798d7 tempest-LiveMigrationTest-740827597 tempest-LiveMigrationTest-740827597-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1533 microversion: 2.1 time: 0.369954 Oct 13 08:41:38.589131 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1263/2306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:38 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1533 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:38.593956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:38.594609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:38.611554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:38.612340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:38.614904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.615935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:38.616631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:38.618545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:38.758816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=19 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:38.952617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fb9c2dc-1ed6-4c60-ac82-db2a122cb813 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] Calling method '.version_select at 0x7f537ab03430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:38.996673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fb9c2dc-1ed6-4c60-ac82-db2a122cb813 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.459925 Oct 13 08:41:38.997350 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1044/2307] 10.222.0.23 () {60 vars in 1226 bytes} [Thu Oct 13 08:41:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:41:39.008413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:39.008930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:39.033982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:39.045212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:39.050130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.050930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.051557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:39.052548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.053431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.054045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:39.054383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:39.059566 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f9df9cf-78b8-497c-aa52-349051d1c0e3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1563 microversion: 2.25 time: 0.469331 Oct 13 08:41:39.071699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1264/2308] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:38 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1563 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:39.080847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ac09ebe-fdaf-4b76-8812-5e122b01d293 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] Action: 'update', calling method: .version_select at 0x7f537ab22700>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:39.172444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:41:39.353169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff354e9e-52b4-4bf0-a561-34fdb582a411 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 204 len: 0 microversion: 2.1 time: 0.354427 Oct 13 08:41:39.357767 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1045/2309] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:41:38 2022] DELETE /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:41:39.365680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:39.366953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:39.378504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.379709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.380600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:39.381795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.382765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.383651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:39.437334 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ac09ebe-fdaf-4b76-8812-5e122b01d293 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.371993 Oct 13 08:41:39.443567 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1265/2310] 10.222.0.23 () {62 vars in 1247 bytes} [Thu Oct 13 08:41:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:41:39.450315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eeeef1a7-b9ff-4bec-aa50-70b638f0db90 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] Calling method '.version_select at 0x7f53769d7f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:39.471510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eeeef1a7-b9ff-4bec-aa50-70b638f0db90 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021031 Oct 13 08:41:39.479456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1266/2311] 10.222.0.23 () {60 vars in 1226 bytes} [Thu Oct 13 08:41:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:41:39.485512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87997e89-5984-4297-b024-473b55acfde5 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] Action: 'update', calling method: .version_select at 0x7f5375dbe310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:39.627852 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87997e89-5984-4297-b024-473b55acfde5 tempest-QuotaClassesAdmin257Test-414981907 tempest-QuotaClassesAdmin257Test-414981907-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.147166 Oct 13 08:41:39.630152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1267/2312] 10.222.0.23 () {62 vars in 1247 bytes} [Thu Oct 13 08:41:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:41:39.638815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:39.645314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:39.655436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.659049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.661302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:39.663064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:39.664420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:39.665750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.237645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:40.248113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1be9a78d-0d91-4f14-92b2-b3ee5904f13b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 200 len: 1487 microversion: 2.1 time: 0.615944 Oct 13 08:41:40.255028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1268/2313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:39 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 1487 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:40.263029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:40.267096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:40.295684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:40.302310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:40.303839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.315501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:40.318053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:40.319411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.388737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:40.436068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59ab321c-cf10-462a-b950-a3961cca8988 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1386 microversion: 2.1 time: 1.075418 Oct 13 08:41:40.454644 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1046/2314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:39 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1386 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:40.462022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1591550153"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:40.472734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:40.484469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:40.486131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:40.487054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.489642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:40.497327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:40.498262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.545530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:40.770317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:40.786019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:40.796143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c09ea2313b3343579cb75d16d8f220ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce8c77c716d424abb6b86181e409501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:40.798193 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e922b7f-f3a4-418f-901d-0f009d727cd3 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 200 len: 1521 microversion: 2.25 time: 0.539026 Oct 13 08:41:40.799362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1269/2315] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:40 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:41:40.805165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79408968-f79c-4af8-815c-c338d2d5cea9", "name": "network-vif-deleted", "tag": "14bf18b9-923e-44b5-89f0-f63aeb02af35"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:40.811226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:40.827515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:40.828724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:40.829682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:40.860682 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] Creating event network-vif-deleted:14bf18b9-923e-44b5-89f0-f63aeb02af35 for instance 79408968-f79c-4af8-815c-c338d2d5cea9 on n-h1-858384-11 Oct 13 08:41:40.907160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-254bd106-30e1-4cf0-b5c3-d7ca13c31d24 req-c1bdd870-bdd8-4254-a642-cf885335154c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105624 Oct 13 08:41:40.908464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1270/2316] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:41.153829 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba560976-6624-4f6b-94de-9420c16383d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712/action" status: 202 len: 0 microversion: 2.1 time: 0.697242 Oct 13 08:41:41.180210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b24a6d72-2b1b-4a7f-b0a9-e46f9d003915 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dbed30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:41.185688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1047/2317] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:41:40 2022] POST /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:41:41.259290 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b24a6d72-2b1b-4a7f-b0a9-e46f9d003915 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.093560 Oct 13 08:41:41.269936 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1271/2318] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:41 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:41.465601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:41.466889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:41.475488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:41.476374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:41.477095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:41.478058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:41.478822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:41.479465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:41.827171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:41.828077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] [instance: 79408968-f79c-4af8-815c-c338d2d5cea9] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:41.857711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:41.858266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:41.862351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:41.863584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:41.868845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:41.871441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:41.914982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] HTTP exception thrown: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Request method failure captured: Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 HTTP/1.1 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR82HyLaqKaA2SUPBraHq6XrnxvUNBLNWwMNu4PEpujOQxdSekreTeTL-0rAfEzqaQZDN4AJp3vvd4bCH2svlNNe2MFMjjzfMrOEhtU3bBhkMuSlblvQNMNGnpvS_sNHn69d-1q3Dh90KU_M9VSeVVBSxdXxPjlhrLvoEeOBg02gq_T8 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.25 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bce8c77c716d424abb6b86181e409501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bce8c77c716d424abb6b86181e409501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bce8c77c716d424abb6b86181e409501 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-729596486 Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c09ea2313b3343579cb75d16d8f220ee Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-729596486-project Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '79408968-f79c-4af8-815c-c338d2d5cea9'} Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. Oct 13 08:41:41.919510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. Oct 13 08:41:41.925491 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:41.928372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] Returning 404 to user: Instance 79408968-f79c-4af8-815c-c338d2d5cea9 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:41.944935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29ca8540-661f-455f-ae37-68e0862f7466 tempest-LiveAutoBlockMigrationV225Test-729596486 tempest-LiveAutoBlockMigrationV225Test-729596486-project] 10.222.0.23 "GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9" status: 404 len: 111 microversion: 2.25 time: 0.108336 Oct 13 08:41:41.946730 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1272/2319] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:41:41 2022] GET /compute/v2.1/servers/79408968-f79c-4af8-815c-c338d2d5cea9 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:41:42.290514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-722268c2-c4f7-4d4a-93c1-9f2c84989184 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dbe9d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:42.388022 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-722268c2-c4f7-4d4a-93c1-9f2c84989184 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.116478 Oct 13 08:41:42.389420 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1273/2320] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:42 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:42.398080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:42.411024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-869e2c61-dab0-49ec-a98f-981d0a6a0a1a tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1386 microversion: 2.1 time: 0.953081 Oct 13 08:41:42.416188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1048/2321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:41 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1386 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:43.406975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee3a6050-7bbb-47da-90d8-9c72c95c77c3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537ac121f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:43.445673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:43.449743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:43.461688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:43.465577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:43.468113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:43.470400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:43.474872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:43.475650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:43.577272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee3a6050-7bbb-47da-90d8-9c72c95c77c3 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.175723 Oct 13 08:41:43.578241 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1274/2322] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:43 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:43.599455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8b162b-28d9-4ce6-991e-4635698868d5", "name": "network-vif-deleted", "tag": "57980b93-8481-47df-a105-363dfd4c0e88"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:43.617151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:43.617952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:43.618599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:43.656507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] Creating event network-vif-deleted:57980b93-8481-47df-a105-363dfd4c0e88 for instance 8d8b162b-28d9-4ce6-991e-4635698868d5 on n-h2-858384-11 Oct 13 08:41:43.662187 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-49591c4e-e6d1-4ac2-8783-c00371fae972 req-ceddb516-fec1-48f7-8d84-f2a22f542c40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078941 Oct 13 08:41:43.663100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1275/2323] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:41:43.813521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:43.844331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a2abb37-2e2e-4810-833e-636817886560 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1183 microversion: 2.1 time: 0.402892 Oct 13 08:41:43.849381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1049/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:43 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:44.603564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9fb27f2b-5577-4b8e-820e-a9b25ff305e8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375e254c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:44.875697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:44.877057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:44.888747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:44.890993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:44.900802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:44.905898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:44.912101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:44.913244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:45.308651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:45.333858 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d52d6547-1c81-4c2f-9923-3c8c3b21de3d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1183 microversion: 2.1 time: 0.462482 Oct 13 08:41:45.345956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1050/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:44 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:46.378292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:46.380990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:46.400677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:46.402353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:46.403005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:46.407398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:46.408140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:46.413764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:47.132551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:47.151590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b14ea6e6-e40e-4e68-b58c-982bd113eae4 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1183 microversion: 2.1 time: 0.783134 Oct 13 08:41:47.152199 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1051/2326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:46 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1183 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:48.416141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-988105178", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a60c4dc5-9870-4932-8541-a2b759d2722e"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:41:48.994285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:49.624945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:53.612658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:53.627552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=74 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:56.226564 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9fb27f2b-5577-4b8e-820e-a9b25ff305e8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 11.627789 Oct 13 08:41:56.231741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1276/2327] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:44 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 11633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:56.245892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] validate_networks() for [('a60c4dc5-9870-4932-8541-a2b759d2722e', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:41:56.263240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:56.266788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:56.299524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:56.300033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:56.300472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:56.301201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:56.301654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:56.304347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:56.538454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:41:56.575311 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c8e39f9-8d12-44eb-9afd-4acf80fab746 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 200 len: 1183 microversion: 2.1 time: 0.338354 Oct 13 08:41:56.575884 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1277/2328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:56 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 1183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:57.146201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:57.246711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3e1ab4a-b909-4250-b4ca-6315b8622a51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53769d4ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:57.379972 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3e1ab4a-b909-4250-b4ca-6315b8622a51 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.138579 Oct 13 08:41:57.380564 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1278/2329] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:57 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:41:57.598465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:57.599002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 8d8b162b-28d9-4ce6-991e-4635698868d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:41:57.627073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:57.627641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:57.634843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:57.642057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:41:57.642663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:41:57.643114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:41:57.742297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] HTTP exception thrown: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Request method failure captured: Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 HTTP/1.1 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR823lFhiWxG3L8PR6_JD_D3kEfBLgiO9Fh6bC9dN4n6hsMuVbsuEaiuBsPZcbwwU_fc4A5tJ8K1nyuulE5fQwNXzwhi0m3ECLIDQb8jmOIReGVZqb_FlJ4b_y-tw87Y8-QTiFnYTRufFtWdSzDw3cFOV44nh-mwTHim-Nt6sLq3fZmY Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveMigrationTest-704538872 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveMigrationTest-704538872-project Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c6b6dd069e4f4c57a9f41197a2cc25d5 Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveMigrationTest-704538872-project Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8d8b162b-28d9-4ce6-991e-4635698868d5'} Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:41:57.744159 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:41:57.750689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Returning 404 to user: Instance 8d8b162b-28d9-4ce6-991e-4635698868d5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:41:57.756718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31e4df17-332b-46b6-b82b-e3092387481d tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5" status: 404 len: 111 microversion: 2.1 time: 0.160908 Oct 13 08:41:57.760556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1279/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:41:57 2022] GET /compute/v2.1/servers/8d8b162b-28d9-4ce6-991e-4635698868d5 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:41:58.395643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3505c454-b7f1-4704-9c67-ca3103100318 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375ddfc10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:58.469762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:41:58.500119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3505c454-b7f1-4704-9c67-ca3103100318 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.108300 Oct 13 08:41:58.511173 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1280/2331] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:58 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:41:59.517176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44fc23ee-f2ed-4ab1-bb80-43bc3c95f098 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375ddd670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:41:59.677262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44fc23ee-f2ed-4ab1-bb80-43bc3c95f098 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.164649 Oct 13 08:41:59.677981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1281/2332] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:41:59 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:00.073109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:42:00.073787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:42:00.074693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:42:00.075286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:42:00.075874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:42:00.095417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:00.098607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:00.099524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:00.100514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:00.104325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:00.106460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:00.155515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Getting quotas for project 1dda75b6d7c349d2b5f87787417281b7. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:42:00.177767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Getting quotas for user 4a84a43db61e4c59a28ad1c3abb1c4ca and project 1dda75b6d7c349d2b5f87787417281b7. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:42:00.236331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:42:00.252693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:42:00.463767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1d8dc6d-a74b-4c1a-b12d-a5d1a838e74d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.104022 Oct 13 08:42:00.474879 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1052/2333] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 13111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:42:00.484386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac16fe3b-ed21-4f6c-954d-7547c025b2ce tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:00.485009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac16fe3b-ed21-4f6c-954d-7547c025b2ce tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:00.610637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e29265-dfc5-4037-b844-0eb5dcc0f712", "name": "network-vif-plugged", "status": "completed", "tag": "54095bae-3efe-4867-a8d0-7f1cc1b76ebb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:00.638010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:00.640634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:00.641279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:00.686304 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] Creating event network-vif-plugged:54095bae-3efe-4867-a8d0-7f1cc1b76ebb for instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 on n-h1-858384-11 Oct 13 08:42:00.740227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-80be6793-6629-4250-b225-e0ae4619a27e req-38847e54-5258-46b5-b777-ccca299588c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135832 Oct 13 08:42:00.745045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1053/2334] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:42:00.776518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f93d5e6c-ed22-4e44-972a-ef07451e8767 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376ed78b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:00.925374 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f93d5e6c-ed22-4e44-972a-ef07451e8767 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.179025 Oct 13 08:42:00.934324 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1054/2335] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:00 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:01.696547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac16fe3b-ed21-4f6c-954d-7547c025b2ce tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:01.709826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac16fe3b-ed21-4f6c-954d-7547c025b2ce tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1216 microversion: 2.1 time: 1.232950 Oct 13 08:42:01.712277 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1282/2336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:00 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1216 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:01.941964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-802a402f-8ddf-4de3-b7ec-84261c6213d8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53768ee310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:02.052845 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-802a402f-8ddf-4de3-b7ec-84261c6213d8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.114478 Oct 13 08:42:02.067508 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1055/2337] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:01 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:02.734749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:02.735489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:02.759428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:02.770884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:02.775070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:02.787727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:02.789802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:02.793054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:03.069520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a802acea-8ced-40e8-a637-ed455941261a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537a9a4ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:03.177375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a802acea-8ced-40e8-a637-ed455941261a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.112862 Oct 13 08:42:03.178238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1056/2338] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:03 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:04.092294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:04.106087 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eae7a654-cdd2-46af-b6b2-9a83da7c792c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1268 microversion: 2.1 time: 1.376099 Oct 13 08:42:04.127240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1283/2339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:02 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1268 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:04.194760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08b0fceb-70a8-40df-9f52-c1f65af8ece6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376788430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:04.282670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08b0fceb-70a8-40df-9f52-c1f65af8ece6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.093139 Oct 13 08:42:04.283286 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1057/2340] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:04 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:05.134884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:05.135542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:05.152229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:05.152739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:05.153186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:05.156090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:05.157808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:05.159691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:05.300611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8840bdf9-a115-482a-8434-e91bc5e1998a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376ed7670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:05.398972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8840bdf9-a115-482a-8434-e91bc5e1998a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.098089 Oct 13 08:42:05.400003 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1058/2341] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:05 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:05.483712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:05.492525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5109a375-cb2c-40f1-a759-18634c4d99eb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1274 microversion: 2.1 time: 0.362439 Oct 13 08:42:05.519569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1284/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:05 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1274 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:06.416877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ad67c43-142e-407b-9907-85d61e4020f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53767efdc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:06.512385 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ad67c43-142e-407b-9907-85d61e4020f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.100949 Oct 13 08:42:06.512972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1059/2343] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:06 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:06.525381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:06.526637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:06.550292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:06.559263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:06.559980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:06.572363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:06.576565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:06.577258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:06.780102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:06.788622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4da62f64-4e92-4646-9497-33d5e66e9168 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1274 microversion: 2.1 time: 0.267115 Oct 13 08:42:06.789218 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1285/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:06 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:07.528345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd495754-68a5-491a-bc3f-cc0b506f3fcb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53768ee3a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:07.616164 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd495754-68a5-491a-bc3f-cc0b506f3fcb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.091757 Oct 13 08:42:07.616759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1060/2345] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:07 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:07.817725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:07.819029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:07.833267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:07.840731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:07.851071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:07.852114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:07.856010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:07.856700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:08.286679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:08.298298 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-177a4f5f-afc7-4f27-adc2-31f0a5be13cb tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1274 microversion: 2.1 time: 0.484231 Oct 13 08:42:08.298942 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1286/2346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:07 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1274 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:08.633338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5db8688-a5d7-4b64-bd77-7b290fbb3537 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53767ef4c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:08.700094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5db8688-a5d7-4b64-bd77-7b290fbb3537 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.071456 Oct 13 08:42:08.701432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1061/2347] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:08 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:09.329952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:09.330735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:09.400318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:09.408677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:09.410354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:09.415974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:09.426719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:09.429263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:09.684222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:09.710756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a602e71a-b4f6-4476-822d-59123c9e7f0b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1274 microversion: 2.1 time: 0.381610 Oct 13 08:42:09.716572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f8aadc1-58e9-4403-9be5-08b07987a73e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5376ed74c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:09.729126 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1287/2348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:09 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:09.838621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f8aadc1-58e9-4403-9be5-08b07987a73e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.123730 Oct 13 08:42:09.847916 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1062/2349] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:09 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:10.742818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:10.745067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:10.774096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:10.775165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:10.785347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:10.792277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:10.795062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:10.796566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:10.801465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:10.808028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:10.808987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:10.812563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:10.819942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:10.826180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:10.895344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:10.897276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:10.898441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:10.904131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:10.908786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:10.909366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:11.078090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:42:11.450624 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50a3e534-9f80-4d49-8e60-ef38bd01c11f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 204 len: 0 microversion: 2.1 time: 0.658870 Oct 13 08:42:11.457870 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1063/2350] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:42:10 2022] DELETE /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:42:11.489544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7bb8885-b661-4566-96bb-568ba1be8931 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f53767b1940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:11.595396 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7bb8885-b661-4566-96bb-568ba1be8931 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.132565 Oct 13 08:42:11.596975 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1064/2351] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:11 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:11.615163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:11.618460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:11.638086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:11.645123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:11.645836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:11.646812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:11.647811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:11.648422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:11.707648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:12.258957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:12.268296 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-198d0640-e0d1-4008-8e5e-fe09075b63a4 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 1.530953 Oct 13 08:42:12.277430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1288/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:10 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:12.611932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca7422f2-fb0c-4cc7-bc33-436a4a29a98f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dbd310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:12.765301 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca7422f2-fb0c-4cc7-bc33-436a4a29a98f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.157640 Oct 13 08:42:12.784385 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1289/2353] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:12 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:13.307119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:13.311640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:13.331892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:13.334316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:13.335815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:13.338137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:13.340355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:13.341552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:14.377198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:14.382192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a491da61-2309-42e4-bcec-41126aa7307b tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 1.084316 Oct 13 08:42:14.387001 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1290/2354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:13 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:14.398132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07a4ea4d-6abd-4615-9671-5b2a2f1b5c98 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dbe310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:14.506198 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07a4ea4d-6abd-4615-9671-5b2a2f1b5c98 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.117764 Oct 13 08:42:14.507265 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1291/2355] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:14 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:15.414163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:15.415530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:15.425717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:15.426310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:15.426921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:15.429018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:15.431931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:15.435058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:15.748031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:15.761285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:15.774956 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-589166c1-4321-4fdd-9c46-079fabdcf830 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 0.362027 Oct 13 08:42:15.777127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3fe6290-8aa7-497d-b6ca-f1c4e474aedd tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1667 microversion: 2.1 time: 4.171044 Oct 13 08:42:15.779762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1292/2356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:15 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:15.791980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-896f3702-acb6-4d12-9100-c3d78aa2e335 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aaa44c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:15.808863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1065/2357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:11 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1667 bytes in 4211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:15.910954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-896f3702-acb6-4d12-9100-c3d78aa2e335 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1414 microversion: 2.1 time: 0.129672 Oct 13 08:42:15.913408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1293/2358] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:15 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:16.810174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:16.811538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:16.811697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:16.812521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:16.830381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:16.833082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:16.833691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:16.834227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:16.835043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:16.835421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:16.836050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:16.836574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:16.838759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:16.840417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:16.844963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:16.845427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:17.593182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:17.603182 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f24e1b08-feb9-4be4-b47e-b6854c6c9816 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1667 microversion: 2.1 time: 0.796352 Oct 13 08:42:17.605993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1294/2359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:16 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1667 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:17.615257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0840f81c-16f6-4b62-b300-f4521641f20c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f537aaa4ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:18.958854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:18.967712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73888bcf-e3a0-4a92-9437-85c859f9e98a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 2.161867 Oct 13 08:42:18.974853 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1066/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:16 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:18.999343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-286189873", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8befbf54-77e2-47f7-8a8a-5af09d560fa6"}], "security_groups": [{"name": "tempest-securitygroup--129425075"}], "key_name": "tempest-keypair-397902749", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0b00cd77-9ce8-4fb8-af7e-90c74bb3833b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:19.799666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] validate_networks() for [('8befbf54-77e2-47f7-8a8a-5af09d560fa6', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:42:22.506009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0840f81c-16f6-4b62-b300-f4521641f20c tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1423 microversion: 2.1 time: 4.896832 Oct 13 08:42:22.507482 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1295/2361] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:17 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1423 bytes in 4899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:22.519315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:22.521622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:22.531771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.532272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.532712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.533428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.533889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.534316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.603843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:22.613504 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49a224e7-9093-488f-b34a-a6e1909050a3 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 200 len: 1599 microversion: 2.1 time: 0.104838 Oct 13 08:42:22.614670 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1296/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:22 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 1599 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:22.619504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:22.620202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:22.629245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.631627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.632245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.632795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.633253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.633678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.662127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for project d3a5ffa0659444f3aec43a22913ae33f. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:42:22.671904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for user 370856659f3c48ab8af5f76a3e04217a and project d3a5ffa0659444f3aec43a22913ae33f. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:42:22.724767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:42:22.725187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:42:22.725664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:42:22.726074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:42:22.726529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:42:22.753798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.756013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.756718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.759572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:22.760237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:22.763824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:22.854194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for project d3a5ffa0659444f3aec43a22913ae33f. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:42:22.879777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Getting quotas for user 370856659f3c48ab8af5f76a3e04217a and project d3a5ffa0659444f3aec43a22913ae33f. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:42:22.993786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:23.006450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-170d6ee2-38e6-4d5b-8b54-2f41c9c43be5 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 0.390349 Oct 13 08:42:23.008992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1297/2363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:22 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:23.015986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29194693-590b-4464-97ca-6c76571d6b28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375ddddc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:23.062268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:42:23.065266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b00cd77-9ce8-4fb8-af7e-90c74bb3833b',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:42:23.111785 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29194693-590b-4464-97ca-6c76571d6b28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 200 len: 1423 microversion: 2.1 time: 0.100234 Oct 13 08:42:23.113969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1298/2364] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:42:23 2022] GET /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:23.136805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "738b3c84-5a45-42cb-a55e-3ba2d83c0c01", "tag": "97381096-df41-4926-88cb-932be31ed7eb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:23.173376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:23.174983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:23.176545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:23.223893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] Creating event network-changed:97381096-df41-4926-88cb-932be31ed7eb for instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 on n-h1-858384-11 Oct 13 08:42:23.237994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d8fff7bf-b98d-4efb-bcfd-4f7691fa1f44 req-6a5415e7-4870-46ed-9c8b-158bd57d838e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115660 Oct 13 08:42:23.238616 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1299/2365] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:23.387817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2117512898", "imageRef": "4c1c45e0-38dd-46f6-8269-d897ba0fa820", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:23.487513 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd7ad7de-b985-4537-afff-744e85e40227 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.508746 Oct 13 08:42:23.488179 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1067/2366] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:42:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:42:23.508759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aad33182-7e2a-4f69-a7a3-24658e828603 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:23.512467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aad33182-7e2a-4f69-a7a3-24658e828603 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:23.574234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:42:24.616634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aad33182-7e2a-4f69-a7a3-24658e828603 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:24.629819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aad33182-7e2a-4f69-a7a3-24658e828603 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1120 microversion: 2.1 time: 1.134259 Oct 13 08:42:24.652084 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1068/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:23 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1120 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:24.690395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:24.691626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: f3acf3e2-d5e1-432e-899b-5bcb2abaabf3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:24.720212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:24.728822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:24.729612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:24.730953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:24.736522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:24.737371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:24.796867 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] HTTP exception thrown: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Request method failure captured: Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 HTTP/1.1 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR823lFhiWxG3L8PR6_JD_D3kEfBLgiO9Fh6bC9dN4n6hsMuVbsuEaiuBsPZcbwwU_fc4A5tJ8K1nyuulE5fQwNXzwhi0m3ECLIDQb8jmOIReGVZqb_FlJ4b_y-tw87Y8-QTiFnYTRufFtWdSzDw3cFOV44nh-mwTHim-Nt6sLq3fZmY Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-LiveMigrationTest-704538872 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c6b6dd069e4f4c57a9f41197a2cc25d5 Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f3acf3e2-d5e1-432e-899b-5bcb2abaabf3'} Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:24.817968 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. Oct 13 08:42:24.825603 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:24.836150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Returning 404 to user: Instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:24.840009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-757ddb20-f370-4dd5-8ca3-13efcfb2c1c7 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3" status: 404 len: 111 microversion: 2.1 time: 0.185869 Oct 13 08:42:24.840875 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1069/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:24 2022] GET /compute/v2.1/servers/f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:42:24.873101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:24.877575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:24.897152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:24.916321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:24.917271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:24.920274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:24.923794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:24.927930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.024994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:42:25.025616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:42:25.025871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:42:25.026991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:42:25.027573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:42:25.030521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=35 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:25.049567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:25.050280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:25.052067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.053642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:25.055631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:25.059371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.085206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=77 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:25.120944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:42:25.145330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:42:25.200078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:42:25.213282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c1c45e0-38dd-46f6-8269-d897ba0fa820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:42:25.340450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9858a7d8-ec6e-4135-9169-c11031d89821 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.957403 Oct 13 08:42:25.346197 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1300/2369] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:42:25.359073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67980815-05c6-4bbd-9998-180e141eb736 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '.version_select at 0x7f5375ddf8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:25.406484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67980815-05c6-4bbd-9998-180e141eb736 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654064360" status: 202 len: 0 microversion: 2.1 time: 0.058355 Oct 13 08:42:25.410759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1301/2370] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:42:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654064360 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:42:25.417690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-672e560f-0389-46cf-a0df-445e5e923473 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:25.423203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-672e560f-0389-46cf-a0df-445e5e923473 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:25.749952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-672e560f-0389-46cf-a0df-445e5e923473 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:25.759018 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-672e560f-0389-46cf-a0df-445e5e923473 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1208 microversion: 2.1 time: 0.346916 Oct 13 08:42:25.764806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1302/2371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:25 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1208 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:25.792580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3acf3e2-d5e1-432e-899b-5bcb2abaabf3", "name": "network-vif-deleted", "tag": "c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:25.838943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:25.839460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:25.839926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.874346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] Creating event network-vif-deleted:c9f5dfd4-6e1b-4fc8-9d9e-e3fc6fe71bb4 for instance f3acf3e2-d5e1-432e-899b-5bcb2abaabf3 on n-h2-858384-11 Oct 13 08:42:25.908853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-43ddd0f3-e87b-4de7-9e72-fa4b631462fa req-e91bb577-eb06-441b-8095-59a453ba4f1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141701 Oct 13 08:42:25.916235 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1303/2372] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:25.928575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:25.929338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:25.959539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:25.960040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:25.960684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.961602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:25.963930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:25.965502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:25.972970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:25.982827 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b1a1973-56d8-417d-8034-dbac36af5686 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 1.139265 Oct 13 08:42:25.990332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1070/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:24 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:26.267775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:26.284067 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-786983f5-5d75-4af7-b9f6-5fc9dccde44f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1218 microversion: 2.1 time: 0.364852 Oct 13 08:42:26.289654 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1304/2374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:25 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:26.591356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93f96042-7168-47c8-bc0c-cc19c2ef6129 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] Calling method '.version_select at 0x7f537683e430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:26.637805 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93f96042-7168-47c8-bc0c-cc19c2ef6129 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.617686 Oct 13 08:42:26.647830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1071/2375] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:42:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:42:26.661037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e07e5e3-a77c-4632-bb1e-3a974e5e017f tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] Action: 'update', calling method: .version_select at 0x7f5375dbd310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:26.796143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:26.797052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:26.814864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:26.819731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:26.820228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:26.824881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:26.825806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:26.827292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:27.447152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e07e5e3-a77c-4632-bb1e-3a974e5e017f tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.782505 Oct 13 08:42:27.447795 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1305/2376] 10.222.0.23 () {60 vars in 1206 bytes} [Thu Oct 13 08:42:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:27.458444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:27.461624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:27.484333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:27.489994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:27.490520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:27.491443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:27.491988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:27.492549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:27.601088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:27.611286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17f94151-2d6e-4298-a229-92deab86af83 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1212 microversion: 2.1 time: 0.826514 Oct 13 08:42:27.633869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1072/2377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:26 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1212 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:27.648417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:27.649266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:27.656080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:27.659195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:27.659655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:27.660402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:27.665680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:27.666381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:27.875810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:27.886908 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea523311-d6bc-45c2-9b0f-99070edcdc9a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1236 microversion: 2.1 time: 0.251307 Oct 13 08:42:27.890778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1073/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:27 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1236 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:27.906520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c44361ea-3662-4c4c-a499-f20bffef73c6 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] Calling method '.version_select at 0x7f5375f9e8b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:27.928157 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c44361ea-3662-4c4c-a499-f20bffef73c6 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035421 Oct 13 08:42:27.935391 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1074/2379] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 08:42:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:27.947682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e35d13f4-d0f2-443f-bcf2-8792bce33457 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] Action: 'update', calling method: .version_select at 0x7f53767ef670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:28.130705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e35d13f4-d0f2-443f-bcf2-8792bce33457 tempest-QuotaClassesAdminTestJSON-1384743375 tempest-QuotaClassesAdminTestJSON-1384743375-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.186791 Oct 13 08:42:28.143856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1075/2380] 10.222.0.23 () {60 vars in 1206 bytes} [Thu Oct 13 08:42:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:42:28.434303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:28.453421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2de4fb3-2565-40e1-bee7-7e4da6ee1fe2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 1.004215 Oct 13 08:42:28.468287 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1306/2381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:27 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:28.556356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e29265-dfc5-4037-b844-0eb5dcc0f712", "name": "network-vif-unplugged", "status": "completed", "tag": "54095bae-3efe-4867-a8d0-7f1cc1b76ebb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:28.575394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:28.576763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:28.578978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:28.599622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] Creating event network-vif-unplugged:54095bae-3efe-4867-a8d0-7f1cc1b76ebb for instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 on n-h1-858384-11 Oct 13 08:42:28.606763 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bed79711-5dff-4bcc-a106-c0c1bac79e02 req-a3e3c7ca-1d8c-4a49-bb13-ad18d3b1f07b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054085 Oct 13 08:42:28.609372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1076/2382] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:28.657521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:28.658619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:28.667112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:28.667862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:28.670454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:28.671950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:28.673021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:28.674314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:28.918756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:28.919974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:28.932083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:28.933477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:28.936296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:28.937429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:28.940700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:28.941160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:29.083113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:29.097266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9eafdc0-6fdf-479a-8734-303c839238cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1266 microversion: 2.1 time: 0.442196 Oct 13 08:42:29.101652 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1307/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:28 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:29.479296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:29.479966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:29.491273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:29.491680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:29.497673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:29.500343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:29.506029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:29.506964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:29.670480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:29.680363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0722b424-48f8-4429-bd18-7d1f17cc644b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1236 microversion: 2.1 time: 0.768363 Oct 13 08:42:29.693036 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1077/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:28 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1236 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:30.100079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:30.111578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e09f375-45b4-491b-bcd8-6980595d370f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 0.636120 Oct 13 08:42:30.116237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1308/2385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:29 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:30.123775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:30.124447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:30.135333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:30.135829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:30.141102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:30.144832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:30.145338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:30.148812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:30.550091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-763c138b-845b-4ed5-9a2e-aa429c4ff4eb tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375dbeee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1798108332", "description": "tempest-description-106793214"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:30.592298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:30.621417 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-867ecdc9-12fe-488a-9481-0cfab734367a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1266 microversion: 2.1 time: 0.501366 Oct 13 08:42:30.630770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1078/2386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:30 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1266 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:30.719390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:30.720736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:30.729487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:30.729976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:30.730437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:30.731145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:30.731594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:30.732556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:31.561794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:31.570621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7cea403-a74e-46d4-8cfa-7b573e77775b tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1236 microversion: 2.1 time: 0.855379 Oct 13 08:42:31.591452 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1079/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:30 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1236 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:31.599406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:31.628443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:31.650756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:31.651258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:31.651696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:31.652417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:31.652867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:31.653295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:31.719530 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-763c138b-845b-4ed5-9a2e-aa429c4ff4eb tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.433410 Oct 13 08:42:31.721189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1309/2388] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:42:31.728200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:31.729564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:31.759846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:31.764843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:31.767129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:31.768679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:31.770880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:31.774851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:32.084362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:32.118542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c2f7032d-885e-46fd-bfb0-a8514fa3b23a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1266 microversion: 2.1 time: 0.395052 Oct 13 08:42:32.124143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1310/2389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:31 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:32.146148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25c9da8c-2c89-4e17-ac12-7066a2906196 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f537abc6430>, body: {"security_group_rule": {"parent_group_id": "5fa07bc9-e9e2-45d0-8a18-3318ccf16261", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:32.822516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:34.196888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:34.212080 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25bc67aa-f55e-4dc6-b868-c5715615ac1a tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 2.616142 Oct 13 08:42:34.217027 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1080/2390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:31 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:34.240231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:34.245645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:34.264011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.265532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.266187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.267971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.272182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.273013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.622012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:34.638276 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a88caef6-d262-4eb5-9c02-0a2ef34aed3a tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1236 microversion: 2.1 time: 0.413402 Oct 13 08:42:34.654433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1081/2391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:34 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1236 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:34.664176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:34.666658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:34.694004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.694535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.695045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.695727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.718612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.719105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.834005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25c9da8c-2c89-4e17-ac12-7066a2906196 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.708360 Oct 13 08:42:34.840480 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1311/2392] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:34.848066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:34.849874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:34.890138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.892567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.893198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.894121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:34.898216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:34.902559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:34.982828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:42:35.096805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:35.333378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e1ae2ce-7b7f-4e87-8ce6-011a65a50a30 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 204 len: 0 microversion: 2.1 time: 0.487991 Oct 13 08:42:35.335614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1312/2393] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:42:34 2022] DELETE /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:42:35.351964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f482d1b-7a62-49db-80e8-2b6aea1e11b6 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f537ab228b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-893113147", "description": "tempest-description-419772689"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:35.415761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:35.435615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5a6dc092-eb4b-4579-a8a1-fd4a106fb876 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.789541 Oct 13 08:42:35.439497 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1082/2394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:34 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:35.451071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:35.456612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:35.477644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:35.479016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:35.480641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:35.483874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:35.500300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:35.500775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:35.961341 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f482d1b-7a62-49db-80e8-2b6aea1e11b6 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.619627 Oct 13 08:42:35.963519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1313/2395] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:35 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:35.974050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:35.975554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:35.996204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:36.000157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:36.000945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:36.003880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:36.006143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:36.006971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:36.537842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:36.553899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c386eb2-e7c7-41b5-ba55-a86b5c90ba63 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1484 microversion: 2.1 time: 0.586461 Oct 13 08:42:36.575018 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1314/2396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:35 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1484 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:36.583237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:36.584333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:36.592683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:36.593535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:36.594333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:36.595396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:36.596498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:36.597148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:37.093163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:37.103501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fe1ed6a-f9bd-4f7f-952b-611c05c7d0d7 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1303 microversion: 2.1 time: 0.526563 Oct 13 08:42:37.105407 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1315/2397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:36 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1303 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:37.112220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-539b65b5-7015-45af-8656-f08c02d3c567 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375deeca0>, body: {"security_group_rule": {"parent_group_id": "f15de355-507b-43b5-8f4d-86d273ffdaba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:37.187006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:37.206449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba3bcab6-9b81-4be3-9137-51e73d2fb6ca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 1.764827 Oct 13 08:42:37.211154 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1083/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:35 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:37.233560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:37.235448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:37.278736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:37.281298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:37.284976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:37.289236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:37.297951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:37.304348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:37.437976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:37.828717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-539b65b5-7015-45af-8656-f08c02d3c567 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.722058 Oct 13 08:42:37.830078 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1316/2399] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:37 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:37.837011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:37.839535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:37.848502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:37.850086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:37.850918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:37.852224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:37.852977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:37.854341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:38.128321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:38.318355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:38.331005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1dd801c9-ae8b-4ff7-9cdb-9aafc19fed61 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1484 microversion: 2.1 time: 0.499458 Oct 13 08:42:38.333678 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1317/2400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:37 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1484 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:38.347764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e69f801-aa25-451a-a384-37154269bd41 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f537ab221f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-724336655", "description": "tempest-description-382167455"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:38.750013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e69f801-aa25-451a-a384-37154269bd41 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.415041 Oct 13 08:42:38.750640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1318/2401] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:38 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:38.755306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738b3c84-5a45-42cb-a55e-3ba2d83c0c01", "name": "network-vif-plugged", "status": "completed", "tag": "97381096-df41-4926-88cb-932be31ed7eb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:38.785063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:38.789011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:38.789692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:38.822020 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] Creating event network-vif-plugged:97381096-df41-4926-88cb-932be31ed7eb for instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 on n-h1-858384-11 Oct 13 08:42:38.845403 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5b649867-1f61-48b0-8f42-57a4fc37928d req-1420a09b-99fd-45e2-8d14-0ba24826f107 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093326 Oct 13 08:42:38.846626 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1319/2402] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:38.853602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:38.858115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:38.872953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:38.877714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:38.878428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:38.879368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:38.880396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:38.880825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:39.748632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:39.765238 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f404d29c-b529-40a5-8709-8819c611b3ed tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1303 microversion: 2.1 time: 0.917202 Oct 13 08:42:39.770726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1320/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:38 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1303 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:39.796028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:39.797004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:39.800453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=13 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:39.819382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:39.835233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:39.837859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:39.838967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:39.839642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:39.842177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:39.891803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:39.896985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:39.925936 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a17a121f-a9e7-4400-a7ae-f418713e3fc2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 2.708575 Oct 13 08:42:39.952907 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1084/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:37 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:39.974161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e115f0f5-66a8-4a92-b6b6-a88b35f85919 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375f9f5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1150600894", "description": "tempest-description-368572497"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:40.641600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:40.674374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7bf02e2e-75dd-4888-9beb-83d0d3353bca tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 0.901490 Oct 13 08:42:40.691125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1321/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:39 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:40.716231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:40.716995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:40.733272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:40.735243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:40.735923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:40.739415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:40.740032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:40.740527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:41.129890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:41.144259 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d4852c3-2cb2-4287-bf85-99f2e63e53a1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1484 microversion: 2.1 time: 0.447294 Oct 13 08:42:41.148732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1322/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:40 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1484 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:41.170499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:41.173786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:41.195365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:41.197559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:41.204019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:41.206148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:41.209914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:41.214383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:41.923168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:41.932466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9998620b-2175-4df7-955d-681c5614a6fc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1303 microversion: 2.1 time: 0.776320 Oct 13 08:42:41.938199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1323/2407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:41 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1303 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:41.942958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:41.943570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:41.973260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:41.973777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:41.974221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:41.974969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:41.975423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:41.986237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:42.738501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:42.746866 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de24c0a5-2487-4fcb-98f1-2e8dc1016d2a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.807486 Oct 13 08:42:42.756278 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1324/2408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:41 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:42.761155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:42.778120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:42.796757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:42.797549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:42.798156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:42.799228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:42.804700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:42.805321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:42.809230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:43.043693 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e115f0f5-66a8-4a92-b6b6-a88b35f85919 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 3.086089 Oct 13 08:42:43.044344 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1085/2409] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 3091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:43.066002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:43.067325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:43.096301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:43.105713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:43.106358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:43.106751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:43.116730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:43.117264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:43.129872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:43.362932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:43.385638 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a72ebc41-facc-48b0-a04c-e355b39d2309 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 200 len: 1281 microversion: 2.1 time: 0.340228 Oct 13 08:42:43.389012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1086/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:43 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:43.404768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:43.409084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:43.440005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:43.440733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:43.441277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:43.461586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:43.463929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:43.471934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:43.713853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:43.724843 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b51d484-5cdd-4acd-b348-141662c8f2d2 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1316 microversion: 2.1 time: 0.967423 Oct 13 08:42:43.726985 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1325/2411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:42 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1316 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:43.739489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb61ea3b-97fd-40c3-b30a-476e4cc7a54d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f537abb1790>, body: {"security_group_rule": {"parent_group_id": "e2f07a23-fc41-45b7-ac31-83071be688db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "560ee35e-769d-440d-acbe-5ff2e10ce6b5"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:44.432760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:44.444954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a7927436-0bb4-4ea5-832d-e7706af03a37 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 1.053404 Oct 13 08:42:44.449923 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1087/2412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:43 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:44.472148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee2b36a-ea79-4853-98d8-fabbe1cdb884", "name": "network-vif-deleted", "tag": "839a253a-27a0-4254-8f21-3655f4cbd69a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:44.518689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:44.519670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:44.520420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:44.536795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] Creating event network-vif-deleted:839a253a-27a0-4254-8f21-3655f4cbd69a for instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 on n-h2-858384-11 Oct 13 08:42:44.568293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8afce019-9c52-4b4f-bc20-a428f0804bf9 req-5eebd0a4-1565-4e96-940d-9c44d44dcd69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103222 Oct 13 08:42:44.569736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1088/2413] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:44.577208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:44.578331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:44.586298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:44.587318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:44.588931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:44.589921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:44.591125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:44.592074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.352462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb61ea3b-97fd-40c3-b30a-476e4cc7a54d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.620861 Oct 13 08:42:45.354191 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1326/2414] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:43 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:45.362823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:45.363832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 6ee2b36a-ea79-4853-98d8-fabbe1cdb884] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:45.382351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.383637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.384568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.386100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.387094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.387804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.435046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] HTTP exception thrown: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Request method failure captured: Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 HTTP/1.1 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR823lFhiWxG3L8PR6_JD_D3kEfBLgiO9Fh6bC9dN4n6hsMuVbsuEaiuBsPZcbwwU_fc4A5tJ8K1nyuulE5fQwNXzwhi0m3ECLIDQb8jmOIReGVZqb_FlJ4b_y-tw87Y8-QTiFnYTRufFtWdSzDw3cFOV44nh-mwTHim-Nt6sLq3fZmY Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-LiveMigrationTest-704538872 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c6b6dd069e4f4c57a9f41197a2cc25d5 Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6ee2b36a-ea79-4853-98d8-fabbe1cdb884'} Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:45.442349 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. Oct 13 08:42:45.449855 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:45.451120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:45.451684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Returning 404 to user: Instance 6ee2b36a-ea79-4853-98d8-fabbe1cdb884 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:45.451684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc2f2716-6046-4470-954e-979a283eaab1 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884" status: 404 len: 111 microversion: 2.1 time: 0.090837 Oct 13 08:42:45.454476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1327/2415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:45 2022] GET /compute/v2.1/servers/6ee2b36a-ea79-4853-98d8-fabbe1cdb884 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:42:45.456834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0c78018-9c6e-4c69-a372-c26b3d09fb28 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.885491 Oct 13 08:42:45.466441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:45.466441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:45.482076 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1089/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:44 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:45.484433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.484930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.485364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.486065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.486788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.487382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.498392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d38c21f4-8c4b-4356-954d-03ffa0630d39 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375f9d700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2107503588", "description": "tempest-description-172951108"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:45.872474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:45.881706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3cdc98a-159e-4f4c-a921-6805dbe6ae1d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1504 microversion: 2.1 time: 0.426032 Oct 13 08:42:45.886857 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1328/2417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:45 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:45.892874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:45.912693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:45.930607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.943259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.945605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:45.947349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:45.949394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:45.951309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.049902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:42:46.204880 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b955ccb-e7cd-4848-bbcf-647c56246508 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 204 len: 0 microversion: 2.1 time: 0.315673 Oct 13 08:42:46.205749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1329/2418] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:42:45 2022] DELETE /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:42:46.218041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:46.218788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:46.232166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.232712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.233200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.233922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.234374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.235047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.695384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:46.703554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19638b40-e671-4283-ae63-f2a58c65f390 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.496443 Oct 13 08:42:46.708255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1330/2419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:46 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:46.714388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:46.714914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:46.733842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.734342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.749819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.750615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.751094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.751533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.790441 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d38c21f4-8c4b-4356-954d-03ffa0630d39 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.311191 Oct 13 08:42:46.791191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1090/2420] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:46.796845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:46.797856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:46.808114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fba2c906-4e89-46fa-a642-ba974841d37f tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips" status: 200 len: 108 microversion: 2.1 time: 0.098426 Oct 13 08:42:46.809121 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1331/2421] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:42:46 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips => generated 108 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:46.822662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.824731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.828515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:46.831811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:46.832718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:46.833613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.224945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:47.237741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dab656b4-5365-4a2e-b3f2-21285c4be4ea tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1499 microversion: 2.1 time: 0.444752 Oct 13 08:42:47.240430 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1091/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:46 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1499 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:47.248975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f07a21f-bfe2-42d5-821d-beb4a2918700 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f53767b1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2085483718", "description": "tempest-description-1079552796"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:47.251591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:47.252307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:47.275024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.276713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.277503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.280925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.281650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.282247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.533282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:47.546121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a68150b-0e2f-47b5-9720-a0ccf0f09b2e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.734586 Oct 13 08:42:47.547058 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1332/2423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:46 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:47.560474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7528d-7aa7-49f8-9006-d4337b105a91", "tag": "a8d5bcd3-af02-44ed-8085-d02912bd3632"}, {"name": "network-changed", "server_uuid": "fef96373-7d8c-443e-b8d0-d1b8cc5b4af2", "tag": "4de90cb3-ed98-4faa-a5df-ca3a5cc0d242"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:47.583348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.583820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.584256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.614220 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Creating event network-changed:a8d5bcd3-af02-44ed-8085-d02912bd3632 for instance e1b7528d-7aa7-49f8-9006-d4337b105a91 on n-h2-858384-11 Oct 13 08:42:47.617634 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] Creating event network-changed:4de90cb3-ed98-4faa-a5df-ca3a5cc0d242 for instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 on n-h2-858384-11 Oct 13 08:42:47.634450 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f07a21f-bfe2-42d5-821d-beb4a2918700 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.392088 Oct 13 08:42:47.634795 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2c1b911c-04b5-46b8-9c50-91054eb6e36c req-3a291a3f-0766-4819-a9ea-b5aa31268839 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.078173 Oct 13 08:42:47.636486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1092/2424] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:47.636798 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1333/2425] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:47.642039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:47.642841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:47.649881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bdb28faf-155c-48b9-824a-60af2c85753f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5376ff3430>, body: {"security_group_rule": {"parent_group_id": "bc6241ae-871c-4771-b145-2616a741928f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1eca7374-3d58-4ab5-bb95-4201a4e81827"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:47.665527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.668370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.669156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.670225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.670916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.675493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.732224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-beaf0b48-10c9-4a94-82c7-f58ef19cce57 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips" status: 200 len: 108 microversion: 2.1 time: 0.093981 Oct 13 08:42:47.735655 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1093/2426] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:42:47 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips => generated 108 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:47.741188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:47.741799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:47.758755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.760866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.766513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:47.767980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:47.768673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:47.769272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.360759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:48.373623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73ca1f6b-bb5d-4341-9cd2-c373b0217c17 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.636138 Oct 13 08:42:48.375895 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1094/2427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:47 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:48.386721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:48.389907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:48.407200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.409054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.410366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.412466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.414505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.415265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.487741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cbb3361-925b-4996-9cd7-3c2539601040 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips/tempest-ServerAddressesTestJSON-378066996-network" status: 200 len: 93 microversion: 2.1 time: 0.107467 Oct 13 08:42:48.491023 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1095/2428] 10.222.0.23 () {58 vars in 1398 bytes} [Thu Oct 13 08:42:48 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01/ips/tempest-ServerAddressesTestJSON-378066996-network => generated 93 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:42:48.512707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:48.515329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:48.527864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.529172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.529796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.530933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.531605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.532259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.612025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.612956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.615690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.620151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lazy-loading 'fault' on Instance uuid 7ff95b85-68c9-4c74-af7d-47419a17bc58 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:42:48.704678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b6dd069e4f4c57a9f41197a2cc25d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bf01803eff94643b4ce733ab410ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:48.728415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7580784-2b57-46f1-a7fb-22412304d546 tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 200 len: 1300 microversion: 2.1 time: 0.235162 Oct 13 08:42:48.729918 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1096/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:48 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:48.746472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:48.747327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:48.778823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.783199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.791006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.791827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:48.792299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:48.792921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:48.874621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:42:49.051664 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c1f251a-3d6d-4dd4-90a9-e91e6cf4c31d tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "DELETE /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 204 len: 0 microversion: 2.1 time: 0.320109 Oct 13 08:42:49.052811 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1097/2430] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:42:48 2022] DELETE /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:42:49.060173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:49.061206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:49.069414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.070340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.071063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:49.072224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.072858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.073425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:49.347563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bdb28faf-155c-48b9-824a-60af2c85753f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.702028 Oct 13 08:42:49.348776 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1334/2431] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:47 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:42:49.354353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:49.355712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:49.371299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.373447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.374061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:49.375882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.376499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.378333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:49.757123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:49.772585 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41b449a0-f7c6-45dd-b48a-11eb55577907 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1510 microversion: 2.1 time: 0.421722 Oct 13 08:42:49.774832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1335/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:49 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:49.783969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c7106f7e-441a-43bf-8617-c9d2590aed3f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375dbd8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:49.858765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:49.871331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11dd47ce-bb33-4cfa-a0b1-9b895bd84460 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.816588 Oct 13 08:42:49.873065 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1098/2433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:49 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:49.884796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:49.886127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:49.896141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.896141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.897225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:49.898519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:49.908351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:49.910279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:50.276123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:50.295922 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b07e2ef-27cd-4f9b-a817-45792f099289 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.421020 Oct 13 08:42:50.297377 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1099/2434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:49 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:50.302959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:50.303814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] [instance: 7ff95b85-68c9-4c74-af7d-47419a17bc58] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:50.312277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:50.315427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:50.318034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:50.319547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:50.323215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:50.323985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:50.347762 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] HTTP exception thrown: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Request method failure captured: Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 HTTP/1.1 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR823lFhiWxG3L8PR6_JD_D3kEfBLgiO9Fh6bC9dN4n6hsMuVbsuEaiuBsPZcbwwU_fc4A5tJ8K1nyuulE5fQwNXzwhi0m3ECLIDQb8jmOIReGVZqb_FlJ4b_y-tw87Y8-QTiFnYTRufFtWdSzDw3cFOV44nh-mwTHim-Nt6sLq3fZmY Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2bf01803eff94643b4ce733ab410ffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-LiveMigrationTest-704538872 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2bf01803eff94643b4ce733ab410ffcc Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-LiveMigrationTest-704538872 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c6b6dd069e4f4c57a9f41197a2cc25d5 Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-LiveMigrationTest-704538872-project Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '7ff95b85-68c9-4c74-af7d-47419a17bc58'} Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:50.350142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. Oct 13 08:42:50.354718 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:42:50.358061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] Returning 404 to user: Instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:50.359285 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11a19ac7-4bf2-406f-8e37-57331b90177f tempest-LiveMigrationTest-704538872 tempest-LiveMigrationTest-704538872-project] 10.222.0.23 "GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58" status: 404 len: 111 microversion: 2.1 time: 0.060808 Oct 13 08:42:50.360910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1100/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:50 2022] GET /compute/v2.1/servers/7ff95b85-68c9-4c74-af7d-47419a17bc58 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:42:50.367084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff95b85-68c9-4c74-af7d-47419a17bc58", "name": "network-vif-deleted", "tag": "1d9d1970-7383-4244-b262-0fe1d569801a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:50.405026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:50.414834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:50.415472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:50.452518 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] Creating event network-vif-deleted:1d9d1970-7383-4244-b262-0fe1d569801a for instance 7ff95b85-68c9-4c74-af7d-47419a17bc58 on n-h1-858384-11 Oct 13 08:42:50.471775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-83f20f77-e4f1-476e-a253-009376dfd3ec req-92e44dae-5d7d-4136-a32f-9b5d51695fe1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109388 Oct 13 08:42:50.477938 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1101/2436] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:50.777162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-58bc3dc7-a126-4967-90be-aa6c1b8db384 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Action: 'create', calling method: .version_select at 0x7f53767ef280>, body: {"keypair": {"name": "tempest-keypair-1217454153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5HZGFwHZyrOPsqU+4Z/AzPSpUEkGCWl8kkzhP8+PauOUf46zsDBUiWztsSNgDEy6izdvsxK/yT4sz0XTmLtBZ//wKEojAsoJW/MtLFWynpPcozsSz0KKSSLE1lNNqCcw=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:50.825939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-58bc3dc7-a126-4967-90be-aa6c1b8db384 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:42:50.867773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-58bc3dc7-a126-4967-90be-aa6c1b8db384 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for user ad1e31177278409199fa651951c5e75a and project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:42:50.924621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-58bc3dc7-a126-4967-90be-aa6c1b8db384 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.443605 Oct 13 08:42:50.933187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1102/2437] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:42:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:50.938392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:50.939339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:50.946039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:50.947221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:50.947822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:50.949134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:50.950436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:50.951011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:51.057489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c7106f7e-441a-43bf-8617-c9d2590aed3f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1eca7374-3d58-4ab5-bb95-4201a4e81827" status: 202 len: 0 microversion: 2.1 time: 1.280565 Oct 13 08:42:51.065240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1336/2438] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:42:49 2022] DELETE /compute/v2.1/os-security-groups/1eca7374-3d58-4ab5-bb95-4201a4e81827 => generated 0 bytes in 1289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:42:51.074698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:51.076543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:51.100696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:51.107864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:51.108347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:51.109526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:51.109968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:51.110430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:51.728610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:51.740269 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d14d6653-0df9-4404-920e-f6f03cb0e10c tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1510 microversion: 2.1 time: 0.805653 Oct 13 08:42:51.740867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1103/2439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:50 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1510 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:51.755990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66f80cdb-0440-484c-9201-0264a1bd2ed0 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f537683e430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:51.914593 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66f80cdb-0440-484c-9201-0264a1bd2ed0 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/bc6241ae-871c-4771-b145-2616a741928f" status: 200 len: 247 microversion: 2.1 time: 0.170206 Oct 13 08:42:51.916396 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1104/2440] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:42:51 2022] GET /compute/v2.1/os-security-groups/bc6241ae-871c-4771-b145-2616a741928f => generated 247 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:51.923697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:51.924675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:51.941385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:51.942124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:51.945233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:51.946221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:51.947367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:51.949158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:52.025851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:52.039687 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-adab5fd8-fee8-41a7-862f-9b2c1479976e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.971174 Oct 13 08:42:52.040592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1337/2441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:51 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:52.048967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c477bcb-a948-45b3-a8e3-7daeb62978ce tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375dbd550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-967720034", "description": "tempest-description-645648419"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:52.605739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c477bcb-a948-45b3-a8e3-7daeb62978ce tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.563821 Oct 13 08:42:52.609307 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1338/2442] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:42:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:52.625131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-655efef6-050a-42ff-9085-1a622e72eef9 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375dd2c10>, body: {"security_group_rule": {"parent_group_id": "0a1c921a-1c95-4f8c-b405-0c84e589df20", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:52.909148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:52.918273 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f326fab6-f051-4b65-8434-0198ba49a131 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 1.000624 Oct 13 08:42:52.929459 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1105/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:51 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:52.974594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:52.975863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:53.020612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:53.021128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:53.021571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:53.022648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:53.022790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:53.035965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:53.136414 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-655efef6-050a-42ff-9085-1a622e72eef9 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.515381 Oct 13 08:42:53.138034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1339/2444] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:53.143268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:53.148900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:53.176971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:53.177859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:53.185799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:53.187228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:53.187860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:53.189326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:53.604621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a84a43db61e4c59a28ad1c3abb1c4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda75b6d7c349d2b5f87787417281b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:53.614192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bedc4dc1-36a1-4225-bb37-374f3475d120 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 200 len: 1468 microversion: 2.1 time: 0.682452 Oct 13 08:42:53.633966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1106/2445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:52 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 1468 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:53.650360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738b3c84-5a45-42cb-a55e-3ba2d83c0c01", "name": "network-vif-deleted", "tag": "97381096-df41-4926-88cb-932be31ed7eb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:53.688184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:53.691032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:53.691680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:53.705558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:42:53.726562 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] Creating event network-vif-deleted:97381096-df41-4926-88cb-932be31ed7eb for instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 on n-h1-858384-11 Oct 13 08:42:53.740324 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d4c4188a-6028-4105-ae7c-a5144c8db3ce req-92ab9463-bd50-44b5-8f31-31a211391a67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102152 Oct 13 08:42:53.741421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1107/2446] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:53.751762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-922b1eb2-c81b-4b10-ae67-915dea963cb4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Action: 'create', calling method: .version_select at 0x7f5375f9e160>, body: {"security_group_rule": {"parent_group_id": "0a1c921a-1c95-4f8c-b405-0c84e589df20", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:53.773191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:53.786113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6557f08e-8d50-4473-bf02-ccea7fd88631 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.646516 Oct 13 08:42:53.787267 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1340/2447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:53 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:53.955028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bea281c-2550-446e-8039-915f6a28c6d6 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Calling method '.version_select at 0x7f5376ff3430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:54.141317 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bea281c-2550-446e-8039-915f6a28c6d6 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.278729 Oct 13 08:42:54.141914 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1341/2448] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:42:53 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:42:54.146542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:54.147357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:54.161999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.162517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.163124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.164000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.164458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.164882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.442515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:54.452063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c538b3af-bdc6-4310-a643-a2d42e15dbbd tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.309056 Oct 13 08:42:54.466261 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1342/2449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:54 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:54.477083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-880b8e8a-a26a-4060-8c79-fee09d6ae8d4 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Action: 'create', calling method: .version_select at 0x7f537aaa4c10>, body: {"pool": "non_exist_pool"} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:54.543764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-880b8e8a-a26a-4060-8c79-fee09d6ae8d4 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] HTTP exception thrown: Floating IP pool not found. Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-880b8e8a-a26a-4060-8c79-fee09d6ae8d4 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Request method failure captured: Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 26 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-N6iiEjsCs1TVIIPiEj2HGKhdhp3mBXmypsM_o8c_ucT3IDybiciwpOT44w2-p_ICzNTL21r8VRtM4MZI5xpV_ilEbSVJLg-6LFG_9Ug17T-mtOQFtvTcX16UFYPb_8eGXH8cWwySwOo-Z5QDPKCOJCqvVfAGRi4CxGd6BUo4z6SE Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 08ee7556f08a4db1b574617415860ba9 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_08ee7556f08a4db1b574617415860ba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 08ee7556f08a4db1b574617415860ba9 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsNegativeTestJSON-714242219-project Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8e05284997cd49028662e5980dc855cf Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-714242219-project Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: {"pool": "non_exist_pool"} Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: exception: Floating IP pool not found. Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:54.545443 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:54.554816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 13 08:42:54.554816 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.554816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-880b8e8a-a26a-4060-8c79-fee09d6ae8d4 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Returning 404 to user: Floating IP pool not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:54.554816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-880b8e8a-a26a-4060-8c79-fee09d6ae8d4 tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.079631 Oct 13 08:42:54.554816 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1343/2450] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:42:54 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:42:54.558638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Calling method '.version_select at 0x7f5375d588b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:54.626472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 657e2861-cd01-4e82-92ce-1a5a4b68a835 could not be found", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:42:54.627339 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] HTTP exception thrown: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Request method failure captured: Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-floating-ips/657e2861-cd01-4e82-92ce-1a5a4b68a835 HTTP/1.1 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-N6iiEjsCs1TVIIPiEj2HGKhdhp3mBXmypsM_o8c_ucT3IDybiciwpOT44w2-p_ICzNTL21r8VRtM4MZI5xpV_ilEbSVJLg-6LFG_9Ug17T-mtOQFtvTcX16UFYPb_8eGXH8cWwySwOo-Z5QDPKCOJCqvVfAGRi4CxGd6BUo4z6SE Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 08ee7556f08a4db1b574617415860ba9 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_08ee7556f08a4db1b574617415860ba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/08ee7556f08a4db1b574617415860ba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 08ee7556f08a4db1b574617415860ba9 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-714242219 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-FloatingIPsNegativeTestJSON-714242219-project Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8e05284997cd49028662e5980dc855cf Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-714242219-project Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: exception: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '657e2861-cd01-4e82-92ce-1a5a4b68a835'} Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 657e2861-cd01-4e82-92ce-1a5a4b68a835 could not be found Oct 13 08:42:54.629390 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d7e4c34-65d8-43af-a3b6-503886e7d060'] Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835. Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835 Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835 Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] Returning 404 to user: Floating IP not found for ID 657e2861-cd01-4e82-92ce-1a5a4b68a835 {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-048ed86a-c8fa-4682-8671-4e8abbb86a2e tempest-FloatingIPsNegativeTestJSON-714242219 tempest-FloatingIPsNegativeTestJSON-714242219-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/657e2861-cd01-4e82-92ce-1a5a4b68a835" status: 404 len: 111 microversion: 2.1 time: 0.076571 Oct 13 08:42:54.632358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1344/2451] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:42:54 2022] DELETE /compute/v2.1/os-floating-ips/657e2861-cd01-4e82-92ce-1a5a4b68a835 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:42:54.661948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:54.662839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] [instance: 738b3c84-5a45-42cb-a55e-3ba2d83c0c01] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:54.674948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.679929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.680492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.681349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.681982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.682591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.719916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] HTTP exception thrown: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Request method failure captured: Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 HTTP/1.1 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR89KE06NPErPvd3SOLC632jbFTGB_U5GdnTYJDc112XkqnZzyEuzwrJdd4jJ-6CDSTlsiQQM4QRqJhs5nmaXjoYEFqt0WlVXI4dAMv9hkU7yM47IfQmRcVeVB-HN8NGOrgsX5fGxfF83D5Ut7TI4L6acKKV6eHcDtRgi5FN8dKyuzgM Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 1dda75b6d7c349d2b5f87787417281b7 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerAddressesTestJSON-2108967252 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1dda75b6d7c349d2b5f87787417281b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1dda75b6d7c349d2b5f87787417281b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1dda75b6d7c349d2b5f87787417281b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1dda75b6d7c349d2b5f87787417281b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerAddressesTestJSON-2108967252 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 1dda75b6d7c349d2b5f87787417281b7 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2108967252 Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerAddressesTestJSON-2108967252-project Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4a84a43db61e4c59a28ad1c3abb1c4ca Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerAddressesTestJSON-2108967252-project Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '738b3c84-5a45-42cb-a55e-3ba2d83c0c01'} Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:54.722014 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. Oct 13 08:42:54.725147 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:54.730431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] Returning 404 to user: Instance 738b3c84-5a45-42cb-a55e-3ba2d83c0c01 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:54.732099 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5989b36c-fa69-4040-adfc-b3375ad2c9b0 tempest-ServerAddressesTestJSON-2108967252 tempest-ServerAddressesTestJSON-2108967252-project] 10.222.0.23 "GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01" status: 404 len: 111 microversion: 2.1 time: 0.074625 Oct 13 08:42:54.733250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1345/2452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:54 2022] GET /compute/v2.1/servers/738b3c84-5a45-42cb-a55e-3ba2d83c0c01 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:42:54.815422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:54.817067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:54.832841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.834327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.837132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.838162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:54.838882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:54.841217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:54.879232 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-922b1eb2-c81b-4b10-ae67-915dea963cb4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.131834 Oct 13 08:42:54.881372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1108/2453] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:42:53 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:54.894744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c21d74c-096d-4be7-b751-ddb39e51762d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375f9f9d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:55.330475 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c21d74c-096d-4be7-b751-ddb39e51762d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/0a1c921a-1c95-4f8c-b405-0c84e589df20" status: 200 len: 663 microversion: 2.1 time: 0.441824 Oct 13 08:42:55.331450 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1109/2454] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:42:54 2022] GET /compute/v2.1/os-security-groups/0a1c921a-1c95-4f8c-b405-0c84e589df20 => generated 663 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:55.346349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb39584a-c925-45fa-996f-82ed105dcd7d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375fb4d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:55.720303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:55.745270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0387d96-4185-4832-861d-5b9fac7b34af tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.938048 Oct 13 08:42:55.746078 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1346/2455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:54 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:55.757592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:55.758602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:55.778199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:55.779390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:55.782061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:55.785776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:55.787284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:55.787950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:56.167956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:56.177416 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3538eb79-16f6-407e-881a-810f81447336 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.429886 Oct 13 08:42:56.190349 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1347/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:55 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:56.760928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb39584a-c925-45fa-996f-82ed105dcd7d tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/5a7903e5-3339-422d-860b-faf226e6f1e9" status: 202 len: 0 microversion: 2.1 time: 1.418594 Oct 13 08:42:56.761856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1110/2457] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Oct 13 08:42:55 2022] DELETE /compute/v2.1/os-security-group-rules/5a7903e5-3339-422d-860b-faf226e6f1e9 => generated 0 bytes in 1420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:42:56.772244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-741ae874-cf60-4216-b428-180e6f9d5b72 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375da0f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:56.776249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:56.777554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:56.796805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:56.800045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:56.800630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:56.801461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:56.802030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:56.802598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:57.545367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:57.561451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9068d3d-8526-4821-b7f2-4a6c7bcd9eeb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.789724 Oct 13 08:42:57.562973 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1111/2458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:56 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:57.571609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:57.575178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:57.590788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:57.591579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:57.592301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:57.593211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:57.593846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:57.594480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:58.090118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:58.111344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b92eb608-fdf4-4ed2-b391-4d7a4090f624 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.538551 Oct 13 08:42:58.112956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1112/2459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:57 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:58.117932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b7528d-7aa7-49f8-9006-d4337b105a91", "name": "network-vif-plugged", "status": "completed", "tag": "a8d5bcd3-af02-44ed-8085-d02912bd3632"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:42:58.140094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:58.140790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:58.141426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:58.173620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] Creating event network-vif-plugged:a8d5bcd3-af02-44ed-8085-d02912bd3632 for instance e1b7528d-7aa7-49f8-9006-d4337b105a91 on n-h2-858384-11 Oct 13 08:42:58.192277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1b7b06b7-23ac-43b5-a84a-dfe6a498c4e1 req-46d307d9-254e-443d-b981-1c5ff7e3b877 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077693 Oct 13 08:42:58.193576 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1113/2460] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:42:58.591730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:58.592554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:58.619637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:58.620420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:58.621197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:58.622327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:58.623026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:58.623818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:58.920445 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-741ae874-cf60-4216-b428-180e6f9d5b72 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0a1c921a-1c95-4f8c-b405-0c84e589df20" status: 202 len: 0 microversion: 2.1 time: 2.153593 Oct 13 08:42:58.921919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1348/2461] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:42:56 2022] DELETE /compute/v2.1/os-security-groups/0a1c921a-1c95-4f8c-b405-0c84e589df20 => generated 0 bytes in 2156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:42:58.931117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375dee1f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:58.941755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:58.950778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f52d5b5-3693-45ec-9ae5-6c5149e935f5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.364263 Oct 13 08:42:58.955301 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1114/2462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:58 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:42:59.062495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:42:59.063349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Neutron security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:42:59.064374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] HTTP exception thrown: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.064374 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Request method failure captured: Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-groups/1eca7374-3d58-4ab5-bb95-4201a4e81827 HTTP/1.1 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR891Kv6NBl2C0xfMGPJ7lV644TKi57iJBhVFfL3Di1Q15XEyTz5TUX1doGnv_kcTGiZj28jFnkoGPuwqo74iAk9GtPgizmxgUOIpNkDWojFQDxd2jzkv92yz4G5m5nLXN4FZzlIwcQWrt3DCuH3wUZvO9lKQVCFz_IP18JRPG9_Miw8 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c63d226110d24d4c93e7cfd7fdac6f8b Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2129887273 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c63d226110d24d4c93e7cfd7fdac6f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c63d226110d24d4c93e7cfd7fdac6f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c63d226110d24d4c93e7cfd7fdac6f8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c63d226110d24d4c93e7cfd7fdac6f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2129887273 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c63d226110d24d4c93e7cfd7fdac6f8b Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2129887273 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupRulesTestJSON-2129887273-project Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b523aa2ee18e47d29aefbda6861da7e3 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2129887273-project Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '1eca7374-3d58-4ab5-bb95-4201a4e81827'} Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:42:59.077211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] Oct 13 08:42:59.080867 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:42:59.083833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Returning 404 to user: Security group 1eca7374-3d58-4ab5-bb95-4201a4e81827 does not exist Oct 13 08:42:59.083833 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-70fc792f-be5f-48ed-a00d-1b04c4aedd4d'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:42:59.084280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d719c01-dbec-4e2e-9dd8-37f8f2ea8ae4 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1eca7374-3d58-4ab5-bb95-4201a4e81827" status: 404 len: 194 microversion: 2.1 time: 0.158392 Oct 13 08:42:59.085183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1349/2463] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:42:58 2022] DELETE /compute/v2.1/os-security-groups/1eca7374-3d58-4ab5-bb95-4201a4e81827 => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:42:59.093779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3058e9ad-ed66-45af-ad39-260b74e294a7 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375fb4160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:59.137567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:42:59.138338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:42:59.147391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:59.148223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:59.149306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:59.150269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:42:59.150966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:42:59.151601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:42:59.741067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:42:59.759839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6747f8ec-9b2d-4a33-8667-3bf2dca858f0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1291 microversion: 2.1 time: 0.626400 Oct 13 08:42:59.765040 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1350/2464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:42:59 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1291 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:42:59.781397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2132453306", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "cc6feba2-427b-4cac-940f-bd5e5b18dc0d"}], "security_groups": [{"name": "tempest-securitygroup--744371096"}], "key_name": "tempest-keypair-1217454153", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:00.114028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] validate_networks() for [('cc6feba2-427b-4cac-940f-bd5e5b18dc0d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:00.822877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3058e9ad-ed66-45af-ad39-260b74e294a7 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/bc6241ae-871c-4771-b145-2616a741928f" status: 202 len: 0 microversion: 2.1 time: 1.733033 Oct 13 08:43:00.824940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1115/2465] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:42:59 2022] DELETE /compute/v2.1/os-security-groups/bc6241ae-871c-4771-b145-2616a741928f => generated 0 bytes in 1735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:00.837649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:00.838280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:00.861193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:00.861696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:00.862446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:00.863184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:00.863640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:00.864262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:00.920188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:01.680099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:01.691446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0424227e-6a1e-4d6e-804a-8de78623abfa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.865258 Oct 13 08:43:01.692383 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1116/2466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:00 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:01.697329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef96373-7d8c-443e-b8d0-d1b8cc5b4af2", "name": "network-vif-plugged", "status": "completed", "tag": "4de90cb3-ed98-4faa-a5df-ca3a5cc0d242"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:01.708041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:01.708865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:01.709541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:01.722687 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] Creating event network-vif-plugged:4de90cb3-ed98-4faa-a5df-ca3a5cc0d242 for instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 on n-h2-858384-11 Oct 13 08:43:01.728234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2ca15f6d-81ca-46ea-93d7-e2ebcbb67bf2 req-be4089dd-5569-45a8-b910-ac4114f6d357 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 Oct 13 08:43:01.729241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1117/2467] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:01.734800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:01.735753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:01.742570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:01.743325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:01.743954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:01.745485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:01.746140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:01.746858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:01.828139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:01.829255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:01.830218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:01.830856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:01.831670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:01.843846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:01.844547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:01.845186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:01.846381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:01.847113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:01.847762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:01.871081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:01.879072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for user ad1e31177278409199fa651951c5e75a and project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:01.897550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:01.900269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:02.001283 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1795f4bc-7e47-4335-a58a-9c3dfb4a4798 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.234458 Oct 13 08:43:02.011060 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1351/2468] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:42:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:43:02.019312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf0553d8-01b3-4831-9232-cd3509a317e5 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f537aaa4ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:02.464806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:02.485043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d245fa39-8f97-4de9-9634-32d57e9d58f8 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1481 microversion: 2.1 time: 0.754577 Oct 13 08:43:02.485970 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1118/2469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:01 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1481 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:02.501453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64b5fcf6-0d6a-4d42-bbf0-d44c43e85f3f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:02.507380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64b5fcf6-0d6a-4d42-bbf0-d44c43e85f3f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:02.637133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64b5fcf6-0d6a-4d42-bbf0-d44c43e85f3f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:02.645071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64b5fcf6-0d6a-4d42-bbf0-d44c43e85f3f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1242 microversion: 2.1 time: 0.157198 Oct 13 08:43:02.651601 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1119/2470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:02 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:02.661921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:02.664312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:02.693878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:02.694399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:02.694869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:02.695596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:02.696054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:02.696482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:02.961559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf0553d8-01b3-4831-9232-cd3509a317e5 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/560ee35e-769d-440d-acbe-5ff2e10ce6b5" status: 202 len: 0 microversion: 2.1 time: 0.948253 Oct 13 08:43:02.966306 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1352/2471] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:02 2022] DELETE /compute/v2.1/os-security-groups/560ee35e-769d-440d-acbe-5ff2e10ce6b5 => generated 0 bytes in 954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:02.973849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:02.974856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:02.986460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:02.987643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:02.988503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:02.989487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:02.990199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:02.990882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:03.066357 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c17de93f-d2d0-4f54-8ff6-04b0e1b2184c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.411726 Oct 13 08:43:03.067436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1120/2472] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:43:02 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91/os-interface => generated 284 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:03.074255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c56d4335-a47c-4239-9273-d7608381d18f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375fb4d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:03.651391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:03.670095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d60f0ae2-6cda-4f3c-b784-7cc2116f8cad tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1308 microversion: 2.1 time: 0.701766 Oct 13 08:43:03.682505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1353/2473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:02 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:03.688569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:03.689222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:03.721115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:03.724770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:03.725633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:03.726877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:03.731854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:03.732483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:03.800362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:03.972977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:03.994546 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05785fe4-1f77-421b-aec5-c4a9ee651f89 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1294 microversion: 2.1 time: 0.313800 Oct 13 08:43:03.995716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1354/2474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:03 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1294 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:04.443782 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c56d4335-a47c-4239-9273-d7608381d18f tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e2f07a23-fc41-45b7-ac31-83071be688db" status: 202 len: 0 microversion: 2.1 time: 1.374553 Oct 13 08:43:04.444921 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1121/2475] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:03 2022] DELETE /compute/v2.1/os-security-groups/e2f07a23-fc41-45b7-ac31-83071be688db => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:04.453577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e17c362a-dd1f-4c92-97ce-7ecdfc5bd553 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f5375dee310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:04.695125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:04.696093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:04.703801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:04.704554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:04.705200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:04.706138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:04.706826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:04.707721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.256484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:05.270185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd1ae90a-83a9-4579-a5a9-e43cc3be006a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1488 microversion: 2.1 time: 0.578860 Oct 13 08:43:05.272989 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1122/2476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:04 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1488 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:05.285886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:05.289542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:05.304175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.304852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.306929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.313488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.314375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.315677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.532459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:05.578601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2e1b81b-1a17-44e2-84e8-fec6c80a1641 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1300 microversion: 2.1 time: 0.303010 Oct 13 08:43:05.591325 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1123/2477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:05 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:05.610973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:05.612216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:05.628011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.628668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.629774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.630745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.631408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.632345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.695766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:43:05.928849 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e17c362a-dd1f-4c92-97ce-7ecdfc5bd553 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f15de355-507b-43b5-8f4d-86d273ffdaba" status: 202 len: 0 microversion: 2.1 time: 1.479054 Oct 13 08:43:05.932656 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1355/2478] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:04 2022] DELETE /compute/v2.1/os-security-groups/f15de355-507b-43b5-8f4d-86d273ffdaba => generated 0 bytes in 1481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:05.944315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f49c3c4-35ae-4c2b-85c9-4320d93d4558 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] Calling method '.version_select at 0x7f537abb1c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:05.944517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-270221d3-4dda-4177-8422-5fb0288de2cb tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 204 len: 0 microversion: 2.1 time: 0.324273 Oct 13 08:43:05.944919 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1124/2479] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:43:05 2022] DELETE /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:05.956258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:05.957493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:05.971310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.977230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.977812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:05.979461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:05.984696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:05.985758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:06.360349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:06.372487 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53574a4e-0e3c-4038-9bce-27a002353e90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1494 microversion: 2.1 time: 0.420941 Oct 13 08:43:06.373091 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1125/2480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:05 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:06.604560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:06.605407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:06.616231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:06.619101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:06.620005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:06.621799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:06.623804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:06.628862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:07.327013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f49c3c4-35ae-4c2b-85c9-4320d93d4558 tempest-SecurityGroupRulesTestJSON-2129887273 tempest-SecurityGroupRulesTestJSON-2129887273-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5fa07bc9-e9e2-45d0-8a18-3318ccf16261" status: 202 len: 0 microversion: 2.1 time: 1.388195 Oct 13 08:43:07.327013 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1356/2481] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:05 2022] DELETE /compute/v2.1/os-security-groups/5fa07bc9-e9e2-45d0-8a18-3318ccf16261 => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:07.382376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:07.401570 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4407a5c6-45bb-4f23-88f4-dc5310d369ee tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.800816 Oct 13 08:43:07.402386 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1126/2482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:06 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:07.408054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:07.410272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:07.428223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:07.428728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:07.431544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:07.433421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:07.434979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:07.435419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:07.792179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:07.793538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:07.802869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:07.806623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:07.807681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:07.809720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:07.814255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:07.816335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:08.415180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:08.430183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56684bb7-d40d-40d4-b3f8-58d3407573ee tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1494 microversion: 2.1 time: 1.035288 Oct 13 08:43:08.445978 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1357/2483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:07 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1494 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:08.455619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7528d-7aa7-49f8-9006-d4337b105a91", "tag": "a8d5bcd3-af02-44ed-8085-d02912bd3632"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:08.485474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:08.487239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:08.488578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:08.510209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] Creating event network-changed:a8d5bcd3-af02-44ed-8085-d02912bd3632 for instance e1b7528d-7aa7-49f8-9006-d4337b105a91 on n-h2-858384-11 Oct 13 08:43:08.523041 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-74113cae-a1fa-43cb-a12f-ec5ce602ef74 req-8131fc69-a849-4b84-a67c-84d0838a9d6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074971 Oct 13 08:43:08.526523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1358/2484] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:08.538092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:08.542455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:08.573020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:08.573535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:08.573989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:08.574859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:08.576535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:08.577128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:09.070788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:09.080863 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcaba2c6-cbfd-4b95-ac6c-5d39cae7e146 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1481 microversion: 2.1 time: 1.292785 Oct 13 08:43:09.087433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1127/2485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:07 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1481 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:09.379440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:09.401222 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8327a906-cc54-4613-aa68-a5b9930607a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.867305 Oct 13 08:43:09.419943 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1359/2486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:08 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:09.461685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:09.462837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:09.485248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:09.487381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:09.488070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:09.489989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:09.491915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:09.492553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:10.429165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:10.429801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:10.437921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:10.442741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:10.445609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:10.447352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:10.451183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:10.451843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:10.453536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:10.752001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:10.760388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a3762a9-6d11-44ef-a206-93dbde6445b1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1494 microversion: 2.1 time: 1.303900 Oct 13 08:43:10.768040 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1128/2487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:09 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1494 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:10.786143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:10.796305 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fda844c0-f60e-4cba-ac8d-9f537a063da4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.371133 Oct 13 08:43:10.806492 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1360/2488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:10 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:10.976240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0319be17-593d-469f-a711-e957e73bcc15 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Action: 'create', calling method: .version_select at 0x7f5376711f70>, body: {"keypair": {"name": "tempest-keypair-75893339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI5R3GndMWOp4jnLsLGetpTjjKpSoNMD2ugnk98lSfx/vBsF7j+a/PqlwbaFzz5Tsc6e+V2Tr+PiLcz5W8p5q9C2+0p2y0xhIsHGoCTY+tbMokStztHF4WnZe0J8zQCFg=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:11.032281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0319be17-593d-469f-a711-e957e73bcc15 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Getting quotas for project cdbd352975224f8da5c993efbe65fd45. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:11.081561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:11.087723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0319be17-593d-469f-a711-e957e73bcc15 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Getting quotas for user f4ceecb84f254b28aa4fd7506cc03a7d and project cdbd352975224f8da5c993efbe65fd45. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:11.133601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0319be17-593d-469f-a711-e957e73bcc15 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.160927 Oct 13 08:43:11.136778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1129/2489] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:43:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:43:11.374261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d58f6098-e514-40d2-87c4-20d90566570c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dd2d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:11.458768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d58f6098-e514-40d2-87c4-20d90566570c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af" status: 200 len: 662 microversion: 2.1 time: 0.090340 Oct 13 08:43:11.460616 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1361/2490] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:11 2022] GET /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:11.475144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d20ee088-6a57-4b1a-93f4-b593ebb185d8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f53767b1040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:11.562793 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d20ee088-6a57-4b1a-93f4-b593ebb185d8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af" status: 200 len: 662 microversion: 2.1 time: 0.089272 Oct 13 08:43:11.565953 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1130/2491] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:11 2022] GET /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:11.589642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef96373-7d8c-443e-b8d0-d1b8cc5b4af2", "name": "network-vif-deleted", "tag": "4de90cb3-ed98-4faa-a5df-ca3a5cc0d242"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:11.634529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.635941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.636964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.674729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] Creating event network-vif-deleted:4de90cb3-ed98-4faa-a5df-ca3a5cc0d242 for instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 on n-h2-858384-11 Oct 13 08:43:11.690078 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5ffb827a-28e9-44ad-890b-7d72498cd134 req-b811acd9-0711-498c-bbff-705ff2c289cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103400 Oct 13 08:43:11.691576 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1362/2492] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:43:11.795738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:11.798744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:11.815565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.816033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.818360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.821952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.823077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.823756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.829141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:11.830068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:11.844004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.844719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.845633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.846719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.847532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.855787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.879479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:11.880202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:11.880785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:11.881464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lazy-loading 'fault' on Instance uuid fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:43:11.893526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:11.894903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:12.054663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:12.065548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73bd334d-010d-4eb0-a064-1d68c10ebe46 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.243412 Oct 13 08:43:12.066223 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1363/2493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:11 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:12.431878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:12.441833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdbade08-64e6-4686-8b3f-1504c25996c9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 200 len: 1298 microversion: 2.1 time: 0.652209 Oct 13 08:43:12.442770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1131/2494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:11 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 1298 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:13.091924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:13.092585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:13.108852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:13.109347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:13.109785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:13.110817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:13.111440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:13.112011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:13.178468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c8d1c80-8515-485f-b417-4384f4030e49 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f44a60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:13.257463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c8d1c80-8515-485f-b417-4384f4030e49 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935" status: 200 len: 661 microversion: 2.1 time: 0.082872 Oct 13 08:43:13.258943 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1132/2495] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:13 2022] GET /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935 => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:13.273746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a42736f1-f517-4524-aa2e-78aa011f03dc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f9f700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:13.330318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a42736f1-f517-4524-aa2e-78aa011f03dc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935" status: 200 len: 661 microversion: 2.1 time: 0.060615 Oct 13 08:43:13.332203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1133/2496] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:13 2022] GET /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:43:13.466859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:13.467647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:13.475094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:13.481596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:13.482420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:13.483582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:13.484234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:13.484883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:13.500678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:13.502328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 HTTP/1.1 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fef96373-7d8c-443e-b8d0-d1b8cc5b4af2'} Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:13.504488 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:43:13.508101 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:13.510189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:13.511105 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93492c2a-fbd2-423a-9428-10b5f3e84a9d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 404 len: 111 microversion: 2.1 time: 0.048615 Oct 13 08:43:13.512667 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1134/2497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:13 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:43:13.521991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c573bfb-5a90-411c-8e6d-ac3f2106cd9e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375f443a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:13.733505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:13.742827 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f89c097-6468-4ef3-b912-af8236b94a25 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.656636 Oct 13 08:43:13.747501 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1364/2498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:13 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:13.774711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9eda17a-5deb-4cb4-b435-98dd8349ede5", "tag": "02872484-6896-4dbd-b476-b9d034ed48e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:13.788112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:13.789006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:13.789908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:13.805046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] Creating event network-changed:02872484-6896-4dbd-b476-b9d034ed48e2 for instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 on n-h1-858384-11 Oct 13 08:43:13.812092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-05628ffa-4ec6-4da9-8f0c-b2084e8c5880 req-3505a10b-f866-4469-91bd-65c69ee14782 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063004 Oct 13 08:43:13.822720 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1365/2499] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:14.429099 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c573bfb-5a90-411c-8e6d-ac3f2106cd9e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 204 len: 0 microversion: 2.1 time: 0.912209 Oct 13 08:43:14.429706 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1135/2500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:13 2022] DELETE /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:43:14.442707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:14.443373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:14.460752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:14.469145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:14.469832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:14.471626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:14.472393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:14.473101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:14.520356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:43:14.682809 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ee71e45-811d-4552-85ab-d9b28dd8c419 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 204 len: 0 microversion: 2.1 time: 0.243644 Oct 13 08:43:14.687596 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1366/2501] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:43:14 2022] DELETE /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:14.777958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:14.778877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:14.788537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:14.789683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:14.790208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:14.791295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:14.792390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:14.793815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:14.975132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2126626394", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8e456827-616c-417b-8baa-537fa54bdd92"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:15.135076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] validate_networks() for [('8e456827-616c-417b-8baa-537fa54bdd92', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:15.332838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:15.346559 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab140c7d-a997-434f-8421-d03f151243b4 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.574768 Oct 13 08:43:15.349857 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1136/2502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:14 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:15.360498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-952380c2-1883-4d76-842a-86bfc30b8249 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f9f670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:15.430730 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-952380c2-1883-4d76-842a-86bfc30b8249 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76" status: 200 len: 661 microversion: 2.1 time: 0.079690 Oct 13 08:43:15.433955 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1137/2503] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:15 2022] GET /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76 => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:15.445361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e6ea784-0335-4797-8034-6a42f72103b4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375fb2f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:15.510030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e6ea784-0335-4797-8034-6a42f72103b4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76" status: 200 len: 661 microversion: 2.1 time: 0.068427 Oct 13 08:43:15.527972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1138/2504] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:15 2022] GET /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:15.762341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1020986339", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:15.837199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:16.377833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:16.378902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:16.380043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:16.380743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:16.381730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:16.398804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.404209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.404910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.406008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.408338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.410854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.441960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Getting quotas for project 9852b0f775bb49b69ec545583461cc04. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:16.448196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Getting quotas for user 6fc215eee0fa48bd9da0c34313a17252 and project 9852b0f775bb49b69ec545583461cc04. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:16.470339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:16.472726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:16.572736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e173d6d-cce1-43c9-a69e-c57cfc13129d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818203 Oct 13 08:43:16.574721 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1139/2505] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:43:16.582793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:16.583827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:16.612196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.612905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.613500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.614376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.616119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.616982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.792094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:16.792524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:16.793003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:16.793420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:16.793837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:16.814635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.815383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.816153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.817041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:16.817732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:16.818308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:16.870540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:16.883121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Getting quotas for user 9ae9b9b9eb124ad0a2638b04c006a4cf and project cfd16320cbff488ba691fbd8c3d92026. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:16.918199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:16.920712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:17.001758 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5885a023-a237-4b52-84f1-3cf20c6cfb7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.030627 Oct 13 08:43:17.003038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1367/2506] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:43:17.014071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1874121576", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e2683b9c-add3-46a2-bd13-1ee4df5f4382"}, {"port": "9e59f91f-f260-4ff8-9bce-6f8a3a6619ab", "tag": "port-1"}, {"port": "a7646a49-4932-4e96-9768-399f7f89cd01", "tag": "port-2"}, {"uuid": "39b41f38-c411-4af3-acd5-7867c455a7b9", "tag": "net-1"}, {"uuid": "39b41f38-c411-4af3-acd5-7867c455a7b9"}, {"uuid": "c0d5df1b-30c2-4786-939b-0c53b1155634", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c0d5df1b-30c2-4786-939b-0c53b1155634", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "dead5d8e-5a06-4e42-8e43-ea4aac0d71f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a97f623d-0191-44b9-a7d0-e189c359d747", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3df4c581-71b4-474a-989c-b3a2b3566c96", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2133178135"}], "key_name": "tempest-keypair-75893339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:17.518021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] validate_networks() for [('e2683b9c-add3-46a2-bd13-1ee4df5f4382', None, None, None, None, None), (None, None, '9e59f91f-f260-4ff8-9bce-6f8a3a6619ab', None, None, None), (None, None, 'a7646a49-4932-4e96-9768-399f7f89cd01', None, None, None), ('39b41f38-c411-4af3-acd5-7867c455a7b9', None, None, None, None, None), ('39b41f38-c411-4af3-acd5-7867c455a7b9', None, None, None, None, None), ('c0d5df1b-30c2-4786-939b-0c53b1155634', '10.2.2.100', None, None, None, None), ('c0d5df1b-30c2-4786-939b-0c53b1155634', '10.2.2.200', None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:17.644645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:17.653572 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-65239dd9-3fc8-4ed0-b422-71858ae01025 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 1.074985 Oct 13 08:43:17.679248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1140/2507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:16 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:17.686146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-568515606", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:17.769244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:18.293759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:18.294329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:18.295046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:18.295482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:18.295986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:18.322462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:18.322991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:18.323474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:18.326336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:18.328817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:18.330358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:18.395561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Getting quotas for project 9852b0f775bb49b69ec545583461cc04. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:18.411197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Getting quotas for user 6fc215eee0fa48bd9da0c34313a17252 and project 9852b0f775bb49b69ec545583461cc04. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:18.453796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:18.459845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:18.564957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b387773-2ed7-443c-b603-01d474ae6018 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884004 Oct 13 08:43:18.568270 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1141/2508] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:43:18.579349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:18.579986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:18.600013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:18.600524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:18.600960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:18.606280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:18.607750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:18.608212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:18.779774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:18.790779 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0031049a-f67f-4fa9-82a9-701e0e0f8599 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1260 microversion: 2.1 time: 0.220489 Oct 13 08:43:18.805612 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1142/2509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:18 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:18.826584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-17ce84df-d642-48f7-a8d8-9427e62c3d51 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:18.827581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-17ce84df-d642-48f7-a8d8-9427e62c3d51 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:18.999046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-17ce84df-d642-48f7-a8d8-9427e62c3d51 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:19.009776 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-17ce84df-d642-48f7-a8d8-9427e62c3d51 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1217 microversion: 2.1 time: 0.197209 Oct 13 08:43:19.013133 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1143/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:18 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:19.029925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:19.032442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:19.048027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:19.049384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:19.059210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:19.059995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:19.060481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:19.061130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:19.442541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:19.458653 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7c50ee8-2713-40f1-a1d5-01d805c6629b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.442102 Oct 13 08:43:19.459867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1144/2511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:19 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:19.823537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:19.824286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:19.837939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:19.838512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:19.839145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:19.841254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:19.841725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:19.842161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.012374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:20.023024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cfd45fc5-866a-4668-af35-61edb84559fa tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1266 microversion: 2.1 time: 0.204942 Oct 13 08:43:20.025787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1145/2512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:19 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:20.056378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:20.057378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:20.087893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.088392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.091157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.091921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.092381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.092815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.251075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:20.268889 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-614c5fec-2184-48a2-8308-884cc4d31fdf tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1269 microversion: 2.1 time: 0.230662 Oct 13 08:43:20.271889 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1146/2513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:20 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:20.281348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e29265-dfc5-4037-b844-0eb5dcc0f712", "name": "network-vif-deleted", "tag": "54095bae-3efe-4867-a8d0-7f1cc1b76ebb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:20.294447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.295354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.296292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.321855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] Creating event network-vif-deleted:54095bae-3efe-4867-a8d0-7f1cc1b76ebb for instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 on n-h1-858384-11 Oct 13 08:43:20.339181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-270e6727-2906-4965-bad7-ee38d527eeb3 req-3faa30da-eb71-4f01-8970-da8aa85a80c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060616 Oct 13 08:43:20.339973 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1147/2514] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:20.352139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9eda17a-5deb-4cb4-b435-98dd8349ede5", "name": "network-vif-plugged", "status": "completed", "tag": "02872484-6896-4dbd-b476-b9d034ed48e2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:20.382763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.383524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.383973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.407444 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] Creating event network-vif-plugged:02872484-6896-4dbd-b476-b9d034ed48e2 for instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 on n-h1-858384-11 Oct 13 08:43:20.415900 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e58d8ced-cd45-423a-9317-30d04e5adea4 req-d92307be-a671-444e-804f-713d949eb1c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074470 Oct 13 08:43:20.420510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1148/2515] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:20.498894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:20.501161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:20.527425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.529663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.535581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.536596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:20.539362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:20.545943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:20.982346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:20.993485 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-97f5cee9-035a-4215-a4be-5ab9f471fcc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.510233 Oct 13 08:43:20.994188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1149/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:20 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:21.071320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:21.074176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:21.098115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:21.100516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:21.102007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:21.103616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:21.104376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:21.105656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:21.254374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:21.264838 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a56bca93-b57c-4f62-b781-c24c647fd540 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1266 microversion: 2.1 time: 0.215230 Oct 13 08:43:21.266532 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1150/2517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:21 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:21.297784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:21.299323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:21.307382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:21.308187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:21.309087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:21.310033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:21.311340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:21.312184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:21.616066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:21.625593 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-569a8724-7d44-46ab-a457-dd4bd76325f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1275 microversion: 2.1 time: 0.332632 Oct 13 08:43:21.642364 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1151/2518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:21 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1275 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:22.020336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:22.021801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:22.036558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:22.037422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:22.038111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:22.047663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:22.048588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:22.049278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:22.622392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:22.639456 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8bfe069f-86b8-49a3-8b16-3972b1a9d3a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1367 microversion: 2.1 time: 0.624528 Oct 13 08:43:22.640151 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1152/2519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:22 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1367 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:22.658103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:22.658942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:22.666369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:22.668160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:22.668743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:22.669552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:22.670435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:22.671147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:23.047534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:23.056862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20cf6c03-9b8d-40e3-b1da-9b08bfe137f6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.415403 Oct 13 08:43:23.063924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1153/2520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:22 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:23.069003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:23.069620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:23.083852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:23.084361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:23.084869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:23.093926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:23.094502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:23.095135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:23.808047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:23.827197 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8178c68b-ccf6-4059-8b3b-5d4d97e29ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.762044 Oct 13 08:43:23.828026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1154/2521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:23 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:23.833194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:23.834004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:23.853957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:23.854755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:23.856852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:23.857758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:23.858384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:23.862462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:24.259704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:24.269697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8245dddf-adaa-44b5-bce9-94a14833c72e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1556 microversion: 2.1 time: 0.440404 Oct 13 08:43:24.277950 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1155/2522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:23 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1556 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:24.296259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:24.297410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:24.315063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:24.315981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:24.318519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:24.319284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:24.319883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:24.321716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:24.753238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:24.769086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f706e50-8fb0-4b72-8e5b-2f9cc6e8b652 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.485126 Oct 13 08:43:24.769877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1156/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:24 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:24.777512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:24.779529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:24.790777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:24.791877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:24.794240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:24.795724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:24.796568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:24.797562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:25.027175 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7414796-79cc-4c28-901b-d428a70c6324 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255789 Oct 13 08:43:25.028000 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1157/2524] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:43:24 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:25.041402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:25.042195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:25.060900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:25.062338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:25.065197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:25.067371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:25.068547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:25.081015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:25.115986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:25.516693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:25.530544 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e608c7e-5253-4de9-85d5-c3950d8e894d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.491824 Oct 13 08:43:25.531554 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1158/2525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:25 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:25.554003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:25.575814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:25.581204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:25.582085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:25.604623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] Creating event network-changed:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:43:25.620316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a8ccc8de-dcb2-458e-9b6e-0301b2e047cd req-2db21bdb-6bef-4ba1-890e-4c13aadcbadb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086583 Oct 13 08:43:25.621167 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1159/2526] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:25.798903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:25.800251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:25.815119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:25.817792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:25.818346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:25.820407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:25.820905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:25.827094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:26.354598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:26.369388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afec6b0b-cf86-49ce-bacd-f3daa3edee4d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.576841 Oct 13 08:43:26.383626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1160/2527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:25 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:26.846755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:26.848903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:26.901615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:26.988263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf812f6e-daab-4b1c-bcfb-8c345f971bb3 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] Action: 'create', calling method: .version_select at 0x7f5375f589d0>, body: {"security_group": {"name": "tempest-securitygroup-1252733873", "description": "tempest-description-359030644"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:27.535957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf812f6e-daab-4b1c-bcfb-8c345f971bb3 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.025972 Oct 13 08:43:27.549282 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1161/2528] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:43:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:27.559620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:27.560598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:27.572800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:27.573916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:27.575810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:27.577358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:27.580626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:27.581368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:27.834826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:27.844235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-187f6dd1-b99e-4a79-824b-79d4dcae56b0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.292993 Oct 13 08:43:27.845938 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1162/2529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:27 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:27.870684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:27.872265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:27.879865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:27.880443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:27.880942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:27.881703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:27.882206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:27.882928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:28.088418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:28.105733 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ccd6c83-027c-4004-9b0e-6882aa73314b tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.257588 Oct 13 08:43:28.118676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1163/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:27 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:28.134311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-329b943c-577f-457d-8dbd-e797c6e6c578 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] Action: 'create', calling method: .version_select at 0x7f5375f59280>, body: {"security_group": {"name": "tempest-securitygroup-1303846771", "description": "tempest-description-1114185180"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:28.320412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:28.321514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:28.322371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:28.323454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:28.324697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:28.349333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:28.350256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:28.351015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:28.353810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:28.357361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:28.360642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:28.361347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:28.394130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Getting quotas for project cdbd352975224f8da5c993efbe65fd45. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:28.402314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Getting quotas for user f4ceecb84f254b28aa4fd7506cc03a7d and project cdbd352975224f8da5c993efbe65fd45. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:28.557479 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-329b943c-577f-457d-8dbd-e797c6e6c578 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.429154 Oct 13 08:43:28.558701 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1164/2531] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:43:28 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:28.563891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a", "tag": "b4a0d212-9351-44e1-8d91-d957d2fe89e5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:28.594345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:28.598551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:28.600032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:28.625612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] Creating event network-changed:b4a0d212-9351-44e1-8d91-d957d2fe89e5 for instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a on n-h1-858384-11 Oct 13 08:43:28.641359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e5e7088a-bf1e-4bdf-b301-be23debbfa47 req-f37d5271-206f-40bb-ad39-ddb8c4f57a5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081352 Oct 13 08:43:28.641992 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1165/2532] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:28.649275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f233a97-412f-400b-8e74-a78dafdb7446", "tag": "0dd84c78-45a7-40b7-8b77-5c964daef940"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:28.662067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:28.663029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:28.663676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:28.678603 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] Creating event network-changed:0dd84c78-45a7-40b7-8b77-5c964daef940 for instance 6f233a97-412f-400b-8e74-a78dafdb7446 on n-h2-858384-11 Oct 13 08:43:28.684791 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-716b89dc-3b56-41a2-91ee-d25b12fab9a2 req-fb0db749-a5da-4f58-92df-4739703003c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040739 Oct 13 08:43:28.686226 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1166/2533] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:28.753436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:28.757228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='dead5d8e-5a06-4e42-8e43-ea4aac0d71f0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a97f623d-0191-44b9-a7d0-e189c359d747',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3df4c581-71b4-474a-989c-b3a2b3566c96',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:28.906211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-492b3146-60c2-4a22-b92e-851cda362437 tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] Action: 'create', calling method: .version_select at 0x7f5375f58160>, body: {"security_group": {"name": "tempest-securitygroup-332469720", "description": "tempest-description-791047498"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:29.004928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=20 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:29.541090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1703e210-8e2a-4151-a089-04d13c208652 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.536720 Oct 13 08:43:29.548826 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1368/2534] 10.222.0.23 () {62 vars in 1189 bytes} [Thu Oct 13 08:43:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 12545 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:43:29.554087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:29.554989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:29.562299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:29.563048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:29.563740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:29.564733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:29.565432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:29.566595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:29.979200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:29.993877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad076d96-f2ea-4015-87fa-07dda4bc2457 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.443608 Oct 13 08:43:29.994495 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1369/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:29 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:30.008440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:30.009311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:30.020024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:30.020556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:30.020994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:30.021716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:30.022184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:30.022643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:30.612842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:30.622714 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43e0757d-cb82-47b2-b404-7c0a47a298be tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.626746 Oct 13 08:43:30.635428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1370/2536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:29 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:30.640711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:30.641332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:30.752369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:30.767434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:30.769747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:30.771433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4eee850a-e2e5-4446-8ef2-b1c4c92fd030 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1284 microversion: 2.32 time: 0.134778 Oct 13 08:43:30.772639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1371/2537] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:30 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:30.941106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: .version_select at 0x7f5375dd2ee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-205314902", "policies": ["affinity"]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:30.972077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:30.983071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:31.126383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:31.144217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:31.165219 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16b78eec-053a-4e13-8397-42816a60c9b4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.391046 Oct 13 08:43:31.170495 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1372/2538] 10.222.0.23 () {60 vars in 1174 bytes} [Thu Oct 13 08:43:30 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:31.175034 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-492b3146-60c2-4a22-b92e-851cda362437 tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.486878 Oct 13 08:43:31.175582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9eda17a-5deb-4cb4-b435-98dd8349ede5", "tag": "02872484-6896-4dbd-b476-b9d034ed48e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:31.176359 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1167/2539] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:43:28 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:31.182082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:31.187790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:31.191481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:31.192954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:31.193849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:31.212556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:31.215672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:31.216384 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] Creating event network-changed:02872484-6896-4dbd-b476-b9d034ed48e2 for instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 on n-h1-858384-11 Oct 13 08:43:31.216632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:31.218627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:31.220830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:31.221439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:31.227084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1846e5a0-1c6a-419d-b099-c47c9c719589 req-ab07c76d-0b49-487d-93a9-c487616f9075 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058111 Oct 13 08:43:31.228527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1373/2540] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:31.239281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: .version_select at 0x7f5375cfb790>, body: {"server_group": {"name": "tempest-server-group-1697748903", "policies": ["affinity"]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:31.274619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:31.307630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:31.398741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:31.473072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:31.486334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:31.535699 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb32de03-b636-497a-bea3-5bf49d332934 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.305589 Oct 13 08:43:31.546353 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1374/2541] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Oct 13 08:43:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:31.561149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-028ab348-4c7a-4dab-9069-2840dd67320d tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] Action: 'create', calling method: .version_select at 0x7f5375dd29d0>, body: {"security_group": {"name": "tempest-securitygroup-726759056", "description": "tempest-description-960682526"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:31.814495 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-028ab348-4c7a-4dab-9069-2840dd67320d tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.265310 Oct 13 08:43:31.824497 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1375/2542] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:43:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:31.834838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: .version_select at 0x7f5375d58ee0>, body: {"server_group": {"name": "tempest-server-group-1697748903", "policies": ["affinity"]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:31.884552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:31.895935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:31.973562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:31.985650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:32.015793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a6d63ed-550e-44b3-ba95-af152fea8109 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.196677 Oct 13 08:43:32.016547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1376/2543] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Oct 13 08:43:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:32.025593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.025815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:32.053582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:32.056293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:32.056293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:32.056293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:32.056829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:32.057158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:32.124892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:32.145602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e153003b-5612-4a20-b856-0339d44a49d3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.967770 Oct 13 08:43:32.146840 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1168/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:31 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:32.161517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.169375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:32.185578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:32.193277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:32.196008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:32.197930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:32.201012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:32.203260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:32.207863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:32.350986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:32.364675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea23d0cb-1187-4662-9391-56893063f0a7 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.346645 Oct 13 08:43:32.378207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1377/2545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:32 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:32.394665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-175397db-7278-4999-bb49-154ebc7c7587 tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] Calling method '.version_select at 0x7f537aaa4040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.581956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:32.596274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:32.598897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:32.601298 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ebcd0079-56b7-4812-9860-b5d5d0941ca1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1574 microversion: 2.32 time: 0.450534 Oct 13 08:43:32.602836 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1169/2546] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:32 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1574 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:32.623611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-909d9db1-d2a1-48fc-bad5-920320c1e02d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.696891 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-909d9db1-d2a1-48fc-bad5-920320c1e02d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c7a95766-e719-4dcc-869b-334be519b835" status: 204 len: 0 microversion: 2.1 time: 0.087964 Oct 13 08:43:32.700464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1170/2547] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:43:32 2022] DELETE /compute/v2.1/os-server-groups/c7a95766-e719-4dcc-869b-334be519b835 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:32.708517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-plugged", "status": "completed", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:32.728157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:32.729075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:32.729946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:32.761823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] Creating event network-vif-plugged:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:43:32.768661 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4312d2a9-c18a-4b5f-a472-5314a371edc9 req-87447236-e74f-4ed9-bdf2-eb2a92584dbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066561 Oct 13 08:43:32.769755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1171/2548] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:32.776730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-380972aa-7a6a-4e12-8805-d4a90fe24c2e tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.800244 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-380972aa-7a6a-4e12-8805-d4a90fe24c2e tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.028824 Oct 13 08:43:32.801541 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1172/2549] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:43:32 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:32.813419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7838a535-2ada-49df-97e5-a1baca202e81 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.885321 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7838a535-2ada-49df-97e5-a1baca202e81 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1ea9bb88-224e-4b96-9c0e-b52f651b550f" status: 204 len: 0 microversion: 2.1 time: 0.076210 Oct 13 08:43:32.887287 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1173/2550] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:43:32 2022] DELETE /compute/v2.1/os-server-groups/1ea9bb88-224e-4b96-9c0e-b52f651b550f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:43:32.899063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4eefe146-0480-460b-8e32-04b898403553 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:32.926830 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4eefe146-0480-460b-8e32-04b898403553 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032134 Oct 13 08:43:32.932477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1174/2551] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:43:32 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:32.947594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: .version_select at 0x7f5375faa9d0>, body: {"server_group": {"name": "tempest-server-group-351338231", "policies": ["affinity"]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:32.982245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:32.997602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:33.080253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:33.087112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:33.108224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f9d1c90b-3e37-43e7-972f-aebbb2da36cc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.164417 Oct 13 08:43:33.110139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1175/2552] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Oct 13 08:43:32 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:43:33.126319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2291e59c-d1cd-4b65-8f3a-c1d4ca9af9f4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:33.183958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2291e59c-d1cd-4b65-8f3a-c1d4ca9af9f4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/aa14e27d-3768-4f18-8676-d2efb86c809d" status: 204 len: 0 microversion: 2.1 time: 0.060904 Oct 13 08:43:33.189853 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1176/2553] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:43:33 2022] DELETE /compute/v2.1/os-server-groups/aa14e27d-3768-4f18-8676-d2efb86c809d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:33.197120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:33.198343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:33.207824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:33.208648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:33.209363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:33.211185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:33.212529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:33.213257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:34.403524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:34.415617 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb45fd6b-6a32-4b28-b57e-aec2dff37fa0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 1.222433 Oct 13 08:43:34.437037 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1177/2554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:33 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:34.443542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d583a228-a502-4986-821f-22dccc7bcbfd tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:34.461354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d583a228-a502-4986-821f-22dccc7bcbfd tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022838 Oct 13 08:43:34.463271 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1178/2555] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:43:34 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:34.468681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:34.470438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:34.479398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:34.480727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:34.481441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:34.482354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:34.484677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:34.485927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:35.381361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:35.392939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aedd8de7-b105-4130-94da-c3889592bca9 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.928274 Oct 13 08:43:35.408178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1179/2556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:34 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:35.416324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:35.417733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:35.424643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:35.425425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:35.426020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:35.426980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:35.427598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:35.428182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:35.887310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:35.897467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:35.899075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:35.900095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b86c5b6a-af51-48f6-8038-3e14bf498ce3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1660 microversion: 2.32 time: 0.490815 Oct 13 08:43:35.900667 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1180/2557] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:35 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1660 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:35.913083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: .version_select at 0x7f5375f39670>, body: {"server_group": {"name": "tempest-server-group-675771601", "policies": ["anti-affinity"]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:35.959282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:35.965714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:36.044404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:36.056986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:36.083071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50fe535f-be8b-4990-b54f-7ceb895d4228 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.181028 Oct 13 08:43:36.084490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1181/2558] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Oct 13 08:43:35 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:36.092371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:36.094601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:36.103011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:36.104462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:36.105170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:36.106098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:36.106910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:36.107625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:36.511338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:36.529471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eac19b89-0400-4771-94c3-fc2127109481 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.442694 Oct 13 08:43:36.530068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1182/2559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:36 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:36.548058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cad4948-725c-4f2c-83e9-2574f074990a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:36.571365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:36.601988 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cad4948-725c-4f2c-83e9-2574f074990a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9b98cbf6-a16f-4d64-86f4-15985d7d72e1" status: 204 len: 0 microversion: 2.1 time: 0.070798 Oct 13 08:43:36.615952 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1183/2560] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:43:36 2022] DELETE /compute/v2.1/os-server-groups/9b98cbf6-a16f-4d64-86f4-15985d7d72e1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:36.632356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:36.634011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:36.646459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:36.648119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:36.648724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:36.650152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:36.650804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:36.651739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:37.052583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:37.063321 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ddd98cd9-580b-4347-ab9c-6d51488291ba tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.438313 Oct 13 08:43:37.068372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1184/2561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:36 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:37.079871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a", "name": "network-vif-plugged", "status": "completed", "tag": "b4a0d212-9351-44e1-8d91-d957d2fe89e5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:37.127334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:37.127837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:37.128274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:37.149734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] Creating event network-vif-plugged:b4a0d212-9351-44e1-8d91-d957d2fe89e5 for instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a on n-h1-858384-11 Oct 13 08:43:37.168227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a7b18e99-5ceb-4b68-a228-554e8c0b9483 req-74d01efb-7c33-4a37-bb17-cfd42844152d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091819 Oct 13 08:43:37.169200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1185/2562] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:37.174226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-003e1a18-c97b-4970-a6f1-177f2fc7cacc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:37.202631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-003e1a18-c97b-4970-a6f1-177f2fc7cacc tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032159 Oct 13 08:43:37.205132 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1186/2563] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:43:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:37.212674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:37.214871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:37.225336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:37.225991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:37.226620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:37.229305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:37.230053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:37.231065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:37.682468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:37.697318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:37.702373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:37.703782 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0610e83-1e4d-4f23-ad7a-86470cd45139 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1707 microversion: 2.32 time: 0.497484 Oct 13 08:43:37.707336 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1187/2564] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:37 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1707 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:37.719194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1110619659", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f903b339-d05f-4589-b974-8c9e6d9c9f70"}]}, "os:scheduler_hints": {"group": "5baf3eee-3955-4617-bd84-138b42b68415"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:37.812509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] validate_networks() for [('f903b339-d05f-4589-b974-8c9e6d9c9f70', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:38.193528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-175397db-7278-4999-bb49-154ebc7c7587 tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12296 microversion: 2.1 time: 5.805345 Oct 13 08:43:38.194681 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1378/2565] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Oct 13 08:43:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12296 bytes in 5816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:43:38.200158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:38.200979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:38.220408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:38.221057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:38.221556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:38.222329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:38.222891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:38.223952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:38.386174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:38.559980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:38.572520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa554895-d0d4-457f-a005-98323c680ecc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1317 microversion: 2.1 time: 0.376440 Oct 13 08:43:38.573602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1379/2566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:38 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:38.590667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:38.592098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:38.609603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:38.610497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:38.611154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:38.612361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:38.623083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:38.623820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:38.915000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:38.931375 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e6c6712-9a92-4a84-bcfd-c0309568035a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.356081 Oct 13 08:43:38.932091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1380/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:38 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:38.936981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f600a4d7-621e-4b0b-872d-ca7830fbe440 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] Calling method '.version_select at 0x7f5375d5ee50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:39.109832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:39.110299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:39.110762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:39.111338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:39.111932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:39.140580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:39.149354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:39.150042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:39.152689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:39.153401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:39.154029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:39.181969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:39.188984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:39.209113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:39.218018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:39.263699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127031) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 13 08:43:39.307451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_group_members'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:39.316450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_group_members'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:39.387767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f600a4d7-621e-4b0b-872d-ca7830fbe440 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.454318 Oct 13 08:43:39.388885 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1381/2568] 10.222.0.23 () {58 vars in 1191 bytes} [Thu Oct 13 08:43:38 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:39.393755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:39.394682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:39.398792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_group_members'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:39.407214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Getting quotas for user b0e2e7c2b13744e49603f3287f721c20 and project ec728ae9359a4cc987b481b4170ede1e. Resources: {'server_group_members'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:39.409308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:39.410899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:39.413008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:39.413830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:39.416875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:39.417635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:39.465064 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac3ed68a-d802-4fb4-aa43-1e3275d0032d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755130 Oct 13 08:43:39.465566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1188/2569] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:43:39.472279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f233a97-412f-400b-8e74-a78dafdb7446", "name": "network-vif-plugged", "status": "completed", "tag": "0dd84c78-45a7-40b7-8b77-5c964daef940"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:39.483816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:39.484945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:39.485499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:39.498972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] Creating event network-vif-plugged:0dd84c78-45a7-40b7-8b77-5c964daef940 for instance 6f233a97-412f-400b-8e74-a78dafdb7446 on n-h2-858384-11 Oct 13 08:43:39.505011 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-71bced65-3e22-459d-a34d-6b9de124854f req-cb1a3279-6294-42a6-94b1-adee96ceb796 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037308 Oct 13 08:43:39.505818 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1189/2570] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:39.512606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-799190ba-8a96-46a6-8795-4b5a2d9b673f tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] Calling method '.version_select at 0x7f5375fb20d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:39.913510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:39.937804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:39.949023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:39.952657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51c05bde-ac9c-4833-81bd-610edf6a4db8 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1754 microversion: 2.32 time: 0.560311 Oct 13 08:43:39.955373 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1382/2571] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:39 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1754 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:39.965096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67d11b4f-d98a-4799-8653-55e35dafcc92 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:39.970272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67d11b4f-d98a-4799-8653-55e35dafcc92 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:39.980289 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-799190ba-8a96-46a6-8795-4b5a2d9b673f tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b4ac97d0-492f-4417-a0bc-1073f8da5d75" status: 202 len: 0 microversion: 2.1 time: 0.462104 Oct 13 08:43:39.986308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1190/2572] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:39 2022] DELETE /compute/v2.1/os-security-groups/b4ac97d0-492f-4417-a0bc-1073f8da5d75 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:39.993438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:39.995529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:40.033305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.035328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.036320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.037364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.038020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.056194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.141532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67d11b4f-d98a-4799-8653-55e35dafcc92 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:40.157153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67d11b4f-d98a-4799-8653-55e35dafcc92 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1213 microversion: 2.1 time: 0.200620 Oct 13 08:43:40.176604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1383/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:39 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:40.330560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:40.331438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1286b592-7fba-466e-842c-2cf1724b29a9 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Action: 'create', calling method: .version_select at 0x7f5375cc1700>, body: {"keypair": {"name": "tempest-keypair-177167479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo2jmVcnW/o08EXJSuJKsXgXrpr/e+LMyuJvWyQ77+sUIfc/VjGReMA3aYTdcLFekHD3k8T5ODJksvnLaWQvioq2h4jTkuofKc3GV0TdsCw++4tB6HGMUR1NmXcIE8aAQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:40.341132 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c218da1b-0228-44d2-a112-d814ce22c065 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1466 microversion: 2.1 time: 0.353341 Oct 13 08:43:40.345685 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1191/2574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:39 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1466 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:40.353345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:40.354700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:40.387694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1286b592-7fba-466e-842c-2cf1724b29a9 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for project ca51c3078db54e67922de8010252af65. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:40.392971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.395093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.395950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.399553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.403575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.407219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-1286b592-7fba-466e-842c-2cf1724b29a9 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for user ba3e098bbf154c738772f3decbb01ad8 and project ca51c3078db54e67922de8010252af65. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:40.408056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.495190 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1286b592-7fba-466e-842c-2cf1724b29a9 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.317328 Oct 13 08:43:40.495808 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1384/2575] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:43:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:40.509806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b15ca4d8-6339-46e4-a452-e6518fb73f2d tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] Calling method '.version_select at 0x7f5375d12ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:40.757156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:40.771993 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd6e4339-bd8a-40f8-be1c-e1f834bd680d tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1308 microversion: 2.1 time: 0.423870 Oct 13 08:43:40.774942 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1192/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:40 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:40.782313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:40.783164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:40.790918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.795580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.796303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.797655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:40.798580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:40.799497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:40.988382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b15ca4d8-6339-46e4-a452-e6518fb73f2d tempest-SecurityGroupsTestAdminJSON-949571640 tempest-SecurityGroupsTestAdminJSON-949571640-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/27c10219-b938-43a2-a309-c582cac3b70a" status: 202 len: 0 microversion: 2.1 time: 0.488311 Oct 13 08:43:40.989408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1385/2577] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:40 2022] DELETE /compute/v2.1/os-security-groups/27c10219-b938-43a2-a309-c582cac3b70a => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:40.997135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:40.997979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:41.013156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.016989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.017623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.021253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.022032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.023025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.109304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:41.112978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:41.121409 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5db11f87-ff9a-4d28-8ad4-b6eb9e5e37a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1467 microversion: 2.1 time: 0.345186 Oct 13 08:43:41.122234 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1193/2578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:40 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1467 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:41.127021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-258a4239-4739-4c2d-916d-14225cd6f632 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] Calling method '.version_select at 0x7f5375f00ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:41.455411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-258a4239-4739-4c2d-916d-14225cd6f632 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9012414b-5283-42ea-b794-d199ef37c937" status: 202 len: 0 microversion: 2.1 time: 0.331822 Oct 13 08:43:41.461286 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1194/2579] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:41 2022] DELETE /compute/v2.1/os-security-groups/9012414b-5283-42ea-b794-d199ef37c937 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:41.468415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-53005597"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:41.474881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:41.492886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.495201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.496804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.499025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.499988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.501909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.509522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:41.531497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:41.539083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:41.540303 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c2b4027f-2f54-4d8f-8c88-b88c1c4aba7c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1801 microversion: 2.32 time: 0.549710 Oct 13 08:43:41.540922 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1386/2580] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:40 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1801 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:41.565093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:41.566185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:41.579752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.582193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.583042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.584455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:41.591518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:41.592080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:41.788792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:41.804578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a7fe6c1-f2f4-4376-b21f-dc5d2647fc30 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1265 microversion: 2.1 time: 0.262430 Oct 13 08:43:41.819495 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1387/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:41 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:41.840031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2fd8fc82-48bc-4e9f-844b-7ccf193ff008 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] Calling method '.version_select at 0x7f5375dd2430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:42.129790 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3afbbf7-47e2-4f39-a4c1-b3b6dd838c3b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "POST /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249/action" status: 202 len: 0 microversion: 2.1 time: 0.665817 Oct 13 08:43:42.131082 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1195/2582] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:43:41 2022] POST /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:43:42.165721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:42.169286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:42.192820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.194771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.197065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:42.197951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.201025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.201179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:42.616069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2fd8fc82-48bc-4e9f-844b-7ccf193ff008 tempest-SecurityGroupsTestAdminJSON-700444261 tempest-SecurityGroupsTestAdminJSON-700444261-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/aece2ae5-e5e8-43a6-ae2d-d8043993b7a6" status: 202 len: 0 microversion: 2.1 time: 0.789665 Oct 13 08:43:42.617143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1388/2583] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:43:41 2022] DELETE /compute/v2.1/os-security-groups/aece2ae5-e5e8-43a6-ae2d-d8043993b7a6 => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:43:42.628510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:42.645095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:42.645779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Searching by: {'deleted': False, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:43:42.668483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.668975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.671024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:42.673494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.677163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.677812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:42.735109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:43:42.797368 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53a6cda3-12b7-4b66-af23-77d24c216950 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.179058 Oct 13 08:43:42.801209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1389/2584] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:43:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:42.812506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cde89c7b-a133-4b82-82f2-6a745ed9b294 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cc13a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:42.932185 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cde89c7b-a133-4b82-82f2-6a745ed9b294 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.122442 Oct 13 08:43:42.934004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1390/2585] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:42 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:42.942931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:42.945296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:42.967313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.970937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.971461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:42.972228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:42.972702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:42.973135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.016053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.033917 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd65029a-bd38-4db6-9104-7fd0e9d9f464 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1488 microversion: 2.1 time: 0.901320 Oct 13 08:43:43.037162 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1196/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:42 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1488 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:43.051569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:43.063464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.071217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Searching by: {'deleted': False, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:43:43.083699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.084187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.086732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.087517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.087967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.088409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.162704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:43:43.224218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.238131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.239297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.239921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.753344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.765320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.768825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.770393 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05757885-6fb2-4c5a-9a7e-de7996ec029e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1848 microversion: 2.32 time: 0.833017 Oct 13 08:43:43.778543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1391/2587] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:42 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1848 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:43.793647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:43.795956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:43.812210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.813194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.813877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.814880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.815599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.816425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.863639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7bbe66ca-36cc-484d-86ea-e259a1557b15 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.815865 Oct 13 08:43:43.864763 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1197/2588] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:43:43 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:43.871484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-360615351"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:43.876835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:43.894754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.898912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.899377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.900121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:43.900574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:43.900994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:43.955622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:43.976847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f16b857-5bdb-4582-a38f-fff4243a37d7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1271 microversion: 2.1 time: 0.196802 Oct 13 08:43:43.980636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1392/2589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:43 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:43.994619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a131d5c1-5eba-4d6e-bab0-13073df0dc05 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.025234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a131d5c1-5eba-4d6e-bab0-13073df0dc05 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041724 Oct 13 08:43:44.027763 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1393/2590] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:43:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:44.038250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb0cd063-0244-4791-8775-383a3ab6a315 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d5e0d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.130169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb0cd063-0244-4791-8775-383a3ab6a315 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.100821 Oct 13 08:43:44.131223 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1394/2591] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:44 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:44.244750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "c555c149-900f-4cd7-9963-b628600fa2f2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:44.263557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.265066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.265748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.292861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] Creating event network-changed:c555c149-900f-4cd7-9963-b628600fa2f2 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:44.308191 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-94ff7623-f3f9-43d9-8a8a-531ac26f2280 req-26562f6c-1a83-45d2-8e96-1b0e6c9a2be9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069171 Oct 13 08:43:44.310753 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1395/2592] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:43:44.350705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4bc6cf95-6f3b-4ea9-ba57-cf623347ed95 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "POST /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446/action" status: 202 len: 0 microversion: 2.1 time: 0.484339 Oct 13 08:43:44.351415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1198/2593] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:43:43 2022] POST /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:43:44.365609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b022fed-69f2-4ad2-b5be-22560b836bb2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375d12940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.405562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.406151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:44.425541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.429303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.437356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.440208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.443299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.445483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.480090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b022fed-69f2-4ad2-b5be-22560b836bb2 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5" status: 200 len: 1413 microversion: 2.1 time: 0.120281 Oct 13 08:43:44.481571 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1396/2594] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:44 2022] GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:44.489435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:43:44.500857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4ca1b4e-2c14-4141-a156-a42c2d7bc2cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375d5e430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.611666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4ca1b4e-2c14-4141-a156-a42c2d7bc2cc tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5" status: 200 len: 1413 microversion: 2.1 time: 0.114836 Oct 13 08:43:44.617335 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1397/2595] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:44 2022] GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:44.639036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-24bd2862-0a06-4756-ab95-57415678bf09 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375d12ee0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.641301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-23938c58-748a-4444-8542-bd98bc280582 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 204 len: 0 microversion: 2.1 time: 0.240197 Oct 13 08:43:44.642708 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1199/2596] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:43:44 2022] DELETE /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:43:44.654271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.661349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:44.702433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.705655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.706140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.709480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.712206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.712690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.947157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-24bd2862-0a06-4756-ab95-57415678bf09 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5" status: 204 len: 0 microversion: 2.1 time: 0.318971 Oct 13 08:43:44.948544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1398/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:44 2022] DELETE /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:44.953824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:44.954597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:44.978900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.979991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.980519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:44.981330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:44.986029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:44.986525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:45.239724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:45.252633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b347423-8538-4753-9ba8-811c11234f54 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1606 microversion: 2.1 time: 0.605176 Oct 13 08:43:45.273070 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1200/2598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:44 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1606 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:45.292391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a563a0a-fa76-4d89-bcec-2d8490cda9c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375fb2f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:45.327490 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8a563a0a-fa76-4d89-bcec-2d8490cda9c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a563a0a-fa76-4d89-bcec-2d8490cda9c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 HTTP/1.1 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'cc5cec53-a996-48d6-b611-942824e04bb5'} Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc5cec53-a996-48d6-b611-942824e04bb5 Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:43:45.330703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5cec53-a996-48d6-b611-942824e04bb5 could not be found. Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:43:45.335309 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:45.340036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a563a0a-fa76-4d89-bcec-2d8490cda9c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:45.341221 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a563a0a-fa76-4d89-bcec-2d8490cda9c0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5" status: 404 len: 62 microversion: 2.1 time: 0.066901 Oct 13 08:43:45.342070 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1201/2599] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:45 2022] GET /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:43:45.350994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:45.353498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:45.371571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:45.371571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:45.371834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:45.372394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:45.375123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:45.377978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:45.735302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:45.755706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:45.757530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:45.759635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96b2835a-5c52-4d22-a6f3-a8544e9c1eb4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1848 microversion: 2.32 time: 0.809949 Oct 13 08:43:45.761306 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1399/2600] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:44 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1848 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:45.778528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00996381-1825-47f6-9114-3f178c7b1259 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d5e040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:45.832820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00996381-1825-47f6-9114-3f178c7b1259 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.069897 Oct 13 08:43:45.842926 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1400/2601] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:45 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:45.849928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:45.850880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:45.861841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:45.862873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:45.864841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:45.866802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:45.868305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:45.869056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:45.924115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:45.935736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74f4dee5-1d9d-4dba-aece-4ef2c7922c72 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.592236 Oct 13 08:43:45.936240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1202/2602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:45 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:45.946479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-406689641", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2230ecc4-7ef3-4d2f-8105-bc878cf19bf5"}], "security_groups": [{"name": "tempest-securitygroup--1719496205"}], "key_name": "tempest-keypair-177167479", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:46.188794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] validate_networks() for [('2230ecc4-7ef3-4d2f-8105-bc878cf19bf5', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:43:46.375698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:46.385893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d878e464-5082-4eff-8ae4-919f33bc2b58 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1500 microversion: 2.1 time: 0.541247 Oct 13 08:43:46.391693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1401/2603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:45 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1500 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:46.401436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:46.402300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:46.416549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:46.418790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:46.421260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:46.422002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:46.423663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:46.424105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:46.728771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:46.738918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-287ff6ca-4b76-4bbe-9a92-a4d963c8adf0 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1606 microversion: 2.1 time: 0.345925 Oct 13 08:43:46.739504 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1402/2604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:46 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1606 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:46.756695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "9e59f91f-f260-4ff8-9bce-6f8a3a6619ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:46.774677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:46.775168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:46.775588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:46.804073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] Creating event network-changed:9e59f91f-f260-4ff8-9bce-6f8a3a6619ab for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:46.814668 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-575d484e-bac3-40a3-99ab-9c272233190d req-4fc2dd22-98a4-4d4e-a170-2de830ce9326 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073925 Oct 13 08:43:46.815480 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1403/2605] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:46.828723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:46.831035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:46.848976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:46.851401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:46.862471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:46.863261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:46.863751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:46.864165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.113450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:47.117274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:47.128892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:47.134518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:47.136070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82080632-69b5-454f-a854-c0aff6885af4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1869 microversion: 2.32 time: 0.316238 Oct 13 08:43:47.138745 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1404/2606] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:46 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1869 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:47.148706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-119e672b-2108-472c-95dc-e5224c838b9e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dbeaf0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:47.220180 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-119e672b-2108-472c-95dc-e5224c838b9e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.077557 Oct 13 08:43:47.227886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1405/2607] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:47 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:47.235072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:47.235720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:47.249292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:47.252253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:47.252780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.253602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:47.255867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:47.256518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.577955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:47.593428 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb691d1d-4a02-4519-bb27-3050ec285649 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.368551 Oct 13 08:43:47.595606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1406/2608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:47 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:47.606847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-plugged", "status": "completed", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:47.634697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:47.637518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:47.638224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.655893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] Creating event network-vif-plugged:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:43:47.663235 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c831f1a2-50fb-485e-929f-ed42d78a1bf1 req-43c2f45b-8e94-4043-8305-aee667df15d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063914 Oct 13 08:43:47.670189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1407/2609] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:47.677897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:47.678815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:47.689162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:47.690027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:47.691569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.692675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:47.693376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:47.694272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:47.999994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:48.010362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-178cee83-930e-4e81-87fe-87cb5f97f0ea tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1500 microversion: 2.1 time: 0.338249 Oct 13 08:43:48.028361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1408/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:47 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1500 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:48.038026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:48.041321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:48.063039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.064326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.065589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.067139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.070655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.071311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.118809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for project ca51c3078db54e67922de8010252af65. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:48.136996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for user ba3e098bbf154c738772f3decbb01ad8 and project ca51c3078db54e67922de8010252af65. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:48.152634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:43:48.153533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:43:48.154227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:43:48.154902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:43:48.155535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:43:48.172861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.173858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.174580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.175534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.177665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.178886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.196523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:48.203124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for project ca51c3078db54e67922de8010252af65. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:43:48.211200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Getting quotas for user ba3e098bbf154c738772f3decbb01ad8 and project ca51c3078db54e67922de8010252af65. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:43:48.249610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:43:48.255419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:43:48.361162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a98cb4d-2531-45a6-ac80-24f7a2e0d17d tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.418717 Oct 13 08:43:48.362399 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1203/2611] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:43:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:43:48.470753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:48.482777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfe59545-7781-49fc-ad8b-599f2213b88f tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1606 microversion: 2.1 time: 0.451009 Oct 13 08:43:48.499332 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1409/2612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:48 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1606 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:48.507698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:48.508531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:48.514384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:48.516009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.516638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.517406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.518690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.519533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.520191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.643784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:48.647941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.649276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.649752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.651805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:48.652961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:48.654242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:48.712373 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7db01b9a-3f1c-40af-b2ad-84438fb16fba tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.348395 Oct 13 08:43:48.713588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1204/2613] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:43:48 2022] GET /compute/v2.1/os-services => generated 949 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:48.719409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f3da6a3-993c-4ac2-a5c5-386e36ac6c05 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f44b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:48.791936 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f3da6a3-993c-4ac2-a5c5-386e36ac6c05 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.074509 Oct 13 08:43:48.802206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1205/2614] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:48 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:48.809876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5faafdd5-2615-4bf6-ae95-9a022752267f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:48.810616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5faafdd5-2615-4bf6-ae95-9a022752267f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:48.972150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5faafdd5-2615-4bf6-ae95-9a022752267f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:48.988134 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5faafdd5-2615-4bf6-ae95-9a022752267f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1276 microversion: 2.1 time: 0.184338 Oct 13 08:43:49.002941 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1206/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:48 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:49.010202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.011431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:49.019044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.019543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.020342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.020700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.021344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.021641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.046582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:49.063040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:49.064582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:49.065864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-158329c0-0f35-4fa5-bf46-357c6d3f0288 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.562550 Oct 13 08:43:49.071055 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1410/2616] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:48 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:49.078023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.089754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.092777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.093408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.094315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.099236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.099887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.145182 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d2a2f6f-d204-4a5e-adcf-0b6967ce47d2 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.072897 Oct 13 08:43:49.154616 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1411/2617] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:49.160585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1bea6e-5a32-4def-b361-7c29ad5f2c99", "tag": "8e88886f-92e6-4c96-b647-da1fba736401"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:49.185643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.190659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.191296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.208403 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] Creating event network-changed:8e88886f-92e6-4c96-b647-da1fba736401 for instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 on n-h2-858384-11 Oct 13 08:43:49.214206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6345ced0-0ab4-462d-b864-47556bfe0fa5 req-93ca9963-f223-46df-8815-0a3c279062c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057622 Oct 13 08:43:49.215703 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1412/2618] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:49.224301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "a7646a49-4932-4e96-9768-399f7f89cd01"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:49.240507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.241348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.241931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.255398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] Creating event network-changed:a7646a49-4932-4e96-9768-399f7f89cd01 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:49.261255 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9541efd3-5015-4f9d-bc3c-d7911616dd82 req-272bbbad-471d-402e-8b22-085e1d188095 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043112 Oct 13 08:43:49.262094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1413/2619] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:49.267920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.268804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:49.280194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.280967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.281874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.282809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.283414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.284005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.688684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:49.699827 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ca1772b-4df1-4b39-9c4a-588d83e46025 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.694886 Oct 13 08:43:49.702677 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1207/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:49.714278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.720289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.720836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.721822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.722813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.723491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.724088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.785944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:49.797224 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1bad43b7-b9a4-4fa7-b71c-f328f6e47c3e tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1506 microversion: 2.1 time: 0.533648 Oct 13 08:43:49.813821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8836a7c3-6c23-431e-a56f-9c3e6d65db0b tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.109859 Oct 13 08:43:49.814802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1414/2621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:49.826228 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1208/2622] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/os-services => generated 949 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:49.837771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dffc30de-63e7-4cac-afcc-9e0be072ee6c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e8f820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.842940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.845356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:49.867404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.868130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.868729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.873268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.873963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.875007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.932948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dffc30de-63e7-4cac-afcc-9e0be072ee6c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.103198 Oct 13 08:43:49.940786 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1209/2623] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:49.950950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:49.956070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.957036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.958187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:49.959133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:49.959804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:49.960749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.003060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-011cd4e2-514f-4838-80c6-0d4d5f43f9da tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-858384-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.068408 Oct 13 08:43:50.012149 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1210/2624] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/os-services?host=n-d-858384-11&binary=xxx => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:43:50.013309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.020907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.024515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a50a8e6-9bdf-4724-9bef-ed7a2295a9e5 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1539 microversion: 2.1 time: 0.206981 Oct 13 08:43:50.024654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.025293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.025820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.027452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.028160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.028748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.044453 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1415/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:49 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:50.056353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.057833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3b76ad6-55d6-422d-a662-0fac6d7ed273 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.042898 Oct 13 08:43:50.062489 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1211/2626] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/os-services => generated 949 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:50.066366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:50.073412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.074259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.074941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.075890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.076448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.077116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.077753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.088988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.089738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.090191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.093378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.094938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.095487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.161482 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c488aae-96ca-4b44-969a-2d1910cf56f1 tempest-ServicesAdminNegativeTestJSON-950340595 tempest-ServicesAdminNegativeTestJSON-950340595-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.093848 Oct 13 08:43:50.162303 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1212/2627] 10.222.0.23 () {58 vars in 1198 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:43:50.167678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.177167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:50.185369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.186152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.186785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.187723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.188414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.189077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.212079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.224664 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42e63e58-c145-4dbb-8414-e90cdba02495 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1328 microversion: 2.1 time: 0.178034 Oct 13 08:43:50.225269 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1416/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:50.383391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fee68e7d-3e3f-4021-a884-94b8813d1fa2 tempest-ServicesAdminNegativeTestJSON-1938241913 tempest-ServicesAdminNegativeTestJSON-1938241913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.390083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fee68e7d-3e3f-4021-a884-94b8813d1fa2 tempest-ServicesAdminNegativeTestJSON-1938241913 tempest-ServicesAdminNegativeTestJSON-1938241913-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd649acf9913e42b283235a2e6a82a82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa94746e202415ca820ab2f4610769f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fee68e7d-3e3f-4021-a884-94b8813d1fa2 tempest-ServicesAdminNegativeTestJSON-1938241913 tempest-ServicesAdminNegativeTestJSON-1938241913-project] Request method failure captured: Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_DM2YcKBWiic8b1CRQojcR0YiE9yThPhXnX67Qf39ckRD619ubCq2VNjimXxXBq_v95UkrGcPNmoy-sUZZ6z0x7WhA5UZk0izJnCsqPODr9d0tHN87q7ZQIIa4FVf4BGY5B2AGPeqNXIjx9CgDDzv-pW4uNQqm9N5mr3oCFdKyjxI Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 8fa94746e202415ca820ab2f4610769f Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1938241913 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa94746e202415ca820ab2f4610769f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fa94746e202415ca820ab2f4610769f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fa94746e202415ca820ab2f4610769f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fa94746e202415ca820ab2f4610769f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1938241913 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 8fa94746e202415ca820ab2f4610769f Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1938241913 Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServicesAdminNegativeTestJSON-1938241913-project Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: d649acf9913e42b283235a2e6a82a82e Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1938241913-project Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:50.398300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fee68e7d-3e3f-4021-a884-94b8813d1fa2 tempest-ServicesAdminNegativeTestJSON-1938241913 tempest-ServicesAdminNegativeTestJSON-1938241913-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fee68e7d-3e3f-4021-a884-94b8813d1fa2 tempest-ServicesAdminNegativeTestJSON-1938241913 tempest-ServicesAdminNegativeTestJSON-1938241913-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.173786 Oct 13 08:43:50.402811 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1417/2629] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:43:50.721425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=38 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:50.726573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.727660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:50.741964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.763397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.763956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.764731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.765210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.765645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.885662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.898797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.904289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:50.905597 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4609920-18a3-4888-a2f8-631c39138d82 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.742345 Oct 13 08:43:50.906119 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1213/2630] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:50.926322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:50.926976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:50.934108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.940646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.941164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.941909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:50.945813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:50.946346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:50.986441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:51.216462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:51.228768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28f5d3a1-e19b-4f53-bf22-e1672139d90d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.508028 Oct 13 08:43:51.232863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:51.243369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1418/2631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:51.247895 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39e25e2f-02a3-454f-946b-40789681f94f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1506 microversion: 2.1 time: 0.339684 Oct 13 08:43:51.249068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1214/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:50 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:51.263069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:51.264134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f18699ed-db2d-48dc-9f0c-9328f28d8d1b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c389d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:51.265423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:51.280980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.282461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.283857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.285274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.287096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.289495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.340851 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f18699ed-db2d-48dc-9f0c-9328f28d8d1b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.096231 Oct 13 08:43:51.360238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1419/2633] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:51 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:51.382080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:51.382950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:51.397243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.397790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.398240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.402951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.403448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.404715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.456508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:51.471319 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-577ffb4c-b550-4a1b-aa59-eb60bc59b595 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.220340 Oct 13 08:43:51.472018 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1215/2634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:51 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:51.482096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "30cd392f-108c-4baf-b95e-e57d29d1dff1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:51.503892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.508463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.509007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.540202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] Creating event network-changed:30cd392f-108c-4baf-b95e-e57d29d1dff1 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:51.549741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f0f15e8d-2436-4ef0-9716-b7e414d29246 req-13857bc7-2afd-458b-b9bc-033b081eb661 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076403 Oct 13 08:43:51.554556 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1216/2635] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:51.582873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b7528d-7aa7-49f8-9006-d4337b105a91", "name": "network-vif-deleted", "tag": "a8d5bcd3-af02-44ed-8085-d02912bd3632"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:51.614595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.615014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.615456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.642685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:51.646128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] Creating event network-vif-deleted:a8d5bcd3-af02-44ed-8085-d02912bd3632 for instance e1b7528d-7aa7-49f8-9006-d4337b105a91 on n-h2-858384-11 Oct 13 08:43:51.656862 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad333b00-ae07-464d-9734-5d28698633db tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1334 microversion: 2.1 time: 0.292793 Oct 13 08:43:51.661331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1420/2636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:51 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1334 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:51.674579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a9d1c9ea-dc7c-4dee-98e9-d95b7b463ec7 req-ca833e50-ae19-4b89-b37d-748edcc124f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100524 Oct 13 08:43:51.677321 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1217/2637] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:51.679360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f233a97-412f-400b-8e74-a78dafdb7446", "name": "network-vif-plugged", "status": "completed", "tag": "0dd84c78-45a7-40b7-8b77-5c964daef940"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:51.709993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.713816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.714433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.740654 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] Creating event network-vif-plugged:0dd84c78-45a7-40b7-8b77-5c964daef940 for instance 6f233a97-412f-400b-8e74-a78dafdb7446 on n-h2-858384-11 Oct 13 08:43:51.755645 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-40d63ca1-07f9-41cb-9b89-f50c7afb77e3 req-17117b4e-b8ec-47ec-b282-c2e1421d7dc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092834 Oct 13 08:43:51.758645 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1421/2638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:51.937863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:51.938702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:51.952672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.955387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.955929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:51.956731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:51.958869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:51.959392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.259337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:52.260165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:52.283787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.289057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.291748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.295178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.296796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.298352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.415660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.429779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.431776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.436565 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3448ad16-53d5-4cf2-b3f2-99f5d8397dbe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.503172 Oct 13 08:43:52.437945 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1218/2639] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:51 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:52.460336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:52.468825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:52.480599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.481304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.482235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.483215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.483877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.484491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.672814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.684690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e17e7a2-1bd4-44ec-9cc2-b10da5c50338 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1506 microversion: 2.1 time: 0.245224 Oct 13 08:43:52.685885 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1219/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:52 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:52.694029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-279385ec-e73e-4085-8b85-aa4bd2b4402c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375fb4310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:52.765942 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-279385ec-e73e-4085-8b85-aa4bd2b4402c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.076490 Oct 13 08:43:52.774742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1220/2641] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:52 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:52.779663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:52.780276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:52.796360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.796870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.797318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.798151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.798594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.798996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.913272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.930304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-14bdba0e-0b65-4d5f-ac27-67716007f20f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.676545 Oct 13 08:43:52.931923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1422/2642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:52 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:43:52.942910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:52.944403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:52.945617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:52.955949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.956754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.957395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.959413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:52.961386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:52.962040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:52.967489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6fcd4e2-67ae-494e-9214-15080735b525 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.184768 Oct 13 08:43:52.971333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1221/2643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:52 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:53.469602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:53.470165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:53.480271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:53.480781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:53.481229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:53.483048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:53.483512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:53.484461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:53.670184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:53.686318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c0489644-c47d-45bb-81e4-9b5e691f351a tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 0.752069 Oct 13 08:43:53.698836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1423/2644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:52 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:53.709823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "20b58af7-2f8f-4193-b395-e685103fc228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:53.732780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:53.733355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:53.733863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:53.751264 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] Creating event network-changed:20b58af7-2f8f-4193-b395-e685103fc228 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:53.757327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b4711101-7b85-4d68-b232-65e0fd53cc95 req-0530e2e6-75ab-46cd-a273-005076254630 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065128 Oct 13 08:43:53.759313 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1424/2645] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:53.766783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:53.767670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:53.775730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:53.780341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:53.780805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:53.781590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:53.782064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:53.782642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:53.954961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:53.969478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:53.972400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:53.973846 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86d37b54-a4a7-48d8-a831-7d17067486f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.508923 Oct 13 08:43:53.977863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1222/2646] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:53 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:54.008952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f853af56-6113-4594-a45c-62fb6260752d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ed2f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:54.096926 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f853af56-6113-4594-a45c-62fb6260752d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.101177 Oct 13 08:43:54.108495 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1223/2647] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:53 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:54.122993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:54.123681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:54.131097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.131588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.132022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.132835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.133362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.133793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.576931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:54.585576 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe9de818-0aa1-4464-8e96-5be59302784f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1506 microversion: 2.1 time: 0.824675 Oct 13 08:43:54.586185 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1425/2648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:53 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:54.597582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:54.600715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:54.629473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.637092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.637800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.638760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.642205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.642873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.728471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:54.743907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d016e240-88b3-414c-8541-b2f0b042aa35 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.633579 Oct 13 08:43:54.748496 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1224/2649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:54 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:54.762233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:54.763143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:54.778296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.782529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.783975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.786723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:54.789603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:54.790222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:54.963480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:54.975362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4db763f-10a7-4b7c-9108-252bceb17d04 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.384542 Oct 13 08:43:54.977363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1426/2650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:54 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:55.011774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:55.013434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:55.022721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:55.023304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:55.023678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:55.024442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:55.032136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:55.033407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:55.930059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:55.948311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:55.953639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:55.955008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48799e96-4fa3-4361-b30a-23f569e99ef5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.950362 Oct 13 08:43:55.960332 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1427/2651] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:55 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:43:55.967314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25e43643-5d92-45b3-80f2-a0112b42402e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d12f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:56.017450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25e43643-5d92-45b3-80f2-a0112b42402e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.055896 Oct 13 08:43:56.018699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1428/2652] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:55 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:56.023532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:56.024582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:56.034354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.035185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.035807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.036734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.037382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.037994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.062011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:56.095086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:56.104813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2194d161-784b-4cfd-8ac7-ffe173488e66 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 1.354993 Oct 13 08:43:56.106657 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1225/2653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:54 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:56.111897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:56.112730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:56.120114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.120931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.121537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.122468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.123087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.123682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.350315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:56.361198 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db3fe8bd-d7ef-4c5c-a66b-5c71800770e4 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.253198 Oct 13 08:43:56.361809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1226/2654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:56 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:56.368763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "1a9c62f1-0d81-4738-8c18-8f3da7ebbc42"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:56.381903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.382719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.386089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.393519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:56.402556 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49a0e361-27bb-4792-984e-ae784344a853 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1501 microversion: 2.1 time: 0.382481 Oct 13 08:43:56.405464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1429/2655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:56 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:56.424274 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] Creating event network-changed:1a9c62f1-0d81-4738-8c18-8f3da7ebbc42 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:56.431243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a35e0839-46d8-4389-8a76-926346c4e9c7 req-4bdc16fc-a65b-4e78-a037-3cb353e481e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067231 Oct 13 08:43:56.431855 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1227/2656] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:56.449906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:56.454060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:56.469838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.470682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.471600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.472539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.473170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.473777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.623400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:56.640934 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2afc19bc-9c8a-437d-a7fd-b82ee727e300 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.207610 Oct 13 08:43:56.642454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1228/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:56 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:56.851633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Action: 'update', calling method: .version_select at 0x7f5375d129d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:56.859403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.860183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.860800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.889001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.890024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.890808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.903285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] HTTP exception thrown: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Request method failure captured: Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be HTTP/1.1 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 56 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_LARmALCnUxDe8fkBiYnvVqe_cZPQ0AV2GVfu-KacRwoMwgXG-ydeyxGkUpvxCdi4PfzKzNkSG3YaFHConnlj53PGJCc3mmHARBc0QGr9N2IvOLXT1TZvV039l8ufMfXMcmW1HnBeQzhEVlBhK0PMV-eTxVHuV3s9eNwuwIC9B5UM Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.53 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: d1c7d7188eda44fd857e6595cd5d2fda Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: exception: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6709a6e8-77c5-4607-a6c1-ace614ede9be', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:43:56.905320 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.909891 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.912231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Returning 404 to user: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:56.913266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99139d78-302d-44d1-a33a-adc628d76280 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be" status: 404 len: 110 microversion: 2.53 time: 0.505670 Oct 13 08:43:56.918873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1430/2658] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Oct 13 08:43:56 2022] PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be => generated 110 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:43:56.924813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Action: 'update', calling method: .version_select at 0x7f5375ed2310>, body: {"status": "disabled"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:56.928300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.928987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.929427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.952771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:56.964516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:56.965256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:56.990149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] HTTP exception thrown: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Request method failure captured: Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be HTTP/1.1 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 22 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_LARmALCnUxDe8fkBiYnvVqe_cZPQ0AV2GVfu-KacRwoMwgXG-ydeyxGkUpvxCdi4PfzKzNkSG3YaFHConnlj53PGJCc3mmHARBc0QGr9N2IvOLXT1TZvV039l8ufMfXMcmW1HnBeQzhEVlBhK0PMV-eTxVHuV3s9eNwuwIC9B5UM Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.53 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: d1c7d7188eda44fd857e6595cd5d2fda Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: {"status": "disabled"} Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: exception: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6709a6e8-77c5-4607-a6c1-ace614ede9be', 'body': {'status': 'disabled'}} Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:43:56.994214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.005168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.007000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.007913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Returning 404 to user: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:57.007913 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5057f669-e48f-42d8-ad3e-68ba6c92de4b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be" status: 404 len: 110 microversion: 2.53 time: 0.078997 Oct 13 08:43:57.008220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:57.008371 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1229/2659] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Oct 13 08:43:56 2022] PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be => generated 110 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:43:57.011500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.014979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.015443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.016176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.016642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.017069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.017190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Action: 'update', calling method: .version_select at 0x7f5375ed29d0>, body: {"status": "enabled"} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:57.024055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.030952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.031508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.048252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.048252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.048664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.068547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] HTTP exception thrown: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Request method failure captured: Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be HTTP/1.1 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 21 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_LARmALCnUxDe8fkBiYnvVqe_cZPQ0AV2GVfu-KacRwoMwgXG-ydeyxGkUpvxCdi4PfzKzNkSG3YaFHConnlj53PGJCc3mmHARBc0QGr9N2IvOLXT1TZvV039l8ufMfXMcmW1HnBeQzhEVlBhK0PMV-eTxVHuV3s9eNwuwIC9B5UM Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.53 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389023e82d7f4a1d8546f0a18a593565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 389023e82d7f4a1d8546f0a18a593565 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237 Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: d1c7d7188eda44fd857e6595cd5d2fda Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: {"status": "enabled"} Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: exception: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6709a6e8-77c5-4607-a6c1-ace614ede9be', 'body': {'status': 'enabled'}} Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:43:57.073091 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Returning 404 to user: Service 6709a6e8-77c5-4607-a6c1-ace614ede9be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:57.076839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-345db13f-6b64-4f99-bd26-64c791f80b8a tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be" status: 404 len: 110 microversion: 2.53 time: 0.066912 Oct 13 08:43:57.082259 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1230/2660] 10.222.0.23 () {62 vars in 1309 bytes} [Thu Oct 13 08:43:57 2022] PUT /compute/v2.1/os-services/6709a6e8-77c5-4607-a6c1-ace614ede9be => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:43:57.090495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62c644c7-bada-4a61-b99b-83e73469719b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f39700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.158141 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62c644c7-bada-4a61-b99b-83e73469719b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.077561 Oct 13 08:43:57.167310 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1231/2661] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:57.172610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.176152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.176639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.177229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.177973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.178435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.179122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.205455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba7fd0b8-4987-49bf-8224-864305015f92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037002 Oct 13 08:43:57.206486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1232/2662] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:57.211773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.212379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:57.220885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.221380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.222438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.223224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.223685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.224114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.373162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:57.386686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:57.388148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:57.394580 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-24913803-a2b6-4ceb-b0e3-cd1bbbafc1e6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.400151 Oct 13 08:43:57.400268 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1431/2663] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:56 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:43:57.414121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.418050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.418772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.419399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.421240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.421698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.425926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.476867 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5eaebdd3-d620-423d-bae7-cae8d2320f3b tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.073597 Oct 13 08:43:57.478443 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1432/2664] 10.222.0.23 () {60 vars in 1211 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:57.483949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.485034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:57.493910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.495597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.497167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.498205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.499089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.501471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.708326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:57.719584 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-feedbe3f-8c30-4214-9521-d7548cf4fb6f tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 0.511941 Oct 13 08:43:57.721126 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1233/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:57.744247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:57.745344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:57.752528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.753306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.753902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.754961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:57.762186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:57.763020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:57.963115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:57.972131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d8780c5f-de44-43b7-b495-65fae9bd6224 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1488 microversion: 2.1 time: 0.249118 Oct 13 08:43:57.990665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1234/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1488 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:57.996425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.000489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.001105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.001642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.002534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.003771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.004306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.032001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0f41bea-d4c6-4a6e-8aa0-f4daa1ca5e92 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039921 Oct 13 08:43:58.033027 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1235/2667] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:58.037738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.038490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:58.044693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.045311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.045846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.046765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.047378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.047898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.116582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:58.126209 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99e18360-49f4-412e-9f57-58edd1437e7c tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.092115 Oct 13 08:43:58.138510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1236/2668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:58.138510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.138510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:58.138958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.139577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.140124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.140926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.144440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.144440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.171421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:43:58.210202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:58.277277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-482967b2-75b1-4c50-b89f-8ec698a5e7da tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 204 len: 0 microversion: 2.1 time: 0.147829 Oct 13 08:43:58.294164 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1237/2669] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:43:58 2022] DELETE /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:58.317288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.329869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.330844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.331588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.332789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.335122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.336477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.378507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d929c8b9-57cf-445b-b4ba-0dec82c20c22 tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-858384-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.072067 Oct 13 08:43:58.379702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1238/2670] 10.222.0.23 () {60 vars in 1237 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/os-services?host=n-d-858384-11&binary=xxx => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:58.388801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4d03bad-0de6-466c-8254-cde47d609cd0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ed23a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.413284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:58.429130 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c7e32db-2def-4ca4-a954-2e5148a5a312 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 0.948965 Oct 13 08:43:58.442431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1433/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:57 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:58.446614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cae2221f-0ec7-42ee-beec-7dae41157005 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dd2d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.506710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cae2221f-0ec7-42ee-beec-7dae41157005 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cae2221f-0ec7-42ee-beec-7dae41157005 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 HTTP/1.1 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cc5cec53-a996-48d6-b611-942824e04bb5'} Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc5cec53-a996-48d6-b611-942824e04bb5 to delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5cec53-a996-48d6-b611-942824e04bb5 could not be found. Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.508460 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cae2221f-0ec7-42ee-beec-7dae41157005 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cae2221f-0ec7-42ee-beec-7dae41157005 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5" status: 404 len: 62 microversion: 2.1 time: 0.078844 Oct 13 08:43:58.513280 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1434/2672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:58 2022] DELETE /compute/v2.1/images/cc5cec53-a996-48d6-b611-942824e04bb5 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:43:58.518759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.523278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.523773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.524213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.524942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.525393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.526467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.541596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4d03bad-0de6-466c-8254-cde47d609cd0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.160645 Oct 13 08:43:58.542195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1239/2673] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:58.560319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.561183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:58.578847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.580885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.581350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.582122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.584086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.584541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.590195 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f327dbce-8ee4-4b2e-bc48-8eb6379cf0bb tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.078274 Oct 13 08:43:58.594812 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1435/2674] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:58.612304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.612828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:58.619899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.620386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.621003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.621865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.624036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.624650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.693105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:43:58.816697 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Instance is already in deleting state, ignoring this request Oct 13 08:43:58.817633 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4c427d8-81f5-444f-b73a-6ca71a9a83b4 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 204 len: 0 microversion: 2.1 time: 0.221590 Oct 13 08:43:58.826779 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1436/2675] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:43:58 2022] DELETE /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:43:58.836705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73432ae-4506-48e7-9960-3d508cc87466", "tag": "55c6c62b-acf1-448d-bf9c-f5c86bfb98ef"}, {"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:58.868003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.868480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.868912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.899293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Creating event network-changed:55c6c62b-acf1-448d-bf9c-f5c86bfb98ef for instance c73432ae-4506-48e7-9960-3d508cc87466 on n-h1-858384-11 Oct 13 08:43:58.900121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] Creating event network-changed:2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:43:58.908559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-13afc68b-2469-4e9e-b232-c01d6f45fe08 req-7a3e4977-46d1-46f3-adc5-b5869eced203 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079983 Oct 13 08:43:58.910299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1437/2676] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:58.916685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.922810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.923571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.924798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.926359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.927063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.927792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.962121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b2a2a31-ee4d-4202-816a-1facaea8b7df tempest-ServicesAdminNegativeV253TestJSON-1059260237 tempest-ServicesAdminNegativeV253TestJSON-1059260237-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.050260 Oct 13 08:43:58.964270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1438/2677] 10.222.0.23 () {60 vars in 1239 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:58.971685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:58.972947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:58.977769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=44 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:43:58.981651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.982545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.983192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:58.984435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:58.985316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:58.986022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.000328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.013464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.015090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.016316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1906ba8-954f-44f0-add8-1cc44aef5adc tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.470284 Oct 13 08:43:59.017352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1240/2678] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:43:59.023727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:59.024342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:59.032664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.035174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.035624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.036346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.036805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.037497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.295242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.307788 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f96f5047-21b0-4814-9b8e-9fa0e02d14b1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 0.341882 Oct 13 08:43:59.308614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1439/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:58 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:59.349208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.359525 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1df9bbe-cda6-49e5-bd45-3d456b6b5ef6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1494 microversion: 2.1 time: 0.341028 Oct 13 08:43:59.360308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1241/2680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:59 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1494 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:59.378989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:59.384270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:59.403149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.406228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.406727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.407497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.410918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.411380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.562060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8000ee64-eef5-4699-97b8-07f641d17bc2 tempest-ServicesAdminNegativeV253TestJSON-882701294 tempest-ServicesAdminNegativeV253TestJSON-882701294-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:59.565848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8000ee64-eef5-4699-97b8-07f641d17bc2 tempest-ServicesAdminNegativeV253TestJSON-882701294 tempest-ServicesAdminNegativeV253TestJSON-882701294-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '918bb6e38f4646f585fd20320e5218db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302c8cf5672d4e9ebee2a967c1034191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8000ee64-eef5-4699-97b8-07f641d17bc2 tempest-ServicesAdminNegativeV253TestJSON-882701294 tempest-ServicesAdminNegativeV253TestJSON-882701294-project] Request method failure captured: Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_KrlxxnVe5v6qBeXUuZIb8KLYpp6yhJyaTfM2gIo9kJz8Ar4VOk3REzJjgqOVdu6MVasxC_ZWD6CbN8PDx06ZkHYkdqVql2ulBXn4500ZZ7IhVKZhf--_DFxdJSddyqZpWIfLUCn821bxUyUZTTqLttHhtaggROqRNnF4bIqjF2eU Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.53 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 302c8cf5672d4e9ebee2a967c1034191 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-882701294 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/302c8cf5672d4e9ebee2a967c1034191"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_302c8cf5672d4e9ebee2a967c1034191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/302c8cf5672d4e9ebee2a967c1034191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/302c8cf5672d4e9ebee2a967c1034191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-882701294 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 302c8cf5672d4e9ebee2a967c1034191 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-882701294 Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServicesAdminNegativeV253TestJSON-882701294-project Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 918bb6e38f4646f585fd20320e5218db Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-882701294-project Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:43:59.567594 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8000ee64-eef5-4699-97b8-07f641d17bc2 tempest-ServicesAdminNegativeV253TestJSON-882701294 tempest-ServicesAdminNegativeV253TestJSON-882701294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8000ee64-eef5-4699-97b8-07f641d17bc2 tempest-ServicesAdminNegativeV253TestJSON-882701294 tempest-ServicesAdminNegativeV253TestJSON-882701294-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.252171 Oct 13 08:43:59.572157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1440/2681] 10.222.0.23 () {60 vars in 1178 bytes} [Thu Oct 13 08:43:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:43:59.581529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:59.582141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:43:59.599676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:43:59.614323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.614842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.615281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.617705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab5195b7-5852-44bd-8228-e4c288027c74 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1251 microversion: 2.1 time: 0.256541 Oct 13 08:43:59.626761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1242/2682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:59 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1251 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:43:59.636420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1bea6e-5a32-4def-b361-7c29ad5f2c99", "name": "network-vif-plugged", "status": "completed", "tag": "8e88886f-92e6-4c96-b647-da1fba736401"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:43:59.640951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.644329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.644898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.677361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:43:59.677746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:43:59.678184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:43:59.718757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] Creating event network-vif-plugged:8e88886f-92e6-4c96-b647-da1fba736401 for instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 on n-h2-858384-11 Oct 13 08:43:59.730291 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-431c57f3-a341-43d8-9763-4ef6c10dc1be req-f3ec19e2-4eb3-4039-9e7f-555166f91967 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102173 Oct 13 08:43:59.731683 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1243/2683] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:43:59.747077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-273fc700-137c-4176-b019-795e85cb44a5 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ed2b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:43:59.846162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-273fc700-137c-4176-b019-795e85cb44a5 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.099859 Oct 13 08:43:59.848453 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1244/2684] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:43:59 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:00.056523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:00.057589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:00.060561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:00.084152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.091823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.092546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.093962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.097625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.098075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.548998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:00.566320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:00.573271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:00.574896 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7d2a4a9-ea95-4d38-a914-633c884b62f2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.525266 Oct 13 08:44:00.576014 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1245/2685] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:00 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:00.586297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:00.590566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:00.601904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.602746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.608661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.609560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.610106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.611205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.812026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:00.821538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f1c676a-0fd5-47a7-be5f-b00f21fac632 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 0.243592 Oct 13 08:44:00.825130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1246/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:00 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:00.831042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:00.833505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:00.850068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.851275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.853021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.855162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.856513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.858592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.882883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:00.899258 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5292027c-9c70-4129-a9d3-18042f6e5863 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1313 microversion: 2.1 time: 1.328138 Oct 13 08:44:00.901398 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1441/2687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:43:59 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1313 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:00.911227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:00.915805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:00.927479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.949255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.952720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:00.962310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:00.963071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:00.966842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.028026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.028753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.029526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.030465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lazy-loading 'fault' on Instance uuid e1b7528d-7aa7-49f8-9006-d4337b105a91 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:44:01.145047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370856659f3c48ab8af5f76a3e04217a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a5ffa0659444f3aec43a22913ae33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:01.154447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1a866d1-f60e-4dd4-939f-522e6a2698bc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 200 len: 1256 microversion: 2.1 time: 0.251798 Oct 13 08:44:01.160438 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1442/2688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:00 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 1256 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:01.167489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-691d8e66-9370-4203-930b-eef342a2fc7d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c38a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:01.235775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-691d8e66-9370-4203-930b-eef342a2fc7d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.074046 Oct 13 08:44:01.237126 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1443/2689] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:01 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:01.243520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7994c5f-d3ff-415a-9c10-9c6927afb371"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:01.247060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:01.253587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.254378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.255108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.256050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.256718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.257368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.419558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:01.437286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d127d58-22b2-49d1-8daa-e2f5c8b22b48 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1494 microversion: 2.1 time: 0.609502 Oct 13 08:44:01.454358 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1247/2690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:00 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:01.608981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:01.609584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:01.618369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.618885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.619347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.620203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.620689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.621420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.787923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83d04902-56c8-41b4-b7f0-cc6d286eb229 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "POST /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549019 Oct 13 08:44:01.787923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1444/2691] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:44:01 2022] POST /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:01.808204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f233a97-412f-400b-8e74-a78dafdb7446", "name": "network-vif-unplugged", "status": "completed", "tag": "0dd84c78-45a7-40b7-8b77-5c964daef940"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:01.849069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.850646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.851178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.896617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] Creating event network-vif-unplugged:0dd84c78-45a7-40b7-8b77-5c964daef940 for instance 6f233a97-412f-400b-8e74-a78dafdb7446 on n-h2-858384-11 Oct 13 08:44:01.910059 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-030153e6-299e-4e2a-bd79-84bf191967df req-3959ac35-6c67-4615-8b94-00e24cecca44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120069 Oct 13 08:44:01.911014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1445/2692] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:01.945841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:01.960266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:01.978285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.982450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.983768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:01.985147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:01.985754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:01.988968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.018343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.027767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7020680d-e1cb-4fb9-b0e9-6ef409447771 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 1.107576 Oct 13 08:44:03.029157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1446/2693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:01 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:03.042158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.047301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:03.068397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.069132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.069917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.070814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.071417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.071989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.382271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.395995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.402540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.406050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9ceed4f-9db4-4917-bcdf-3b9d534d78f1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 1.801350 Oct 13 08:44:03.415283 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1248/2694] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:01 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:03.432844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.445147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] [instance: e1b7528d-7aa7-49f8-9006-d4337b105a91] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:03.469851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.470712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.471306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.472161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.472769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.473200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.535198 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] HTTP exception thrown: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Request method failure captured: Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 HTTP/1.1 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR88wfN4TU5d9dwo93ksA-3xRc31ZDPwCyishRrH_OwheInCShaml3de4GmryVAEm0zVDQNRkXU7_G_smbzhZ5-OB11GxoqlD8XWrEAU0rPblKmqI8Yzirs7lxk7JFgzzWH_STXPuuvdvgv4YMPYrAnDh2cADfzbYr3QgH-D9L8Vhbm0 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d3a5ffa0659444f3aec43a22913ae33f Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestBootFromVolume-670311457 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a5ffa0659444f3aec43a22913ae33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3a5ffa0659444f3aec43a22913ae33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a5ffa0659444f3aec43a22913ae33f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3a5ffa0659444f3aec43a22913ae33f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestBootFromVolume-670311457 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d3a5ffa0659444f3aec43a22913ae33f Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestBootFromVolume-670311457 Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestBootFromVolume-670311457-project Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 370856659f3c48ab8af5f76a3e04217a Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestBootFromVolume-670311457-project Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e1b7528d-7aa7-49f8-9006-d4337b105a91'} Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:03.537593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Returning 404 to user: Instance e1b7528d-7aa7-49f8-9006-d4337b105a91 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50f5497d-3ee9-4d9f-b797-dd060b98f8cc tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91" status: 404 len: 111 microversion: 2.1 time: 0.122512 Oct 13 08:44:03.543456 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1249/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:03 2022] GET /compute/v2.1/servers/e1b7528d-7aa7-49f8-9006-d4337b105a91 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:03.550148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6705b96e-6e11-40ff-8c88-1db86d074085 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375eb2280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.613828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.622346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6705b96e-6e11-40ff-8c88-1db86d074085 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.077745 Oct 13 08:44:03.627737 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1250/2696] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:03 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:03.632660 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfeaeb37-736a-43ec-b52b-3374565db36c tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1498 microversion: 2.1 time: 0.602131 Oct 13 08:44:03.640759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.641948 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1447/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:03 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1498 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:03.646876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f233a97-412f-400b-8e74-a78dafdb7446", "name": "network-vif-deleted", "tag": "0dd84c78-45a7-40b7-8b77-5c964daef940"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:03.654214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:03.668458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.671574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.676070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.677159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.677772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.681420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.684717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.685892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.692792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.730937 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] Creating event network-vif-deleted:0dd84c78-45a7-40b7-8b77-5c964daef940 for instance 6f233a97-412f-400b-8e74-a78dafdb7446 on n-h2-858384-11 Oct 13 08:44:03.751553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b4890694-d4c1-402e-9dec-fa7022c96b65 req-fa76309b-f275-4a5f-b1c3-b82040fc203e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108143 Oct 13 08:44:03.756381 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1448/2698] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:03.761677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-385fc946-df13-4ad1-97b2-e9afbca87955 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] Calling method '.version_select at 0x7f5375c6d790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.785696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.786168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.786617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.791709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lazy-loading 'fault' on Instance uuid 6f233a97-412f-400b-8e74-a78dafdb7446 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:44:03.814166 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-385fc946-df13-4ad1-97b2-e9afbca87955 tempest-ServersTestBootFromVolume-670311457 tempest-ServersTestBootFromVolume-670311457-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397902749" status: 202 len: 0 microversion: 2.1 time: 0.056471 Oct 13 08:44:03.818229 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1449/2699] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397902749 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:44:03.824706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.843567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_groups [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Querying cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) for 1 instances {{(pid=127030) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 13 08:44:03.844612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.845263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.845901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.867347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5dad75b1-d035-4444-a687-8a399b35fe9f tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415" status: 200 len: 221 microversion: 2.1 time: 0.047690 Oct 13 08:44:03.870399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1450/2700] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:44:03 2022] GET /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415 => generated 221 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:03.881228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:03.883284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:03.911091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.912234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.912969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.913965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:03.914714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:03.915366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:03.956147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:44:03.961978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9b9b9eb124ad0a2638b04c006a4cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd16320cbff488ba691fbd8c3d92026', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:03.973977 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45c4e908-6ffa-43b2-92c4-d51947dd2042 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 200 len: 1298 microversion: 2.1 time: 0.343343 Oct 13 08:44:03.976527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:03.980693 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1251/2701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:03 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 1298 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:04.059494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:04.060383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:04.083927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.084477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.089353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.090268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.091114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.094599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.180761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6a82c02-35e4-4654-bcf0-a4e9811eb022 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 204 len: 0 microversion: 2.1 time: 0.301803 Oct 13 08:44:04.184067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1451/2702] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:03 2022] DELETE /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:44:04.198806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:04.200813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:04.218098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.218874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.219457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.223369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.225077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.225647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.376058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:04.385838 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be6605f8-9190-4488-88f6-37b731249742 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 0.336940 Oct 13 08:44:04.405167 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1252/2703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:04 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:04.427042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73432ae-4506-48e7-9960-3d508cc87466", "name": "network-vif-plugged", "status": "completed", "tag": "55c6c62b-acf1-448d-bf9c-f5c86bfb98ef"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:04.462097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.462658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.464236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.489645 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] Creating event network-vif-plugged:55c6c62b-acf1-448d-bf9c-f5c86bfb98ef for instance c73432ae-4506-48e7-9960-3d508cc87466 on n-h1-858384-11 Oct 13 08:44:04.502724 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-75f39f62-a917-4722-be51-55236cee6573 req-8a5d8e90-d088-43e3-83a9-98a77c35a53b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076605 Oct 13 08:44:04.504593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1253/2704] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:04.518012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:04.522846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:04.539692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.540197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.540642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.541396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:04.541872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:04.542280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:04.941873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:04.951274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5d78239-0ad6-44ec-a64c-71797c3d05fb tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1504 microversion: 2.1 time: 0.762195 Oct 13 08:44:04.954296 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1452/2705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:04 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:04.961406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c46b6e2c-6df0-43f6-8476-852f3f0a77d9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c6d8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.078693 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c46b6e2c-6df0-43f6-8476-852f3f0a77d9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.123189 Oct 13 08:44:05.079559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1453/2706] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:04 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:05.094777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.100890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 6f233a97-412f-400b-8e74-a78dafdb7446] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.113188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:05.123333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.123555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:05.124800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:05.129710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.131984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f825a050-44c5-40a1-9930-146562864157 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.625999 Oct 13 08:44:05.132588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.134178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.137487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.137897 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1254/2707] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:04 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:05.140796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.195033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 HTTP/1.1 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6f233a97-412f-400b-8e74-a78dafdb7446'} Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.200075 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. Oct 13 08:44:05.204063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.209137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance 6f233a97-412f-400b-8e74-a78dafdb7446 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.212726 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b60b4c9c-261a-4aee-bb6c-98d17d314c4f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446" status: 404 len: 111 microversion: 2.1 time: 0.131852 Oct 13 08:44:05.218037 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1454/2708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/6f233a97-412f-400b-8e74-a78dafdb7446 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.224748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.225398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.232869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.233639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.234377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.235105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.235694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.236122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.255228 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 HTTP/1.1 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fef96373-7d8c-443e-b8d0-d1b8cc5b4af2'} Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.259208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.263855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69c0fd70-57f0-45e9-b9e6-0493524258c5 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 404 len: 111 microversion: 2.1 time: 0.041437 Oct 13 08:44:05.270679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.271382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fef96373-7d8c-443e-b8d0-d1b8cc5b4af2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.274552 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1255/2709] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.280267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.280919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.281758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.282655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.283257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.283842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.301865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 HTTP/1.1 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fef96373-7d8c-443e-b8d0-d1b8cc5b4af2'} Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.303671 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. Oct 13 08:44:05.308062 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.310340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.311401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99859eee-9a00-4cba-9682-73ceca5f52d1 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2" status: 404 len: 111 microversion: 2.1 time: 0.044890 Oct 13 08:44:05.324330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7538c0bc-b727-4211-b1cf-e75ec28879ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375e5e550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.329168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1455/2710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/fef96373-7d8c-443e-b8d0-d1b8cc5b4af2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.358245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7538c0bc-b727-4211-b1cf-e75ec28879ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7538c0bc-b727-4211-b1cf-e75ec28879ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 HTTP/1.1 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '4c1c45e0-38dd-46f6-8269-d897ba0fa820'} Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4c1c45e0-38dd-46f6-8269-d897ba0fa820 to delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c1c45e0-38dd-46f6-8269-d897ba0fa820 could not be found. Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.360423 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7538c0bc-b727-4211-b1cf-e75ec28879ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.364835 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7538c0bc-b727-4211-b1cf-e75ec28879ce tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820" status: 404 len: 62 microversion: 2.1 time: 0.045820 Oct 13 08:44:05.366509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1256/2711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/images/4c1c45e0-38dd-46f6-8269-d897ba0fa820 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:44:05.372645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.373349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.385524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.385524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.388149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.388968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.390868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.393288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.418653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.419446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.438571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.440121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.440708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.443068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.443740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.445090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.449073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 HTTP/1.1 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a9e29265-dfc5-4037-b844-0eb5dcc0f712'} Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.453857 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.459636 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.465164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.468108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53f1fc44-1475-48c4-90af-19a74eb79548 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 404 len: 111 microversion: 2.1 time: 0.098753 Oct 13 08:44:05.474704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1456/2712] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.492056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.495083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: a9e29265-dfc5-4037-b844-0eb5dcc0f712] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.512222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.513079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.513722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.515510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.516192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.516856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.586779 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 HTTP/1.1 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a9e29265-dfc5-4037-b844-0eb5dcc0f712'} Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.590052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. Oct 13 08:44:05.596138 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.599311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance a9e29265-dfc5-4037-b844-0eb5dcc0f712 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.600557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6008c74-09eb-4b57-beb4-0b69b16fb877 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712" status: 404 len: 111 microversion: 2.1 time: 0.124461 Oct 13 08:44:05.604738 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1457/2713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/a9e29265-dfc5-4037-b844-0eb5dcc0f712 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.614698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c6b0ed4-59b3-45f8-bc9f-70d3f7411fb6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375dd2af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.656482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4c6b0ed4-59b3-45f8-bc9f-70d3f7411fb6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c6b0ed4-59b3-45f8-bc9f-70d3f7411fb6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad HTTP/1.1 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8b60d57e-21bd-4c1f-997c-1edbff062aad'} Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b60d57e-21bd-4c1f-997c-1edbff062aad to delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b60d57e-21bd-4c1f-997c-1edbff062aad could not be found. Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.658841 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c6b0ed4-59b3-45f8-bc9f-70d3f7411fb6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c6b0ed4-59b3-45f8-bc9f-70d3f7411fb6 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad" status: 404 len: 62 microversion: 2.1 time: 0.054312 Oct 13 08:44:05.663635 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1458/2714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/images/8b60d57e-21bd-4c1f-997c-1edbff062aad => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:44:05.670313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.680326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.697472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:05.702363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.704438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.705141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.706309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.709383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.709931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.732568 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a HTTP/1.1 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fd594a67-d6c0-41e1-acfe-771e300d9d2a'} Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.734506 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.743945 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.750163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.751364 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad840b55-0367-4e8f-9b7b-84b3e1b54f8f tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 404 len: 111 microversion: 2.1 time: 0.085463 Oct 13 08:44:05.752545 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1459/2715] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.761794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.762786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: fd594a67-d6c0-41e1-acfe-771e300d9d2a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.771555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.772171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.772686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.773457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.773984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.775117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.803432 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a HTTP/1.1 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fd594a67-d6c0-41e1-acfe-771e300d9d2a'} Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.809442 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. Oct 13 08:44:05.815367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.816942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance fd594a67-d6c0-41e1-acfe-771e300d9d2a could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.818051 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac80b8b0-9989-4973-bd0b-a508336b9805 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a" status: 404 len: 111 microversion: 2.1 time: 0.061349 Oct 13 08:44:05.819624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1460/2716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/fd594a67-d6c0-41e1-acfe-771e300d9d2a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:44:05.842349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-055746ee-180b-4851-8891-25895f3baa7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375c6d790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.882250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-055746ee-180b-4851-8891-25895f3baa7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-055746ee-180b-4851-8891-25895f3baa7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 HTTP/1.1 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e2732f7e-145e-454f-8263-c4750833b999'} Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e2732f7e-145e-454f-8263-c4750833b999 to delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2732f7e-145e-454f-8263-c4750833b999 could not be found. Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.884313 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:44:05.888462 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.892013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-055746ee-180b-4851-8891-25895f3baa7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.893126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-055746ee-180b-4851-8891-25895f3baa7a tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999" status: 404 len: 62 microversion: 2.1 time: 0.064820 Oct 13 08:44:05.897386 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1461/2717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/images/e2732f7e-145e-454f-8263-c4750833b999 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:44:05.903212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.903966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.912804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.913712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.914426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.915333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.915974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.917159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.957043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b HTTP/1.1 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd93157e5-04e7-4922-9b38-81e0aa31372b'} Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:05.959532 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:05.963231 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:05.967231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:05.968342 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b57a1b5-2c65-4413-84b0-39936cdd9375 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 404 len: 111 microversion: 2.1 time: 0.069770 Oct 13 08:44:05.972602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1462/2718] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:05 2022] DELETE /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:05.981587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:05.982762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: d93157e5-04e7-4922-9b38-81e0aa31372b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:05.989859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.990620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.991328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:05.992434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:05.993072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:05.993649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.011330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b HTTP/1.1 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd93157e5-04e7-4922-9b38-81e0aa31372b'} Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.013359 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. Oct 13 08:44:06.017299 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.019212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance d93157e5-04e7-4922-9b38-81e0aa31372b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:06.020234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb5a14e7-f08e-464e-8646-5b0a8e75af90 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b" status: 404 len: 111 microversion: 2.1 time: 0.044240 Oct 13 08:44:06.025606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1463/2719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/d93157e5-04e7-4922-9b38-81e0aa31372b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:06.031445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.032672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:06.040463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.041758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.042348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.043256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.043859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.044433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.510187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:06.520748 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52f11fd5-f8dc-49e6-aeeb-63ab9eb00a62 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1504 microversion: 2.1 time: 0.493722 Oct 13 08:44:06.522191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:06.524661 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1464/2720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:06 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:06.531117 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc871bd8-281d-4f60-be33-827ac6013cde tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1402 microversion: 2.1 time: 1.122158 Oct 13 08:44:06.531678 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1257/2721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:05 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1402 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:06.551963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67777b61-75c6-4117-bf26-820d9aa898c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '.version_select at 0x7f5375d128b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.555418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-15f6a20c-0063-4089-ad7a-497915e0ccb1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375f42f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.602163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-67777b61-75c6-4117-bf26-820d9aa898c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Image not found. Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67777b61-75c6-4117-bf26-820d9aa898c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 HTTP/1.1 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '20ebfd7b-a961-431e-ae4b-319ea1c9f472'} Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20ebfd7b-a961-431e-ae4b-319ea1c9f472 to delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20ebfd7b-a961-431e-ae4b-319ea1c9f472 could not be found. Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.604487 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:44:06.608766 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.610150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67777b61-75c6-4117-bf26-820d9aa898c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:06.611101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67777b61-75c6-4117-bf26-820d9aa898c8 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472" status: 404 len: 62 microversion: 2.1 time: 0.084724 Oct 13 08:44:06.612285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1465/2722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:06 2022] DELETE /compute/v2.1/images/20ebfd7b-a961-431e-ae4b-319ea1c9f472 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:44:06.630461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.632608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:06.655638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.656273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.656819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.658104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.660757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.672603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.694802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-15f6a20c-0063-4089-ad7a-497915e0ccb1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.158322 Oct 13 08:44:06.695636 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1258/2723] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:06 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:06.708002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.708850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:06.715661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.718183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.722999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.724243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.724863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.725721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.756531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e HTTP/1.1 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '967fa910-47ba-4b35-913a-93408711c30e'} Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:06.760774 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.764508 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.769133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:06.770104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dfe44a8f-873c-473a-bf69-c80ce4d14690 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "DELETE /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 404 len: 111 microversion: 2.1 time: 0.073200 Oct 13 08:44:06.777752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1259/2724] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:06 2022] DELETE /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:06.783302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:06.787241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] [instance: 967fa910-47ba-4b35-913a-93408711c30e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:06.800133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.801042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.801766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.802697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:06.803365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:06.803969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:06.850108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] HTTP exception thrown: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Request method failure captured: Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e HTTP/1.1 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR85ZYkC8_m9yjwEQzvdfxWIJIGZEuf_dCD1ugizQ9px940obXvUMewVIGm6D_eu9fdMqvQuiJeCCY87YTDwbL5La-nNxveuYvK5jWXxYvf84eyrPg-BgqjzGdDzrFKRA20QYlj2YEQ7ymUnHJJwsP7xDLkpfLSVCMwkwZNaZZFxyibM Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cfd16320cbff488ba691fbd8c3d92026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cfd16320cbff488ba691fbd8c3d92026 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesTestJSON-1279303839 Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 9ae9b9b9eb124ad0a2638b04c006a4cf Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesTestJSON-1279303839-project Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '967fa910-47ba-4b35-913a-93408711c30e'} Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.851787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. Oct 13 08:44:06.856797 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:06.865158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] Returning 404 to user: Instance 967fa910-47ba-4b35-913a-93408711c30e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:06.868831 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb039975-2ff5-4960-918a-9303f00555d0 tempest-ImagesTestJSON-1279303839 tempest-ImagesTestJSON-1279303839-project] 10.222.0.23 "GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e" status: 404 len: 111 microversion: 2.1 time: 0.089440 Oct 13 08:44:06.873294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1260/2725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:06 2022] GET /compute/v2.1/servers/967fa910-47ba-4b35-913a-93408711c30e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:07.073892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:07.090118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:07.092657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:07.096782 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-60d65e7a-6e2d-4fca-bb42-fa17d2e39d9d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 0.481699 Oct 13 08:44:07.099423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1466/2726] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:06 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:07.557271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:07.557271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:07.557872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:07.557872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:07.569530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:07.571442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:07.576250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:07.577389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:07.577651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:07.578512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:07.579052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:07.579876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:07.580436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:07.581141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:07.581792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:07.591172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:07.847154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:07.860323 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e0336f17-3081-4796-809f-346bb93bda5c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1590 microversion: 2.1 time: 0.309820 Oct 13 08:44:07.874953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1467/2727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:07 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1590 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:07.888162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-221718c9-dfb2-42f5-89f2-e4ff3b55f213 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cf0a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:07.955931 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-221718c9-dfb2-42f5-89f2-e4ff3b55f213 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.078578 Oct 13 08:44:07.956652 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1468/2728] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:07 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:08.285996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-333617930", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:08.359937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=26 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:08.392443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:44:08.778273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e2e7c2b13744e49603f3287f721c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec728ae9359a4cc987b481b4170ede1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:08.793988 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c3f3991-05d3-4bcc-8c48-063a147e1f65 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 200 len: 1504 microversion: 2.1 time: 1.251032 Oct 13 08:44:08.801461 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1261/2729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:07 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 1504 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:08.815628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:08.823741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:08.845084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:08.845596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:08.846040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:08.846810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:08.847255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:08.847679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:08.941869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:08.991629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:44:08.992475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:44:08.993208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:44:08.993863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:44:08.994668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:44:09.015557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:09.016308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:09.017018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:09.018080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:09.018852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:09.019499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:09.079108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Getting quotas for project f87c4c0630284b389c5d569d430495ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:44:09.094999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Getting quotas for user 7e81d9517e6c4155952fe4ea1cd3b519 and project f87c4c0630284b389c5d569d430495ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:44:09.124695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:44:09.128306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:44:09.308377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf1f7a4d-9dfb-440a-a67b-d498e5b2c04d tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350467 Oct 13 08:44:09.312880 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1469/2730] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:44:09.325786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:09.327056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:09.350793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:09.353484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:09.354327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:09.360207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:09.361024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:09.366155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:09.733283 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9ba4fec3-f4ab-430a-b379-69c40d38e2e8 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.930310 Oct 13 08:44:09.741212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1262/2731] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:44:08 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466/os-interface => generated 285 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:09.747204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9a11e09-01fa-448e-ac69-f0780d3f7838 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ed24c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:09.891238 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9a11e09-01fa-448e-ac69-f0780d3f7838 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.148772 Oct 13 08:44:09.894909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1263/2732] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:09 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:09.910780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79e42513-c10e-4f01-bb5c-177317f5d1dc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:09.911485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79e42513-c10e-4f01-bb5c-177317f5d1dc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:10.756458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:10.773809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:10.787444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:10.796201 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52e68d22-d2e9-4891-b389-81facc144cad tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1890 microversion: 2.32 time: 1.481844 Oct 13 08:44:10.798663 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1470/2733] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:09 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1890 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:10.810514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1bea6e-5a32-4def-b361-7c29ad5f2c99", "name": "network-vif-deleted", "tag": "8e88886f-92e6-4c96-b647-da1fba736401"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:10.825896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:10.826654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:10.827261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:10.860865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] Creating event network-vif-deleted:8e88886f-92e6-4c96-b647-da1fba736401 for instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 on n-h2-858384-11 Oct 13 08:44:10.877903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d5064ea1-fd46-4f13-bf1a-ad58d64ece3f req-68408907-0aed-42ee-9faa-bbe11fdf1f62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077748 Oct 13 08:44:10.879069 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1471/2734] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:10.884295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:10.891381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:10.907981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:10.910997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:10.911629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:10.912991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:10.915180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:10.917040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:10.949959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 HTTP/1.1 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ae1bea6e-5a32-4def-b361-7c29ad5f2c99'} Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:10.953546 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:10.958068 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:10.964151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:10.970200 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b40c1c8-28f3-4fde-895f-c535c5aff66d tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 404 len: 111 microversion: 2.1 time: 0.089793 Oct 13 08:44:10.974212 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1472/2735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:10 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:10.983355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-863ed09a-abab-4645-95fe-231746867450 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c19940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.081666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79e42513-c10e-4f01-bb5c-177317f5d1dc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:11.092697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79e42513-c10e-4f01-bb5c-177317f5d1dc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1213 microversion: 2.1 time: 1.195271 Oct 13 08:44:11.094709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1264/2736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:09 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1213 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:11.107986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.108293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-863ed09a-abab-4645-95fe-231746867450 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.132730 Oct 13 08:44:11.108907 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1473/2737] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:10 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:11.145413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_groups [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Querying cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) for 1 instances {{(pid=127031) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 13 08:44:11.149056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.151196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.153364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.183627 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f166f947-8d4e-4957-b92e-313ae1a8cbb7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.087607 Oct 13 08:44:11.184913 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1265/2738] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:44:11 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:11.196530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.229933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_groups [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Querying cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) for 1 instances {{(pid=127030) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 13 08:44:11.230761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.231253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.231696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.254531 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ff840f5-b0cb-4192-b4b1-968e17c4fd03 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415" status: 200 len: 183 microversion: 2.1 time: 0.061743 Oct 13 08:44:11.260161 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1474/2739] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:44:11 2022] GET /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415 => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:11.269287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.269963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:11.280328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.293771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.297491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.298447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.298949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.299396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.320397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:11.346851 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 HTTP/1.1 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ae1bea6e-5a32-4def-b361-7c29ad5f2c99'} Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:11.348698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.352859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.356977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.358802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39fb78f7-20b4-4e0d-9d1a-e225926420a6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 404 len: 111 microversion: 2.1 time: 0.095153 Oct 13 08:44:11.368238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1266/2740] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:11.373042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.373718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] [instance: ae1bea6e-5a32-4def-b361-7c29ad5f2c99] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:11.380170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.380576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.381040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.381834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.382203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.382663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.432861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 HTTP/1.1 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ae1bea6e-5a32-4def-b361-7c29ad5f2c99'} Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.434445 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. Oct 13 08:44:11.438693 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.439859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance ae1bea6e-5a32-4def-b361-7c29ad5f2c99 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.440870 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab6f77ee-812d-4277-9490-6ca54007495a tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99" status: 404 len: 111 microversion: 2.1 time: 0.071949 Oct 13 08:44:11.441896 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1475/2741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:11 2022] GET /compute/v2.1/servers/ae1bea6e-5a32-4def-b361-7c29ad5f2c99 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:11.452601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45b6e227-6fb2-4ca7-b778-e5a3a59f43f7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.460300 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-45b6e227-6fb2-4ca7-b778-e5a3a59f43f7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45b6e227-6fb2-4ca7-b778-e5a3a59f43f7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-server-groups/9b98cbf6-a16f-4d64-86f4-15985d7d72e1 HTTP/1.1 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '9b98cbf6-a16f-4d64-86f4-15985d7d72e1'} Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.471754 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45b6e227-6fb2-4ca7-b778-e5a3a59f43f7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance group 9b98cbf6-a16f-4d64-86f4-15985d7d72e1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.475292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45b6e227-6fb2-4ca7-b778-e5a3a59f43f7 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/9b98cbf6-a16f-4d64-86f4-15985d7d72e1" status: 404 len: 117 microversion: 2.1 time: 0.026780 Oct 13 08:44:11.477600 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1267/2742] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/os-server-groups/9b98cbf6-a16f-4d64-86f4-15985d7d72e1 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:11.484362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb0f388c-d550-4c6a-9893-cb3eeec702b3 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.492274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bb0f388c-d550-4c6a-9893-cb3eeec702b3 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb0f388c-d550-4c6a-9893-cb3eeec702b3 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-server-groups/aa14e27d-3768-4f18-8676-d2efb86c809d HTTP/1.1 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'aa14e27d-3768-4f18-8676-d2efb86c809d'} Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.494856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.498850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb0f388c-d550-4c6a-9893-cb3eeec702b3 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance group aa14e27d-3768-4f18-8676-d2efb86c809d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.502933 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb0f388c-d550-4c6a-9893-cb3eeec702b3 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/aa14e27d-3768-4f18-8676-d2efb86c809d" status: 404 len: 117 microversion: 2.1 time: 0.019345 Oct 13 08:44:11.507547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1476/2743] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/os-server-groups/aa14e27d-3768-4f18-8676-d2efb86c809d => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:11.513434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49979486-5600-4afd-bb77-dd74fba7c4d8 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.522662 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-49979486-5600-4afd-bb77-dd74fba7c4d8 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49979486-5600-4afd-bb77-dd74fba7c4d8 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-server-groups/1ea9bb88-224e-4b96-9c0e-b52f651b550f HTTP/1.1 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '1ea9bb88-224e-4b96-9c0e-b52f651b550f'} Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.524804 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. Oct 13 08:44:11.528639 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.530343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49979486-5600-4afd-bb77-dd74fba7c4d8 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance group 1ea9bb88-224e-4b96-9c0e-b52f651b550f could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.531473 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-49979486-5600-4afd-bb77-dd74fba7c4d8 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1ea9bb88-224e-4b96-9c0e-b52f651b550f" status: 404 len: 117 microversion: 2.1 time: 0.022859 Oct 13 08:44:11.538504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1268/2744] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/os-server-groups/1ea9bb88-224e-4b96-9c0e-b52f651b550f => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:11.540991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9f82524-f49f-4c18-b651-1a7a7d840457 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.559143 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b9f82524-f49f-4c18-b651-1a7a7d840457 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] HTTP exception thrown: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9f82524-f49f-4c18-b651-1a7a7d840457 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Request method failure captured: Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-server-groups/c7a95766-e719-4dcc-869b-334be519b835 HTTP/1.1 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-yuOsuT-LdNdhag27mDUEhkJDAro6ozr6lvGi1eba7xBllh4JqT-AW9us12OsWMoG5TTLJvsKhfki0D4Gt5TxBqQxdzwaG4ZGVKLyVSHfEVJCNVVKc7Cda3O4I26-Nq_pRgG9RQd5cSAWRTblLuAyhMr3B-Xl7OXf55SRPksJrYYc Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec728ae9359a4cc987b481b4170ede1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ec728ae9359a4cc987b481b4170ede1e Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerGroupTestJSON-460676714 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b0e2e7c2b13744e49603f3287f721c20 Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerGroupTestJSON-460676714-project Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c7a95766-e719-4dcc-869b-334be519b835'} Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.562125 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:11.565763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9f82524-f49f-4c18-b651-1a7a7d840457 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Returning 404 to user: Instance group c7a95766-e719-4dcc-869b-334be519b835 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:11.570813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9f82524-f49f-4c18-b651-1a7a7d840457 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c7a95766-e719-4dcc-869b-334be519b835" status: 404 len: 117 microversion: 2.1 time: 0.026864 Oct 13 08:44:11.571708 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1477/2745] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/os-server-groups/c7a95766-e719-4dcc-869b-334be519b835 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:44:11.581370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6cbba0eb-f108-436d-be7d-0b933138f1e6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.638370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6cbba0eb-f108-436d-be7d-0b933138f1e6 tempest-ServerGroupTestJSON-460676714 tempest-ServerGroupTestJSON-460676714-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415" status: 204 len: 0 microversion: 2.1 time: 0.060426 Oct 13 08:44:11.641333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1269/2746] 10.222.0.23 () {58 vars in 1266 bytes} [Thu Oct 13 08:44:11 2022] DELETE /compute/v2.1/os-server-groups/5baf3eee-3955-4617-bd84-138b42b68415 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:44:11.837189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:11.838973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:11.868396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.871041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.871731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:11.873526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:11.883761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:11.885389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:12.122974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:12.124146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:12.140209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:12.141132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:12.141782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:12.142809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:12.143496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:12.144133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:12.437785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:12.450209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:12.452035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:12.453903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-019b2d83-c1f1-4e7c-9fda-aaf78dc1c433 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.628273 Oct 13 08:44:12.455509 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1478/2747] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:11 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:12.465318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a56bea3-64a4-44b0-8a5b-7a16cd8c3eed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cf0280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:12.517916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a56bea3-64a4-44b0-8a5b-7a16cd8c3eed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.060655 Oct 13 08:44:12.518233 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1479/2748] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:12 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:12.634548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:12.642978 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c46cd756-3696-4bdd-89e9-c90bab9279a3 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1271 microversion: 2.1 time: 0.525924 Oct 13 08:44:12.647966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1270/2749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:12 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1271 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:13.490343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:13.492064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:13.511705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:13.516898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:13.517617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:13.520541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:13.521221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:13.528131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:13.534866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1be60d33-68e5-440f-8d64-269408b1af52 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ee7820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:13.659580 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1be60d33-68e5-440f-8d64-269408b1af52 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.128277 Oct 13 08:44:13.660585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1271/2750] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:13 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:13.672710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:13.673530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:13.694294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:13.695103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:13.695691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:13.696568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:13.697711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:13.698288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:14.260211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:14.261449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:14.273233 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78f62ad3-d968-4714-9070-bcff2b7d8a92 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1271 microversion: 2.1 time: 0.605450 Oct 13 08:44:14.276412 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1272/2751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:13 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1271 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:14.279609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:14.281073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:14.282266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-573d8c9e-cd98-424a-abb0-05ad678bf005 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.802042 Oct 13 08:44:14.313476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1480/2752] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:13 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:14.418153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:14.425810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:14.439572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:14.440483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:14.441769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:14.443914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:14.444722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:14.446230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:14.523143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73432ae-4506-48e7-9960-3d508cc87466", "tag": "55c6c62b-acf1-448d-bf9c-f5c86bfb98ef"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:14.555043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:14.557567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:14.558258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:14.590281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] Creating event network-changed:55c6c62b-acf1-448d-bf9c-f5c86bfb98ef for instance c73432ae-4506-48e7-9960-3d508cc87466 on n-h1-858384-11 Oct 13 08:44:14.599310 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1fd09a66-f893-4287-aa53-5032c7260768 req-2ad5da71-f208-43d6-96b3-6fce794338fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080375 Oct 13 08:44:14.602868 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1481/2753] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:14.676736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3646ad70-d227-4a54-8980-d539e910d8a9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c25280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:14.754327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3646ad70-d227-4a54-8980-d539e910d8a9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.081794 Oct 13 08:44:14.763099 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1482/2754] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:14 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:15.073177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:15.095371 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ac1fb34-268b-4ffe-9930-b858b836d5a7 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1590 microversion: 2.1 time: 0.679874 Oct 13 08:44:15.099619 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1273/2755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:14 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1590 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:15.300463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:15.301399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:15.313064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:15.313709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:15.314261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:15.315106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:15.328066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:15.328850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:15.340282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:15.341324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:15.362004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:15.370077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:15.375102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:15.376134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:15.380078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:15.381830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:15.589147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:15.600469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bbc9dbe4-4912-4cdf-93e4-c5605e7886c5 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1271 microversion: 2.1 time: 0.302013 Oct 13 08:44:15.602623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1483/2756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:15 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:15.770357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-edd07359-732d-40e7-97c0-a818b92811ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c4c280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:15.852728 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-edd07359-732d-40e7-97c0-a818b92811ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.086080 Oct 13 08:44:15.854095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1484/2757] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:15 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:16.629621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:16.630238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:16.650235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:16.652673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:16.653383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:16.654284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:16.656242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:16.656833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:17.249397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:17.266261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:17.267777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:17.268985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e02c53a-f2c4-40fd-9a12-38d1237bbf8d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.935165 Oct 13 08:44:17.303025 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1274/2758] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:15 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:17.324322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05ee1878-944c-4d76-9df8-ac50d90bd1a9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dfd700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:17.330774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:17.362076 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eddad1e6-1571-49d3-9295-50498487c304 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.729984 Oct 13 08:44:17.362770 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1485/2759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:16 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:17.441004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05ee1878-944c-4d76-9df8-ac50d90bd1a9 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.136881 Oct 13 08:44:17.442096 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1275/2760] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:17 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:18.325325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:18.325908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:18.360289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:18.361234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:18.361234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:18.361951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:18.362430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:18.362864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:18.392637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:18.393481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:18.438389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:18.439084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:18.439545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:18.440300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:18.440756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:18.441184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:18.798931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:18.809075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:18.810558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:18.811729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e4f2f7a-562f-47b4-bf5c-c46d992663be tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.494491 Oct 13 08:44:18.824833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1486/2761] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:18 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:18.834006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-910f9cd5-c77c-42fe-b10b-6c07416c39dd tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c4c280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:18.918541 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-910f9cd5-c77c-42fe-b10b-6c07416c39dd tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.092209 Oct 13 08:44:18.930728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1487/2762] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:18 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:18.998751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:19.015048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4b7aa81-626b-4984-90d7-1245a64bcb4b tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.629972 Oct 13 08:44:19.026515 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1276/2763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:18 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:19.841629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:19.842242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:19.844355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:19.845022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:19.857919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:19.858433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:19.858892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:19.864007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:19.864805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:19.866202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:19.920884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:19.939168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22caebd1-ce3a-42a6-9e73-0518d575eb45 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dfdf70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:20.021705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22caebd1-ce3a-42a6-9e73-0518d575eb45 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.091430 Oct 13 08:44:20.022687 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1277/2764] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:19 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:20.047621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:20.052191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:20.070868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:20.071682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:20.072591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:20.076856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:20.077579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:20.079176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:20.240909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:20.252743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:20.255370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:20.257572 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b93228e4-07c6-47fc-b0cc-219385363ad2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.420390 Oct 13 08:44:20.276200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1488/2765] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:19 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:20.800467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:20.809451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1495f89d-c063-4d23-994f-ee3f735e53bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.767347 Oct 13 08:44:20.813585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1278/2766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:20 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:21.047293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0aec5bf2-10b4-4a7d-b605-3f436d9ed1ee tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c0b0d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:21.180724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0aec5bf2-10b4-4a7d-b605-3f436d9ed1ee tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.146637 Oct 13 08:44:21.193680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1489/2767] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:21 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:21.289270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:21.289922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:21.293983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:21.305540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:21.315944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:21.316435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:21.318151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:21.321475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:21.327200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:21.336504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91915aae-601c-4a7c-a384-64814fc34f1b", "tag": "3000661a-e3ef-4f98-85e5-8eb92342227c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:21.389727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:21.396370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:21.403688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:21.442792 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] Creating event network-changed:3000661a-e3ef-4f98-85e5-8eb92342227c for instance 91915aae-601c-4a7c-a384-64814fc34f1b on n-h2-858384-11 Oct 13 08:44:21.452759 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c25a337f-cc9c-42e0-aa65-1c2af4ef9d17 req-0fbcaf03-9b07-4386-9156-e7add0b6dfb2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119920 Oct 13 08:44:21.454053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1490/2768] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:21.837240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:21.839455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:21.874521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:21.876146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:21.876792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:21.879856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:21.884199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:21.885773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:22.200098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:22.213552 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0443758d-b59f-4855-a3f3-072cd15e1b66 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.381449 Oct 13 08:44:22.231429 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1491/2769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:21 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:22.251842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-732397d6-8832-474b-928d-9442c507ef86 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c19af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:22.359277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-732397d6-8832-474b-928d-9442c507ef86 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1453 microversion: 2.1 time: 0.123244 Oct 13 08:44:22.361323 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1492/2770] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:22 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:22.386821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:22.399713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:22.407469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:22.411597 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56486fd7-278f-49b0-802e-8a2acbdc525f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.126182 Oct 13 08:44:22.423188 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1279/2771] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:21 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:23.260286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:23.260900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:23.275963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.305479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.312917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:23.315808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.317374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.319290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:23.375969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e59f5e95-c924-407f-adcd-2bf8fa789546 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e9e790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:23.435829 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e59f5e95-c924-407f-adcd-2bf8fa789546 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1462 microversion: 2.1 time: 0.063680 Oct 13 08:44:23.438214 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1280/2772] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:23 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1462 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:23.457179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:23.458324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:23.467206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.467930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.468535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:23.469621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.470350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.470985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:23.781920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:23.793099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:23.793267 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e01b2de-6ff9-4e90-b51e-edfea5c9a631 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.539384 Oct 13 08:44:23.804425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:23.807804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:23.813220 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7a53f11-8b4f-46a0-8e9d-ce6e86632050 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.372937 Oct 13 08:44:23.813549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1493/2773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:23 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:23.815481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1281/2774] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:23 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:23.840754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc7e74a9-768e-4566-8a89-025f6ff92170 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c19790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:23.899848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc7e74a9-768e-4566-8a89-025f6ff92170 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 200 len: 1462 microversion: 2.1 time: 0.084274 Oct 13 08:44:23.900521 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1494/2775] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:23 2022] GET /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:23.916832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:23.918248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:23.935924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.938030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.938679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:23.939657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:23.940276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:23.941625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.325929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:24.345740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78ac3f81-de13-4d8e-828e-a1f7782ff2ab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1467 microversion: 2.1 time: 0.433679 Oct 13 08:44:24.347692 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1282/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:23 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:24.374669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1469186703"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:24.381735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:24.413656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.414509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.415885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.418909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.420694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.421399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.799582 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8d185a4-5d87-4f12-b921-5a9af0c3c094 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "POST /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a/action" status: 202 len: 0 microversion: 2.1 time: 0.424550 Oct 13 08:44:24.804631 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1283/2777] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:44:24 2022] POST /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:44:24.817869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6347557-9921-4c10-b4f3-a42dd0f5876b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ee7430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:24.870121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "156cc7ee-0a30-4e79-823e-97ce9e1cd603"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:24.877486 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6347557-9921-4c10-b4f3-a42dd0f5876b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.065235 Oct 13 08:44:24.878189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:24.887159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1284/2778] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:24 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:24.895319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:24.896079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:24.896499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.897228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.897893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.901094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.901828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.902581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.907280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.908033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.908706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:24.909713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:24.910479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:24.911535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.050242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] HTTP exception thrown: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Request method failure captured: Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments/b7994c5f-d3ff-415a-9c10-9c6927afb371 HTTP/1.1 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 74 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-Jdl48zR_Pj6bim07B3-ypFwv4_o9B66N38x077eu6N1_8tOmdqORMWTnWLFATL43pVZeWqdSupLUCeDmjQz8sa-4H8_sd_cihgRpsSO-i4-098VKVgOTu7lmI-DNos-MoTMFXd96VZNciz3OVTzcfMgSgFmrGxa7EoS9aaS3AeW4 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 96ea63d52901444db0bf008db7235b7d Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ea63d52901444db0bf008db7235b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 96ea63d52901444db0bf008db7235b7d Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesAdminNegativeTest-230589257-project-admin Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 625af43d36be48de8a85bc94280d5364 Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesAdminNegativeTest-230589257-project-admin Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: {"volumeAttachment": {"volumeId": "156cc7ee-0a30-4e79-823e-97ce9e1cd603"}} Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: exception: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': 'f9eda17a-5deb-4cb4-b435-98dd8349ede5', 'id': 'b7994c5f-d3ff-415a-9c10-9c6927afb371', 'body': {'volumeAttachment': {'volumeId': '156cc7ee-0a30-4e79-823e-97ce9e1cd603'}}} Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. (HTTP 404) (Request-ID: req-241a82d9-2c65-4e13-8a4f-6cb5e5a15c60) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 08:44:25.095856 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. Oct 13 08:44:25.100687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:25.105955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Returning 400 to user: Volume 156cc7ee-0a30-4e79-823e-97ce9e1cd603 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:25.107499 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65fd07c5-38a9-4b4b-8f8f-1e42b27c177a tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments/b7994c5f-d3ff-415a-9c10-9c6927afb371" status: 400 len: 107 microversion: 2.1 time: 0.805550 Oct 13 08:44:25.108422 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1495/2779] 10.222.0.23 () {60 vars in 1433 bytes} [Thu Oct 13 08:44:24 2022] PUT /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments/b7994c5f-d3ff-415a-9c10-9c6927afb371 => generated 107 bytes in 807 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:44:25.114138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:25.114796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:25.129878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.130378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.130854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.131575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.132025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.139651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.162422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:25.174213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c7a1f9f-e090-4dab-9255-37a1229479bc tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.285089 Oct 13 08:44:25.175539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1285/2780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:24 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:25.225983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:25.226519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:25.233245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.237505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.238278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.239260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.239933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.241319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.412489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lazy-loading 'services' on Instance uuid f9eda17a-5deb-4cb4-b435-98dd8349ede5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:44:25.633468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6e70b363-cd3f-4152-aff7-b3cb33339b92 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments/b7994c5f-d3ff-415a-9c10-9c6927afb371" status: 202 len: 0 microversion: 2.1 time: 0.411215 Oct 13 08:44:25.635021 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1286/2781] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:44:25 2022] DELETE /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments/b7994c5f-d3ff-415a-9c10-9c6927afb371 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:44:25.644768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:25.655294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:25.679850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.680582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.681329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.682222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:25.682878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:25.683514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:25.799686 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e939f2fa-064c-4256-9ee8-dc28b30f69a6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159102 Oct 13 08:44:25.801382 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1287/2782] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:25 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:25.864108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:25.895105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6b2222c-4dfc-44c7-9c02-8dada9740add tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e109d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:25.953775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:25.977153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:25.990944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2cddaed6-8f45-4b20-a7cb-9b66be971904 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.877877 Oct 13 08:44:26.014326 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1496/2783] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:25 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:26.058334 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6b2222c-4dfc-44c7-9c02-8dada9740add tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.167910 Oct 13 08:44:26.059785 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1288/2784] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:25 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:26.202076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:26.203192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:26.216589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:26.219239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:26.219944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:26.222869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:26.224070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:26.225778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:26.813976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:26.816100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:26.829344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:26.836795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:26.837845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:26.838766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:26.839269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:26.839749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:26.886380 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3498cddd-9bf0-4778-9149-3c15a11649b8 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077071 Oct 13 08:44:26.887195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1289/2785] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:26 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:44:27.021410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:27.022136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:27.046310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:27.047216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:27.048074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:27.049028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:27.049725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:27.050368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:27.069639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:27.075991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:27.091009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f42ea222-76b1-4e6d-b280-de06f585037c tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.890992 Oct 13 08:44:27.104011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1497/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:26 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:27.109223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b72c8a09-2baf-427f-ac93-8ce593a0ab5e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c0bf70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:27.199908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b72c8a09-2baf-427f-ac93-8ce593a0ab5e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.094405 Oct 13 08:44:27.200533 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1498/2787] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:27 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:27.302655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:27.321212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:27.324015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:27.325504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69151a4c-46e9-4e35-b63b-ebdbea4046bd tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.308908 Oct 13 08:44:27.336092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1290/2788] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:27 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:27.900752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:27.902988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:27.926900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:27.927397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:27.927837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:27.933489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:27.934502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:27.936288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.016030 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8480f3d3-28c0-4839-85d0-839ed9651d01 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120498 Oct 13 08:44:28.019381 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1499/2789] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:27 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:28.080201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91915aae-601c-4a7c-a384-64814fc34f1b", "name": "network-vif-plugged", "status": "completed", "tag": "3000661a-e3ef-4f98-85e5-8eb92342227c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:28.104867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:28.105349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:28.105790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.120818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:28.122144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:28.129003 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] Creating event network-vif-plugged:3000661a-e3ef-4f98-85e5-8eb92342227c for instance 91915aae-601c-4a7c-a384-64814fc34f1b on n-h2-858384-11 Oct 13 08:44:28.135277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:28.137746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:28.138438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.141979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:28.142909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:28.143712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f299f7d6-62f3-4f01-b809-9bba21fa4941 req-1e86c20d-ba24-485f-a28c-67cad9cc6e61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067248 Oct 13 08:44:28.144643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1291/2790] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:28.145211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.216618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9cad4d3e-b412-40e7-822f-89d70d7ca434 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e101f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:28.291674 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9cad4d3e-b412-40e7-822f-89d70d7ca434 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.079929 Oct 13 08:44:28.294218 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1292/2791] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:28 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:28.353598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:28.355264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:28.367978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:28.369367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:28.370030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.374494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:28.375678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:28.376368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:28.552362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:28.566747 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64212a7b-189a-4d48-8673-ae9e8cd1f29f tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.450080 Oct 13 08:44:28.571358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1500/2792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:28 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:29.036000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:29.039409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:29.054477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:29.055206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:29.056880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:29.059042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:29.062329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:29.063469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:29.080312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:29.098248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:29.100196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:29.107434 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-884ea85f-816d-42a6-a43d-47c972638bb1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.755713 Oct 13 08:44:29.109042 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1293/2793] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:28 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:44:29.146212 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-693c8929-3446-4dca-87f1-b1125db9e838 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119943 Oct 13 08:44:29.147883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1501/2794] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:29 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:29.307736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1aad2ed3-4e9a-4560-a39a-63c656b42f77 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e10ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:29.388357 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1aad2ed3-4e9a-4560-a39a-63c656b42f77 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.084437 Oct 13 08:44:29.389033 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1294/2795] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:29 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:29.601670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:29.602249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:29.617910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:29.619029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:29.619371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:29.620080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:29.620537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:29.620956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:29.935648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:29.964846 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfde7764-ff76-4ab5-bbb9-5b18540b1acd tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1313 microversion: 2.1 time: 0.360053 Oct 13 08:44:29.969101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1502/2796] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:29 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:30.139854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:30.140466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:30.151650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:30.158476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:30.161210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:30.165901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:30.169269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:30.170810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:30.183233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:30.183963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:30.185848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:30.191156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:30.191859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:30.192763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:30.193364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:30.193949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:30.277515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-66a89393-ae05-4f9b-b84a-7ea903d974b6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122858 Oct 13 08:44:30.287784 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1503/2797] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:30 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:30.295246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-unplugged", "status": "completed", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:30.316823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:30.317579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:30.322208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:30.339450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] Creating event network-vif-unplugged:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:44:30.359369 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3903512b-579d-4f01-a265-598e095edd34 req-0895629d-cf81-4410-ba37-5363fa1b9b82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069932 Oct 13 08:44:30.373273 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1504/2798] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:30.405097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3af8f0e9-7496-4daa-8e0e-cc9d2355485b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c4cc10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:30.499657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3af8f0e9-7496-4daa-8e0e-cc9d2355485b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.098634 Oct 13 08:44:30.504324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1505/2799] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:30 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:30.994209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:30.994986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:31.007512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:31.008006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:31.008444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:31.021400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:31.022252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:31.022889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:31.248628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:31.258829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:31.260416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:31.261620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-531cd4fa-98f9-42fd-a398-096181c6b474 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.126023 Oct 13 08:44:31.297779 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1295/2800] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:30 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:31.321718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:31.329579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:31.373006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:31.385168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:31.385861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:31.387988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:31.388952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:31.418111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:31.419445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:31.535502 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b679e674-3b79-45f7-9659-e52470eddc5b tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235005 Oct 13 08:44:31.545038 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1296/2801] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:31 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:31.568963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25a823fc-79d0-4eff-a570-0413bd2d3b44 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e5e4c0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:31.654602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25a823fc-79d0-4eff-a570-0413bd2d3b44 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.107591 Oct 13 08:44:31.655115 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1297/2802] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:31 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:32.202355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:32.216043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea7655d9-474c-4de4-9672-d54d12e21cae tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1462 microversion: 2.1 time: 1.226450 Oct 13 08:44:32.224775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1506/2803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:30 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1462 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:44:32.293973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:32.294756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:32.315258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:32.316051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:32.317776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:32.320286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:32.321675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:32.324217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:32.939178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Calling method '.version_select at 0x7f5375e109d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:32.989935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:33.002204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:33.012913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.014015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.016257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.019420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:33.036421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8a0e747-7cbe-4b90-864b-bfb7c69f2a83 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.748008 Oct 13 08:44:33.045211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1507/2804] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:32 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:33.057482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:33.074085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:33.097309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.097959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.098435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.100307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.100816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.101259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.101985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.102466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.102964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.171179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0fc0f646-4b69-497b-bda2-1c3d6083404b tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/f87c4c0630284b389c5d569d430495ac?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687" status: 200 len: 694 microversion: 2.1 time: 0.923604 Oct 13 08:44:33.187768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1298/2805] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Oct 13 08:44:32 2022] GET /compute/v2.1/os-simple-tenant-usage/f87c4c0630284b389c5d569d430495ac?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687 => generated 694 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:33.209581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6e9419f3-38e8-4f4d-8b66-43252e54db1b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e100d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:33.296397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6e9419f3-38e8-4f4d-8b66-43252e54db1b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.107309 Oct 13 08:44:33.297115 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1299/2806] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:33 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:33.314263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '.version_select at 0x7f5375f39b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:33.350580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.351058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.351507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.370035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.370564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.371015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.395852 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a357852-3cd2-4523-9e9e-29528a0c6c68 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/f87c4c0630284b389c5d569d430495ac?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687" status: 200 len: 694 microversion: 2.1 time: 0.097780 Oct 13 08:44:33.417371 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1300/2807] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Oct 13 08:44:33 2022] GET /compute/v2.1/os-simple-tenant-usage/f87c4c0630284b389c5d569d430495ac?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687 => generated 694 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:33.422377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Calling method '.version_select at 0x7f5375e5a670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:33.451672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.452377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.452990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.487005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.487495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.487932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.694301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b3f8427c-6f82-497f-8d07-cc7e70663464 tempest-TenantUsagesTestJSON-1265649570 tempest-TenantUsagesTestJSON-1265649570-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687&detailed=1" status: 200 len: 27981 microversion: 2.1 time: 0.275616 Oct 13 08:44:33.744318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1301/2808] 10.222.0.23 () {58 vars in 1335 bytes} [Thu Oct 13 08:44:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-12T08%3A44%3A32.243687&end=2022-10-14T08%3A44%3A32.243687&detailed=1 => generated 27981 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 08:44:33.749323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:33.749833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:33.772126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.772631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.773095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.773815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:33.774279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:33.774812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:33.823690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:44:33.846940 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12bb0862-fa3c-48d3-b823-15462366a95e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.800325 Oct 13 08:44:33.852253 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1508/2809] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:33 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:33.999015 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-932d6e0c-8134-47fd-aecc-1ce6e4ac88f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 204 len: 0 microversion: 2.1 time: 0.253104 Oct 13 08:44:34.001781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1302/2810] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:33 2022] DELETE /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:44:34.011044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:34.011837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:34.029549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.030154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.030837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.031635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.032200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.033078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.075367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:34.076225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:34.085272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.088990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.089894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.090887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.094277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.095045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.464203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:34.474042 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c82b4893-e30e-4166-bf11-94edcd00b140 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1468 microversion: 2.1 time: 0.468099 Oct 13 08:44:34.482959 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1509/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:34 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:34.489856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9df4b86-e219-4e81-8691-11256d81bb7b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375bbb3a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:34.581908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9df4b86-e219-4e81-8691-11256d81bb7b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.097561 Oct 13 08:44:34.594258 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1510/2812] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:34 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:34.867098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:34.870644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:34.892040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.895317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.896084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.898324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:34.901511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:34.903405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:34.966318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7fd3064b-0ff2-4aaa-b272-939dd045b781 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104150 Oct 13 08:44:34.971675 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1511/2813] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:34 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:44:34.987027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:35.003908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:35.007798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:35.011354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a527801d-de60-4f3a-be66-f47f067b7db9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.940048 Oct 13 08:44:35.012484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1303/2814] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:34 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:44:35.504630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:35.505638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:35.517393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:35.530432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:35.532451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:35.535430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:35.536730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:35.540661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:35.601080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63e0e11b-7bd3-4abe-b404-6c89b1bd4bd2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e9eaf0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:35.695991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63e0e11b-7bd3-4abe-b404-6c89b1bd4bd2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.098622 Oct 13 08:44:35.701783 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1304/2815] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:35 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:35.979721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:35.981835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:36.003443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:36.003955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:36.010696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:36.012777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:36.013281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:36.013727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:36.094262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e81d9517e6c4155952fe4ea1cd3b519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87c4c0630284b389c5d569d430495ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:36.098009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:36.107999 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-223a301d-8079-44ee-abab-a9aa3241b5eb tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 200 len: 1468 microversion: 2.1 time: 0.607682 Oct 13 08:44:36.116309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c228dc23-7fd8-4470-8267-3b4ce5ebf886 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141095 Oct 13 08:44:36.132649 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1512/2816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:35 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 1468 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:36.132866 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1305/2817] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:35 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:36.132988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:36.132988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:36.166369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:36.171074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:36.171595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:36.172047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:36.177439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:36.180942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:36.181453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:36.716715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c531c51-cdcb-477f-93c6-3a9b5106921e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d83c10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:36.748485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:36.772988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:36.774946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:36.776262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e1dd848-3753-4b82-8284-8b4835404b38 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.657144 Oct 13 08:44:36.781102 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1513/2818] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:36 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:36.828649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c531c51-cdcb-477f-93c6-3a9b5106921e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.115721 Oct 13 08:44:36.830360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1306/2819] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:36 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:36.922017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1469690605", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:36.980637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-816063901", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "fd50a888-6bb9-40dd-87c7-f8b4d0f1c900"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:37.094591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:44:37.115062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] validate_networks() for [('fd50a888-6bb9-40dd-87c7-f8b4d0f1c900', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:44:38.244496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:44:38.254037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:44:38.255421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:44:38.256124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:44:38.256809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:44:38.280840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.289207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.290539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.293114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.293847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.298815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.371346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Getting quotas for project 9260b44756a44338937ff836808535f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:44:38.379737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:44:38.380746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:44:38.381405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:44:38.381967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:44:38.382558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:44:38.385474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Getting quotas for user 684f0d06e83b4ce4a3de8946f517131a and project 9260b44756a44338937ff836808535f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:44:38.395766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.398312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.400837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.401952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.406354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.407082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.428364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:44:38.434575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:44:38.452670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:44:38.459118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:44:38.486445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:44:38.491112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:44:38.563390 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7b0a5f0-5f73-4589-a035-fd14d74810fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.686081 Oct 13 08:44:38.564820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1307/2820] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:44:38.569884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:38.573310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:38.581768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.582954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.583554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.584433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.585118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.585708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.589104 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7febc698-b536-40d7-b1ba-f875b3643013 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806771 Oct 13 08:44:38.592292 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1514/2821] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:44:38.602689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:38.603329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] [instance: 91915aae-601c-4a7c-a384-64814fc34f1b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:38.616947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.620499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.621171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.622066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.624402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.625404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.633646 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-42348d67-0506-4b87-a724-2c6f57760a68 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067553 Oct 13 08:44:38.641447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1308/2822] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:44:38 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:44:38.648372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91915aae-601c-4a7c-a384-64814fc34f1b", "name": "network-vif-deleted", "tag": "3000661a-e3ef-4f98-85e5-8eb92342227c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:38.665380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.666081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.666695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.672245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] HTTP exception thrown: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Request method failure captured: Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b HTTP/1.1 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_WX6bXHkkiek0TtVmOiyaDyX8SlQcaUCB5iDCp-v1hedYnMbfU53KHhpj4XSC6qtEZajlbPNiWjUteDexY8MtMqqDJzapsvxitC3tKsyeOrxfI-yFAUk-sAO47R4tIUr-1gSYRzaKMK-lv7w8bkoznC-HvYzAM2oN2vHIWjS-sa6w Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: f87c4c0630284b389c5d569d430495ac Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TenantUsagesTestJSON-2049276144 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f87c4c0630284b389c5d569d430495ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f87c4c0630284b389c5d569d430495ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f87c4c0630284b389c5d569d430495ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f87c4c0630284b389c5d569d430495ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TenantUsagesTestJSON-2049276144 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: f87c4c0630284b389c5d569d430495ac Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2049276144 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TenantUsagesTestJSON-2049276144-project Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e81d9517e6c4155952fe4ea1cd3b519 Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TenantUsagesTestJSON-2049276144-project Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '91915aae-601c-4a7c-a384-64814fc34f1b'} Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:38.674036 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] Returning 404 to user: Instance 91915aae-601c-4a7c-a384-64814fc34f1b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:38.678637 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45d2ee23-9091-4b51-99a5-b74b95fae7f1 tempest-TenantUsagesTestJSON-2049276144 tempest-TenantUsagesTestJSON-2049276144-project] 10.222.0.23 "GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b" status: 404 len: 111 microversion: 2.1 time: 0.082191 Oct 13 08:44:38.679389 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1515/2823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:38 2022] GET /compute/v2.1/servers/91915aae-601c-4a7c-a384-64814fc34f1b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:38.685603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:38.686383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:38.690901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] Creating event network-vif-deleted:3000661a-e3ef-4f98-85e5-8eb92342227c for instance 91915aae-601c-4a7c-a384-64814fc34f1b on n-h2-858384-11 Oct 13 08:44:38.697112 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d9e5eb34-aeef-4bd9-9a60-bd08acdc214b req-118056fb-6957-400f-939e-ee14c5ffb216 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053124 Oct 13 08:44:38.698774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1309/2824] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:38.704925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-58a0e2e9-ccad-496d-9ffa-90182cdd7cc8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d03d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:38.722152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.723850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.725953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.726901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:38.729340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:38.729929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:38.822911 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-58a0e2e9-ccad-496d-9ffa-90182cdd7cc8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.122523 Oct 13 08:44:38.832251 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1310/2825] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:38 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:38.838135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:38.853807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:38.983640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:38.993319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:38.994898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:38.996190 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe29b9e6-30e2-4e60-a181-07d453f10abc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1258 microversion: 2.21 time: 0.162405 Oct 13 08:44:39.006187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1311/2826] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:38 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:39.011607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29bc9b30-b849-46a5-a0bd-2cc2902d2c3b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:39.012217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29bc9b30-b849-46a5-a0bd-2cc2902d2c3b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:39.115242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29bc9b30-b849-46a5-a0bd-2cc2902d2c3b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:39.126141 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29bc9b30-b849-46a5-a0bd-2cc2902d2c3b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1193 microversion: 2.1 time: 0.118761 Oct 13 08:44:39.127073 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1312/2827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:39 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:39.145411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-706323872", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "cc6feba2-427b-4cac-940f-bd5e5b18dc0d"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:39.271147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] validate_networks() for [('cc6feba2-427b-4cac-940f-bd5e5b18dc0d', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:44:40.107551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.124247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.131283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.136373 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c9a16b1-eed7-4559-8952-3e5a3511f351 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.452221 Oct 13 08:44:40.138998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1516/2828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:38 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:40.156626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67bf266a-99b7-4120-8851-c696dfc0f635 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cc18b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:40.314938 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67bf266a-99b7-4120-8851-c696dfc0f635 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.174347 Oct 13 08:44:40.322842 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1517/2829] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:40 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:40.327536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:40.328191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:40.345998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.346533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.346977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.350643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.351290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.351958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.374142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:44:40.374690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:44:40.375085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:44:40.375497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:44:40.375910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:44:40.407657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.408151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.408593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.409329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.420017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.424461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.516520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:44:40.540826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Getting quotas for user ad1e31177278409199fa651951c5e75a and project b7f2eedb85b648f7aa5ed433ec79de49. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:44:40.588849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:44:40.608707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:44:40.663676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.687742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.697885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:40.703553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06bdf41b-aba4-4859-be42-cbd5404cf31b tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1254 microversion: 2.21 time: 0.384360 Oct 13 08:44:40.707271 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1518/2830] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:40 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1254 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:40.720676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:40.728918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:40.768412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.768929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.769368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.771197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:40.772665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:40.774068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:40.797879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d926b533-6052-4228-94f8-682abe54cf62 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669605 Oct 13 08:44:40.813294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1313/2831] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:44:40.830494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc06aa43-9dc7-4348-afa5-d78279d2c8dd tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:40.831333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc06aa43-9dc7-4348-afa5-d78279d2c8dd tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:41.092805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc06aa43-9dc7-4348-afa5-d78279d2c8dd tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:41.111147 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc06aa43-9dc7-4348-afa5-d78279d2c8dd tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1217 microversion: 2.1 time: 0.288959 Oct 13 08:44:41.111792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1314/2832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:40 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:41.168055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:41.168690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:41.193522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:41.193936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:41.194387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:41.204708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:41.205187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:41.205635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:41.325182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:41.339679 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fc261ce-b701-402f-a683-46c78530071f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1189 microversion: 2.1 time: 0.630656 Oct 13 08:44:41.341366 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1519/2833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:40 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1189 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:41.349874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85b08e8d-70e5-4d1f-8e75-451f32b81ad6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c38f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:41.463244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85b08e8d-70e5-4d1f-8e75-451f32b81ad6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.120505 Oct 13 08:44:41.465528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1520/2834] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:41 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:41.737647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:41.740311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:41.754728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:41.757322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:41.764205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:41.769718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:41.772233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:41.773728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:42.637290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.658188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.668233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.676694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb833c8d-bdd0-4d2c-bf62-91d09beb75e6 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1318 microversion: 2.21 time: 0.945796 Oct 13 08:44:42.677633 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1521/2835] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:41 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1318 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:44:42.682593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:42.700969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:42.711023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.713455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:42.714372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:42.723340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:42.724428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:42.725122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:42.725786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:42.744158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.748163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.755493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d23dd42b-4375-4051-8a8d-daae5b7c6531 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.592039 Oct 13 08:44:42.756121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1315/2836] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:41 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:44:42.789041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:42.800285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:42.820120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:42.821998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:42.822631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:42.823467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:42.824059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:42.824621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:42.902018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:42.920520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba997c67-8343-4f50-8742-1ba11bc7e44a tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1221 microversion: 2.1 time: 0.241504 Oct 13 08:44:42.922493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1522/2837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:42 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:42.934748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7468a97d-a509-49ff-947d-dd78f6a0e095 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c0b280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:43.046610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7468a97d-a509-49ff-947d-dd78f6a0e095 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.122732 Oct 13 08:44:43.047786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1523/2838] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:42 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:43.108045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:43.124801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0edab08-f14b-4be6-a0c0-83159397f0df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1245 microversion: 2.1 time: 0.352723 Oct 13 08:44:43.131982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1316/2839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:42 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1245 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:43.712292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:43.713385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:43.729702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:43.735462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:43.736205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:43.739257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:43.739846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:43.740417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:43.785870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:43.789769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:43.797825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:43.806710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:43.812109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:43.816936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:43.820815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:43.823025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:43.982060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:43.991682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.004575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.011269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2153790a-18a5-46cb-8f4c-e1db5a14d218 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1316 microversion: 2.21 time: 0.304754 Oct 13 08:44:44.015077 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1524/2840] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:43 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:44.042086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:44.042879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:44.075498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:44.076524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:44.076524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:44.077205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:44.077941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:44.078218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:44.185124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.195206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ffc5ca9-60b8-49b6-809d-69099b439032 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1277 microversion: 2.1 time: 0.178869 Oct 13 08:44:44.196770 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1525/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:44 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:44.222342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e007689c-c8a1-4755-acf1-e71faf55dcb3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c258b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:44.312900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e007689c-c8a1-4755-acf1-e71faf55dcb3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.097398 Oct 13 08:44:44.313530 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1526/2842] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:44 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:44.591336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-84749584", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "ea9dba19-ae29-472b-9f4d-0d0b50f53e88"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:44.822475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] validate_networks() for [('ea9dba19-ae29-472b-9f4d-0d0b50f53e88', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:44:44.873178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.886178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.892192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:44.893404 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a594186d-5b2d-473d-9d6e-c339429f7b43 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.112766 Oct 13 08:44:44.893992 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1317/2843] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:43 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:44.924953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:44.927149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:44.942916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:44.944829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:44.946858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:44.950456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:44.951183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:44.952938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:45.323588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:45.333818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ac5380f-ced0-4102-9b93-062e9ebe759b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1251 microversion: 2.1 time: 0.417373 Oct 13 08:44:45.354761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1318/2844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:44 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1251 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:45.362152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:45.363033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:45.378491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:45.379259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:45.379847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:45.380884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:45.381469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:45.382057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.087687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:46.106824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:46.110078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:44:46.111409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:44:46.112242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:44:46.112971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:44:46.113641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:44:46.118881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:46.126090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86abef7e-bdd9-4e11-acbd-432a099a5afd tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.769907 Oct 13 08:44:46.133423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.134303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.134550 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1319/2845] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:45 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:46.135242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.136249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.137533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.138215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.156329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:46.156964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:46.182451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:44:46.185276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.185785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.186230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.186974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.189987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for user e27491f47ce944f0936a61bd642cd057 and project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:44:46.195077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.197449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.210468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:46.231170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:44:46.237040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:44:46.347776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ae324b0-49bd-4835-b2f9-39246bd2bc4c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.032863 Oct 13 08:44:46.348714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1527/2846] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:44:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:44:46.355044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87a24097-0b5e-4ff6-8dc5-7715c3766bb2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c25f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:46.425134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87a24097-0b5e-4ff6-8dc5-7715c3766bb2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.074723 Oct 13 08:44:46.431462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1528/2847] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:46 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:46.443824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:46.457537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:46.474950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.475449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.475888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:46.492460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:46.494334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:46.498173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:47.004395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:47.016543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:47.031546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:47.037078 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c5ad662-e66e-484e-a361-c6173bfb1434 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.604311 Oct 13 08:44:47.041516 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1529/2848] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:46 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:47.788878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a", "name": "network-vif-plugged", "status": "completed", "tag": "b4a0d212-9351-44e1-8d91-d957d2fe89e5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:47.809963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:47.810476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:47.813495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:47.845639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] Creating event network-vif-plugged:b4a0d212-9351-44e1-8d91-d957d2fe89e5 for instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a on n-h1-858384-11 Oct 13 08:44:47.868680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f4172186-8f2f-4510-96b1-5808234bf783 req-4eaabe2b-4449-41fd-841c-85c98b734ddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.822993 Oct 13 08:44:47.873824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1530/2849] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:47.888371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:47.893239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:47.934558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:47.953064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:47.955072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:47.955974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:47.958957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:47.967260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:47.968028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:47.987190 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2cca1d35-8a26-462f-b750-fd5c1d513bf2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 1.848709 Oct 13 08:44:48.002433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1320/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:46 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:48.021887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:48.029648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:48.089124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.091517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.099204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:48.104745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.111708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.117099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:48.138390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:48.150436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc2bed19-2e49-46b2-b953-ed093d852d65 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1275 microversion: 2.1 time: 0.272619 Oct 13 08:44:48.152022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1531/2851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:47 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:48.172648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:48.173447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:48.183478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.185287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.186211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:48.190792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.191488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.192074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:48.480486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:48.489794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:48.494121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:48.496245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd97bb02-ad0b-4e43-abe6-2f292cafc9fb tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.343086 Oct 13 08:44:48.496829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1532/2852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:48 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:48.507596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58f36b63-896d-42d2-a0c0-b739a49376fc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d58940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:48.589047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58f36b63-896d-42d2-a0c0-b739a49376fc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.089591 Oct 13 08:44:48.590767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1533/2853] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:48 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:48.601035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:48.601999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:48.619629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.620388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.620950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:48.621677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:48.622145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:48.622612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.155432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.161140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.170022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0b19b04-b78d-4f1a-b934-da134cf8fd8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 1.174109 Oct 13 08:44:49.185840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.185840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.185840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd4f3828-583e-4c74-a0aa-241ebe0a835d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.587700 Oct 13 08:44:49.186998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1321/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:47 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:49.192413 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1534/2855] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:48 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:49.197921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:49.203653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.212856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Searching by: {'deleted': False, 'project_id': 'ca51c3078db54e67922de8010252af65'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:44:49.220173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.228591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.229422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.230438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.231334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.231911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.272296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:44:49.361503 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d4e0b287-7dd9-4226-9b52-34ea6983d1b5 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.173078 Oct 13 08:44:49.364927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1322/2856] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:44:49 2022] GET /compute/v2.1/servers => generated 339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:49.381934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:49.382968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:49.400919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.401802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.404659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.405708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.408671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.409329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.459214 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a235d9a-ce37-4782-a2cd-8d1e05346a10 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-12T08%3A44%3A48.756350&end=2022-10-14T08%3A44%3A48.756350" status: 404 len: 112 microversion: - time: 0.265468 Oct 13 08:44:49.460262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1535/2857] 10.222.0.23 () {58 vars in 1316 bytes} [Thu Oct 13 08:44:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-12T08%3A44%3A48.756350&end=2022-10-14T08%3A44%3A48.756350 => generated 112 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 08:44:49.471822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:49.475145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:49.530725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.531446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.534915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.539417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.540752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.541380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.689874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.704745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-846f8107-4f46-4c8f-9551-64c99ace4cee tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1281 microversion: 2.1 time: 0.243098 Oct 13 08:44:49.707186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1536/2858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:49 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:49.729110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:49.738923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:49.748468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Searching by: {'deleted': False, 'project_id': 'ca51c3078db54e67922de8010252af65'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:44:49.756094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.757690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.759104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.760923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:49.762063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:49.762728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:49.878453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:44:50.117307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:50.131984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:50.134953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:50.135662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:50.748454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ba945a0-47e7-4e3d-9904-45037bebcce1 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.039081 Oct 13 08:44:50.749860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1537/2859] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:44:49 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:50.760228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1e113df-6d0c-45f5-9611-11aed7af1b36 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] Calling method '.version_select at 0x7f5375da0040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:50.779859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b1e113df-6d0c-45f5-9611-11aed7af1b36 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1e113df-6d0c-45f5-9611-11aed7af1b36 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] Request method failure captured: Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-simple-tenant-usage/12c81af09fcd4703a95d705f1a24fdb7?start=2022-10-14T08%3A44%3A48.756350&end=2022-10-12T08%3A44%3A48.756350 HTTP/1.1 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9AA0b4K0ndMT8-_Nk4KP0E_iVOyUMFoCgCPh0vWerBWC_uXim6AU_5GFp0vpH8ywI-eRRzA6BS2FEzIhV_-vGOXoHxGsZc2S0Vtqi5obY9VHjOMuIMNC2N24xADp1ZvfOEAdzDA-uh5x4aw9_k_frAL5ZjhGqj7DrLoAhddQVI-efs Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2dbdf0cf62c743529ddece9de1e735f7 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-140942735 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2dbdf0cf62c743529ddece9de1e735f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2dbdf0cf62c743529ddece9de1e735f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2dbdf0cf62c743529ddece9de1e735f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2dbdf0cf62c743529ddece9de1e735f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-140942735 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2dbdf0cf62c743529ddece9de1e735f7 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-140942735 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TenantUsagesNegativeTestJSON-140942735-project-admin Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6bab040f8fd14f409f05605e3923bec8 Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-140942735-project-admin Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid start time. The start time cannot occur after the end time. Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '12c81af09fcd4703a95d705f1a24fdb7'} Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 13 08:44:50.790194 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:50.796009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1e113df-6d0c-45f5-9611-11aed7af1b36 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:50.799653 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b1e113df-6d0c-45f5-9611-11aed7af1b36 tempest-TenantUsagesNegativeTestJSON-140942735 tempest-TenantUsagesNegativeTestJSON-140942735-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/12c81af09fcd4703a95d705f1a24fdb7?start=2022-10-14T08%3A44%3A48.756350&end=2022-10-12T08%3A44%3A48.756350" status: 400 len: 111 microversion: 2.1 time: 0.043786 Oct 13 08:44:50.806139 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1538/2860] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Oct 13 08:44:50 2022] GET /compute/v2.1/os-simple-tenant-usage/12c81af09fcd4703a95d705f1a24fdb7?start=2022-10-14T08%3A44%3A48.756350&end=2022-10-12T08%3A44%3A48.756350 => generated 111 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:44:50.811540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:50.821780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:50.836136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:50.841133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:50.842286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:50.843081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:50.844042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:50.850153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:50.851568 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9cd433a6-68ef-4ae2-9d0f-2cc00753ca78 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 1.483992 Oct 13 08:44:50.852168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:50.877588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1323/2861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:49 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:50.897366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0e90054-bbe2-44ed-9e02-f168b0a07ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e67790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:50.907481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:50.986049 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0e90054-bbe2-44ed-9e02-f168b0a07ccb tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.105535 Oct 13 08:44:50.986863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1324/2862] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:50 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:50.993372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "1a9c62f1-0d81-4738-8c18-8f3da7ebbc42"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:51.006687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:51.009420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:51.016906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:51.053671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] Creating event network-vif-plugged:1a9c62f1-0d81-4738-8c18-8f3da7ebbc42 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:51.077109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0dc60455-bc88-4b15-b4f5-27049722c734 req-8deb9725-fa39-4376-aa2a-1152eaec29e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086441 Oct 13 08:44:51.081062 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1325/2863] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:51.098579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:51.103018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:51.120462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:51.125942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:51.127846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:51.129713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:51.132023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:51.134368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:51.135863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:51.385307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:51.396578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:51.402314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:51.407942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dcc22b77-8533-41b2-a49c-7bb67f029d66 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.600342 Oct 13 08:44:51.436322 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1539/2864] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:50 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:51.445832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:51.446869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:51.454017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:51.455494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:51.456175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:51.457118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:51.458230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:51.461420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:52.076049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:52.092545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b90286b4-012c-4c3e-b6ba-e3a4a7b5f7ae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 1.008681 Oct 13 08:44:52.097605 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1326/2865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:51 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:52.127101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:52.128503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:52.135842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:52.136878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:52.137614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:52.138245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:52.139364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:52.139970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:52.142703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:52.153942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:52.160204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:52.162869 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a39e7fdc-cf40-48fc-9075-ea73a9d9ee3f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.724213 Oct 13 08:44:52.185165 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1540/2866] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:51 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:52.197185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dba7ae74-6568-40bb-85ef-89f90d5ae959 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:52.212717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dba7ae74-6568-40bb-85ef-89f90d5ae959 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025582 Oct 13 08:44:52.217273 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1541/2867] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:44:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:52.438747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-708e074b-98c7-4a81-aa36-a79fc49cadc2 tempest-TenantUsagesNegativeTestJSON-1672139933 tempest-TenantUsagesNegativeTestJSON-1672139933-project] Calling method '.version_select at 0x7f5375da09d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:52.443636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-708e074b-98c7-4a81-aa36-a79fc49cadc2 tempest-TenantUsagesNegativeTestJSON-1672139933 tempest-TenantUsagesNegativeTestJSON-1672139933-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f28f9569c4614813a58c3ed551a604f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c81af09fcd4703a95d705f1a24fdb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-708e074b-98c7-4a81-aa36-a79fc49cadc2 tempest-TenantUsagesNegativeTestJSON-1672139933 tempest-TenantUsagesNegativeTestJSON-1672139933-project] Request method failure captured: Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-12T08%3A44%3A48.756350&end=2022-10-14T08%3A44%3A48.756350&detailed=1 HTTP/1.1 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_-gXUyScnuSx5mqxOPrD_Ymv-G1OrqCGWd_5kalRpsphy_e06i1flGtUcPnxYj51hUP9jbCzghMSe4V5VKW3_258mVMyQPlPD4bu4QTBa8OwZuDFv6yle08Di7-DiuXTcq5QYEwGrOIQfnJVb-fCyX2w50oxA71n6wwVCxvTkBv9U Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 12c81af09fcd4703a95d705f1a24fdb7 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1672139933 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12c81af09fcd4703a95d705f1a24fdb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_12c81af09fcd4703a95d705f1a24fdb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/12c81af09fcd4703a95d705f1a24fdb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/12c81af09fcd4703a95d705f1a24fdb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1672139933 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 12c81af09fcd4703a95d705f1a24fdb7 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1672139933 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TenantUsagesNegativeTestJSON-1672139933-project Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f28f9569c4614813a58c3ed551a604f5 Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1672139933-project Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise self.value Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 13 08:44:52.449613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 13 08:44:52.453951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:52.455957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-708e074b-98c7-4a81-aa36-a79fc49cadc2 tempest-TenantUsagesNegativeTestJSON-1672139933 tempest-TenantUsagesNegativeTestJSON-1672139933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:52.459378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-708e074b-98c7-4a81-aa36-a79fc49cadc2 tempest-TenantUsagesNegativeTestJSON-1672139933 tempest-TenantUsagesNegativeTestJSON-1672139933-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-12T08%3A44%3A48.756350&end=2022-10-14T08%3A44%3A48.756350&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.235317 Oct 13 08:44:52.460304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1542/2868] 10.222.0.23 () {58 vars in 1335 bytes} [Thu Oct 13 08:44:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-12T08%3A44%3A48.756350&end=2022-10-14T08%3A44%3A48.756350&detailed=1 => generated 123 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:52.484339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:52.485957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:52.506274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:52.509681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:52.510394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:52.511397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:52.514175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:52.518355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.028623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:53.048549 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-420a4f09-ee8b-4d9d-8a2e-c3af72e0ca0d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.948616 Oct 13 08:44:53.050855 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1327/2869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:52 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:53.083067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74ff006b-6027-4128-9567-fa3cd7a4b4b2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d03550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:53.216201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74ff006b-6027-4128-9567-fa3cd7a4b4b2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.163279 Oct 13 08:44:53.218487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1328/2870] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:53 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:53.268623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:53.272876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:53.304990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.308833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.309309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.310057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.317974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.318777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.688083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:53.699009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53cefb66-f882-493b-b07d-4e8386feee85 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 1.235911 Oct 13 08:44:53.700163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1543/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:52 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:53.705534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:53.706208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:53.717215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.717993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.718619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.719634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.720237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.720812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.763029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:44:53.902449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:53.928235 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f763602e-bac4-45dc-a494-773d8683b384 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 204 len: 0 microversion: 2.1 time: 0.225416 Oct 13 08:44:53.929192 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1544/2872] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:44:53 2022] DELETE /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:44:53.936455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:53.940237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:53.940771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:53.942007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:53.949330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2ad46c4-55cc-4380-ac52-18584ff87f1f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.709127 Oct 13 08:44:53.952583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.952817 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1329/2873] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:53 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:53.953685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.954332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.955382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:53.956113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:53.957439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:53.975752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "c555c149-900f-4cd7-9963-b628600fa2f2"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "30cd392f-108c-4baf-b95e-e57d29d1dff1"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "20b58af7-2f8f-4193-b395-e685103fc228"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:54.011161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.013721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.014331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.045414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Creating event network-vif-plugged:c555c149-900f-4cd7-9963-b628600fa2f2 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:54.050704 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Creating event network-vif-plugged:30cd392f-108c-4baf-b95e-e57d29d1dff1 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:54.051489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Creating event network-vif-plugged:2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:54.052208 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] Creating event network-vif-plugged:20b58af7-2f8f-4193-b395-e685103fc228 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:54.070594 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c8584a5c-4784-4b44-a9f4-69a3f3caf26e req-6ea96305-c45d-491e-888f-7fa2530f7d4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.114888 Oct 13 08:44:54.072038 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1330/2874] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:54.085087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:54.090275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:54.100685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.101478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.102662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.103577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.104231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.104892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.331434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:54.343801 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdaca130-e043-4f90-82c8-53a580804d2b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.412542 Oct 13 08:44:54.344430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1545/2875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:53 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:54.593558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da36532e-130e-4b35-95fe-622a63f06f75", "tag": "408f171a-6c25-442f-9a04-da273a4ae8f9"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:54.611966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.614191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.616613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.642207 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] Creating event network-changed:408f171a-6c25-442f-9a04-da273a4ae8f9 for instance da36532e-130e-4b35-95fe-622a63f06f75 on n-h2-858384-11 Oct 13 08:44:54.649912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c2455b7d-847a-4952-9fe5-6ba00881cc4e req-4122994d-3b58-4ef8-8e3e-bfb274c34283 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285066 Oct 13 08:44:54.651979 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1546/2876] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:54.661914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:54.665157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:54.681768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.682901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.683568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.684522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.685197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.685848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.905125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:54.916357 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17059c7d-ceb1-444b-9ac0-f5d88f22928c tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1714 microversion: 2.1 time: 0.261419 Oct 13 08:44:54.916648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1547/2877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:54 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1714 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:54.941121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:54.942301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:54.960187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.960871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.961497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:54.962890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:54.963449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:54.969840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.144511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.154868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.165885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.167433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27e395dd-286b-4140-b70e-238ab6330333 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 1.093606 Oct 13 08:44:55.168175 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1331/2878] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:54 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:55.178747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1907bf6-68f8-490a-b6d8-cf139ea1aeab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d18430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:55.251997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1907bf6-68f8-490a-b6d8-cf139ea1aeab tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.082039 Oct 13 08:44:55.253143 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1332/2879] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:55 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:55.384085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707c9f64-eef3-4e91-bd32-6b3b44501e27", "tag": "1441e9d1-43fb-4c2f-9b29-931cda4e0b52"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:55.422460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.430375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.431182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.431631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.449037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e1db839-efe4-4c9c-b2b7-433870376352 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.530660 Oct 13 08:44:55.451802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1548/2880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:54 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:55.457087 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] Creating event network-changed:1441e9d1-43fb-4c2f-9b29-931cda4e0b52 for instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 on n-h1-858384-11 Oct 13 08:44:55.464613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-27c865aa-0ea1-4076-8328-86d56abf51b8 req-455c929e-a0d7-4a42-9758-7dcca99d5fb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209557 Oct 13 08:44:55.465806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1333/2881] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:55.469373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:55.471759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:55.473352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:55.474273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:55.481528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:55.485445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.486149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.486827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.487708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.488313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.488888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.490480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.494977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.499618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.503755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.506041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.512583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.724853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.734305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.736220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:55.737517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c48e1a1-4f3b-4b66-a7b8-d438aca66532 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.270283 Oct 13 08:44:55.755863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1334/2882] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:55 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:55.763700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:55.764668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:55.771877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.772607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.773330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:55.774919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:55.775958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:55.776560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.009826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:56.020064 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-06c443d7-276d-4b93-a176-8d5ba72bdf46 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.260434 Oct 13 08:44:56.021111 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1335/2883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:55 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:56.029445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:56.030283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:56.071312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.073324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.074043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.076538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.077561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.079176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.187268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:56.199526 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f934d775-1bcb-42fb-ae24-edef19b1f6d9 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.745601 Oct 13 08:44:56.202659 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1549/2884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:55 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:56.218724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "a7646a49-4932-4e96-9768-399f7f89cd01"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-plugged", "status": "completed", "tag": "9e59f91f-f260-4ff8-9bce-6f8a3a6619ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:56.245154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.245833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.247294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.270908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Creating event network-vif-plugged:a7646a49-4932-4e96-9768-399f7f89cd01 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:56.275543 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] Creating event network-vif-plugged:9e59f91f-f260-4ff8-9bce-6f8a3a6619ab for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:44:56.291225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3138835d-015b-477a-be56-301be3fd1255 req-4d4db7d1-d474-44dd-b44c-7be32e160345 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087097 Oct 13 08:44:56.294439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1550/2885] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:56.315748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:56.326433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:56.345234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.345892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.346462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.347540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.348232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.348881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.451541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:56.468769 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0889208-10ee-458d-b35b-b5b235d0f9da tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1714 microversion: 2.1 time: 0.445491 Oct 13 08:44:56.473121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1336/2886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:56 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1714 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:56.484134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9ff298c6-61ed-4559-be27-c8508726bc19 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d83310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:56.583321 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9ff298c6-61ed-4559-be27-c8508726bc19 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.108469 Oct 13 08:44:56.599121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1337/2887] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:56 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:56.613631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:56.617185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:56.632414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.634612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.635074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.635802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.636265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.636692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:56.935700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:56.954721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4bdf5977-1f61-4941-923d-6d001ed370e4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.354169 Oct 13 08:44:56.955661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1338/2888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:56 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:56.961308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be0b56b-fff4-4ae1-94cf-34cb3849cc35", "tag": "afcaf5ce-db12-4687-bd06-f8a163815bdb"}, {"name": "network-changed", "server_uuid": "dcaad3ad-ed17-4741-9e03-5e7ced47ecdc", "tag": "7239aa63-4869-413c-9a36-a17a519f08b0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:56.988332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:56.989155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:56.989592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.022041 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Creating event network-changed:afcaf5ce-db12-4687-bd06-f8a163815bdb for instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 on n-h2-858384-11 Oct 13 08:44:57.023013 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] Creating event network-changed:7239aa63-4869-413c-9a36-a17a519f08b0 for instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc on n-h2-858384-11 Oct 13 08:44:57.033867 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-51167184-d672-47cc-baa9-54f69604a3e9 req-18b38125-b0ac-426f-a6ab-253de40a4943 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076634 Oct 13 08:44:57.035327 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1339/2889] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:57.053334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:57.054275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:57.066312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.067032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:57.067482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.068445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.070057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.071946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.072559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.091758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:57.093500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:57.094753 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0cca879d-ef48-4071-8b75-d6c1c21192f3 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.798974 Oct 13 08:44:57.102860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1551/2890] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:56 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:57.108540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:57.109166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:57.137805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.138698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.140844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.143320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.143969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.146003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.804851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:57.815007 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-574cf3f3-73d9-4aa4-8907-c9dfcaaec89c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.710770 Oct 13 08:44:57.817211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1552/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:57 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:57.822055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:57.829487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:57.849610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.850149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.850826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:57.854537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:57.855223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:57.855844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.238033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.248888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.251032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.252370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50a46cee-2977-4418-9717-2484721c51fc tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 1.213753 Oct 13 08:44:58.253686 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1340/2892] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:57 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:58.280601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.281349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:58.282149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:58.290494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.291426 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b63033c7-6dfe-41ef-84b3-973d7d9c7109 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.472996 Oct 13 08:44:58.291816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.292263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.295448 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1553/2893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:57 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:58.304753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9c33790-385c-4146-b5b1-a7f0e323022d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c25b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:58.307180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.308427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.308884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.377876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.379135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.379751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.380509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lazy-loading 'fault' on Instance uuid c73432ae-4506-48e7-9960-3d508cc87466 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:44:58.391857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9c33790-385c-4146-b5b1-a7f0e323022d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.095074 Oct 13 08:44:58.392999 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1554/2894] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:58 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:58.399617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73432ae-4506-48e7-9960-3d508cc87466", "name": "network-vif-deleted", "tag": "55c6c62b-acf1-448d-bf9c-f5c86bfb98ef"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:44:58.424766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:58.427068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.432517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.433157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.459593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] Creating event network-vif-deleted:55c6c62b-acf1-448d-bf9c-f5c86bfb98ef for instance c73432ae-4506-48e7-9960-3d508cc87466 on n-h1-858384-11 Oct 13 08:44:58.484213 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6e328173-9b2c-46ae-8fbb-8309cb3efb43 req-5f0fcc66-3ff5-427b-bf4c-cac523f04662 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082880 Oct 13 08:44:58.485159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1555/2895] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:44:58.494075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:58.498150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:58.512364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.512876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.513342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.516311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.516793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.517254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.522503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3e098bbf154c738772f3decbb01ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca51c3078db54e67922de8010252af65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.540426 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-919d80b4-9d6b-4bb1-a119-de5b88cf7d27 tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 200 len: 1366 microversion: 2.1 time: 0.259878 Oct 13 08:44:58.558709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1341/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:58 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:58.564631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:58.573450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:58.589429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.591998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.592669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.593567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.595491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.597514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.911560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:58.921393 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e7a9dde-8e18-4554-a4b7-057e5203cf72 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.434771 Oct 13 08:44:58.927085 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1556/2897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:58 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:58.946890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:58.947760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:58.959325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.978726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.979749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:58.980539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:58.984666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:58.985131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.246181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:59.247465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.253417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.263480 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-490cb665-aa7e-4b6a-9331-b5850dcc4179 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.332673 Oct 13 08:44:59.266269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:59.266466 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1557/2898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:58 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:59.276693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.281211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.284215 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3fe48eb-7501-4cdc-9f1f-69506f00b56e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1878 microversion: 2.32 time: 0.723363 Oct 13 08:44:59.300666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.301054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1342/2899] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:58 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1878 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:59.314344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:59.321653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.322553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:59.334320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.336924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.338661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.341348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.342120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.343263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.345396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.346394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.349931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.366547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.367358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.367996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.651299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.670688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.674990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:44:59.679578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c685a605-cde7-40fa-a03d-b502014c067f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.398035 Oct 13 08:44:59.683085 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1558/2900] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:44:59 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:44:59.701733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d64b610b-acc9-4687-9786-6b4294ec1dba tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c38d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.807170 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d64b610b-acc9-4687-9786-6b4294ec1dba tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.122321 Oct 13 08:44:59.815752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1559/2901] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:44:59 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:44:59.826763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.828036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] [instance: c73432ae-4506-48e7-9960-3d508cc87466] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:59.835181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:44:59.837714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.838376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.839123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.840030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.840649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.841747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.865995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] HTTP exception thrown: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Request method failure captured: Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 HTTP/1.1 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-7e4hDU5RWdkU5r1pqCFzCzLhxRfEGhtdT33RnOIYZ5xKvO9ou1jb7drVwsPZH26zrQXDrWIJJlRl2KSVjbhay3WJyuLYWZya2s6qyExLRBPoRPMd17s1qbXvEyHHMcLLdnyxaLN4Dsh6ihpmYaM7M0g5ZZMrH_h2miz_hkATNcFQ Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ca51c3078db54e67922de8010252af65 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestManualDisk-2024186118 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51c3078db54e67922de8010252af65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca51c3078db54e67922de8010252af65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca51c3078db54e67922de8010252af65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca51c3078db54e67922de8010252af65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestManualDisk-2024186118 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ca51c3078db54e67922de8010252af65 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestManualDisk-2024186118 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestManualDisk-2024186118-project Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ba3e098bbf154c738772f3decbb01ad8 Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestManualDisk-2024186118-project Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c73432ae-4506-48e7-9960-3d508cc87466'} Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:44:59.868650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. Oct 13 08:44:59.873072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:44:59.875098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Returning 404 to user: Instance c73432ae-4506-48e7-9960-3d508cc87466 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:44:59.876257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fda9dc27-577b-4b6b-a9dc-d3a9277269ec tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466" status: 404 len: 111 microversion: 2.1 time: 0.059202 Oct 13 08:44:59.877420 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1560/2902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:59 2022] GET /compute/v2.1/servers/c73432ae-4506-48e7-9960-3d508cc87466 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:44:59.888542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42080abc-dd10-4447-aca3-1582195e449e tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] Calling method '.version_select at 0x7f5375c25430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.927401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42080abc-dd10-4447-aca3-1582195e449e tempest-ServersTestManualDisk-2024186118 tempest-ServersTestManualDisk-2024186118-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177167479" status: 202 len: 0 microversion: 2.1 time: 0.043598 Oct 13 08:44:59.929173 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1561/2903] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177167479 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:44:59.950297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:44:59.951161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:44:59.965277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.965793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.968715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.975000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:44:59.975568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:44:59.980386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:44:59.993696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:00.108496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=14 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:00.456080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:00.466417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:00.472676 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7fd231a-7b2f-4837-99a4-dd743baeafc6 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 1.149044 Oct 13 08:45:00.486592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d55589d6-4bb0-41c1-9f96-753987129288 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.540709 Oct 13 08:45:00.489873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1562/2904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:59 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:00.492148 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1343/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:44:59 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:00.518477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:00.526384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:00.526726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da36532e-130e-4b35-95fe-622a63f06f75", "name": "network-vif-plugged", "status": "completed", "tag": "408f171a-6c25-442f-9a04-da273a4ae8f9"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:00.536090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:00.536881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:00.537498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:00.538381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:00.550053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:00.552355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:00.562002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:00.562833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:00.563998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:00.584222 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] Creating event network-vif-plugged:408f171a-6c25-442f-9a04-da273a4ae8f9 for instance da36532e-130e-4b35-95fe-622a63f06f75 on n-h2-858384-11 Oct 13 08:45:00.593904 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-42a6b9ce-9d60-4c66-b12c-60c5ecce6930 req-2493ec78-9cda-4fb8-be18-de4c5926122e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084366 Oct 13 08:45:00.595163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1563/2906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:00.602200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:00.603439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:00.611493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:00.612257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:00.613155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:00.614026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:00.614692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:00.615368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.144767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.167404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.169924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.171724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b768ce95-6c9f-4e33-b2b6-5af2d2c882da tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2829 microversion: 2.32 time: 0.575130 Oct 13 08:45:01.173153 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1564/2907] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:00 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2829 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:01.181086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:01.182520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:01.192975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.193717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.194375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.195405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.196118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.196782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.371730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.381476 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0ab96d2-02ef-4c74-a8ae-5526e1315330 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.884083 Oct 13 08:45:01.387768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1344/2908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:00 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:01.406201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c8fb5ec-c645-4fcb-9091-e804d0547b56 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cd3040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:01.486125 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c8fb5ec-c645-4fcb-9091-e804d0547b56 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.096449 Oct 13 08:45:01.509738 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1345/2909] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:01 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:01.515133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:01.517905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:01.529892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.530735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.531333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.532213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.532827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.533414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.543236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.553245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.557612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:01.561834 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f43898cd-28cd-476a-a916-f6545b9e75b5 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.387324 Oct 13 08:45:01.569623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1565/2910] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:01 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:01.575271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:01.579225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:01.593930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.594721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.595355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.599752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.600609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.601222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.813839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-599931e8-1637-4222-b62c-4c798bcccc1d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.302652 Oct 13 08:45:01.814464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1346/2911] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:45:01 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6/os-interface => generated 1830 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:01.820132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:01.820841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:01.840418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.840931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.841381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:01.842107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:01.842597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:01.843028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:02.257774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:02.266722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e112b21-ff4b-4975-a134-faa1872c77bc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.451088 Oct 13 08:45:02.271855 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1347/2912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:01 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:02.359373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:02.374446 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bceae851-a48e-4c71-903e-f2939ecdf52e tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.801215 Oct 13 08:45:02.375725 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1566/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:01 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:02.409260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:02.409883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:02.420304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:02.420803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:02.421245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:02.421957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:02.422432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:02.422870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:02.503687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3e0ff55-6b6d-4e1a-bab4-3155f6ef4b2e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dee700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:02.583823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3e0ff55-6b6d-4e1a-bab4-3155f6ef4b2e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1455 microversion: 2.1 time: 0.084251 Oct 13 08:45:02.595562 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1567/2914] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:02 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:02.614278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:02.615785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:02.634367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:02.636050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:02.638320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:02.640764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:02.642509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:02.643124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.063305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.087025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.088514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.089660 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-efa5c131-b4d1-4b93-b162-993656bbb4e9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.492610 Oct 13 08:45:03.095061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1568/2915] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:02 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:03.114829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c9f64-eef3-4e91-bd32-6b3b44501e27", "name": "network-vif-plugged", "status": "completed", "tag": "1441e9d1-43fb-4c2f-9b29-931cda4e0b52"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:03.125445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.128997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.129578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.130018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.134239 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f73430e8-3ee6-45da-bd8c-7775229370cc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.728919 Oct 13 08:45:03.139068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1348/2916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:02 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:03.148934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] Creating event network-vif-plugged:1441e9d1-43fb-4c2f-9b29-931cda4e0b52 for instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 on n-h1-858384-11 Oct 13 08:45:03.167240 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6016f43d-a7e4-4044-af76-a4adab3ce72d req-692779dd-2432-4ec4-84d7-9244daf1b39f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075071 Oct 13 08:45:03.168421 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1569/2917] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:03.296477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:03.297100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:03.308052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.308462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.308910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.315225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.318653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.319189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.400003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:03.400749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:03.411685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.412171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.418699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.419890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.420529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.421120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.737620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.757276 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbecca18-cd7b-4061-a7f7-9838b2679efa tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.362176 Oct 13 08:45:03.765570 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1570/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:03 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:03.771995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44a35bc0-a79b-4728-b26b-3a5dc7255978 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d58790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:03.839587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44a35bc0-a79b-4728-b26b-3a5dc7255978 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1464 microversion: 2.1 time: 0.072146 Oct 13 08:45:03.848904 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1571/2919] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:03 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:03.854505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84e0068d-8e21-43de-b956-8a7b4541c18c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d5e1f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:03.867870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:03.876887 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4019e40-6b1d-45df-b3c4-b29233b16ad2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1323 microversion: 2.1 time: 0.584924 Oct 13 08:45:03.887673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1349/2920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:03 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:03.907415 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84e0068d-8e21-43de-b956-8a7b4541c18c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 200 len: 1464 microversion: 2.1 time: 0.057150 Oct 13 08:45:03.908114 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1572/2921] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:03 2022] GET /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 1464 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:03.922249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:03.922904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:03.930424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.931120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.931964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:03.932832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:03.933292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:03.933780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.121631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:04.122253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:04.139604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.140099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.140543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.141637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.142101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.142769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.393961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:04.404741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:04.407705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:04.408825 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5fcc8e33-75b9-4acc-8cac-1d4549c9367e tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1358 microversion: 2.21 time: 0.292313 Oct 13 08:45:04.415068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1573/2922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:04 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:45:04.424237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:04.424879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:04.445489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.446031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.446519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.447255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.447901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.448494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.737217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:04.752590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0972a933-a371-4c89-83ff-e42268baef98 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.335899 Oct 13 08:45:04.753346 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1574/2923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:04 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:04.784339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:04.804907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:04.826883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.828904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.830999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.835509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.840740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:04.856294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.856862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.858012 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3716ef70-180e-4362-82e5-fbd21cab4ec4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1466 microversion: 2.1 time: 0.939042 Oct 13 08:45:04.860189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1350/2924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:03 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1466 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:04.885071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1591230479"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:04.887904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:04.894743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.895578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.896287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:04.897189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:04.898110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:04.899252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:05.341987 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47763ad9-e251-4212-b9f9-080bf2c8fd79 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "POST /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249/action" status: 202 len: 0 microversion: 2.1 time: 0.460968 Oct 13 08:45:05.348748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1351/2925] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:45:04 2022] POST /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:45:05.369857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:05.371093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:05.387676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:05.389174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:05.390155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:05.391634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:05.393562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:05.394637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:05.482916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:05.495171 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-920ed9f2-d19c-49de-ab19-a750a1de0ab1 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.716394 Oct 13 08:45:05.510439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1575/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:04 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:05.515731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be0b56b-fff4-4ae1-94cf-34cb3849cc35", "name": "network-vif-plugged", "status": "completed", "tag": "afcaf5ce-db12-4687-bd06-f8a163815bdb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:05.549582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:05.550976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:05.551664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:05.566787 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] Creating event network-vif-plugged:afcaf5ce-db12-4687-bd06-f8a163815bdb for instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 on n-h2-858384-11 Oct 13 08:45:05.572394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bb9e2744-838f-4939-9b16-849fadcaa835 req-6ee68594-1922-4d0f-93c4-bd638fcc20e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070897 Oct 13 08:45:05.573751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1576/2927] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:05.584834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-649a33f5-fbef-46dc-a8cd-9a7afa7c626f tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dee700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:05.654714 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-649a33f5-fbef-46dc-a8cd-9a7afa7c626f tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.079327 Oct 13 08:45:05.657702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1577/2928] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:05 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:05.667361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:05.668415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:05.675788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:05.678606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:05.679278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:05.682976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:05.683848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:05.684810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.042617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.060105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.061795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.063064 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ab0afeb-09c2-46a0-960c-956a42650a6c tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1552 microversion: 2.21 time: 0.404176 Oct 13 08:45:06.084110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1578/2929] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:05 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1552 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:06.089928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:06.090439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:06.099324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.099819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.100291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.100968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.102132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.102601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.337678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.341105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.351331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e25b6f4-3b25-46b0-aff0-209b57bfa106 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.997426 Oct 13 08:45:06.351905 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75184839-b388-4ac3-a84a-bcd639041520 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.266110 Oct 13 08:45:06.352112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1579/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:06 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:06.353185 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1352/2931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:05 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:06.380052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:06.381125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:06.388644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.389490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.390219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.392764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.393419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.394519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.400439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:06.401073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:06.427961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.428757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.429329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.431243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.431811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.432339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.491845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:45:06.647405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd266abe-671c-49dc-b652-7aa08d635686 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 204 len: 0 microversion: 2.21 time: 0.261486 Oct 13 08:45:06.651040 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1580/2932] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:45:06 2022] DELETE /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:45:06.669806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:06.670495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:06.681265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.681769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.682214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.689182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.689847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.690646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.913875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:06.923049 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75fc0e8c-73d6-460b-84dc-9ee54c7aee4d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.547453 Oct 13 08:45:06.935031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1353/2933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:06 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:06.944243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:06.944243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:06.959841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.963515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.964242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:06.965218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:06.965914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:06.966601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.432654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:07.450836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:07.453690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:07.455191 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-24bd9a02-9bcd-44ba-a22a-3d3c2bab544f tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1558 microversion: 2.21 time: 0.519221 Oct 13 08:45:07.455976 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1354/2934] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:06 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1558 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:07.461099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:07.470915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-562b77c8-ccb1-4cbd-838f-758397e6bd55 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cd3280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:07.474969 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae566c80-6887-4cb0-9980-898ac9e4c7ab tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.822465 Oct 13 08:45:07.475829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1581/2935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:06 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:07.501759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "tag": "c555c149-900f-4cd7-9963-b628600fa2f2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:07.518600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:07.519389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:07.519830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.535752 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] Creating event network-changed:c555c149-900f-4cd7-9963-b628600fa2f2 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:45:07.542220 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-127cc3bd-ce9c-43a6-9b02-5e832fe0502e req-02ca71d8-c25b-48ef-9f23-3ffb6043112f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048163 Oct 13 08:45:07.542865 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1582/2936] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:07.548461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4a5b890-7ae6-4679-b602-bfe8fe8a1641 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-310144790", "metadata": {"": ""}}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:07.552484 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-562b77c8-ccb1-4cbd-838f-758397e6bd55 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.094944 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4a5b890-7ae6-4679-b602-bfe8fe8a1641 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action HTTP/1.1 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 106 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-310144790", "metadata": {"": ""}}} Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-310144790', 'metadata': {'': ''}}}} Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'': ''} Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:07.553097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:07.557850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:07.559058 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1355/2937] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:07 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:07.560290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:07.560717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4a5b890-7ae6-4679-b602-bfe8fe8a1641 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:07.561735 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4a5b890-7ae6-4679-b602-bfe8fe8a1641 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action" status: 400 len: 170 microversion: 2.1 time: 0.017701 Oct 13 08:45:07.562786 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1583/2938] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Oct 13 08:45:07 2022] POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:07.569608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:07.576968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:07.577833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:07.588107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:07.588814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:07.589411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.591250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:07.592171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:07.592769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.601244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:07.605811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:07.606354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.607318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:07.607808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:07.608249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:07.965140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:07.969695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:07.986169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15a70658-b33c-4cce-84f7-d12207810b35 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.418564 Oct 13 08:45:08.002444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1584/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:07 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:08.002444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaad3ad-ed17-4741-9e03-5e7ced47ecdc", "name": "network-vif-plugged", "status": "completed", "tag": "7239aa63-4869-413c-9a36-a17a519f08b0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:08.031459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.031969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.032429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.086726 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] Creating event network-vif-plugged:7239aa63-4869-413c-9a36-a17a519f08b0 for instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc on n-h2-858384-11 Oct 13 08:45:08.113025 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1c55f316-f161-4140-931d-865e2d1e3ef4 req-e6d61ad8-f180-42e1-b754-e443516ca9a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117989 Oct 13 08:45:08.113866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1585/2940] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:08.133957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:08.134774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:08.150776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.152405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.153019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.153779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.154243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.154983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.413068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:08.422229 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac5200ca-73b3-443c-8507-2d9cd0ffa85c tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.307350 Oct 13 08:45:08.427820 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1586/2941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:08 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:08.457323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dece298-3f15-4729-8dea-d7f3dc6df9b8 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-112757281", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dece298-3f15-4729-8dea-d7f3dc6df9b8 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action HTTP/1.1 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 618 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-112757281", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-112757281', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:45:08.472519 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:45:08.475537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:08.482449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dece298-3f15-4729-8dea-d7f3dc6df9b8 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:08.485172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5dece298-3f15-4729-8dea-d7f3dc6df9b8 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action" status: 400 len: 938 microversion: 2.1 time: 0.035557 Oct 13 08:45:08.492365 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1587/2942] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Oct 13 08:45:08 2022] POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action => generated 938 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:08.498260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:08.503956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:08.518100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.524929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.525684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.528467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.529972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.531824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.714944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:08.726896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:08.729238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:08.731043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d070f93-5ed4-4c45-a8a8-b54a7cb64207 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1558 microversion: 2.21 time: 0.237417 Oct 13 08:45:08.732396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1588/2943] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:08 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:08.737620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:08.737900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:08.739456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:08.747743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a994171-d9e8-40e2-8e53-be2f5ee2c57f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 1.193527 Oct 13 08:45:08.749687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.750579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.750849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1356/2944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:07 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:08.751482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.752429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.753096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.753761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.762046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:08.763095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:08.776562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.777127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.778720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:08.781213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:08.781710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:08.783393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.015045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:09.028856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7be9ca42-3039-42a6-95f0-79dd49dd827f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.295002 Oct 13 08:45:09.029466 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1589/2945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:08 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:09.037019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7c62032-5c7c-4f98-9b4c-4f8a496656e8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dbeb80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:09.118097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7c62032-5c7c-4f98-9b4c-4f8a496656e8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.087014 Oct 13 08:45:09.130799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1590/2946] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:09 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:09.136913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:09.137751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:09.148842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.151927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.152529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.155030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.157687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.158343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.245371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:09.255884 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b0d2d9d-13d6-473f-ad99-c2da7e06bd0f tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1317 microversion: 2.1 time: 0.503783 Oct 13 08:45:09.256478 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1357/2947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:08 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:09.437600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:09.452585 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f61dfd28-02ae-4665-a268-6ee5bd4d27f0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.319860 Oct 13 08:45:09.454795 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1591/2948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:09 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:09.480517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6012c56-58e7-4193-b385-9be1205e6909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6012c56-58e7-4193-b385-9be1205e6909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action HTTP/1.1 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 285 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:09.484666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6012c56-58e7-4193-b385-9be1205e6909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:09.491622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6012c56-58e7-4193-b385-9be1205e6909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action" status: 400 len: 619 microversion: 2.1 time: 0.009677 Oct 13 08:45:09.497059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:09.497693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:09.497874 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1358/2949] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Oct 13 08:45:09 2022] POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:09.515073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.515622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.516060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.516862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.517260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.517685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.763512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:09.764892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:09.784045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.784915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.785862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.787235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:09.789362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:09.790071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:09.939881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:09.964911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f14fce56-cf1a-4b2d-83b5-b9f1ea06c539 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.473604 Oct 13 08:45:09.967559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1592/2950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:09 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:09.984844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:09.987920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:10.011782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:10.012303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:10.016413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:10.017457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:10.018108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:10.020460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:10.485558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:10.496191 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-78272ba0-d7e9-4f51-80d6-9ab2e38bd622 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.527059 Oct 13 08:45:10.501676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1593/2951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:09 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:10.522889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:10.524839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:10.531889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:10.532660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:10.533278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:10.534181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:10.534989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:10.535622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:10.749852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:10.766376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:10.774510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:10.779778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86bbe1c7-2a5b-4508-b295-6673f66cea06 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1558 microversion: 2.21 time: 1.020798 Oct 13 08:45:10.782747 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1359/2952] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:09 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1558 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:45:10.796085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f9f6c3-8073-4761-bc2c-c9c23d9f0f1e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cd3160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:10.890429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57f9f6c3-8073-4761-bc2c-c9c23d9f0f1e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.104376 Oct 13 08:45:10.892516 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1360/2953] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:10 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:10.897442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a0d212-9351-44e1-8d91-d957d2fe89e5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:10.921788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:10.926656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:10.927410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:10.953230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] Creating event network-vif-unplugged:b4a0d212-9351-44e1-8d91-d957d2fe89e5 for instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a on n-h1-858384-11 Oct 13 08:45:10.970724 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-389980e4-16ac-495c-9662-d50a788b62b8 req-ca770124-6b70-4e28-9ff6-94db571eb198 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076651 Oct 13 08:45:10.971733 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1361/2954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:10.980287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:10.987588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:10.996485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.003083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.003737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.004724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.005303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.005845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.135387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:11.159501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52337fc6-9a2d-4a2a-9b73-acdca33f628f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.637569 Oct 13 08:45:11.161340 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1594/2955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:10 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:11.190912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-269686294"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:11.194491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:11.210148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.214877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.216085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.217546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.219147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.220346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.359879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:11.374201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f398263-baf2-4484-b39e-02ab570ae223 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1506 microversion: 2.1 time: 0.398442 Oct 13 08:45:11.376623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1362/2956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:10 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:11.525509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:11.526592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:11.543624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.544895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.546020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.546812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.551803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.552006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.577031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:11.718140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd4416b7-740a-4b4e-9daf-6906e1fc8ece tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action" status: 202 len: 0 microversion: 2.1 time: 0.531505 Oct 13 08:45:11.722219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1595/2957] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:45:11 2022] POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:45:11.742546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1264003503"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:11.753277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:11.776870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.777377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.777872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.782779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.789824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.796787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.899561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Cannot 'createImage' instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 while it is in task_state image_snapshot Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action HTTP/1.1 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 85 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1264003503"}} Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'createImage' instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 while it is in task_state image_snapshot Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1264003503'}}} Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:45:11.920572 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 while it is in task_state image_snapshot Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 while it is in task_state image_snapshot Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 409 to user: Cannot 'createImage' instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 while it is in task_state image_snapshot {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a96ec806-3b0d-4c20-9cc8-15d577782bad tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action" status: 409 len: 159 microversion: 2.1 time: 0.187403 Oct 13 08:45:11.925254 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1596/2958] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:45:11 2022] POST /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27/action => generated 159 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:45:11.934295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:11.940060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:11.959465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.964161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.965021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:11.965860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:11.967596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:11.968139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:12.246014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:12.260485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:12.265330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:12.271880 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5afbb27b-0d98-4f9d-8f3b-db3019c93ba6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1293 microversion: 2.1 time: 0.751161 Oct 13 08:45:12.274194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1363/2959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:11 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1293 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:12.277381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:12.281469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2edcf5a8-9b13-484c-993a-bc4167970500 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1516 microversion: 2.21 time: 0.354714 Oct 13 08:45:12.286345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1597/2960] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:11 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:12.294047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa404292-34bc-4a91-818b-19b640595987 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f537aaa4790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:12.306286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92909e6b-e62d-474b-bc2c-c81e0a9ec8e1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cce9d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:12.411917 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-92909e6b-e62d-474b-bc2c-c81e0a9ec8e1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.136417 Oct 13 08:45:12.413063 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1364/2961] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:12 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:12.440720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da36532e-130e-4b35-95fe-622a63f06f75", "name": "network-vif-deleted", "tag": "408f171a-6c25-442f-9a04-da273a4ae8f9"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:12.481664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:12.485357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:12.485995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:12.536592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] Creating event network-vif-deleted:408f171a-6c25-442f-9a04-da273a4ae8f9 for instance da36532e-130e-4b35-95fe-622a63f06f75 on n-h2-858384-11 Oct 13 08:45:12.558076 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-7e85c62f-47a8-476f-ac2b-2255d0ac56a7 req-072f2485-099b-4ee5-8c6d-7f41f43103df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131670 Oct 13 08:45:12.558811 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1365/2962] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:12.626758 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa404292-34bc-4a91-818b-19b640595987 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/images/9c54a8bc-184a-406a-9052-a172a55fff7b" status: 204 len: 0 microversion: 2.1 time: 0.336790 Oct 13 08:45:12.627571 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1598/2963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:12 2022] DELETE /compute/v2.1/images/9c54a8bc-184a-406a-9052-a172a55fff7b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:45:12.641960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:12.643038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:12.661356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:12.662315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:12.664994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:12.666173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:12.669082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:12.669707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.156334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:13.170523 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7a45def4-6f78-4c23-a6db-1c95b10abcdd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1531 microversion: 2.1 time: 0.536597 Oct 13 08:45:13.172390 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1366/2964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:12 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1531 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:13.311014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:13.311692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:13.312043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:13.312222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:13.321297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:13.324197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:13.325188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.326436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:13.328830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:13.329624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:13.330728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:13.334042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.334515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.335368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:13.337321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:13.339789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.414903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:13.415944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:13.417341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:13.418082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lazy-loading 'fault' on Instance uuid da36532e-130e-4b35-95fe-622a63f06f75 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:45:13.744463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:13.760904 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-953be891-b312-4b2d-bc10-b95f9636eafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1474 microversion: 2.1 time: 0.453799 Oct 13 08:45:13.761489 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1599/2965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:13 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1474 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:13.775249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7967ca3-e285-4710-bc42-9602e36b1338 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dddca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:13.855656 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7967ca3-e285-4710-bc42-9602e36b1338 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.090655 Oct 13 08:45:13.864400 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1600/2966] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:13 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:13.960507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1361323795", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:14.048001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:45:14.306722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:14.315853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:14.324217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '684f0d06e83b4ce4a3de8946f517131a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9260b44756a44338937ff836808535f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:14.326018 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38cea61e-eb5a-4d44-98e7-eb73c9b397b9 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 200 len: 1348 microversion: 2.21 time: 1.019088 Oct 13 08:45:14.329199 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1367/2967] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:13 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 1348 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:14.336268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "63003b48-c261-4c03-9769-184e4ca693e4"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:14.345818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:14.364183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:14.366763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:14.367388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:14.369138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:14.369619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:14.373109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:14.469877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] HTTP exception thrown: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Request method failure captured: Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: request: PUT /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35/os-volume_attachments/01033095-f499-44c9-a449-def4261086b3 HTTP/1.1 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 74 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8-Jdl48zR_Pj6bim07B3-ypFwv4_o9B66N38x077eu6N1_8tOmdqORMWTnWLFATL43pVZeWqdSupLUCeDmjQz8sa-4H8_sd_cihgRpsSO-i4-098VKVgOTu7lmI-DNos-MoTMFXd96VZNciz3OVTzcfMgSgFmrGxa7EoS9aaS3AeW4 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 96ea63d52901444db0bf008db7235b7d Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_96ea63d52901444db0bf008db7235b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/96ea63d52901444db0bf008db7235b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 96ea63d52901444db0bf008db7235b7d Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-230589257 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesAdminNegativeTest-230589257-project-admin Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 625af43d36be48de8a85bc94280d5364 Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesAdminNegativeTest-230589257-project-admin Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: {"volumeAttachment": {"volumeId": "63003b48-c261-4c03-9769-184e4ca693e4"}} Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: exception: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '2be0b56b-fff4-4ae1-94cf-34cb3849cc35', 'id': '01033095-f499-44c9-a449-def4261086b3', 'body': {'volumeAttachment': {'volumeId': '63003b48-c261-4c03-9769-184e4ca693e4'}}} Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. (HTTP 404) (Request-ID: req-b6bc3390-b78b-4017-bb10-3e56559117c4) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 08:45:14.473778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] Returning 404 to user: Volume 01033095-f499-44c9-a449-def4261086b3 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-399b0c9a-b5d8-4f0d-8573-8ab276a040c0 tempest-VolumesAdminNegativeTest-230589257 tempest-VolumesAdminNegativeTest-230589257-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35/os-volume_attachments/01033095-f499-44c9-a449-def4261086b3" status: 404 len: 109 microversion: 2.1 time: 0.145230 Oct 13 08:45:14.478224 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1368/2968] 10.222.0.23 () {60 vars in 1433 bytes} [Thu Oct 13 08:45:14 2022] PUT /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35/os-volume_attachments/01033095-f499-44c9-a449-def4261086b3 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:45:14.496509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:14.497384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:14.528905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:14.529542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:14.530926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:14.533803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:14.546463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:14.548270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.015930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:15.035371 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8c86ae1-8cfb-4e72-a858-f412143224f3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1537 microversion: 2.1 time: 0.552521 Oct 13 08:45:15.054790 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1369/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:14 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1537 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:15.078657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-42b1d9a4-c7c6-4995-a24c-73fc57ab45ed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375ee7280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:15.191483 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-42b1d9a4-c7c6-4995-a24c-73fc57ab45ed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.135304 Oct 13 08:45:15.192598 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1370/2970] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:15 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:15.362982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:15.363643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:15.370641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.372680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.374444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.376129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.378830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.381186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.418829 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] HTTP exception thrown: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Request method failure captured: Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 HTTP/1.1 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0BZRl5hH6k2pZxIqKQ3PDo0FWylC_gM7X5NMIUsSgoi3Pp_1KfeMTnxq9DOthqddxqqV8DNUVJIUfIkHoRuvQkF7C6akMEPxwd_-XrIlAx2rrTodGOd6e6BYkFIXuqFdoMQBXn2rVezkZyA1wFN16xCqB3Re84D7jmd-0wE8ATiM Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.21 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9260b44756a44338937ff836808535f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9260b44756a44338937ff836808535f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 684f0d06e83b4ce4a3de8946f517131a Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'da36532e-130e-4b35-95fe-622a63f06f75'} Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.427044 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.431424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.433207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Returning 404 to user: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:15.434277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ac5cdcc-97a6-4f5e-b025-e35b33c964ad tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 404 len: 111 microversion: 2.21 time: 0.075914 Oct 13 08:45:15.438956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1371/2971] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:15 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:15.449662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '.version_select at 0x7f5375d16ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:15.450190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:15.466370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.469001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.486638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.487870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.488574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.489232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.597124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:45:15.598495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:45:15.599129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:45:15.599716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:45:15.600284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:45:15.623901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.625633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.626982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.629935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.634011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.636510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.735517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85c5c60c-0ba1-49d7-a26c-ddaaafbaa4ca tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.292320 Oct 13 08:45:15.740676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:45:15.756391 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1372/2972] 10.222.0.23 () {60 vars in 1337 bytes} [Thu Oct 13 08:45:15 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75/os-instance-actions => generated 611 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 08:45:15.765068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:45:15.781691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:15.782198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:15.813688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.814218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.814711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.815435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.815873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.816296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.847763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:45:15.852948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:45:15.871150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] HTTP exception thrown: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Request method failure captured: Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 HTTP/1.1 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0BZRl5hH6k2pZxIqKQ3PDo0FWylC_gM7X5NMIUsSgoi3Pp_1KfeMTnxq9DOthqddxqqV8DNUVJIUfIkHoRuvQkF7C6akMEPxwd_-XrIlAx2rrTodGOd6e6BYkFIXuqFdoMQBXn2rVezkZyA1wFN16xCqB3Re84D7jmd-0wE8ATiM Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.21 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9260b44756a44338937ff836808535f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9260b44756a44338937ff836808535f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 684f0d06e83b4ce4a3de8946f517131a Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'da36532e-130e-4b35-95fe-622a63f06f75'} Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:15.878852 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Returning 404 to user: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:15.883592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c31c756a-df20-4f67-be13-e35dadb551e8 tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 404 len: 111 microversion: 2.21 time: 0.123268 Oct 13 08:45:15.889669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1373/2973] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:45:15 2022] DELETE /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:15.909717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:15.910341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] [instance: da36532e-130e-4b35-95fe-622a63f06f75] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:15.927735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.928229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.928670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.929426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:15.929920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:15.930346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:15.973634 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d43e1f4-2123-4f6b-b6e4-329080ed6b31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018496 Oct 13 08:45:15.985836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1601/2974] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:45:15.995202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] HTTP exception thrown: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Request method failure captured: Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 HTTP/1.1 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0BZRl5hH6k2pZxIqKQ3PDo0FWylC_gM7X5NMIUsSgoi3Pp_1KfeMTnxq9DOthqddxqqV8DNUVJIUfIkHoRuvQkF7C6akMEPxwd_-XrIlAx2rrTodGOd6e6BYkFIXuqFdoMQBXn2rVezkZyA1wFN16xCqB3Re84D7jmd-0wE8ATiM Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.21 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9260b44756a44338937ff836808535f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9260b44756a44338937ff836808535f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9260b44756a44338937ff836808535f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9260b44756a44338937ff836808535f8 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-172107130 Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 684f0d06e83b4ce4a3de8946f517131a Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceActionsV221TestJSON-172107130-project Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'da36532e-130e-4b35-95fe-622a63f06f75'} Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:15.996784 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. Oct 13 08:45:16.003053 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.004713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:16.005361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] Returning 404 to user: Instance da36532e-130e-4b35-95fe-622a63f06f75 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:16.005515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:16.005685 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d76b9af-8a64-4512-8586-265b4785e03d tempest-InstanceActionsV221TestJSON-172107130 tempest-InstanceActionsV221TestJSON-172107130-project] 10.222.0.23 "GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75" status: 404 len: 111 microversion: 2.21 time: 0.104177 Oct 13 08:45:16.005685 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1374/2975] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:15 2022] GET /compute/v2.1/servers/da36532e-130e-4b35-95fe-622a63f06f75 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:45:16.060767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:16.061516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:16.075496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:45:16.090098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:16.095834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:16.100144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:16.100301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:16.107551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:16.108397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:16.110264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:16.519647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:16.533135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8fecc13-1a53-44f8-80c5-82d310cc2329 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1519 microversion: 2.1 time: 0.473389 Oct 13 08:45:16.538788 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1375/2976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:16 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:16.549581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c537bf27-f007-40ed-b0a4-57526c9e24ed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375caaaf0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:16.661362 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c537bf27-f007-40ed-b0a4-57526c9e24ed tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.121349 Oct 13 08:45:16.663118 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1376/2977] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:16 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:16.680952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-plugged", "status": "completed", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:16.713475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:16.716770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:16.720407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:16.761169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] Creating event network-vif-plugged:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:45:16.772338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3ca1ff38-c1d6-4776-8649-11b518654934 req-6ca3518b-6181-446c-b9e2-b50a0b1bec52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107116 Oct 13 08:45:16.777585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1377/2978] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:16.787641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:16.791602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:16.807143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:16.809859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:16.810436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:16.811289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:16.815252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:16.815998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:16.902010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.scheduler.client.report [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Deleted allocations for instance 22e6af67-729b-4f06-8dc5-f1602a27b138 Oct 13 08:45:16.908518 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Instance Mapping does not exist while attempting local delete cleanup. Oct 13 08:45:16.909592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8677f785-e4e1-4c7d-8995-654eabdc0487 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138" status: 204 len: 0 microversion: 2.1 time: 0.917699 Oct 13 08:45:16.911263 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1602/2979] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:45:15 2022] DELETE /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:45:16.926944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:45:16.941642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:16.943937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:16.984134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 HTTP/1.1 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '22e6af67-729b-4f06-8dc5-f1602a27b138'} Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:16.985955 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31286b17-1a36-4b62-92d0-c700857f5ab5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138" status: 404 len: 111 microversion: 2.1 time: 0.071873 Oct 13 08:45:16.996088 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1603/2980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:16 2022] GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:45:17.243242 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d979dbcf-5299-45b7-b3ab-600a6945986a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 204 len: 0 microversion: 2.1 time: 0.461272 Oct 13 08:45:17.249449 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1378/2981] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:45:16 2022] DELETE /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:45:17.259597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:17.261118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:17.269321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:17.270113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:17.270771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:17.271792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:17.272501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:17.273937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:17.336459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-456232643", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:17.511652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:45:18.190515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:18.207452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8f683ce0-9684-495a-95d9-7a32622dfb21 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1525 microversion: 2.1 time: 0.948993 Oct 13 08:45:18.208734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1604/2982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:17 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1525 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:18.214363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f385f4f9-b6cb-4130-a730-4378d4a428ce tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376868310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:18.290465 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f385f4f9-b6cb-4130-a730-4378d4a428ce tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.080459 Oct 13 08:45:18.292946 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1605/2983] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:18 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:18.896441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:45:18.897477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:45:18.898171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:45:18.898644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:45:18.899063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:45:18.921690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:18.931564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:18.934041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:18.935060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:18.935690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:18.936296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:19.017360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:45:19.035053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:45:19.081983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:45:19.085271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:45:19.232869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:19.233646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:19.253595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:19.254516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:19.255212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:19.256571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:19.257258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:19.258539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:19.266165 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b437f73-7573-4ff6-943d-1b7ddb3d8527 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.934835 Oct 13 08:45:19.271390 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1379/2984] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:45:19.290017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed5a0b4b-1799-43b0-bafe-ef609daadbca tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:19.290964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ed5a0b4b-1799-43b0-bafe-ef609daadbca tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:19.294104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:19.620500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ed5a0b4b-1799-43b0-bafe-ef609daadbca tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:19.638960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed5a0b4b-1799-43b0-bafe-ef609daadbca tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1220 microversion: 2.1 time: 0.355727 Oct 13 08:45:19.641124 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1380/2985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:19 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1220 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:19.658742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef018d12-15d6-47a8-b892-84dbdf3783fc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375caa700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:19.761557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef018d12-15d6-47a8-b892-84dbdf3783fc tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.116144 Oct 13 08:45:19.772089 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1381/2986] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:19 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:20.280607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:20.282638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:20.314058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.316602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.317395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.321348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.322104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.324763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.369798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:45:20.373482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:20.386887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d1e872b-cd03-4d6b-95ed-26107f1a4fe3 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1525 microversion: 2.1 time: 1.154302 Oct 13 08:45:20.392602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1606/2987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:19 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1525 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:20.533016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c45be646-0279-4c2c-bb23-dfe9ad9acaf5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 204 len: 0 microversion: 2.1 time: 0.265061 Oct 13 08:45:20.537465 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1382/2988] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:45:20 2022] DELETE /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:45:20.542306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:20.543079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:20.564179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.565047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.565728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.566604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.569709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.570386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.669368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:20.670276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:20.698727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.699731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.711614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.715255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:20.717389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:20.721068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:20.971410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:20.980009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8304db86-b33c-4e0a-b9e5-11a9bb2386ca tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1512 microversion: 2.1 time: 0.441620 Oct 13 08:45:20.981242 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1607/2989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:20 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:20.985968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-827ff1e8-cffa-4ebf-9bb5-f538015b3f50 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375dee280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:21.045779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:21.070553 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a06bd76c-02e8-4229-91a4-ee70cb0e3996 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1272 microversion: 2.1 time: 0.400927 Oct 13 08:45:21.071509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1383/2990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:20 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1272 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:21.085486 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-827ff1e8-cffa-4ebf-9bb5-f538015b3f50 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.102897 Oct 13 08:45:21.090347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1608/2991] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:20 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:21.418034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:21.420800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:21.432710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:21.434807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:21.435527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:21.438615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:21.441224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:21.441933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:21.605484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:21.618903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eaa5436e-2b79-48e7-941a-5d3c86e6f3e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 200 len: 1483 microversion: 2.1 time: 0.202416 Oct 13 08:45:21.621743 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1384/2992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:21 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 1483 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:21.693439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c9f64-eef3-4e91-bd32-6b3b44501e27", "name": "network-vif-deleted", "tag": "1441e9d1-43fb-4c2f-9b29-931cda4e0b52"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:21.719686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:21.721632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:21.723552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:21.751508 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] Creating event network-vif-deleted:1441e9d1-43fb-4c2f-9b29-931cda4e0b52 for instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 on n-h1-858384-11 Oct 13 08:45:21.760169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f2fd0c02-d291-434f-b148-4f8998a774e9 req-8049764e-01ba-4ddd-b9be-516644c321b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072624 Oct 13 08:45:21.760922 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1609/2993] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:45:22.004215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:22.004950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:22.024578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.026559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.030982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.039571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.040723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.043886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.096151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:22.096862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:22.114255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.114786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.115234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.115964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.118020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:22.122639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.123509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.141667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:22.398331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:22.410351 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3c0ab22-4013-4736-ba7e-158acc2aed99 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1272 microversion: 2.1 time: 0.318394 Oct 13 08:45:22.446501 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1610/2994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:22 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:22.460541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2eee9ee2-4b87-4100-92a6-48595d121f4a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376868d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:22.629650 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2eee9ee2-4b87-4100-92a6-48595d121f4a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.181390 Oct 13 08:45:22.630247 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1611/2995] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:22 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:22.653794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:22.656312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:22.669582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.670663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.671281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.672292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:22.672921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:22.673559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:22.709161 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 HTTP/1.1 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27'} Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:22.712421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:45:22.716409 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:22.718037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:22.719233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb564f25-792e-45e6-86d8-5f62049a2027 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 404 len: 111 microversion: 2.1 time: 0.075627 Oct 13 08:45:22.720975 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1612/2996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:22 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:45:22.736207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f249356-84c7-47d0-b7e8-734300a5a146 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'create', calling method: .version_select at 0x7f53769c41f0>, body: {"keypair": {"name": "tempest-keypair-477382130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Mx0yxVI+F56ac3Q9KLzBVzlkUtROHrOMr/MJ4ShKmVB/2BnqJCaI+9GRhscnRnEh7xBZ8HmOaUO2z0bfvzaZaz1di21QZBOfCigs7W8Ry41dFinNJZa9XP/Vv0LSlAQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:22.761065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2f249356-84c7-47d0-b7e8-734300a5a146 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:45:22.769415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2f249356-84c7-47d0-b7e8-734300a5a146 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for user e27491f47ce944f0936a61bd642cd057 and project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:45:22.803657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f249356-84c7-47d0-b7e8-734300a5a146 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072960 Oct 13 08:45:22.805686 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1613/2997] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:45:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:23.159888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:23.173670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6479ce6-23d6-4d6d-be89-6350d7907528 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1512 microversion: 2.1 time: 1.171109 Oct 13 08:45:23.175787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1385/2998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:21 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1512 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:23.439192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:23.440244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:23.452393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:23.457501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:23.460809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:23.464495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:23.467819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:23.471522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:23.667583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a0055cb-72c8-4c68-b559-b18aed8929a4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c031f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:23.759666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:23.778457 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d89dedf6-ca29-4ce6-892a-a43085ce3462 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1278 microversion: 2.1 time: 0.337383 Oct 13 08:45:23.780752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1614/2999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:23 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:23.786196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a0055cb-72c8-4c68-b559-b18aed8929a4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.139862 Oct 13 08:45:23.790792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1386/3000] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:23 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:24.201674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:24.202353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:24.222036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:24.222792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:24.223412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:24.224154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:24.224622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:24.225062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:24.803237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7dd304d8-10c4-494f-a0e1-58128b2c91c4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c2cdc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:24.886182 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7dd304d8-10c4-494f-a0e1-58128b2c91c4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.088156 Oct 13 08:45:24.904743 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1387/3001] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:24 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:24.914357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:24.926174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:24.936756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:24.937623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:24.938317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:24.939360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:24.940082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:24.940754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:25.048155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:25.057114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-003eeb37-97fe-474b-9b6d-c89e5405d0e8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1278 microversion: 2.1 time: 0.151096 Oct 13 08:45:25.068574 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1388/3002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:24 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:25.676404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:25.713780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:25.725508 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8fa555d-8bf4-4d1e-9dc4-f238389729ac tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1512 microversion: 2.1 time: 1.528343 Oct 13 08:45:25.740848 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1615/3003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:24 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1512 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:25.918830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3981e50-2130-4a3e-b96c-2266a1fd748a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cd2b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:26.096456 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3981e50-2130-4a3e-b96c-2266a1fd748a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.185273 Oct 13 08:45:26.105358 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1389/3004] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:25 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:26.105689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:26.105689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:26.124456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:26.124890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:26.125326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:26.126047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:26.140106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:26.140735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:26.559252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:26.572254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5cde753-bdf3-4d97-928a-5d0f976fd0bc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1278 microversion: 2.1 time: 0.482292 Oct 13 08:45:26.574090 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1616/3005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:26 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1278 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:26.760684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:26.762940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:26.793655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:26.796187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:26.798981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:26.801864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:26.802632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:26.805440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:27.114963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-556906c5-85cf-480f-a826-7bd6b000f0a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f537aaa4280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:27.197103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-556906c5-85cf-480f-a826-7bd6b000f0a6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.087393 Oct 13 08:45:27.198651 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1617/3006] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:27 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:27.449516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be0b56b-fff4-4ae1-94cf-34cb3849cc35", "name": "network-vif-deleted", "tag": "afcaf5ce-db12-4687-bd06-f8a163815bdb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:27.471795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:27.478548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:27.479278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:27.507658 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] Creating event network-vif-deleted:afcaf5ce-db12-4687-bd06-f8a163815bdb for instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 on n-h2-858384-11 Oct 13 08:45:27.521778 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b0d05768-6a48-45f4-b0d4-426d42ac266c req-8ef2d651-50d0-4475-a362-5b570338c482 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078483 Oct 13 08:45:27.536003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1618/3007] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:27.604640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:27.608530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:27.625906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:27.627083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:27.627942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:27.630227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:27.631037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:27.631688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:27.690760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:27.707375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32d8bfbf-836a-47bd-a3bd-75daf0fd12d3 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 200 len: 1470 microversion: 2.1 time: 0.953890 Oct 13 08:45:27.708257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1390/3008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:26 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 1470 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:27.916247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:27.944028 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d166ec93-9a9b-4151-8a7f-56568a92752a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1278 microversion: 2.1 time: 0.344374 Oct 13 08:45:27.965886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1619/3009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:27 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:28.213855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef5e8f5e-cd93-4888-95b7-f116465d9b3c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d83700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:28.295633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef5e8f5e-cd93-4888-95b7-f116465d9b3c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.086718 Oct 13 08:45:28.296546 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1391/3010] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:28 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:28.733716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:28.734454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: 2be0b56b-fff4-4ae1-94cf-34cb3849cc35] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:28.746302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:28.751187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:28.751960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:28.752954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:28.754875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:28.755573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:28.788996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] HTTP exception thrown: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Request method failure captured: Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 HTTP/1.1 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR89uNT_mNtocu2jayyVDMr5F-KBLj-QYhsqaeC1SNe5J5Q98VDWmDZN7GuX3dejWJis5Tznxw8di-cTGa4gIV2fEzYBMCpjnWXVINSQVe64Xq5y6GQrkVDAOqMTK-5e0KZNm1i1uNY3Z2uLtOUFUbrpMMiR-vU-btLlcUOIDTDqYVqM Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b7f2eedb85b648f7aa5ed433ec79de49 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b7f2eedb85b648f7aa5ed433ec79de49 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesAdminNegativeTest-406421828-project Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ad1e31177278409199fa651951c5e75a Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesAdminNegativeTest-406421828-project Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '2be0b56b-fff4-4ae1-94cf-34cb3849cc35'} Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:28.794669 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. Oct 13 08:45:28.801806 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:45:28.805542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Returning 404 to user: Instance 2be0b56b-fff4-4ae1-94cf-34cb3849cc35 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:28.806720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8dd8d6a3-477e-41cb-9112-d3d314a5b901 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35" status: 404 len: 111 microversion: 2.1 time: 0.077468 Oct 13 08:45:28.810196 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1620/3011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:28 2022] GET /compute/v2.1/servers/2be0b56b-fff4-4ae1-94cf-34cb3849cc35 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:45:28.969644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:28.970571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:28.985581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:28.988002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:28.988532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:28.991083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:28.992638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:28.998767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:28.999385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:29.311710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-048f5526-9d0c-4c52-8b5a-814b4b8b1589 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c0b3a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:29.393756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-048f5526-9d0c-4c52-8b5a-814b4b8b1589 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.085765 Oct 13 08:45:29.394470 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1621/3012] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:29 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:29.626979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:29.962323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1907686521", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:30.110201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] validate_networks() for [('ea9dba19-ae29-472b-9f4d-0d0b50f53e88', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:45:30.338095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:30.354257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7893a3f4-be38-4dd3-bd97-dd446829e731 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 1.388566 Oct 13 08:45:30.355549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1392/3013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:28 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:30.409881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-019e18de-8246-4f89-a61b-a1ffe66e6b29 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d1ec10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:30.468971 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-019e18de-8246-4f89-a61b-a1ffe66e6b29 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.062953 Oct 13 08:45:30.470749 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1393/3014] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:30 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:31.335104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:45:31.336113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:45:31.336673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:45:31.337140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:45:31.337656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:45:31.383300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:31.405688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:31.451561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:31.453987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:31.458343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:31.463819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:31.467802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:31.468349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:31.470339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:31.472971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:31.474304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:31.477345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:31.480792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:31.486122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:31.686257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:45:31.698258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for user e27491f47ce944f0936a61bd642cd057 and project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:45:31.737422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:45:31.740128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:45:31.909149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2f13522-116e-4d3b-bc62-de1b5fcbc70b tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.950748 Oct 13 08:45:31.932315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1622/3015] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:45:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:45:31.948008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5dbf729-4e2b-4d2b-87f5-21e50e3c7189 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f53769d7c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:33.498701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:33.512572 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a2869cef-4e84-4481-8032-f3715ac82282 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 2.135119 Oct 13 08:45:33.537717 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1394/3016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:31 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:33.559631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:33.560533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:33.568899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:33.574976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:33.575737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:33.576668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:33.580305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:33.581409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:33.891349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:33.900757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c85f5517-fe45-4d1e-a002-7f197c37d9c9 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1229 microversion: 2.1 time: 0.361185 Oct 13 08:45:33.932867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1395/3017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:33 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1229 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:34.553780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:34.555579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:34.588016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:34.588919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:34.592292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:34.595315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:34.597954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:34.598810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:36.181250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5dbf729-4e2b-4d2b-87f5-21e50e3c7189 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 4.241943 Oct 13 08:45:36.181250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1623/3018] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:31 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 4243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:36.214458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:36.219286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:36.255289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:36.257732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:36.260801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:36.264452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:36.268074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:36.269889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:36.749005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:36.769798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf681201-d9c0-4748-9183-a0441ac38bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 2.229759 Oct 13 08:45:36.772561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1396/3019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:34 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:36.793823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118c9803-57d5-4674-a598-94ab63ad0b23", "tag": "34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:36.795601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:36.832972 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f18585c4-d32c-4b20-a410-c657ee2a53b6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1283 microversion: 2.1 time: 0.652219 Oct 13 08:45:36.841475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1624/3020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:36 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1283 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:36.877103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:36.877790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:36.878450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:36.938855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] Creating event network-changed:34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c for instance 118c9803-57d5-4674-a598-94ab63ad0b23 on n-h2-858384-11 Oct 13 08:45:36.960360 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2e11b7e7-e62a-41db-b64e-2e5b30249d3e req-4e5ea51c-b513-48a6-8a9a-800215842a17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186191 Oct 13 08:45:36.975323 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1397/3021] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:37.202003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c47586b9-16cd-4913-a98c-224bd4c0bc44 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f53768651f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:37.293441 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c47586b9-16cd-4913-a98c-224bd4c0bc44 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.096018 Oct 13 08:45:37.300945 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1625/3022] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:37 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:37.807050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:37.808476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:37.841692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:37.842221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:37.842762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:37.843508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:37.844020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:37.844520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:37.873254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:37.873932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:37.930575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:37.931091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:37.931596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:37.932335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:37.932791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:37.933276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:39.645257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:39.666767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19395f95-b056-48da-b2bd-cfd019896b6f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1283 microversion: 2.1 time: 1.797863 Oct 13 08:45:39.672093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1626/3023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:37 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1283 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:39.685811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e62f110-577e-4dc3-bd61-09278cdcfbf8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d58430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:39.779509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e62f110-577e-4dc3-bd61-09278cdcfbf8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.106067 Oct 13 08:45:39.781735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1627/3024] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:39 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:39.843972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:39.844794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:39.853856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:39.857297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:39.858014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:39.860469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:39.861385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:39.864133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:39.931449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:45:40.248994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-edc2e8d8-2c11-4c45-bea3-d2c93fe2b161 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 204 len: 0 microversion: 2.1 time: 0.409311 Oct 13 08:45:40.253519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1628/3025] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:45:39 2022] DELETE /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:45:40.270879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:40.274366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:40.300591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:40.301105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:40.301554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:40.311177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:40.311775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:40.312235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:40.525122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:40.549275 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a548fe53-9c3a-4fa2-89f2-2e957de2e63a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 2.746903 Oct 13 08:45:40.554487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1398/3026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:37 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 2755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:40.701490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:40.702039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:40.713808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:40.725235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:40.726903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:40.728101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:40.728781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:40.729863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:41.117080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:41.139363 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3eb8730a-26b4-4bd5-aa13-ed6dc246ccd2 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1680 microversion: 2.1 time: 0.879930 Oct 13 08:45:41.152094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1629/3027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:40 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1680 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:41.180101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70bea610-979c-4966-aee3-3e38b9aefff3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f53769d7c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:41.296593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70bea610-979c-4966-aee3-3e38b9aefff3 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.131023 Oct 13 08:45:41.299994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1630/3028] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:41 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:41.583598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:41.584301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:41.612770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:41.635109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:41.641079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:41.641786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:41.645138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:41.648120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:41.648591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:41.766842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=18 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:41.791583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:41.814652 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9bf087bf-c1b6-4942-8f63-5ce0838ea963 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 1.117237 Oct 13 08:45:41.823178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1399/3029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:40 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:42.180845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:42.181915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:42.207478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:42.209139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:42.213916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:42.218324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:42.222234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:42.223054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:42.878803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:42.890461 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6f28ef6-499c-41ee-afc7-a390cea3d4a6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 1.314110 Oct 13 08:45:42.926640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1631/3030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:41 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:42.933358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ea813b8-5660-4233-9296-a9543d5cae7c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375e25af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:43.094127 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ea813b8-5660-4233-9296-a9543d5cae7c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.166122 Oct 13 08:45:43.102829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1632/3031] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:42 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:43.117098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:43.117716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:43.128286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:43.129050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:43.132036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:43.133146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:43.133942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:43.135239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:43.338658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:43.350450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdc7e08e-ac8b-4fbd-804a-e3a92184b5d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.246255 Oct 13 08:45:43.363632 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1633/3032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:43 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:43.925500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:43.927069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:43.937046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:43.940786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:43.942542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:43.943552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:43.946234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:43.946965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:44.518351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:44.531155 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76d4be58-2980-48f7-b952-2c05784cce75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 0.609597 Oct 13 08:45:44.543885 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1634/3033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:43 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:44.563238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-893ac083-8aa3-4221-a2cb-f7b1e51cc1c6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376e49160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:44.700378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-893ac083-8aa3-4221-a2cb-f7b1e51cc1c6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1455 microversion: 2.1 time: 0.154722 Oct 13 08:45:44.702951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1635/3034] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:44 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:44.721260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:44.724037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:44.748599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:44.749411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:44.750951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:44.759216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:44.760002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:44.761826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:45.640210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:45.654825 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d928430-17b0-43fe-a350-e407a49cf5dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.946628 Oct 13 08:45:45.655830 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1636/3035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:44 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:45.685635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:45.687869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:45.690275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:45.701214 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9abc7c2f-787b-42bd-a127-2099513a4867 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1680 microversion: 2.1 time: 3.523513 Oct 13 08:45:45.704315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:45.707670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:45.709301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:45.712094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:45.712808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:45.712934 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1400/3036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:42 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1680 bytes in 3538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:45.715595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:45.731381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04095d69-13e3-40ae-883c-8e72a5bb57f0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c6f700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:46.139924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:46.143852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:46.163114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73c19af8-278f-48af-83af-390131126b04 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 0.493464 Oct 13 08:45:46.164702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1637/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:45 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:46.590398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9eda17a-5deb-4cb4-b435-98dd8349ede5", "name": "network-vif-deleted", "tag": "02872484-6896-4dbd-b476-b9d034ed48e2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:46.619394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:46.621947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:46.631224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:46.632090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:46.683205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] Creating event network-vif-deleted:02872484-6896-4dbd-b476-b9d034ed48e2 for instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 on n-h1-858384-11 Oct 13 08:45:46.711606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0c755fbb-cbcd-4119-baec-8249361fb3c1 req-f7f5c791-0e82-4a44-b612-b0c87bc184f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126028 Oct 13 08:45:46.713490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1638/3038] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:46.738336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:46.747895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:46.784321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:46.785062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:46.786508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:46.788893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:46.794951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:46.796763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:47.494245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:47.510806 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43bb8b8a-85c2-45a8-9f3c-c4a9d53487be tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.787758 Oct 13 08:45:47.529729 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1639/3039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:46 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:47.542510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:47.559415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:47.587663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:47.591282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:47.593520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:47.598613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:47.604157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:47.606101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:47.750824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:47.753724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:47.754388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:47.755105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lazy-loading 'fault' on Instance uuid f9eda17a-5deb-4cb4-b435-98dd8349ede5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:45:47.838085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1e31177278409199fa651951c5e75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7f2eedb85b648f7aa5ed433ec79de49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:47.850703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7da32709-9054-4c82-b806-ae2d87004cbf tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 200 len: 1332 microversion: 2.1 time: 0.316614 Oct 13 08:45:47.852093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1640/3040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:47 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 1332 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:47.861375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:47.863101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:47.876561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:47.880772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:47.883528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:47.886901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:47.889353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:47.890174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:48.291262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:48.316157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2992ccb5-2d53-4708-a612-4d5ac9c54cac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 0.462802 Oct 13 08:45:48.331802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1641/3041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:47 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:48.351348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-403336532", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "fedba645-4217-4e76-922d-f07fb603c582"}, {"uuid": "dad33d99-49fe-47cf-ade1-622cc8130494"}, {"uuid": "fedba645-4217-4e76-922d-f07fb603c582"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:50.929917 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04095d69-13e3-40ae-883c-8e72a5bb57f0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1464 microversion: 2.1 time: 5.210273 Oct 13 08:45:50.941275 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1401/3042] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:45 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1464 bytes in 5222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:50.948791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] validate_networks() for [('fedba645-4217-4e76-922d-f07fb603c582', None, None, None, None, None), ('dad33d99-49fe-47cf-ade1-622cc8130494', None, None, None, None, None), ('fedba645-4217-4e76-922d-f07fb603c582', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:45:50.961417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237325ea-f9dc-46d2-b465-29caf04d175b", "tag": "9c9e98b0-7d89-4579-8641-ae92fbd79825"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:50.973810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:51.009938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.014160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.014766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.110230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] Creating event network-changed:9c9e98b0-7d89-4579-8641-ae92fbd79825 for instance 237325ea-f9dc-46d2-b465-29caf04d175b on n-h1-858384-11 Oct 13 08:45:51.117085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-87bf0e31-d614-4ba9-a50a-8b58965ced40 req-75e048d5-24b5-4c51-9957-88d0a9b251b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174208 Oct 13 08:45:51.118765 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1402/3043] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:51.128068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:51.129696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:51.139556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.141047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.141768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.143174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.145299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.146052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.760455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:51.778244 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0fa8a694-0d2e-4d60-b3c1-037a2b9c813d tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.652613 Oct 13 08:45:51.778978 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1403/3044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:51 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:51.797516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:51.797516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] [instance: f9eda17a-5deb-4cb4-b435-98dd8349ede5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:51.834174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.842169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.842698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.849379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.855696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.856536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.918646 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] HTTP exception thrown: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Request method failure captured: Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 HTTP/1.1 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR89uNT_mNtocu2jayyVDMr5F-KBLj-QYhsqaeC1SNe5J5Q98VDWmDZN7GuX3dejWJis5Tznxw8di-cTGa4gIV2fEzYBMCpjnWXVINSQVe64Xq5y6GQrkVDAOqMTK-5e0KZNm1i1uNY3Z2uLtOUFUbrpMMiR-vU-btLlcUOIDTDqYVqM Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b7f2eedb85b648f7aa5ed433ec79de49 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7f2eedb85b648f7aa5ed433ec79de49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b7f2eedb85b648f7aa5ed433ec79de49 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-406421828 Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesAdminNegativeTest-406421828-project Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ad1e31177278409199fa651951c5e75a Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesAdminNegativeTest-406421828-project Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f9eda17a-5deb-4cb4-b435-98dd8349ede5'} Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:45:51.920778 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. Oct 13 08:45:51.928093 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:45:51.940647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Returning 404 to user: Instance f9eda17a-5deb-4cb4-b435-98dd8349ede5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:45:51.943401 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f49a0c4-d05f-40d1-a43e-3787f546a647 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5" status: 404 len: 111 microversion: 2.1 time: 0.160053 Oct 13 08:45:51.948235 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1404/3045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:51 2022] GET /compute/v2.1/servers/f9eda17a-5deb-4cb4-b435-98dd8349ede5 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:45:51.953707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:51.954781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:51.967430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.968263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.969002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:51.971677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:51.972403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:51.973058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:52.196099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:52.204764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=73 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:45:52.229246 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00568585-9080-4e5e-840d-fd42c075b603 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 0.277463 Oct 13 08:45:52.230490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1405/3046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:51 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:52.244642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:52.248999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:52.258133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:52.259577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:52.260256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:52.261368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:52.262131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:52.262979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:52.767546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:52.782679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:52.784232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:52.785530 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba06f4cb-84f2-4750-9f94-53401884aca2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2948 microversion: 2.32 time: 0.550130 Oct 13 08:45:52.826746 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1406/3047] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:45:52 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2948 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:52.838789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea825b3c-52bf-441b-b1e4-7a92c1400e13 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c6f0d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:52.984866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea825b3c-52bf-441b-b1e4-7a92c1400e13 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 200 len: 1464 microversion: 2.1 time: 0.156366 Oct 13 08:45:52.987820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1407/3048] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:45:52 2022] GET /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:52.995099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8b28179-ff67-40ea-b2da-fa64af11c1a5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] Calling method '.version_select at 0x7f5375bc1160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:53.061284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8b28179-ff67-40ea-b2da-fa64af11c1a5 tempest-VolumesAdminNegativeTest-406421828 tempest-VolumesAdminNegativeTest-406421828-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217454153" status: 202 len: 0 microversion: 2.1 time: 0.067901 Oct 13 08:45:53.064068 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1408/3049] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217454153 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:45:53.079444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:53.082863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:53.117510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:53.126042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:53.126563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:53.132487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:53.140415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:53.140803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:53.815954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:53.831184 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e08b796d-2aea-4199-a7f2-34567a9b46da tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.765405 Oct 13 08:45:53.832026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1409/3050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:53 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:53.848982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:53.850390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:53.864387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:53.867356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:53.867832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:53.870692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:53.871193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:53.871644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:54.841588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66e9c8fc-bed1-4fa7-bed0-1a8bac084b9e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.005931 Oct 13 08:45:54.846448 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1410/3051] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:45:53 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6/os-interface => generated 1830 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:45:54.852766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:54.853479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:54.864379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:54.864882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:54.873974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:54.877995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:54.878578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:54.881036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:54.896091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:45:54.898611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:45:54.899140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:45:54.899944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:45:54.900651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:45:54.937328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:54.942939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:54.956592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:54.961735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:54.965009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:54.967064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:55.008589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Getting quotas for project 4ba45f45bd464b9889a06f8573e15495. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:45:55.016296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Getting quotas for user 121483ba66f145de9e50420bd52cf669 and project 4ba45f45bd464b9889a06f8573e15495. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:45:55.075167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:45:55.077841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:45:55.109213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:55.123267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f97f790-3810-4a3a-84ad-56b43e1a99f1 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1467 microversion: 2.1 time: 0.270724 Oct 13 08:45:55.140009 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1411/3052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:54 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:55.159280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:55.160736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:55.198760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:55.199806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:55.202708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:55.207426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:55.208908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:55.212552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:55.234983 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70f2dfdf-d6c6-4e25-8fa7-fb61a16a12bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.901603 Oct 13 08:45:55.235687 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1642/3053] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 6903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:45:55.264732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:55.265199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:55.312386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:55.314963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:55.316213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:55.329125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:55.334031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:55.335967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:56.159947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:56.179436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d9c39bf-a90e-4bed-b1e2-727bde4448dc tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.942589 Oct 13 08:45:56.192111 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1643/3054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:55 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:56.220594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b315ffdf-4704-4d96-9d1b-f0a41d29172a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376927040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:56.494833 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b315ffdf-4704-4d96-9d1b-f0a41d29172a tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-10-13T08%3A43%3A13Z" status: 200 len: 2799 microversion: 2.1 time: 0.297289 Oct 13 08:45:56.495970 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1644/3055] 10.222.0.23 () {58 vars in 1199 bytes} [Thu Oct 13 08:45:56 2022] GET /compute/v2.1/images?changes-since=2022-10-13T08%3A43%3A13Z => generated 2799 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:56.515157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:56.516524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:56.529118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:56.529994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:56.530667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:56.534711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:56.535429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:56.536025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:56.779129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:56.780759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:56.788747 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9be9dc0-87b9-478b-b1e2-3c9d73e554c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 1.647236 Oct 13 08:45:56.789718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1412/3056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:55 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:56.794209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118c9803-57d5-4674-a598-94ab63ad0b23", "name": "network-vif-plugged", "status": "completed", "tag": "34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:56.806003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a82a2713-c5c4-4267-99a4-cc112856c4e0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1216 microversion: 2.1 time: 0.308470 Oct 13 08:45:56.812099 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1645/3057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:56 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1216 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:56.816665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:56.817149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:56.817765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:56.820793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c14fcd3c-5567-4db6-a276-006e25d25d3d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376fc79d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:56.852678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] Creating event network-vif-plugged:34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c for instance 118c9803-57d5-4674-a598-94ab63ad0b23 on n-h2-858384-11 Oct 13 08:45:56.874386 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-fbc1d88d-31ac-4c5c-ba46-fcc732f30472 req-c6ddfae4-603a-44b1-8e66-f59dc0b62d83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083441 Oct 13 08:45:56.875026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1413/3058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:56.958029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c14fcd3c-5567-4db6-a276-006e25d25d3d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1954274235" status: 200 len: 485 microversion: 2.1 time: 0.144741 Oct 13 08:45:56.959933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1646/3059] 10.222.0.23 () {58 vars in 1231 bytes} [Thu Oct 13 08:45:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1954274235 => generated 485 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:56.973015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0b7f682-150c-4a6d-a7ee-067b58c4fc1c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cc43a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.218809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.220229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:57.233436 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0b7f682-150c-4a6d-a7ee-067b58c4fc1c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?server=341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 956 microversion: 2.1 time: 0.264522 Oct 13 08:45:57.235561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:57.236251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:57.236854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:57.237723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:57.238334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:57.238941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:57.243326 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1414/3060] 10.222.0.23 () {58 vars in 1209 bytes} [Thu Oct 13 08:45:56 2022] GET /compute/v2.1/images?server=341b7b88-c80b-4cdc-9118-9af64498c249 => generated 956 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:57.258392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cbda6c8-7b65-4c9b-9751-a8ed7fda08b6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c6ea60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.374761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cbda6c8-7b65-4c9b-9751-a8ed7fda08b6 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 485 microversion: 2.1 time: 0.108444 Oct 13 08:45:57.375453 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1415/3061] 10.222.0.23 () {58 vars in 1317 bytes} [Thu Oct 13 08:45:57 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 485 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:57.387947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd535e53-4e6c-4230-bf4c-cfa57b32647e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375bc13a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.491313 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd535e53-4e6c-4230-bf4c-cfa57b32647e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 485 microversion: 2.1 time: 0.106715 Oct 13 08:45:57.491910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1416/3062] 10.222.0.23 () {58 vars in 1303 bytes} [Thu Oct 13 08:45:57 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:45:57.506362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffd34cf9-9a96-4d7a-bb02-bd635f103c12 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d1ec10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.785674 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ffd34cf9-9a96-4d7a-bb02-bd635f103c12 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.283132 Oct 13 08:45:57.801191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1417/3063] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:45:57 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:57.828558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:57.840214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:57.879829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:57.885526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:57.889325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:57.890268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:57.893566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:57.896888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:58.758260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:58.771315 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee1259a3-7424-434c-b461-3ba1adbe6384 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 1.556147 Oct 13 08:45:58.773261 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1647/3064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:57 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:45:58.777861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f0a5c97-b6d6-401c-bd8f-ef367cb19d42 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d58430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:58.938952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f0a5c97-b6d6-401c-bd8f-ef367cb19d42 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.164499 Oct 13 08:45:58.941664 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1648/3065] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:45:58 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:58.960856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:58.963056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:58.979451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:58.984445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:58.985217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:58.988515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:58.989252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:58.991793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:59.092205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:59.102449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9395cae0-ce91-4713-a140-76502dd24bae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1320 microversion: 2.1 time: 1.282526 Oct 13 08:45:59.124296 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1418/3066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:57 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1320 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:59.136607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91b17f58-9c12-4513-b263-f8d7c42656ce tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375bda0d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.238119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:45:59.250803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69712c6b-fb88-40cb-9988-fcd85f9e3411 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1270 microversion: 2.1 time: 0.297685 Oct 13 08:45:59.252415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1649/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:58 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:59.260103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-unplugged", "status": "completed", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}, {"server_uuid": "237325ea-f9dc-46d2-b465-29caf04d175b", "name": "network-vif-plugged", "status": "completed", "tag": "9c9e98b0-7d89-4579-8641-ae92fbd79825"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:59.275480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:59.275972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:59.276403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:59.293223 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Creating event network-vif-unplugged:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:45:59.294021 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] Creating event network-vif-plugged:9c9e98b0-7d89-4579-8641-ae92fbd79825 for instance 237325ea-f9dc-46d2-b465-29caf04d175b on n-h1-858384-11 Oct 13 08:45:59.304557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ab1f2fde-ebbe-49bb-9002-801ff86d952c req-77323564-87ec-4716-aff4-4598618bb39b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050591 Oct 13 08:45:59.305352 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1650/3068] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:59.392097 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91b17f58-9c12-4513-b263-f8d7c42656ce tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.266108 Oct 13 08:45:59.402807 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1419/3069] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:59.408642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67d0727e-f8b1-4819-9740-c063aafff546 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375caa670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.578307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67d0727e-f8b1-4819-9740-c063aafff546 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-10-13T08%3A43%3A09Z" status: 200 len: 7011 microversion: 2.1 time: 0.173474 Oct 13 08:45:59.591206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1420/3070] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-13T08%3A43%3A09Z => generated 7011 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:59.604709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b832f8ec-e8b6-4033-8d93-e08a3389bac4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375bda700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.615155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-779665737", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "53587e12-4d9d-405f-b55a-2bd3268b390c"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:45:59.669160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b832f8ec-e8b6-4033-8d93-e08a3389bac4 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1954274235" status: 200 len: 665 microversion: 2.1 time: 0.068465 Oct 13 08:45:59.684032 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1421/3071] 10.222.0.23 () {58 vars in 1252 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1954274235 => generated 665 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:45:59.690315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff687302-65dc-4a91-9d70-9f4149f896a8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c031f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.765999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] validate_networks() for [('53587e12-4d9d-405f-b55a-2bd3268b390c', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:45:59.777457 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff687302-65dc-4a91-9d70-9f4149f896a8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1467 microversion: 2.1 time: 0.092034 Oct 13 08:45:59.778269 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1422/3072] 10.222.0.23 () {58 vars in 1338 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:59.797768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22f85aa7-90e0-4b37-91ab-5c2a2920e584 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375bda040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.860258 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22f85aa7-90e0-4b37-91ab-5c2a2920e584 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1467 microversion: 2.1 time: 0.065257 Oct 13 08:45:59.860858 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1423/3073] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1467 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:45:59.881671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:45:59.881671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:45:59.899079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:59.899787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:59.900337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:45:59.901189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:45:59.901768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:45:59.902337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:00.196520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:00.205967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe19e565-7bc5-4346-b44e-113a1ec7fbf6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1325 microversion: 2.1 time: 0.334112 Oct 13 08:46:00.208518 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1424/3074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:45:59 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:00.223743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39545308-40b6-42a2-bd57-87c772c7f212 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c209d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:00.429139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39545308-40b6-42a2-bd57-87c772c7f212 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.217931 Oct 13 08:46:00.430132 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1425/3075] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 08:46:00 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:00.436096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:00.436991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:00.443618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:00.444455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:00.445119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:00.446068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:00.446806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:00.447477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:00.959002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:00.975694 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f35a3efb-69ff-42ae-a764-f6a31dce6c4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1502 microversion: 2.1 time: 0.543710 Oct 13 08:46:00.976451 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1426/3076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:00 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1502 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:00.981172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:00.991460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:00.998028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:00.998723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:00.999264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.000070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.000755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.011124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.071972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:01.073212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:01.074293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:01.075033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:01.075815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:01.125671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.126843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.127468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.131011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.132556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.133752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.195128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Getting quotas for project 9c9e6f7e0c014a9b9102581e93962949. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:01.210980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Getting quotas for user 506df0c3fce94f11bb0328831c16c7aa and project 9c9e6f7e0c014a9b9102581e93962949. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:01.255030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:01.261188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:01.327818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:01.342950 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9f97e7f9-4db4-4baa-9063-13a2f2988d72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1312 microversion: 2.1 time: 0.364972 Oct 13 08:46:01.360585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1427/3077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:00 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:01.372907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86863e61-9f60-4a36-8adf-dd3edee51e30 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d16550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:01.418271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c09cff4-6c6a-44c5-bcff-44ea6704cabc tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052220 Oct 13 08:46:01.425980 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1651/3078] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:46:01.431102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:01.437791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:01.452212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.453737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.454904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.457658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.459503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.460087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.562324 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86863e61-9f60-4a36-8adf-dd3edee51e30 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.199112 Oct 13 08:46:01.571398 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1428/3079] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 08:46:01 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:01.591453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:01.592377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:01.605368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.607021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.608184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.609477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:01.613675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:01.616057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:01.997952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:02.008767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43a1310f-789d-4672-99a6-d15275179c04 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1522 microversion: 2.1 time: 0.436112 Oct 13 08:46:02.021567 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1429/3080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:01 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:02.062958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6eb71633-ca17-45e1-bbb9-375b100a8a21 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:02.084562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6eb71633-ca17-45e1-bbb9-375b100a8a21 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:02.322673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6eb71633-ca17-45e1-bbb9-375b100a8a21 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:02.329707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6eb71633-ca17-45e1-bbb9-375b100a8a21 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1224 microversion: 2.1 time: 0.306405 Oct 13 08:46:02.330292 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1430/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:02 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1224 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:02.366089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:02.376735 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f401385e-302a-4378-b0ec-ffbe05f1a82f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1502 microversion: 2.1 time: 0.955078 Oct 13 08:46:02.392446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c179f533-1b4d-4902-9b0c-5d352180bd2b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375cd3430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:02.405690 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1652/3082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:01 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1502 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:02.411541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:02.413290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:02.439980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:02.441281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:02.442059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:02.451213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:02.452093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:02.452782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:02.494355 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c179f533-1b4d-4902-9b0c-5d352180bd2b tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375" status: 200 len: 784 microversion: 2.1 time: 0.115978 Oct 13 08:46:02.495240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1431/3083] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:02 2022] GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375 => generated 784 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:02.527905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:02.528733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:02.536791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:02.537659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:02.538294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:02.539210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:02.539825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:02.540460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.089559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:03.098810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-444011da-20e2-4b6f-9968-307dce66f969 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1522 microversion: 2.1 time: 0.691633 Oct 13 08:46:03.114737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1653/3084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:02 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:03.130128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:03.132673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:03.139332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.140111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.140755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.141701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.142377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.143034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.231240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:03.463450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42f75cbf-8e01-46b5-97f2-d3c85ab6884e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 204 len: 0 microversion: 2.1 time: 0.346912 Oct 13 08:46:03.464725 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1654/3085] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:03 2022] DELETE /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:03.480155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6fbab0b3-5721-4b29-8ded-e0c97855af78 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c0b3a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:03.513317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:03.523498 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04d30ae3-56e3-4e81-8b46-d85924fc95bd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1333 microversion: 2.1 time: 1.012792 Oct 13 08:46:03.551369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1432/3086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:02 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1333 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:03.564088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-657276643"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:03.566581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:03.585276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.585843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.586299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.587342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.588031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.588696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.596337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6fbab0b3-5721-4b29-8ded-e0c97855af78 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 835 microversion: 2.1 time: 0.129934 Oct 13 08:46:03.598520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1655/3087] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:46:03 2022] GET /compute/v2.1/images/detail?limit=1 => generated 835 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:03.604398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:03.605799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:03.617374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.618862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.619637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.620515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.621859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.622760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.762377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:03.774962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-706f0128-37c7-4ecb-bfad-0845704edd94 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1276 microversion: 2.1 time: 0.174476 Oct 13 08:46:03.776346 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1656/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:03 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:03.790882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:03.791774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:03.808485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.813550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.814542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:03.815690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:03.816329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:03.816993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:04.023834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e50b83a3-9e7e-4358-bee9-1bfa6a2077a1 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b/action" status: 202 len: 0 microversion: 2.1 time: 0.470481 Oct 13 08:46:04.025815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1433/3089] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:46:03 2022] POST /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:46:04.032477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30fe8e55-3c03-4f79-b32c-240e2ab93d96 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d1eca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:04.181475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:04.196675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8b2378f-c0a8-4d3b-9469-8a1c60c8f7d4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1508 microversion: 2.1 time: 0.418697 Oct 13 08:46:04.204156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1657/3090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:03 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:04.219066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd3ca835-9e43-4938-b0df-d952ed3ae9d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f5375deec10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:05.392299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30fe8e55-3c03-4f79-b32c-240e2ab93d96 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755" status: 204 len: 0 microversion: 2.1 time: 1.364827 Oct 13 08:46:05.393951 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1434/3091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:04 2022] DELETE /compute/v2.1/images/58fa7e41-e5a9-4c54-94fb-2c22cbbc7755 => generated 0 bytes in 1367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:05.399839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:05.400579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:05.447930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.450898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.451356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:05.462678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.463218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.467186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:05.786854 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd3ca835-9e43-4938-b0df-d952ed3ae9d5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269" status: 204 len: 0 microversion: 2.1 time: 1.581450 Oct 13 08:46:05.787565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1658/3092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:04 2022] DELETE /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269 => generated 0 bytes in 1583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:05.792637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:05.794294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:05.809712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.810211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.810695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:05.811871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.812484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.816486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:05.947059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:05.957032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8a86489-2903-4499-8c01-f64d45ee7e2e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1282 microversion: 2.1 time: 0.168091 Oct 13 08:46:05.962381 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1659/3093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:05 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:05.970094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:05.972667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:05.987384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.988058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.988652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:05.989540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:05.990160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:05.991031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:06.001398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:06.411893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:06.428625 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86e9a79d-342c-4b3f-81b7-0325f3e050c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 1.029699 Oct 13 08:46:06.449527 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1435/3094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:05 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:06.461335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2769747-cc88-450b-b93f-0839d5f29b2e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d185e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:07.097574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:07.116298 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a267f87-adfa-4df9-b26d-7cb74aa6c1f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 200 len: 1508 microversion: 2.1 time: 1.150706 Oct 13 08:46:07.120201 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1660/3095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:05 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 1508 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:07.195984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bb138ae-1c62-477f-839b-6d60f5e997e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f53769d7f70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:07.362510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2769747-cc88-450b-b93f-0839d5f29b2e tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6" status: 204 len: 0 microversion: 2.1 time: 0.911686 Oct 13 08:46:07.363770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1436/3096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:06 2022] DELETE /compute/v2.1/images/95e8ee94-7486-43e3-9a52-251bb24bbac6 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:07.372392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:07.373362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:07.404484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:07.406031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:07.406644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:07.410543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:07.416758 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4bb138ae-1c62-477f-839b-6d60f5e997e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Image not found. Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bb138ae-1c62-477f-839b-6d60f5e997e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269 HTTP/1.1 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '35c8694a-3c66-4290-abf3-9def98a56269'} Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 35c8694a-3c66-4290-abf3-9def98a56269 Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:46:07.419110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35c8694a-3c66-4290-abf3-9def98a56269 could not be found. Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bb138ae-1c62-477f-839b-6d60f5e997e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bb138ae-1c62-477f-839b-6d60f5e997e6 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269" status: 404 len: 62 microversion: 2.1 time: 0.298636 Oct 13 08:46:07.424608 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1661/3097] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:07 2022] GET /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269 => generated 62 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:46:07.432513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:07.432513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:07.433433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118c9803-57d5-4674-a598-94ab63ad0b23", "name": "network-vif-deleted", "tag": "34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:07.500502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:07.507423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:07.509986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:07.551470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] Creating event network-vif-deleted:34d1ee2a-f0b0-4cfe-aedf-ba5c78f62f8c for instance 118c9803-57d5-4674-a598-94ab63ad0b23 on n-h2-858384-11 Oct 13 08:46:07.565601 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-917dab5c-1973-47b5-b283-a9ed25fcd28c req-bd2ad21f-db84-4295-9504-f5c5c952cfbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142311 Oct 13 08:46:07.568065 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1662/3098] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:07.595599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c746a246-9eb2-4f2e-8d49-3e638824a9e7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376d55160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:07.602342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:07.639073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7f409c6-14de-4dd9-8098-37d6d558b03a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1282 microversion: 2.1 time: 0.269433 Oct 13 08:46:07.639766 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1437/3099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:07 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:07.660739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:07.661643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:07.671537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:07.672232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:07.672858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:07.673768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:07.674422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:07.675667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.274986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:08.284064 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-169410f5-5416-4926-8685-1536c8d8d853 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1535 microversion: 2.1 time: 0.627896 Oct 13 08:46:08.286924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1438/3100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:07 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1535 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:08.301093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:08.311609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:08.325972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.326500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.335004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.335827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.336332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.336765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.339875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:08.535757 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c746a246-9eb2-4f2e-8d49-3e638824a9e7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e" status: 204 len: 0 microversion: 2.1 time: 0.963468 Oct 13 08:46:08.536443 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1663/3101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:07 2022] DELETE /compute/v2.1/images/ec85cfbc-721b-452b-a9b8-a0af79f7351e => generated 0 bytes in 968 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:08.545737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:08.546748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:08.572781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.573544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.574191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.575197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.576236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.576885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.602067 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 HTTP/1.1 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '118c9803-57d5-4674-a598-94ab63ad0b23'} Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:08.608356 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:46:08.613535 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:08.615812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:08.617096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4e9fd1d-22c7-4fa5-aaa6-87b1455de39a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 404 len: 111 microversion: 2.1 time: 0.079651 Oct 13 08:46:08.618033 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1664/3102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:08 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:08.623363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "tag": "de5aff6a-98f2-4beb-bc1a-67118fb3204e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:08.635053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.635854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.636685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.650713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] Creating event network-changed:de5aff6a-98f2-4beb-bc1a-67118fb3204e for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:08.664723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-74b9f0df-fbc3-46b2-913f-062ed6518112 req-c9d7f0b0-7747-4e74-bc94-98e96dfb87ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042843 Oct 13 08:46:08.667996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1665/3103] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:08.686118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:08.694819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:08.705963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.710325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.711010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.712162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:08.713396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:08.715189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:08.796998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:08.918840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8cee5226-d98f-4ce4-b183-d4b44707e28c tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 204 len: 0 microversion: 2.1 time: 0.248705 Oct 13 08:46:08.919565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1666/3104] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:08 2022] DELETE /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:08.936287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:08.939065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33bf9bc1-6a2f-4f56-a826-66c3c0d2ab53 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: .version_select at 0x7f537ab22820>, body: {"keypair": {"name": "tempest-key-387055673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlkPnTaAs6n0ig/6FjoAP4pTRTPk06BFGvY63NdQy3VC6MGgVMO/fwxbLjHMYbUg6qqxLaN0WcvaG+coJzvXuy7TPAeDR5akUxsgAt5+bACW0+f6BV5s4lLyqNS29bzkg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:08.963767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-33e388f8-34d2-4e0c-bd72-b2e382b112cd tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.663304 Oct 13 08:46:08.964443 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1439/3105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:08 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:08.982718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-33bf9bc1-6a2f-4f56-a826-66c3c0d2ab53 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:08.992220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:08.995098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-33bf9bc1-6a2f-4f56-a826-66c3c0d2ab53 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:08.995251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:09.023035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.024446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.027513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.031818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.032682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.035087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.064724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-33bf9bc1-6a2f-4f56-a826-66c3c0d2ab53 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.142823 Oct 13 08:46:09.065636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1667/3106] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:46:08 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:09.070960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:09.072576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:09.082291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.083067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.084594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.085551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.086262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.086903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.494741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:09.503149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb3b108a-8b14-4d79-b670-2bee227f1409 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.537545 Oct 13 08:46:09.518210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1440/3107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:08 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:09.532348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48b5ea42-30ed-4bea-99e7-3fc953f505df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '.version_select at 0x7f5375c20790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:09.538827 n-d-858384-11 devstack@n-api.service[127031]: WARNING oslo_db.sqlalchemy.utils [None req-48b5ea42-30ed-4bea-99e7-3fc953f505df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:46:09.555154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48b5ea42-30ed-4bea-99e7-3fc953f505df tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.031825 Oct 13 08:46:09.555969 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1441/3108] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:46:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:09.565265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:09.566282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:09.588894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.591649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.592487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.598495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.599184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.600427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.809864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:09.819073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09cfff45-902a-4066-a364-691a71ae3427 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1472 microversion: 2.1 time: 0.751994 Oct 13 08:46:09.825361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1668/3109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:09 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1472 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:09.838514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1850034679", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-key-387055673", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:09.852488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:09.861655 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3cdfb213-4848-4c4c-8ce2-8773ca2218d7 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1522 microversion: 2.1 time: 0.304168 Oct 13 08:46:09.866241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1442/3110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:09 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:09.870049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:09.893407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:09.894327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:09.903248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.905511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.907793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.909092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:09.910852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:09.912746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:09.996888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:09.997503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:10.138253 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8c52c99-716f-4619-b9f3-ba961978f3cd tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 204 len: 0 microversion: 2.1 time: 0.249734 Oct 13 08:46:10.139439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1443/3111] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:09 2022] DELETE /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:10.156088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:10.158002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:10.172534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:10.176375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:10.177220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:10.179642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:10.180359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:10.184026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:10.738960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:10.764798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d120dafb-d08e-48e1-a703-febe9fa99649 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.623778 Oct 13 08:46:10.765410 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1444/3112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:10 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:10.786099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:10.786787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:10.813137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:10.813669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:10.814327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:10.815479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:10.816182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:10.816785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.165937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:11.226267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:11.226884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:11.227523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:11.227990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:11.228788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:11.247391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.248148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.249235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.252024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.252756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.254345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.300981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:11.316837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:11.345458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:11.348245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:11.454576 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-814ac1dc-7e88-42ff-8b9c-5b8a36d1486b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626915 Oct 13 08:46:11.455990 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1669/3113] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:11.465998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:11.466966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:11.468195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:11.477481 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6ac2fc6-7611-4830-86c0-354878542909 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1528 microversion: 2.1 time: 0.710984 Oct 13 08:46:11.485162 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1445/3114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:10 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1528 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:11.509439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237325ea-f9dc-46d2-b465-29caf04d175b", "name": "network-vif-plugged", "status": "completed", "tag": "9c9e98b0-7d89-4579-8641-ae92fbd79825"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:11.515896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.517597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.536871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.537521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.538005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.538808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.539395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.539911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.542600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.570283 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] Creating event network-vif-plugged:9c9e98b0-7d89-4579-8641-ae92fbd79825 for instance 237325ea-f9dc-46d2-b465-29caf04d175b on n-h1-858384-11 Oct 13 08:46:11.576533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-749b8809-2f32-4fc2-b5ee-7ea2c1690dd0 req-1d6acbaf-11d6-4e63-8f17-50062fe53618 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089861 Oct 13 08:46:11.577464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1446/3115] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:11.582953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4090ddd3-e92b-40ab-92db-d637dac74af6", "tag": "ade43845-b327-4b2a-93bb-66fe7ed094dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:11.613150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.613675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.614107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.631086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] Creating event network-changed:ade43845-b327-4b2a-93bb-66fe7ed094dc for instance 4090ddd3-e92b-40ab-92db-d637dac74af6 on n-h2-858384-11 Oct 13 08:46:11.635975 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1d902945-7a15-4460-880f-33fd21c5ddfa req-ed4dfd1d-447e-438b-9d97-5dcad250e06c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057068 Oct 13 08:46:11.639102 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1447/3116] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:11.668624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:11.680004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:11.706642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.710094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.710579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:11.711324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:11.716521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:11.717223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.266004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:12.279321 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-873f8c77-8469-4d36-8782-95ccd2567aa2 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1472 microversion: 2.1 time: 0.638945 Oct 13 08:46:12.284363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1448/3117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:11 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1472 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:12.296659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "tag": "955884cf-3bf5-4261-9c1b-c1d6c1d88414"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:12.327930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:12.330317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:12.330930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.342341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:12.363856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] Creating event network-changed:955884cf-3bf5-4261-9c1b-c1d6c1d88414 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:12.380976 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b85d37fc-9e7f-4eec-868b-7cd3d842a1b5 req-02c33d54-bfe4-4bea-89a5-5992316a7696 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091368 Oct 13 08:46:12.384684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1449/3118] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:12.402315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:12.407113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:12.432014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:12.433369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:12.435547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.440253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:12.441215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:12.445119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.819277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:12.835660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c6d70ec-9e64-46ba-b3b1-9831cfa72d9d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1232 microversion: 2.1 time: 0.448722 Oct 13 08:46:12.836552 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1450/3119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:12 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1232 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:12.841463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:12.844566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:12.857598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:12.858093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:12.858565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.871551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:12.872041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:12.872486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:12.983511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:13.013652 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d4db5ee-ef15-4d4a-8b39-1e4aed52cbe9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 1.554021 Oct 13 08:46:13.014994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1670/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:11 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:13.074071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:13.076056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:13.093550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.095190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.096154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:13.100289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.101464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.102935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:13.328465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:13.354469 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e512b9ef-8edd-4310-a2bb-97e612b8b27c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.516017 Oct 13 08:46:13.366438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1451/3121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:12 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:13.395193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:13.396206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:13.415740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.419555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.420267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:13.421245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.421947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.422621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:13.561074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:13.570980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8cf5fbfa-6154-4bee-8708-ddd00ddce26f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 200 len: 1486 microversion: 2.1 time: 0.554209 Oct 13 08:46:13.579021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1671/3122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:13 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 1486 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:13.864857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:13.866712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:13.879941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.881574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.882267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:13.883982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:13.884822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:13.885498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.056594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:14.091601 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a08d2522-c658-44f4-8259-5c5f3a465b69 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1232 microversion: 2.1 time: 0.230559 Oct 13 08:46:14.094387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1672/3123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:13 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1232 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:14.103412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:14.107235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:14.121689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.122902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.123695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.124649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.129055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.129836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.270149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:14.285041 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-014ef67e-367a-42d2-b7c9-04fe407ebce7 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 200 len: 1430 microversion: 2.1 time: 0.910705 Oct 13 08:46:14.288447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1452/3124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:13 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 1430 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:14.304613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237325ea-f9dc-46d2-b465-29caf04d175b", "name": "network-vif-deleted", "tag": "9c9e98b0-7d89-4579-8641-ae92fbd79825"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:14.346901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.361875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.362469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.442436 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] Creating event network-vif-deleted:9c9e98b0-7d89-4579-8641-ae92fbd79825 for instance 237325ea-f9dc-46d2-b465-29caf04d175b on n-h1-858384-11 Oct 13 08:46:14.473046 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-28023d67-64e6-41f0-9883-b8989515817d req-79c95c64-b5ed-42b7-806a-8516e7ba5cc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183209 Oct 13 08:46:14.477212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1453/3125] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:14.487422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:14.488129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:14.503666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.504336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.505050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.506688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.507148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.508987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.633043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:14.644312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-212b3e2e-32ec-4246-8c97-3ad73a342c4a tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.548291 Oct 13 08:46:14.657624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1673/3126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:14 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:14.675872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a", "name": "network-vif-deleted", "tag": "b4a0d212-9351-44e1-8d91-d957d2fe89e5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:14.701588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.702520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.703114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.717852 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] Creating event network-vif-deleted:b4a0d212-9351-44e1-8d91-d957d2fe89e5 for instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a on n-h1-858384-11 Oct 13 08:46:14.726842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c25000a6-9064-422c-9e0e-ce18ea12378a req-570f03fb-f6e9-407b-90da-61114de6a4bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064340 Oct 13 08:46:14.727664 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1674/3127] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:14.743745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:14.760610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7366bbb3-8539-4ff9-b14b-5dec01db9f51 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.279378 Oct 13 08:46:14.761525 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1454/3128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:14 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:14.778708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:14.779300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:14.793981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.796298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.797547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.799162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:14.800596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:14.802135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:14.825251 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b HTTP/1.1 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '237325ea-f9dc-46d2-b465-29caf04d175b'} Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:14.828339 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:14.834556 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:14.838385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:14.839588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa9949e4-b540-45ea-a4af-52bde83450aa tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 404 len: 111 microversion: 2.1 time: 0.076578 Oct 13 08:46:14.840933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1455/3129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:14 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:14.915569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3cf62789-9e36-4838-a66c-e8bfe4bf4e21 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Action: 'create', calling method: .version_select at 0x7f5376d55dc0>, body: {"keypair": {"name": "tempest-keypair-950684778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAXV1ALGacC7uboSSuoOW3mvbyCi+jWrk4AXcqePpC0EBmDfB2q4Ytt57OEug8oDDGedS9S151i2nHUSJBxrac6mULISerdcS/gsaeSNqxTmpgUpIb7UV3LHR6eXs7ZRA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:14.940159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3cf62789-9e36-4838-a66c-e8bfe4bf4e21 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Getting quotas for project 3040e47e475743a09cc51c365544bcef. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:14.946881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3cf62789-9e36-4838-a66c-e8bfe4bf4e21 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Getting quotas for user bae3cc2beac74abab5de2f8a722a2e0d and project 3040e47e475743a09cc51c365544bcef. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:15.000316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2050719956", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:15.016068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3cf62789-9e36-4838-a66c-e8bfe4bf4e21 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287071 Oct 13 08:46:15.033238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1675/3130] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:46:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:15.099870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] validate_networks() for [('ea9dba19-ae29-472b-9f4d-0d0b50f53e88', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:15.117708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:15.118596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:15.127207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.128154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.128902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.129944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.130609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.131893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.297661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:15.309828 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5b9999b-74b6-40f4-bcda-209f94e3d22d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1288 microversion: 2.1 time: 0.195856 Oct 13 08:46:15.324296 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1676/3131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:15 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1288 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:15.336937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:15.338722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:15.346616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.347114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.347551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.348481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.348943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.349499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.365937 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] HTTP exception thrown: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Request method failure captured: Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a HTTP/1.1 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-cuusSHXv3qBlJOka2Wl_v1LFyLq41Cz-RtUamJeIn2mmem3eWXG7r8BvKWds1z3oMHHu9OINxEvjona-oMG51KFUFJtlNrC3hPcdgS6Rt7IpYRqb1nrJR2-h1XctxAwQfNvsKv906bMVPcdykZYdY1jiLEjBELKFaKMgXYXdlCsk Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9852b0f775bb49b69ec545583461cc04 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9852b0f775bb49b69ec545583461cc04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9852b0f775bb49b69ec545583461cc04 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListImageFiltersTestJSON-1624445598-project Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6fc215eee0fa48bd9da0c34313a17252 Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListImageFiltersTestJSON-1624445598-project Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a'} Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:15.368131 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Returning 404 to user: Instance d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:15.374795 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f14c4524-0090-45b0-9cc0-27cf7c3cc437 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a" status: 404 len: 111 microversion: 2.1 time: 0.044062 Oct 13 08:46:15.379347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1677/3132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:15 2022] GET /compute/v2.1/servers/d4b3d43b-c021-4a57-b65a-a3c5bf9a3a6a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:15.385246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:15.385757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:15.393323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.393815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.394255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.394987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.395442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.395863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.429991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:15.548116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b704952-6829-4a75-bee6-f32a700398ad tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 204 len: 0 microversion: 2.1 time: 0.167105 Oct 13 08:46:15.548995 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1678/3133] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:15 2022] DELETE /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:15.559507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:15.560283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:15.567230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.574334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.575150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.576768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.578783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.579488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.914311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:15.934088 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb471f0a-3d3f-4661-a6d6-52bb5a6626d0 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1473 microversion: 2.1 time: 0.379460 Oct 13 08:46:15.936203 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1679/3134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:15 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:15.943377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:15.944868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:15.953235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.954367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.955488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:15.956882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:15.957511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:15.959587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.337755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:16.338386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:16.338677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:16.339300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:16.339902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:16.361456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.361957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.362399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.363167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.363629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.364065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.384560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:16.391450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Getting quotas for user e27491f47ce944f0936a61bd642cd057 and project 79dd0ede64c1404db2bf7c78059238ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:16.408757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:16.413478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:16.451358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:16.492784 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7772cec5-4780-4a95-b5ea-cac6d507edef tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.497946 Oct 13 08:46:16.495190 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1456/3135] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:46:16.504474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:16.509645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:16.510458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:16.514491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8888abff-bf98-42d3-9746-59651c7480b9 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.576857 Oct 13 08:46:16.526315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1680/3136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:15 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:16.532141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:16.532947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:16.549413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.549884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.550322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.551058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.551510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.551937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.562090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.562782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.563243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.563997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.564462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.564895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.614060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:16.806146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:16.824127 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e123c15-b1f7-4c88-b143-916c81bd1922 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1286 microversion: 2.1 time: 0.288491 Oct 13 08:46:16.838963 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1681/3137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:16 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1286 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:16.850702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a2b8a90-0d17-431e-82ca-024f9ffb4005 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:16.851224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a2b8a90-0d17-431e-82ca-024f9ffb4005 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:16.891881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:16.908879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39b915fe-8b87-4439-aa44-b0c969fe70e7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.412072 Oct 13 08:46:16.910753 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1457/3138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:16 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:16.924156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "tag": "c13942fc-db0b-461d-9b58-0a3096cc7863"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:16.955947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:16.956909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:16.957545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:16.986810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a2b8a90-0d17-431e-82ca-024f9ffb4005 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:16.993964 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a2b8a90-0d17-431e-82ca-024f9ffb4005 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1225 microversion: 2.1 time: 0.153813 Oct 13 08:46:16.999012 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1682/3139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:16 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:17.006303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:17.011322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:17.017465 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] Creating event network-changed:c13942fc-db0b-461d-9b58-0a3096cc7863 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:17.026587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.026857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c70583a4-c965-4981-8b0e-b800b0cdadc4 req-c15080a4-4f65-4717-a4ec-9af44c3948ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112501 Oct 13 08:46:17.027606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.028212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.028432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1458/3140] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:17.029559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.030177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.031396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.412456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:17.416793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46b543ac-431e-46d7-ae65-43132b040087 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1473 microversion: 2.1 time: 0.419722 Oct 13 08:46:17.431328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1683/3141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:16 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:17.551870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:17.552774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:17.562777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.563687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.564456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.565492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.566196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.566859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.852058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:17.853415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:17.859868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.860864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.861561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.862584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.863294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.864022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.942391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:17.945487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:17.952973 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78b3e613-7ec3-48d7-97e1-2061ef71cf0c tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.406700 Oct 13 08:46:17.970340 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1459/3142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:17 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:17.976742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:17.977741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:17.985490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.986303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.987126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:17.987909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:17.988444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:17.988948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.168082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:18.186949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9b777d0-0fe6-4db0-8855-5e685e1dc0aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.337736 Oct 13 08:46:18.187851 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1684/3143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:17 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:18.198660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:18.204831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:18.213371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.214571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.215197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.216068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.217653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.218833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.323250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:18.331889 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dfc6032b-e480-4aae-a384-7a9a5843848a tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1285 microversion: 2.1 time: 0.142726 Oct 13 08:46:18.332764 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1685/3144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:18 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:18.441340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:18.441954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:18.457175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.457666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.458141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.459655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.460154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.460576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.583073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:18.593272 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e66ad27f-c26c-4ecf-a669-32ce7fc2ef2e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.620720 Oct 13 08:46:18.603673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1460/3145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:17 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:18.612908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4090ddd3-e92b-40ab-92db-d637dac74af6", "name": "network-vif-plugged", "status": "completed", "tag": "ade43845-b327-4b2a-93bb-66fe7ed094dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:18.624090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:18.627315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.627950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.628486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.633509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7e0312b-cadb-4897-a22f-30bcec993a84 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1473 microversion: 2.1 time: 0.195943 Oct 13 08:46:18.639111 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1686/3146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:18 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:18.645921 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] Creating event network-vif-plugged:ade43845-b327-4b2a-93bb-66fe7ed094dc for instance 4090ddd3-e92b-40ab-92db-d637dac74af6 on n-h2-858384-11 Oct 13 08:46:18.653473 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6349b8f0-578d-445a-ba4f-391fe5da9b43 req-b8465d89-ea19-479a-8034-f3b4a1ba7864 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045844 Oct 13 08:46:18.654847 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1461/3147] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:18.977957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:18.978627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:18.988240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.989357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.989803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:18.991792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:18.992242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:18.992674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.216802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:19.218025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:19.236326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.237141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.238854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.240751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.242716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.243771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.353575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:19.362978 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-abfe8302-ee5c-4024-ab92-50ab28ed34f4 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.389450 Oct 13 08:46:19.378981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1687/3148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:18 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:19.386148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:19.387047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:19.394887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.395634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.396280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.397156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.397894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.398562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.529856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:19.539587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6788fe1c-6262-4b44-836e-f48387435306 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1283 microversion: 2.1 time: 0.158357 Oct 13 08:46:19.540785 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1688/3149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:19 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:19.616844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:19.617265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:19.623820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.624553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.625171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.626042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.626830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.627422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.778516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:19.790007 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6226d04-ddf8-44f7-b8b0-fcbe7fce12c6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.579839 Oct 13 08:46:19.803777 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1462/3150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:19 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:19.818397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:19.819237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:19.828735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.829437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.830001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.831030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:19.831675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:19.832821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:19.992112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc215eee0fa48bd9da0c34313a17252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9852b0f775bb49b69ec545583461cc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:19.996262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:20.000353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1298eff-de7a-47b6-b36f-56466f789633 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 200 len: 1431 microversion: 2.1 time: 0.195086 Oct 13 08:46:20.008197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6eefa3bc-cf95-4ecb-b392-7013a2e9e3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.393531 Oct 13 08:46:20.009205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1689/3151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:19 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:20.015234 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1463/3152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:19 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 1431 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:20.023209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341b7b88-c80b-4cdc-9118-9af64498c249", "name": "network-vif-deleted", "tag": "82d6b402-b08a-44ef-835c-942ee4a36594"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:20.059347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:20.060083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:20.060703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:20.075986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] Creating event network-vif-deleted:82d6b402-b08a-44ef-835c-942ee4a36594 for instance 341b7b88-c80b-4cdc-9118-9af64498c249 on n-h2-858384-11 Oct 13 08:46:20.084899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c8ffdd37-f768-4a9c-ab4a-ef227bf31f61 req-e0bfe1e9-9694-460e-81b0-7bc25df2fe7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071042 Oct 13 08:46:20.086134 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1690/3153] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:20.186459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1077644470", "imageRef": "c1a7ec4a-30ab-4300-b258-f3fa90eddf53", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a5f9214a-8120-4a06-9220-6215755b5f6f"}], "security_groups": [{"name": "tempest-securitygroup--935730690"}], "key_name": "tempest-keypair-950684778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:20.360799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] validate_networks() for [('a5f9214a-8120-4a06-9220-6215755b5f6f', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:20.500881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1103191397", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:20.570152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:20.845675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:20.846994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:20.847822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:20.848451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:20.849018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:20.873496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:20.876753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:20.878299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:20.880114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:20.881656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:20.882722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:20.904163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Getting quotas for project 3040e47e475743a09cc51c365544bcef. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:20.913622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Getting quotas for user bae3cc2beac74abab5de2f8a722a2e0d and project 3040e47e475743a09cc51c365544bcef. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:20.931068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:20.934172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1a7ec4a-30ab-4300-b258-f3fa90eddf53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:20.941160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:20.942048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:20.942563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:20.943606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:20.944035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:20.968175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:20.969095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:20.970000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:20.970951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:20.971618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:20.972271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:20.996029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Getting quotas for project 16aeb065971b44dd88f56cc3c5c10ee7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:20.998997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b81d024f-0e9a-46b8-a03c-b308e2766915 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818036 Oct 13 08:46:21.000239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1464/3154] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:21.003865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Getting quotas for user 2077f75835184be788773e1eeb0b0f47 and project 16aeb065971b44dd88f56cc3c5c10ee7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:21.005224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.006655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.013330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.013946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.014557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.015364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.016053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.016833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.020216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:21.030282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:21.134039 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b56cb70d-3b21-4115-8c00-aa3d2bdd4374 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823756 Oct 13 08:46:21.147522 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1691/3155] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:46:21.170491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.173429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.186691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.187254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.187697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.188409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.188884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.190440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.326940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:21.337640 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-911b4f19-b3d5-432d-aa57-2520cd9ae951 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1324 microversion: 2.1 time: 0.336067 Oct 13 08:46:21.338634 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1465/3156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:21.344520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.345341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.352462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.353266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.353905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.354756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.355569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.356119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.684267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:21.692378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d6cfcdf-f813-4e99-a9b1-16ea96873cb0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.543688 Oct 13 08:46:21.697775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1692/3157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:21.722599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae90d7a3-4152-4409-a91f-fe3d0fcaa778 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.723602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae90d7a3-4152-4409-a91f-fe3d0fcaa778 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.732774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:21.749169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-911fad65-de26-45af-b330-a3d41ba118a1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.408430 Oct 13 08:46:21.753339 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1466/3158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:21.763802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.764421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.775980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.785605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.788296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.791877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.792419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.795474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.862276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae90d7a3-4152-4409-a91f-fe3d0fcaa778 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:21.870931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=35 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:21.881615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae90d7a3-4152-4409-a91f-fe3d0fcaa778 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1245 microversion: 2.1 time: 0.182353 Oct 13 08:46:21.883484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1693/3159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1245 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:21.906370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.908832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] [instance: 341b7b88-c80b-4cdc-9118-9af64498c249] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.915550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:21.930651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.932096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.932740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.933878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.945499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.946763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.970356 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] HTTP exception thrown: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Request method failure captured: Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 HTTP/1.1 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8-cuusSHXv3qBlJOka2Wl_v1LFyLq41Cz-RtUamJeIn2mmem3eWXG7r8BvKWds1z3oMHHu9OINxEvjona-oMG51KFUFJtlNrC3hPcdgS6Rt7IpYRqb1nrJR2-h1XctxAwQfNvsKv906bMVPcdykZYdY1jiLEjBELKFaKMgXYXdlCsk Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9852b0f775bb49b69ec545583461cc04 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9852b0f775bb49b69ec545583461cc04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9852b0f775bb49b69ec545583461cc04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9852b0f775bb49b69ec545583461cc04 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1624445598 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListImageFiltersTestJSON-1624445598-project Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6fc215eee0fa48bd9da0c34313a17252 Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListImageFiltersTestJSON-1624445598-project Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '341b7b88-c80b-4cdc-9118-9af64498c249'} Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:21.972649 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Returning 404 to user: Instance 341b7b88-c80b-4cdc-9118-9af64498c249 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47df0445-dc60-429f-b266-093ce573953d tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249" status: 404 len: 111 microversion: 2.1 time: 0.089740 Oct 13 08:46:21.978928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1694/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/341b7b88-c80b-4cdc-9118-9af64498c249 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:21.983845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:21.984673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:21.992988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.993800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.994549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:21.995461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:21.996676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:21.997465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.138121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:22.153017 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c307cc8e-a636-482f-b082-3ff769d6cb59 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.395865 Oct 13 08:46:22.153930 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1467/3161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:22.169570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6fd809a-cd83-4242-82ec-9297d9eb0ba8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375c20ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.207874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:22.239790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd865345-f8c4-4cff-88e0-33688e30e86c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1221 microversion: 2.1 time: 0.261261 Oct 13 08:46:22.262837 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1695/3162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:21 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1221 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:22.290191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c8f7df-186c-412a-995e-b33ef2e2e7c7", "tag": "6e27cf91-30d4-47d3-ac0c-fc6949a90046"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:22.309698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.310194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.310661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.357254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] Creating event network-changed:6e27cf91-30d4-47d3-ac0c-fc6949a90046 for instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 on n-h2-858384-11 Oct 13 08:46:22.370565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1cfe4979-65c9-47c9-b623-05c305f8b685 req-09fc4563-b538-4fa1-a6a0-afc45b8c719f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106099 Oct 13 08:46:22.372390 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1696/3163] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:22.382875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.383583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:22.397533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.398132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.399333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.400628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.401316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.401950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.635731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6fd809a-cd83-4242-82ec-9297d9eb0ba8 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76" status: 204 len: 0 microversion: 2.1 time: 0.477966 Oct 13 08:46:22.636433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1468/3164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:22 2022] DELETE /compute/v2.1/images/497a243f-545f-4324-8005-aba424ea0c76 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:22.644276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f067187f-e3c6-44f5-8e7e-2ad4fc0cef93 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5375d16820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.670022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:22.684396 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d96a608b-62f8-43c7-b9d6-e8660cbe193e tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1521 microversion: 2.1 time: 0.304354 Oct 13 08:46:22.685718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1697/3165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:22 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:22.709763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.710294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:22.716986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.717593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.718212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.719300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.719908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.720487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.770503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] HTTP exception thrown: Action 999 not found Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Request method failure captured: Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6/os-instance-actions/999 HTTP/1.1 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9BHBB1ZoTqWmmxt-mXa1XqUtGXrQVD6Wb5BmXGVQdTAJL5wPBim0yI7Td7gwhUPyjZ3JQdSJfBBgfqGifvt8fHEHHcGzsVJS9LKH2wq84C4GnSJBfAeCLyTxqQq7tgSQ1wj_FYSsCkQXJHIBjHEoAUqyA_LweP7pe6sdI5Zy7h6gXs Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 506df0c3fce94f11bb0328831c16c7aa Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: exception: Action 999 not found Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': '4090ddd3-e92b-40ab-92db-d637dac74af6', 'id': '999'} Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 13 08:46:22.782598 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:22.787525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Returning 404 to user: Action 999 not found {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:22.787525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2a9b8b7-a991-4eca-b76c-33e865597f65 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.079245 Oct 13 08:46:22.787525 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1698/3166] 10.222.0.23 () {58 vars in 1308 bytes} [Thu Oct 13 08:46:22 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6/os-instance-actions/999 => generated 66 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:46:22.795840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.796912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:22.808354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.808860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.809719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.811057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.811653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.813061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.947253 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f067187f-e3c6-44f5-8e7e-2ad4fc0cef93 tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935" status: 204 len: 0 microversion: 2.1 time: 0.306542 Oct 13 08:46:22.948104 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1469/3167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:22 2022] DELETE /compute/v2.1/images/33ad3a1d-3300-4360-90eb-8d5a0e3e9935 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:22.953156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f71ad1-18fd-44d9-878e-0ba4fbc08aad", "tag": "26bdeb26-8951-45ed-b59e-047e683d25c6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:22.966842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:22.967763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:22.968680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:22.982115 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] Creating event network-changed:26bdeb26-8951-45ed-b59e-047e683d25c6 for instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad on n-h1-858384-11 Oct 13 08:46:22.989128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-71cd7d3d-ed27-4f6a-a6fd-125204bbc3b5 req-e8059b20-0b84-4cc3-8227-863d9d46032a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038890 Oct 13 08:46:22.990487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1470/3168] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:22.995963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:22.996853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.004707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.005360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.006611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.007521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.008134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.008723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.179278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:23.187981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-49023b80-ee88-4cf8-8a54-48e58c338729 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.195985 Oct 13 08:46:23.188568 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1471/3169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:22 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:23.196021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '.version_select at 0x7f5375c20670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.196832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: c41035a7-fc6b-41ce-ba71-77cdbc2c2937] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.205419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] HTTP exception thrown: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Request method failure captured: Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c41035a7-fc6b-41ce-ba71-77cdbc2c2937/os-instance-actions HTTP/1.1 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BHBB1ZoTqWmmxt-mXa1XqUtGXrQVD6Wb5BmXGVQdTAJL5wPBim0yI7Td7gwhUPyjZ3JQdSJfBBgfqGifvt8fHEHHcGzsVJS9LKH2wq84C4GnSJBfAeCLyTxqQq7tgSQ1wj_FYSsCkQXJHIBjHEoAUqyA_LweP7pe6sdI5Zy7h6gXs Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 506df0c3fce94f11bb0328831c16c7aa Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'c41035a7-fc6b-41ce-ba71-77cdbc2c2937'} Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:23.207734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Returning 404 to user: Instance c41035a7-fc6b-41ce-ba71-77cdbc2c2937 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:23.214907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ca7de32-1c6f-4feb-91a2-c4ee1c270daa tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/c41035a7-fc6b-41ce-ba71-77cdbc2c2937/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.020465 Oct 13 08:46:23.216506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:23.217134 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1472/3170] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Oct 13 08:46:23 2022] GET /compute/v2.1/servers/c41035a7-fc6b-41ce-ba71-77cdbc2c2937/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:23.222774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.223396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.223905 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07e83440-e960-4b57-9436-658e5421d176 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.438030 Oct 13 08:46:23.232016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.232505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.233551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.234802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.235283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.236110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.238876 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1699/3171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:22 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:23.247050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8237a790-be96-4f4d-a8ef-1cf9df8c6fca tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] Calling method '.version_select at 0x7f5376963670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.312100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:23.325069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46098bc0-afac-435c-8ea2-150171057488 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1303 microversion: 2.1 time: 0.107991 Oct 13 08:46:23.338450 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1473/3172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:23 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:23.338450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.338450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.344735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.344735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.344735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.345032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.345652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.347012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.632152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:23.646950 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96f0dda2-e699-4a3b-aeb6-3b7449fd78c5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.316983 Oct 13 08:46:23.648591 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1474/3173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:23 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:23.663405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.663890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8237a790-be96-4f4d-a8ef-1cf9df8c6fca tempest-ListImageFiltersTestJSON-1624445598 tempest-ListImageFiltersTestJSON-1624445598-project] 10.222.0.23 "DELETE /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af" status: 204 len: 0 microversion: 2.1 time: 0.423769 Oct 13 08:46:23.664012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.664552 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1700/3174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:23 2022] DELETE /compute/v2.1/images/c68d6bf9-4803-4ab0-bb08-2dff8d4bf4af => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:23.669899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.671182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.680375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.681231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.681852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.682758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.683396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.683904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.693733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.695727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.696813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.699082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.701137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.703138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.782772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:23.790337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:23.799742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff0bfa6d-dedf-49cc-a326-3d984331a644 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1269 microversion: 2.1 time: 0.133930 Oct 13 08:46:23.800792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1701/3175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:23 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:23.900817 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0cefb564-8c6f-4924-aa46-7685962c8bd6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 204 len: 0 microversion: 2.1 time: 0.248732 Oct 13 08:46:23.902211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1475/3176] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:23 2022] DELETE /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:23.912577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:23.913517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:23.923433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.923964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.925037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:23.925980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:23.926646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:23.928229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.148884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:24.159614 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7df23c32-7779-4e49-9636-4cda00069515 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1527 microversion: 2.1 time: 0.252268 Oct 13 08:46:24.173921 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1702/3177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:23 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1527 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:24.216127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:24.217500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:24.228195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.228701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.229144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.230392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.230880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.231338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.258595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:24.259899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:24.273975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.274957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.277436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.279487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.280135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.287163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.468806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:24.478681 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8edfeae-a3a9-4ff3-9295-503aeb84b373 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.269928 Oct 13 08:46:24.491421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1476/3178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:24 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:24.502048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:24.503063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:24.509790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.510578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.511836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.512860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.513479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.514071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.556642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:24.560185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:24.570487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f408707f-d9ac-4bdb-8b2c-f4d51c4f4b7f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.319411 Oct 13 08:46:24.571331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1703/3179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:24 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:24.590879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:24.601703 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6e99326-816d-4bba-b3a8-1f4420996664 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1303 microversion: 2.1 time: 0.104342 Oct 13 08:46:24.616582 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1477/3180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:24 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:24.678389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:24.678389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:24.692647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.696617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.697104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.697864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.698327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.698803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.828247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:24.829129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:24.843361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.846830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.847859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.848790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:24.849439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:24.850832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:24.972862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:25.009717 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6d94793b-118e-454c-9f91-297e87869856 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1269 microversion: 2.1 time: 0.186281 Oct 13 08:46:25.011403 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1478/3181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:24 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:25.026283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-plugged", "status": "completed", "tag": "955884cf-3bf5-4261-9c1b-c1d6c1d88414"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:25.064116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:25.065268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:25.066032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:25.095728 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] Creating event network-vif-plugged:955884cf-3bf5-4261-9c1b-c1d6c1d88414 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:25.105434 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c1e5fe38-41ba-44ea-a2fe-21983be10c29 req-b8e655f9-9a2d-4189-beca-9a0b9ab3b0c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092073 Oct 13 08:46:25.107035 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1479/3182] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:25.191564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:25.198036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:25.214781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:25.217845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:25.220933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:25.223676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:25.225459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:25.226653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:25.254977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:25.277830 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb92cbd3-5bce-4904-bd3f-17399f372cab tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.594143 Oct 13 08:46:25.278572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1704/3183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:24 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:25.284684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:25.507643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:25.508833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:25.530352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:25.533023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:25.534940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:25.539493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:25.544211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:25.544972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:26.131311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:26.144482 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e42dba52-e26b-47e0-bbca-f461d9b2fd42 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1527 microversion: 2.1 time: 0.961324 Oct 13 08:46:26.150438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1480/3184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:25 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1527 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:26.164896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:26.171747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:26.193518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:26.197330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:26.197982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:26.199218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:26.204277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:26.206802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:26.719500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:26.729240 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-694a7fb3-d898-4bf8-9c33-1ff63f4602de tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 1.228349 Oct 13 08:46:26.735079 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1705/3185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:25 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:26.754329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:26.772696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:26.828581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:26.831937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:26.832608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:26.837802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:26.838474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:26.839077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.143625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:27.152317 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-819a2007-c0ce-439a-877c-0d5c0aa675fa tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.402515 Oct 13 08:46:27.162968 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1706/3186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:26 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:27.178150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:27.179221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:27.185598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.190131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.190683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.191438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.192359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.193493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.196708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:27.219171 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c70a894f-43b8-4f82-bff3-a3601c365301 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 1.067274 Oct 13 08:46:27.220346 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1481/3187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:26 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:27.270395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:27.281295 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2b265548-f339-4143-81c6-f1e715f9a1d6 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1275 microversion: 2.1 time: 0.116812 Oct 13 08:46:27.281971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1707/3188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:27 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:27.288249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:27.289110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:27.297015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.297502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.298138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.299038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.299657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.300420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.389418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01d24695-7268-48bb-a7ca-583e77df8329 tempest-ListImageFiltersNegativeTestJSON-1155263748 tempest-ListImageFiltersNegativeTestJSON-1155263748-project] Calling method '.version_select at 0x7f5375e63f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:27.414008 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-01d24695-7268-48bb-a7ca-583e77df8329 tempest-ListImageFiltersNegativeTestJSON-1155263748 tempest-ListImageFiltersNegativeTestJSON-1155263748-project] HTTP exception thrown: Image not found. Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01d24695-7268-48bb-a7ca-583e77df8329 tempest-ListImageFiltersNegativeTestJSON-1155263748 tempest-ListImageFiltersNegativeTestJSON-1155263748-project] Request method failure captured: Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/images/3afa15c8-9da4-4ab7-a8f4-f25fce17ec38 HTTP/1.1 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Bi810_HNd_A2E_W1SMakQAhXshSRFcnOjuudPXWV8ptehEpllRDH9x-cob6XjsrkZ-9DvHq4vCNSmkNps6NW4byOkUDhdfC5ubVwpI8Hdmgvuz85e8Ako2XEPhGXCZUM5zPOB-QhEKah_XmIE1bstGK_JC70aqk-iCflc46o6-YjQ Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: fec590fc0fc14e7fa5dd6ef8c50131ea Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1155263748 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fec590fc0fc14e7fa5dd6ef8c50131ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fec590fc0fc14e7fa5dd6ef8c50131ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fec590fc0fc14e7fa5dd6ef8c50131ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fec590fc0fc14e7fa5dd6ef8c50131ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1155263748 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: fec590fc0fc14e7fa5dd6ef8c50131ea Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1155263748 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ListImageFiltersNegativeTestJSON-1155263748-project Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f3f44c691f6140a8a5febd035cd66587 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1155263748-project Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3afa15c8-9da4-4ab7-a8f4-f25fce17ec38'} Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3afa15c8-9da4-4ab7-a8f4-f25fce17ec38 Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:46:27.416647 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3afa15c8-9da4-4ab7-a8f4-f25fce17ec38 could not be found. Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:46:27.420815 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:27.425283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01d24695-7268-48bb-a7ca-583e77df8329 tempest-ListImageFiltersNegativeTestJSON-1155263748 tempest-ListImageFiltersNegativeTestJSON-1155263748-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:27.426389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-01d24695-7268-48bb-a7ca-583e77df8329 tempest-ListImageFiltersNegativeTestJSON-1155263748 tempest-ListImageFiltersNegativeTestJSON-1155263748-project] 10.222.0.23 "GET /compute/v2.1/images/3afa15c8-9da4-4ab7-a8f4-f25fce17ec38" status: 404 len: 62 microversion: 2.1 time: 0.204722 Oct 13 08:46:27.427598 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1482/3189] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:27 2022] GET /compute/v2.1/images/3afa15c8-9da4-4ab7-a8f4-f25fce17ec38 => generated 62 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:46:27.437199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-plugged", "status": "completed", "tag": "de5aff6a-98f2-4beb-bc1a-67118fb3204e"}, {"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-plugged", "status": "completed", "tag": "c13942fc-db0b-461d-9b58-0a3096cc7863"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:27.447402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.448202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.448863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.461070 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Creating event network-vif-plugged:de5aff6a-98f2-4beb-bc1a-67118fb3204e for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:27.461945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] Creating event network-vif-plugged:c13942fc-db0b-461d-9b58-0a3096cc7863 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:27.467620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bf405008-e108-41de-9b1d-b917fcb4a7e6 req-057f657b-c851-4d76-bf4d-d717b3e32596 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038573 Oct 13 08:46:27.468845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1483/3190] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:27.474729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:27.475437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:27.481694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:27.481910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.482209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.482685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.483408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.483853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.484281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.493030 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23346378-3471-40cd-8b92-42515d12cbe7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.209732 Oct 13 08:46:27.498558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1708/3191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:27 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:27.770633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:27.771454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:27.785193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.788487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.788961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.790986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:27.792577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:27.793025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:27.859973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506df0c3fce94f11bb0328831c16c7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f7e0c014a9b9102581e93962949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:27.868887 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30e8c862-e588-41d5-b74a-0b5a3627b25f tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 200 len: 1527 microversion: 2.1 time: 0.398669 Oct 13 08:46:27.874028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1484/3192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:27 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:28.025802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4090ddd3-e92b-40ab-92db-d637dac74af6", "name": "network-vif-deleted", "tag": "ade43845-b327-4b2a-93bb-66fe7ed094dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:28.047087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.051071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.051774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.101761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] Creating event network-vif-deleted:ade43845-b327-4b2a-93bb-66fe7ed094dc for instance 4090ddd3-e92b-40ab-92db-d637dac74af6 on n-h2-858384-11 Oct 13 08:46:28.119640 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-df3618c0-01f3-498b-ba9a-bdf8e06231b3 req-1439b00a-5bc0-497b-80c0-2ee08ba03c4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099010 Oct 13 08:46:28.120941 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1485/3193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:28.184865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:28.186204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:28.187848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:28.196405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.196828 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75cc1b43-5e95-4715-8fcb-9692c0ba3e81 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.431881 Oct 13 08:46:28.201547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.202744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.203746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.204427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.205081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.221831 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1709/3194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:27 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:28.247815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:28.248442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:28.260713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.261213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.276129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.290177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.291907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.293281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.919076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:28.933674 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6637a443-c7b4-4e76-9c5a-a83611d1063f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.753402 Oct 13 08:46:28.948092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1486/3195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:28 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:28.958084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:28.959900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:28.967348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.968154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.968906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:28.969906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:28.970637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:28.971485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.120052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:29.155671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54c50683-e465-4d26-957a-458b93b4ff35 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1275 microversion: 2.1 time: 0.203418 Oct 13 08:46:29.156653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1487/3196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:28 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:29.165912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:29.171602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:29.182723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.183699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.184467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.185512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.186925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.187680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.267469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:29.275401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6696bdee-06a4-4fce-a06d-c5d2f3cabf98 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 1.032319 Oct 13 08:46:29.295127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1710/3197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:28 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:29.301488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:29.302214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] [instance: 4090ddd3-e92b-40ab-92db-d637dac74af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:29.318755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.319242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.323039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.324935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.325595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.331186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.375681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] HTTP exception thrown: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Request method failure captured: Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 HTTP/1.1 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9BHBB1ZoTqWmmxt-mXa1XqUtGXrQVD6Wb5BmXGVQdTAJL5wPBim0yI7Td7gwhUPyjZ3JQdSJfBBgfqGifvt8fHEHHcGzsVJS9LKH2wq84C4GnSJBfAeCLyTxqQq7tgSQ1wj_FYSsCkQXJHIBjHEoAUqyA_LweP7pe6sdI5Zy7h6gXs Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9e6f7e0c014a9b9102581e93962949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9c9e6f7e0c014a9b9102581e93962949 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2001226139 Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 506df0c3fce94f11bb0328831c16c7aa Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2001226139-project Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4090ddd3-e92b-40ab-92db-d637dac74af6'} Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:29.378664 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] Returning 404 to user: Instance 4090ddd3-e92b-40ab-92db-d637dac74af6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:29.383792 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-866ff33d-4214-49de-b762-3ed1e41c66d6 tempest-InstanceActionsNegativeTestJSON-2001226139 tempest-InstanceActionsNegativeTestJSON-2001226139-project] 10.222.0.23 "GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6" status: 404 len: 111 microversion: 2.1 time: 0.086364 Oct 13 08:46:29.387415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1711/3198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:29 2022] GET /compute/v2.1/servers/4090ddd3-e92b-40ab-92db-d637dac74af6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:29.396194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:29.397965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:29.405818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.406708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.407476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.409526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.411022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.412915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:29.932860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:29.948339 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b4b5af0-0f08-41bb-a16d-74fc5fdb8de6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.788597 Oct 13 08:46:29.950464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1488/3199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:29 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:29.968089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c8f7df-186c-412a-995e-b33ef2e2e7c7", "name": "network-vif-plugged", "status": "completed", "tag": "6e27cf91-30d4-47d3-ac0c-fc6949a90046"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:29.990012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:29.995833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:29.996521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.031372 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] Creating event network-vif-plugged:6e27cf91-30d4-47d3-ac0c-fc6949a90046 for instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 on n-h2-858384-11 Oct 13 08:46:30.053397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ba779dc1-1dc8-41fd-9793-2050623bfd08 req-b0c9a1ce-915b-4b35-aa68-ef5046ada98c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099250 Oct 13 08:46:30.055483 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1489/3200] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:30.070545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:30.071634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:30.089772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.090435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.091104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.091998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.092623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.095019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.227906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:30.241118 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f3eaec3-99d7-4804-8774-f77e595a6fe5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.849057 Oct 13 08:46:30.243411 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1712/3201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:29 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:30.257228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:30.258166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:30.266180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.266977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.267716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.269123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.269825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.270582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.409751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:30.431580 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c6649d5-4015-4b9d-babd-44c44b64d07f tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.374811 Oct 13 08:46:30.432389 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1490/3202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:30 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:30.459232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:30.461450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:30.479968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.481091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.482858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.484949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.486730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:30.487685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:30.717608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:30.731871 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c6c90ed-2803-44b6-a7c9-247896ee1d07 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.296756 Oct 13 08:46:30.733032 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1491/3203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:30 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:30.835778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:30.860071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a1e6159-528d-4231-9254-1fddc32a0009 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.604100 Oct 13 08:46:30.861389 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1713/3204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:30 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:30.980979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:30.981664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:30.991366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:30.993826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:30.996041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:30.998906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.000675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.002916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.004578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.006945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.272187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:31.272840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:31.289384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:31.291916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.292785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.293236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.294774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.295428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.296043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.467907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:31.477721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d40bb6ae-5eb8-4e2d-88ec-3e4547a8182c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1354 microversion: 2.1 time: 0.501412 Oct 13 08:46:31.478578 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1492/3205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:30 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1354 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:31.724618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:31.727763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.728607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.729215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.730253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.731026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.731765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.779768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0ce553b-dc48-4c3c-a3fe-370182721920 tempest-AZV2TestJSON-315913857 tempest-AZV2TestJSON-315913857-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.292499 Oct 13 08:46:31.780825 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1493/3206] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Oct 13 08:46:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:46:31.793622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:31.796052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:31.815441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.818143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.821796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.826526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:31.827315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:31.828008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:31.877601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:31.976005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:31.989271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c46cfef-017c-432f-9a16-189f1961809e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1328 microversion: 2.1 time: 0.718647 Oct 13 08:46:31.991057 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1714/3207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:31 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1328 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:31.998038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:32.000122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:32.017291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.023003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.023691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.024670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.025341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.025998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.204069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:32.218437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4e9ffc4-cf1b-4f86-a4b3-c8c261511356 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.436246 Oct 13 08:46:32.229813 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1494/3208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:31 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:32.243091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:32.244432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:32.252733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.253164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.253637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.254398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.254900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.255873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.486434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:32.501676 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31fcad3b-e6ee-4449-9e2e-c078f2df4814 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.509123 Oct 13 08:46:32.502734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1715/3209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:31 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:32.513241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f71ad1-18fd-44d9-878e-0ba4fbc08aad", "name": "network-vif-plugged", "status": "completed", "tag": "26bdeb26-8951-45ed-b59e-047e683d25c6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:32.542920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.543411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.543842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.571227 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] Creating event network-vif-plugged:26bdeb26-8951-45ed-b59e-047e683d25c6 for instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad on n-h1-858384-11 Oct 13 08:46:32.578760 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2e210824-2b60-401e-97dc-82ab139041d7 req-94eb13eb-242d-4e0c-b926-93c1c6d4759c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073711 Oct 13 08:46:32.584616 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1716/3210] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:32.595649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb60673-11e1-4222-88a5-514d66ab9ee5", "tag": "3e9c8ed0-7d8f-4a1d-bbe7-330230344053"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:32.617388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.617875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.618307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.642580 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] Creating event network-changed:3e9c8ed0-7d8f-4a1d-bbe7-330230344053 for instance acb60673-11e1-4222-88a5-514d66ab9ee5 on n-h1-858384-11 Oct 13 08:46:32.652258 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3687b0cc-8573-4c23-be55-335cce1c9d42 req-4ee7eed4-dc6c-48bb-bba4-be249fd87dc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065909 Oct 13 08:46:32.660251 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1717/3211] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:32.666298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:32.668915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:32.688739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.689548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.689993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.690762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.692258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.693906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.781112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:32.792654 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a5575c3-d812-4915-acb3-946a9e8b6ce2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.559072 Oct 13 08:46:32.793454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1495/3212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:32 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:32.806142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:32.825718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:32.828320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:32.830439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:32.831200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:32.862648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] Creating event network-changed:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:46:32.869225 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ec82aa8a-bd0d-4b19-8154-dcc87b414183 req-8cfc808b-b706-4713-9c7a-cc13d972c8f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072414 Oct 13 08:46:32.870297 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1496/3213] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:33.021998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.022617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.037271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.038718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.039384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.040355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.042659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.043274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.222912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:33.238173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-074d9788-cba5-466c-bd9f-48327dacb119 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1804 microversion: 2.1 time: 0.571640 Oct 13 08:46:33.239359 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1718/3214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:32 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1804 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:33.254500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.260185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.278221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.279157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.279776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.280674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.281306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.281922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.353412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:33.361938 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-92b9524e-6915-43ac-84e8-96f2ec797970 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1509 microversion: 2.1 time: 0.346460 Oct 13 08:46:33.371659 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1497/3215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:33 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:33.371971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.374046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.393475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.393983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.394454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.395266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.395760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.396192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.445468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a11d5ab-1d11-4bd6-941c-7d9f538f4349 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be/ips" status: 200 len: 218 microversion: 2.1 time: 0.077246 Oct 13 08:46:33.452337 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1498/3216] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:46:33 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be/ips => generated 218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:33.473170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.473871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.484326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.484837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.485304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.485999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.486464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.486894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.728117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:33.739526 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-829111eb-ca16-44a3-ac63-4b1c1d399406 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.490589 Oct 13 08:46:33.740186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1719/3217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:33 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:33.745057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.745556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.751284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:33.751584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.752757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.753400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.754643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.756329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.756766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.762048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6554ad23-21b8-4f5c-ae65-8f31b4653a75 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1509 microversion: 2.1 time: 0.300916 Oct 13 08:46:33.762048 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1499/3218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:33 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:33.767230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.767831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.787773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:33.788699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.789680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.790448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.791164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.791834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.792029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.861156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:33.902366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-616900c8-62a1-4e83-8966-2dfa77156744 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 204 len: 0 microversion: 2.1 time: 0.159875 Oct 13 08:46:33.903718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1720/3219] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:33 2022] DELETE /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:33.910883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:33.912657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:33.920421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.921344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.922014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.923150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:33.923773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:33.924415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:33.956192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:34.117886 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfc8d805-71c9-493f-87af-927d5eea5301 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 204 len: 0 microversion: 2.1 time: 0.211863 Oct 13 08:46:34.123491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1721/3220] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:33 2022] DELETE /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:34.132339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:34.146328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c76be766-8156-4eab-a629-a1e2b9783441 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.382580 Oct 13 08:46:34.146966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1500/3221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:33 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:34.151403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:34.151403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:34.158001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.158520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.162302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:34.163061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:34.166398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.167373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.168038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.168653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.177391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.178209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.178698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.184928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.189706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.190386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.397952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:34.400702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:34.408617 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-26092415-6c07-4aea-8163-0d89ffe3c576 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1810 microversion: 2.1 time: 0.257399 Oct 13 08:46:34.413942 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1501/3222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:34 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:34.424772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:34.426290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:34.427218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:34.434095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd28f229-6dac-4e8f-888f-dac3e90b214f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.308197 Oct 13 08:46:34.434735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1722/3223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:34 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:34.436387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.436912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.437352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.438067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.438554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.438986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.640800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:34.652916 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e37864a6-fb07-469d-bec6-0b9fa71cbf33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1515 microversion: 2.1 time: 0.239743 Oct 13 08:46:34.653555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1502/3224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:34 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:34.763427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:34.764043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:34.772253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.774524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.775330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:34.776959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:34.777637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:34.778239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.040965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:35.057971 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88bc7ac3-9757-4f9c-9325-5ad39846fc01 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.298361 Oct 13 08:46:35.059271 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1723/3225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:34 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:35.171280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:35.173064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:35.180047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.180806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.181499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.182312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.183057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.184366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.248845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e455c9de-dd8a-425e-9b6f-7d641fb8902e tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-817349791", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:35.252267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-e455c9de-dd8a-425e-9b6f-7d641fb8902e tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] HTTP exception thrown: min_count must be <= max_count Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e455c9de-dd8a-425e-9b6f-7d641fb8902e tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Request method failure captured: Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 183 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BqMhRBuCxC2HJeEKzJbXMwCFvBdSJr0KvJprDzWvQv36mllpgfqUmv_lj3_zg5pUmRPEzACRb-Wf1ILP1htoLUrId9E8cmygp-Itz7IwOpitHK-51xvxhTN6GBl7gfUp-FED702q4p3z82OCLyiZwe3iOPailnsryxZKQ17hY_UBc Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb5c5f8237784ea7af07942cf966ecdc Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-817349791", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: exception: min_count must be <= max_count Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-817349791', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 13 08:46:35.254119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.260654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e455c9de-dd8a-425e-9b6f-7d641fb8902e tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Returning 400 to user: min_count must be <= max_count {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:35.261671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e455c9de-dd8a-425e-9b6f-7d641fb8902e tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.180114 Oct 13 08:46:35.262249 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1503/3226] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:35 2022] POST /compute/v2.1/servers => generated 74 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:46:35.315326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-050f9d29-0ab7-4bec-8ff3-c700a3102990 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-933007736", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "max_count": 0}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-050f9d29-0ab7-4bec-8ff3-c700a3102990 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Request method failure captured: Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 167 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BqMhRBuCxC2HJeEKzJbXMwCFvBdSJr0KvJprDzWvQv36mllpgfqUmv_lj3_zg5pUmRPEzACRb-Wf1ILP1htoLUrId9E8cmygp-Itz7IwOpitHK-51xvxhTN6GBl7gfUp-FED702q4p3z82OCLyiZwe3iOPailnsryxZKQ17hY_UBc Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb5c5f8237784ea7af07942cf966ecdc Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-933007736", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "max_count": 0}} Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-933007736', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'max_count': 0}}} Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 0 Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:46:35.319442 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-050f9d29-0ab7-4bec-8ff3-c700a3102990 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-050f9d29-0ab7-4bec-8ff3-c700a3102990 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009482 Oct 13 08:46:35.324342 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1504/3227] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:46:35.375377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c564014a-6a01-4ec6-8d84-94dfaeef5531 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-432731014", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "max_count": 2.5}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c564014a-6a01-4ec6-8d84-94dfaeef5531 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Request method failure captured: Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 169 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BqMhRBuCxC2HJeEKzJbXMwCFvBdSJr0KvJprDzWvQv36mllpgfqUmv_lj3_zg5pUmRPEzACRb-Wf1ILP1htoLUrId9E8cmygp-Itz7IwOpitHK-51xvxhTN6GBl7gfUp-FED702q4p3z82OCLyiZwe3iOPailnsryxZKQ17hY_UBc Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb5c5f8237784ea7af07942cf966ecdc Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-432731014", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "max_count": 2.5}} Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-432731014', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'max_count': 2.5}}} Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 2.5 Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:46:35.379383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c564014a-6a01-4ec6-8d84-94dfaeef5531 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c564014a-6a01-4ec6-8d84-94dfaeef5531 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010291 Oct 13 08:46:35.384593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1505/3228] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:46:35.435473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-004391f5-9852-42d4-bdbb-d2c7ed20fde1 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388616808", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 0}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-004391f5-9852-42d4-bdbb-d2c7ed20fde1 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Request method failure captured: Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 168 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BqMhRBuCxC2HJeEKzJbXMwCFvBdSJr0KvJprDzWvQv36mllpgfqUmv_lj3_zg5pUmRPEzACRb-Wf1ILP1htoLUrId9E8cmygp-Itz7IwOpitHK-51xvxhTN6GBl7gfUp-FED702q4p3z82OCLyiZwe3iOPailnsryxZKQ17hY_UBc Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb5c5f8237784ea7af07942cf966ecdc Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1388616808", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 0}} Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1388616808', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'min_count': 0}}} Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 0 Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:46:35.440909 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-004391f5-9852-42d4-bdbb-d2c7ed20fde1 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:35.446454 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-004391f5-9852-42d4-bdbb-d2c7ed20fde1 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011194 Oct 13 08:46:35.454318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1506/3229] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:46:35.461147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:35.461975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:35.462657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:35.470956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.471727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.472346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.473221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.473882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.474512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.479225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08728c79-60bb-47f0-ba4f-a1923ef79b1f tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.312543 Oct 13 08:46:35.479820 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1724/3230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:35 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:35.484844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:35.492955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:35.500758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.501280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.501716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.502434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.502883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.503307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.731598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:35.740068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88615439-8e0d-4377-afc2-8827ee171e61 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1810 microversion: 2.1 time: 0.283303 Oct 13 08:46:35.740673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1507/3231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:35 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:35.752106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed31660f-f9cc-4c56-b5a5-9b08e2cdd087 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1371260348", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 2.5}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed31660f-f9cc-4c56-b5a5-9b08e2cdd087 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Request method failure captured: Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 170 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BqMhRBuCxC2HJeEKzJbXMwCFvBdSJr0KvJprDzWvQv36mllpgfqUmv_lj3_zg5pUmRPEzACRb-Wf1ILP1htoLUrId9E8cmygp-Itz7IwOpitHK-51xvxhTN6GBl7gfUp-FED702q4p3z82OCLyiZwe3iOPailnsryxZKQ17hY_UBc Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2589021f7e7e48519bf48c12eef9316e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 2589021f7e7e48519bf48c12eef9316e Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-452143926 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: eb5c5f8237784ea7af07942cf966ecdc Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-452143926-project Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1371260348", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 2.5}} Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1371260348', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'min_count': 2.5}}} Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 2.5 Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:46:35.756786 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed31660f-f9cc-4c56-b5a5-9b08e2cdd087 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed31660f-f9cc-4c56-b5a5-9b08e2cdd087 tempest-MultipleCreateNegativeTestJSON-452143926 tempest-MultipleCreateNegativeTestJSON-452143926-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016384 Oct 13 08:46:35.763305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1508/3232] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:46:35.767838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:35.768690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:35.778912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.779444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.779919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.780673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:35.781160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:35.781800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:35.785563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:35.805613 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-650a5648-6384-4aae-9190-1a83be381b4a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.324567 Oct 13 08:46:35.814771 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1725/3233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:35 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:36.084553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:36.085201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:36.095050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.095789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.096489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.097207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.097837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.098477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.135657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:36.146738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e9e1459-b6e3-467d-9da8-f664b5998976 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1515 microversion: 2.1 time: 0.382639 Oct 13 08:46:36.159405 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1509/3234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:35 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:36.458956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:36.467447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57098e70-bb20-49e2-84d9-0f235384ab38 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.388919 Oct 13 08:46:36.487926 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1726/3235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:36 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:36.504682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:36.510775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:36.520124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.521671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.522777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.523734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.524276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.524783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.572817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c8f7df-186c-412a-995e-b33ef2e2e7c7", "name": "network-vif-deleted", "tag": "6e27cf91-30d4-47d3-ac0c-fc6949a90046"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:36.599299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.599815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.602153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.626324 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] Creating event network-vif-deleted:6e27cf91-30d4-47d3-ac0c-fc6949a90046 for instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 on n-h2-858384-11 Oct 13 08:46:36.634451 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8625aefe-dc5b-41e5-8998-a11773ba008b req-0d353866-47c0-4050-b0e5-66b8487ba2ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072247 Oct 13 08:46:36.636016 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1727/3236] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:36.765819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:36.767421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:36.775740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.776479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.777175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.778127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.778827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.779513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.858691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:36.870270 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab4fa63a-a452-4d3d-b465-88227ebe25d4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1325 microversion: 2.1 time: 0.370831 Oct 13 08:46:36.870911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1510/3237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:36 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1325 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:36.884516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:36.890364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:36.903438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.904071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.904440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:36.917993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:36.918600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:36.919283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.088037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:37.098239 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b75c4172-55a4-4b14-b185-3296af784116 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1810 microversion: 2.1 time: 0.337279 Oct 13 08:46:37.099388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1728/3238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:36 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:37.133373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:37.142777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac72efbc-42c9-4fb5-b168-469720646e05 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.270762 Oct 13 08:46:37.160516 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1511/3239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:36 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:37.172058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:37.172797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:37.188034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.188558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.189019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.189757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.190439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.191650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.291609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.294195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.294775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.296435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lazy-loading 'fault' on Instance uuid 77c8f7df-186c-412a-995e-b33ef2e2e7c7 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:46:37.464678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:37.472464 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38fe8bc0-cbf7-48c0-bdb2-03d09137e87a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 200 len: 1318 microversion: 2.1 time: 0.304555 Oct 13 08:46:37.475409 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1729/3240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:37 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:37.504198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:37.505674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:37.513092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.513819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.514525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.515462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.516081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.516730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.866258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:37.874916 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b2ffa988-5e5e-4f47-9e16-3d3568a9b219 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.376253 Oct 13 08:46:37.891766 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1512/3241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:37 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:37.897615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:37.898327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:37.905132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.905793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.906502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:37.907442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:37.908105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:37.908877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.127252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.127252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.132968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.133316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.133757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.136193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.136655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.137084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.345468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:38.366542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3f6eca9-48ae-4ef9-85c3-b6e507900caf tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1522 microversion: 2.1 time: 0.473187 Oct 13 08:46:38.380509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:38.383689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1730/3242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:37 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:38.397540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.398399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a2940fb4-ef42-4f91-8244-6923de218216 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1789 microversion: 2.1 time: 0.277112 Oct 13 08:46:38.398585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.399287 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1513/3243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:38 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1789 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:38.409889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.410849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.413251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.413747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.415515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.416306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.416768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.417190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.426570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.427161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.427841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.430757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.431638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.432383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.468519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:46:38.592324 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-431caec1-0da0-415b-8520-86987107951e tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 204 len: 0 microversion: 2.1 time: 0.190948 Oct 13 08:46:38.594007 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1514/3244] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:38 2022] DELETE /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:46:38.602567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.605014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.614475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.615455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.616375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.617085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.617695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.618970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.637243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 HTTP/1.1 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '77c8f7df-186c-412a-995e-b33ef2e2e7c7'} Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:38.638984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:46:38.644267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:38.644769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:38.646249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:38.647238 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32a8018f-2144-4c3f-96d3-bfbe9a473d42 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 404 len: 111 microversion: 2.1 time: 0.051819 Oct 13 08:46:38.648061 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1515/3245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:38 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:38.653344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-deleted", "tag": "c13942fc-db0b-461d-9b58-0a3096cc7863"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:38.653969 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1cfee1a-a853-42a1-b206-53ddf692dcc1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.269126 Oct 13 08:46:38.664316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.665231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.665917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.667548 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1731/3246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:38 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:38.676407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.677990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.682348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] Creating event network-vif-deleted:c13942fc-db0b-461d-9b58-0a3096cc7863 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:38.684809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.685308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.685744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.686468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.686925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.687343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.691551 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2b766a15-cc72-424f-bfa3-087fbb00b1b7 req-cbd842d4-8d52-48c2-85c5-ff17843e3af9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042043 Oct 13 08:46:38.696130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1516/3247] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:38.705516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3e2e64bf-eb78-48b0-bfb5-801d68c64b95 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '.version_select at 0x7f5375ed2670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.742834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3e2e64bf-eb78-48b0-bfb5-801d68c64b95 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-387055673" status: 202 len: 0 microversion: 2.1 time: 0.045244 Oct 13 08:46:38.744934 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1517/3248] 10.222.0.23 () {58 vars in 1206 bytes} [Thu Oct 13 08:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-387055673 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:46:38.880823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:38.898296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:38.899171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:38.900033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d93d05ee-2341-49e7-bd57-eef16bef9580 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1528 microversion: 2.1 time: 0.225622 Oct 13 08:46:38.914031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.917876 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1732/3249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:38 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1528 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:38.929867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.932356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.935282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:38.938668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:38.941050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:38.986319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1491157103", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:39.102381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:39.127799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:39.141896 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbcd9eb8-247d-4b50-931b-3708f36d3ed1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.248737 Oct 13 08:46:39.143088 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1518/3250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:38 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:39.151182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-unplugged", "status": "completed", "tag": "955884cf-3bf5-4261-9c1b-c1d6c1d88414"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:39.164711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.166393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.166966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.184889 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] Creating event network-vif-unplugged:955884cf-3bf5-4261-9c1b-c1d6c1d88414 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:39.191576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0fedeb85-ad8c-4fba-9a0a-25d1a668f7ed req-4422d762-b794-4339-b602-b2cd378c6ea6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045393 Oct 13 08:46:39.193598 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1519/3251] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:39.429469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:39.430253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:39.437324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.437824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.438296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.439026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.439660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.440069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.593059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:39.602701 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fbbfc479-b796-4760-8d1c-a04ae77c1413 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1674 microversion: 2.1 time: 0.178273 Oct 13 08:46:39.604644 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1520/3252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:39 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:39.681702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:39.682600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:39.689063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.689633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.690187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.690995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.691586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.694746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.857235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:39.867284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4487d39-9509-4a82-9809-78cc4ba6f01e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.190510 Oct 13 08:46:39.868035 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1521/3253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:39 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:39.945995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:39.946770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:39.953507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.953995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.954662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:39.955542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:39.956001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:39.956594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.211610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:40.231519 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b6c784e-322b-4872-bd73-491b58bc2ee0 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1528 microversion: 2.1 time: 0.290128 Oct 13 08:46:40.237804 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1522/3254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:39 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1528 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:40.247290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:40.255397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:40.268122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.271812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.272439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.273750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.274218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.277167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.591272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:40.606390 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2cd21dcf-872b-4bfb-bfc9-82db52ab6572 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.366925 Oct 13 08:46:40.609268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1523/3255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:40 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:40.632882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:40.633980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:40.645682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.646592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.647217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.648150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.648784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.649376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.728421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:40.729048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:40.729309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:40.729915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:40.730540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:40.749098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.749596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.752655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.752655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:40.752655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:40.752655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:40.783708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:40.792530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:40.836453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:40.849848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:40.857522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:40.962927 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f33cae17-a1a9-4ad0-984c-606e86078dfd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982051 Oct 13 08:46:40.970032 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1733/3256] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:46:40.987182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-deleted", "tag": "de5aff6a-98f2-4beb-bc1a-67118fb3204e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:41.051242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.052990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.053508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.087847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] Creating event network-vif-deleted:de5aff6a-98f2-4beb-bc1a-67118fb3204e for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:41.102352 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-70ffa425-1295-4644-b870-9eae84a678c5 req-a60628ad-f8f6-48d9-855f-6da9cef16781 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129312 Oct 13 08:46:41.103536 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1734/3257] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:41.145322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:41.153673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:41.175857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.176502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.177718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.178571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.180423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.181994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.402346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:41.404910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:41.418527 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39b40d03-e6aa-43f6-ab1e-623b69b0a81c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1653 microversion: 2.1 time: 0.793828 Oct 13 08:46:41.418892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:41.432663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40405fba-0cc2-4aae-80d9-a90b115922ef tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.306263 Oct 13 08:46:41.435164 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1735/3259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:41 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:41.437817 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1524/3259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:40 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1653 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:41.445438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:41.448791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6cd1e9c-dba6-42f8-a255-07e54b0c8c8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:41.449481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6cd1e9c-dba6-42f8-a255-07e54b0c8c8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:41.449874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:41.471315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.471848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.472510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.473093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.474134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.474629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.676250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d6cd1e9c-dba6-42f8-a255-07e54b0c8c8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:41.710019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6cd1e9c-dba6-42f8-a255-07e54b0c8c8c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1209 microversion: 2.1 time: 0.266889 Oct 13 08:46:41.715521 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1736/3260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:41 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1209 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:41.734939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-unplugged", "status": "completed", "tag": "de5aff6a-98f2-4beb-bc1a-67118fb3204e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:41.740926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:41.780592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.781314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.782288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.800686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] Creating event network-vif-unplugged:de5aff6a-98f2-4beb-bc1a-67118fb3204e for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:41.811196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-924bcead-c854-4c5d-bddb-fedbfcedcc9f req-ac3793f6-01bb-45a1-b563-20c217e792dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092181 Oct 13 08:46:41.812160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1737/3261] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:41.830919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:41.843447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:41.857345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.859038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.859600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:41.863881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:41.864536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:41.865074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.217881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:42.242425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6142c4dc-57dd-43bc-9189-f95839aa2ee4 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1528 microversion: 2.1 time: 0.799220 Oct 13 08:46:42.244498 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1525/3262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:41 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1528 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:42.357040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:42.372904 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea3fa56b-cdde-4adb-92db-312c5b2e1f71 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.558601 Oct 13 08:46:42.382751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1738/3263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:41 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:42.448168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:42.452324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:42.467457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:42.468852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:42.472826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.475095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.478508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.479393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.480324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.483296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.483688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.485474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.486243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.486745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.487157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.488438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.499910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:42.568110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.569430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.570211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.570955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lazy-loading 'fault' on Instance uuid 71af2c59-068c-4250-8575-6da00105d0be {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:46:42.643385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:42.652515 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b371cb03-14a6-4c78-bc0a-a18310826667 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 200 len: 1302 microversion: 2.1 time: 0.210976 Oct 13 08:46:42.653323 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1526/3264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:42 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 1302 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:42.711227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:42.719605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc470601-bd09-4814-a3f6-d0d13df34f54 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.257296 Oct 13 08:46:42.720335 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1739/3265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:42 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:42.742113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:42.742951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:42.750322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.750857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.751292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.752258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:42.754503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:42.755911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:42.872728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:42.910879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4072f06d-7f2b-406b-b980-0097eb37ee57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1261 microversion: 2.1 time: 0.171308 Oct 13 08:46:42.914541 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1527/3266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:42 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:43.157754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71af2c59-068c-4250-8575-6da00105d0be", "name": "network-vif-deleted", "tag": "955884cf-3bf5-4261-9c1b-c1d6c1d88414"}, {"server_uuid": "69f71ad1-18fd-44d9-878e-0ba4fbc08aad", "name": "network-vif-deleted", "tag": "26bdeb26-8951-45ed-b59e-047e683d25c6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:43.195294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.199967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.201542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.248686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Creating event network-vif-deleted:955884cf-3bf5-4261-9c1b-c1d6c1d88414 for instance 71af2c59-068c-4250-8575-6da00105d0be on n-h1-858384-11 Oct 13 08:46:43.251299 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] Creating event network-vif-deleted:26bdeb26-8951-45ed-b59e-047e683d25c6 for instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad on n-h1-858384-11 Oct 13 08:46:43.259134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-819352e1-2ee7-4a01-8f7c-55a311ad4fab req-2bdd071c-ce0a-43a3-bb4b-7789c94d5b7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105230 Oct 13 08:46:43.262571 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1740/3267] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:43.267118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:43.267736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:43.279848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.280112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.285588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.287083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.290213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.290896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.377553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.379025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.379475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.381590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lazy-loading 'fault' on Instance uuid 69f71ad1-18fd-44d9-878e-0ba4fbc08aad {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:46:43.398475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:43.400334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:43.415680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.416470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.417168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.417934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.418482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.420630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.492739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27491f47ce944f0936a61bd642cd057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dd0ede64c1404db2bf7c78059238ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:43.500731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9082af6-4077-4c30-ade0-ae296286b5f5 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 200 len: 1315 microversion: 2.1 time: 0.237510 Oct 13 08:46:43.517023 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1528/3268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:43 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:43.652133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:43.661893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d820407-72a8-4a5d-9b92-d8b6a82dd60e tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.267471 Oct 13 08:46:43.663163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1741/3269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:43 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:43.683512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:43.684396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:43.691479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.691990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.692952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.693982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.694631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.695371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.720319 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be HTTP/1.1 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '71af2c59-068c-4250-8575-6da00105d0be'} Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:43.722312 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:46:43.726341 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:43.734083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:43.737145 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a357cf55-1cfc-416a-890f-612a68bcf6ba tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 404 len: 111 microversion: 2.1 time: 0.063555 Oct 13 08:46:43.737774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1529/3270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:43 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:43.744656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:43.745439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:43.752666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.753407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.754106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.755623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:43.756316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:43.756976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:43.987600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:43.999137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6509ce3-535f-4bca-b790-434eedaba586 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.258522 Oct 13 08:46:43.999747 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1742/3271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:43 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:44.014309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-plugged", "status": "completed", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}, {"server_uuid": "acb60673-11e1-4222-88a5-514d66ab9ee5", "name": "network-vif-plugged", "status": "completed", "tag": "3e9c8ed0-7d8f-4a1d-bbe7-330230344053"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:44.029458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-517164726", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:44.041080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.041562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.041995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.071895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Creating event network-vif-plugged:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:46:44.078542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] Creating event network-vif-plugged:3e9c8ed0-7d8f-4a1d-bbe7-330230344053 for instance acb60673-11e1-4222-88a5-514d66ab9ee5 on n-h1-858384-11 Oct 13 08:46:44.102594 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7e39f7d9-7863-482c-b38a-6d51ecec084e req-ca3dd23c-5f9d-44d0-86a0-39e6e45f9b92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097548 Oct 13 08:46:44.103541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1743/3272] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:44.110834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] validate_networks() for [('1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:44.121867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:44.122741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:44.130463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.131343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.132034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.133035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.133742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.134396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.360235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:44.372560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cda79644-931d-4632-83b2-f40b1bfd49d6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1267 microversion: 2.1 time: 0.267061 Oct 13 08:46:44.373646 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1744/3273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:44 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:44.528801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:44.532185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 69f71ad1-18fd-44d9-878e-0ba4fbc08aad] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:44.550947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.552334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.552992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.555535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.556265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.558798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.612524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad HTTP/1.1 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '69f71ad1-18fd-44d9-878e-0ba4fbc08aad'} Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.615591 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 69f71ad1-18fd-44d9-878e-0ba4fbc08aad could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:44.620206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5a8d6e5-9762-425d-8bb8-3765f153c025 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad" status: 404 len: 111 microversion: 2.1 time: 0.098769 Oct 13 08:46:44.620915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1745/3274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:44 2022] GET /compute/v2.1/servers/69f71ad1-18fd-44d9-878e-0ba4fbc08aad => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:44.634094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57ed4a94-fe70-43c1-8bfd-1f2557aea5a2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f53765e34c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:44.675602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-57ed4a94-fe70-43c1-8bfd-1f2557aea5a2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Image not found. Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57ed4a94-fe70-43c1-8bfd-1f2557aea5a2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269 HTTP/1.1 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '35c8694a-3c66-4290-abf3-9def98a56269'} Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 35c8694a-3c66-4290-abf3-9def98a56269 to delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35c8694a-3c66-4290-abf3-9def98a56269 could not be found. Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:44.682301 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57ed4a94-fe70-43c1-8bfd-1f2557aea5a2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57ed4a94-fe70-43c1-8bfd-1f2557aea5a2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269" status: 404 len: 62 microversion: 2.1 time: 0.059727 Oct 13 08:46:44.690503 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1746/3275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:44 2022] DELETE /compute/v2.1/images/35c8694a-3c66-4290-abf3-9def98a56269 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:46:44.700608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:44.701241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:44.725402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.726041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.729397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:44.730541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:44.731106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:44.731649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.163062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:45.180554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3933ddee-a652-4a8e-84b4-9b62f82e98c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1370 microversion: 2.1 time: 0.489210 Oct 13 08:46:45.181152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1747/3276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:44 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1370 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:45.201278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:45.201989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:45.212296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.212836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.213293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.224439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.225111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.225620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.248755 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b HTTP/1.1 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '237325ea-f9dc-46d2-b465-29caf04d175b'} Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:45.250361 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:45.254336 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-703a3697-03f9-446b-b2d4-90d0be4105d2 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 404 len: 111 microversion: 2.1 time: 0.056304 Oct 13 08:46:45.276051 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1748/3277] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:45 2022] DELETE /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:45.281206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:45.283232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:45.294127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.295165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.295689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.296769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.297311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.297902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.367440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:45.368682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:45.369564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:45.369924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:45.370365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:45.386751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.388400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.389416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.390675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.392743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.393989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.485504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:45.506931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for user 0b27726e98ef45d197945672a6e66f22 and project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:45.548988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:45.559298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:45.658133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3f56267-0a6d-4bd7-87e2-ccbdc428610d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859481 Oct 13 08:46:45.662383 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1530/3278] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:45.667405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:45.674729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 237325ea-f9dc-46d2-b465-29caf04d175b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:45.704094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.707012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.710242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.712199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.712684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.714343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.747224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b HTTP/1.1 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '237325ea-f9dc-46d2-b465-29caf04d175b'} Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.749452 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. Oct 13 08:46:45.754653 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:46:45.757281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 237325ea-f9dc-46d2-b465-29caf04d175b could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:45.758388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14d9eca5-7177-48d1-9003-8c91be1bf940 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b" status: 404 len: 111 microversion: 2.1 time: 0.094801 Oct 13 08:46:45.759469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1531/3279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:45 2022] GET /compute/v2.1/servers/237325ea-f9dc-46d2-b465-29caf04d175b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:45.766332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:45.767447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:45.775868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.777571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.778277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:45.780339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:45.781328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:45.782277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:46.014314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:46.027020 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d66847a6-a69e-4945-a825-449bfed0538b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1317 microversion: 2.1 time: 0.748744 Oct 13 08:46:46.035392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1749/3280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:45 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:46.060197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-639823786", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:46.158132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] validate_networks() for [('1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:46.800484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:46.819566 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cbd86f0-fc71-4c21-bf5b-6ba0fe6fa888 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 1.058693 Oct 13 08:46:46.820413 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1532/3281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:45 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:46.825106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10fa447c-96e4-451c-a490-1be2f4107630 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f5375eaa700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:46.864956 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10fa447c-96e4-451c-a490-1be2f4107630 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-477382130" status: 202 len: 0 microversion: 2.1 time: 0.042892 Oct 13 08:46:46.866119 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1533/3282] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-477382130 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:46:46.871057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:46.876799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:46.892521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:46.893323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:46.893960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:46.894976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:46.896194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:46.896896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.413137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:47.423834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6907418-2f46-4b93-9359-93742d96ba4c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1556 microversion: 2.1 time: 0.556407 Oct 13 08:46:47.427025 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1534/3283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:46 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1556 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:47.457441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:47.458159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:47.480314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.480931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.481387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.482150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.482645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.483082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.684116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:47.684688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:47.685508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:47.687177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:47.688127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:47.705603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.706552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.708959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.710006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.713052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.713729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.763740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:47.782931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for user 0b27726e98ef45d197945672a6e66f22 and project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:47.819061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:47.823490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:47.897766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:47.909155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e84db25c-3a94-4357-a992-9a91ce8b8d7b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1466 microversion: 2.1 time: 0.480864 Oct 13 08:46:47.909832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1535/3284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:47 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1466 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:47.930745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f02f228-b94d-409c-a487-477ed276baa9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889714 Oct 13 08:46:47.931762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1750/3285] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:47.946452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:47.948180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:47.949617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:47.950236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:47.964319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.966073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.966869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.967846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.968534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.969208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.974828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.977069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.977725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:47.978661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:47.984708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:47.985551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:48.565014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:48.576739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1103c65d-7516-4366-a273-b64748d7e4c9 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.643647 Oct 13 08:46:48.578006 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1751/3286] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:46:47 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-interface => generated 284 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:48.582471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93050a3b-b689-44d6-a102-cc4607b9eb7e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.637820 Oct 13 08:46:48.583957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1141817181", "metadata": {"image_type": "test"}}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:48.586661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1536/3287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:47 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:48.606307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1928960481", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "451", "networks": [{"uuid": "1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:48.608370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:48.623557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:48.624410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:48.625079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:48.626022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:48.626738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:48.627426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:48.671018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:48.713681 n-d-858384-11 devstack@n-api.service[127031]: Exception ignored in: . at 0x7f5375f63d30> Oct 13 08:46:48.713681 n-d-858384-11 devstack@n-api.service[127031]: Traceback (most recent call last): Oct 13 08:46:48.713681 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 13 08:46:48.718920 n-d-858384-11 devstack@n-api.service[127031]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 13 08:46:48.718920 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 13 08:46:48.719465 n-d-858384-11 devstack@n-api.service[127031]: connection_record.checkin() Oct 13 08:46:48.719465 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 13 08:46:48.719768 n-d-858384-11 devstack@n-api.service[127031]: pool.dispatch.checkin(connection, self) Oct 13 08:46:48.719768 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 13 08:46:48.727543 n-d-858384-11 devstack@n-api.service[127031]: fn(*args, **kw) Oct 13 08:46:48.727543 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 13 08:46:48.729313 n-d-858384-11 devstack@n-api.service[127031]: time.sleep(0) Oct 13 08:46:48.729313 n-d-858384-11 devstack@n-api.service[127031]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 13 08:46:48.729870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Getting quotas for project 16aeb065971b44dd88f56cc3c5c10ee7. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:48.735118 n-d-858384-11 devstack@n-api.service[127031]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 13 08:46:48.735118 n-d-858384-11 devstack@n-api.service[127031]: AssertionError: do not call blocking functions from the mainloop Oct 13 08:46:48.736993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Getting quotas for user 2077f75835184be788773e1eeb0b0f47 and project 16aeb065971b44dd88f56cc3c5c10ee7. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:48.755957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] validate_networks() for [('1bcb98d3-bbb1-4a33-bdb4-e5da6cd6b339', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:49.076869 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c84c34c0-2eed-4a64-af00-8f205451ab59 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "POST /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626/action" status: 202 len: 0 microversion: 2.1 time: 0.496994 Oct 13 08:46:49.080120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1752/3288] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:46:48 2022] POST /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:46:49.100425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee6e59cf-7a64-4104-abb7-ef0f5f7c160f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765e3940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:49.173092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee6e59cf-7a64-4104-abb7-ef0f5f7c160f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.085397 Oct 13 08:46:49.173752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1753/3289] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:49 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:49.612669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:49.614618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:49.637008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:49.641080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:49.642437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:49.644352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:49.648539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:49.649592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:49.974383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:49.986202 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c167c0d2-7407-4ea5-a818-6647f02b1cc3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.380758 Oct 13 08:46:49.986980 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1754/3290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:49 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:50.002222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32305f64-fabb-4240-8c9a-e1a23bc86907 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '.version_select at 0x7f5375e259d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:50.080635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-32305f64-fabb-4240-8c9a-e1a23bc86907 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Image not found. Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32305f64-fabb-4240-8c9a-e1a23bc86907 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/images/9c54a8bc-184a-406a-9052-a172a55fff7b HTTP/1.1 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: exception: Image not found. Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '9c54a8bc-184a-406a-9052-a172a55fff7b'} Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9c54a8bc-184a-406a-9052-a172a55fff7b to delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c54a8bc-184a-406a-9052-a172a55fff7b could not be found. Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.083721 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:46:50.089187 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.093417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32305f64-fabb-4240-8c9a-e1a23bc86907 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Image not found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:50.094562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32305f64-fabb-4240-8c9a-e1a23bc86907 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/images/9c54a8bc-184a-406a-9052-a172a55fff7b" status: 404 len: 62 microversion: 2.1 time: 0.105366 Oct 13 08:46:50.095485 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1755/3291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:49 2022] DELETE /compute/v2.1/images/9c54a8bc-184a-406a-9052-a172a55fff7b => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:46:50.101983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2534080-aa36-404f-9a80-6efe22745775", "tag": "d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:50.127661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:50.134491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:50.135181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:50.150796 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] Creating event network-changed:d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d for instance b2534080-aa36-404f-9a80-6efe22745775 on n-h2-858384-11 Oct 13 08:46:50.156335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f0bf77bc-0407-4898-ac02-15b22abfec70 req-dac88e4d-36c4-4736-a1d8-7a726978ef66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059170 Oct 13 08:46:50.157561 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1756/3292] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:50.164590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:50.165530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:50.172051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:50.172685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:50.173228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:50.174050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:50.174915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:50.175534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:50.190213 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 HTTP/1.1 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27'} Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:50.193396 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.197369 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.199727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:50.200806 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c196ac82-a784-4ffd-8590-227f8ccec700 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "DELETE /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 404 len: 111 microversion: 2.1 time: 0.041357 Oct 13 08:46:50.201567 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1757/3293] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:46:50 2022] DELETE /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:50.208167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd562575-2d3e-4496-9316-0bc7891b194c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765725e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:50.335250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd562575-2d3e-4496-9316-0bc7891b194c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.132016 Oct 13 08:46:50.339914 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1758/3294] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:50 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:50.346367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:50.347187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] [instance: 707c9f64-eef3-4e91-bd32-6b3b44501e27] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:50.377975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:50.378833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:50.380032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:50.381508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:50.383573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:50.384484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:50.456298 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] HTTP exception thrown: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Request method failure captured: Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 HTTP/1.1 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_7AnZ6hkev-KMJigsIE7BYFf8cJVEj79JKypBNhoXx0rPJ_wwFIjPsrqZ-moZM12-xs6K3kPjBw4Zg0SrbheKPX_687AddgxV9Ta3aldaCV3-YBVVVETD7honFeKvfRu04eURljIZSVBcMz8fQk1Qm719J8OXNzEPsVkERHDCTyQI Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/79dd0ede64c1404db2bf7c78059238ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 79dd0ede64c1404db2bf7c78059238ac Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: e27491f47ce944f0936a61bd642cd057 Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1443394195-project Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '707c9f64-eef3-4e91-bd32-6b3b44501e27'} Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.460120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. Oct 13 08:46:50.464714 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:46:50.469051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] Returning 404 to user: Instance 707c9f64-eef3-4e91-bd32-6b3b44501e27 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:46:50.470247 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ec5b5aa0-eff6-4580-a136-3f22e74e8169 tempest-ImagesOneServerNegativeTestJSON-1443394195 tempest-ImagesOneServerNegativeTestJSON-1443394195-project] 10.222.0.23 "GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27" status: 404 len: 111 microversion: 2.1 time: 0.129354 Oct 13 08:46:50.471237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1759/3295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:50 2022] GET /compute/v2.1/servers/707c9f64-eef3-4e91-bd32-6b3b44501e27 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:46:51.015660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:51.019002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:51.040540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:51.041480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:51.043627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:51.045224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:51.046432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:51.048143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:51.561338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:51.571886 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f803f1d-4b25-4981-8267-3fd4201dc887 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.561774 Oct 13 08:46:51.578852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1760/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:51 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:51.589500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38e92551-b29c-45bf-af3a-ff5a7a6e5448 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53764dde50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:51.669551 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38e92551-b29c-45bf-af3a-ff5a7a6e5448 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.089435 Oct 13 08:46:51.670504 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1761/3297] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:51 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:51.830848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1306956869", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "5f1a323a-49c5-4cdc-a0eb-d638ab6d76b4"}, {"uuid": "e901e802-0845-4e6a-8229-6c4ff8b35d24"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:51.898234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] validate_networks() for [('5f1a323a-49c5-4cdc-a0eb-d638ab6d76b4', None, None, None, None, None), ('e901e802-0845-4e6a-8229-6c4ff8b35d24', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:53.404418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:53.404982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:53.405369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:53.405804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:53.406263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:53.430338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.430867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.431309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.432114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.433032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.433629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.482349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:53.500668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Getting quotas for user 0b27726e98ef45d197945672a6e66f22 and project f564a6a72a37480ebd87a2c2f44950cc. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:53.523329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:53.529243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:53.601267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:46:53.601845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:46:53.602519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:46:53.603208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:46:53.603834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:46:53.619059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.623095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.623844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.624877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.625894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.627312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.654739 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b7f6c55-5e52-4025-a43a-7637692d0e04 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.061610 Oct 13 08:46:53.656239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1537/3298] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:53.662496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:53.668980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:53.678522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.679306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.679925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.680438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Getting quotas for project 4ba45f45bd464b9889a06f8573e15495. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:46:53.681000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:53.681617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:53.682756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:53.712212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Getting quotas for user 121483ba66f145de9e50420bd52cf669 and project 4ba45f45bd464b9889a06f8573e15495. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:46:53.746523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:46:53.749371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:46:53.844540 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-469c9fb3-7d6b-4b00-ac97-055e14730555 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.017581 Oct 13 08:46:53.855526 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1762/3299] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:46:53.882499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0cc19ad3-7617-43ac-9b15-d3ddbf07d6a3 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5376696310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:53.981866 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0cc19ad3-7617-43ac-9b15-d3ddbf07d6a3 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.123767 Oct 13 08:46:53.983194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1763/3300] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:53 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:53.988622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-553178a4-4420-4520-a236-f22324828cc7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:53.989713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-553178a4-4420-4520-a236-f22324828cc7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:54.118689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-553178a4-4420-4520-a236-f22324828cc7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:54.130286 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-553178a4-4420-4520-a236-f22324828cc7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1221 microversion: 2.1 time: 0.145196 Oct 13 08:46:54.134709 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1764/3301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:53 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:54.144336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b86a45d0-c337-4078-a4d2-586a84c2b787 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:54.151540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b86a45d0-c337-4078-a4d2-586a84c2b787 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:54.289214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b86a45d0-c337-4078-a4d2-586a84c2b787 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:54.307450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b86a45d0-c337-4078-a4d2-586a84c2b787 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1213 microversion: 2.1 time: 0.171545 Oct 13 08:46:54.309484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1765/3302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:54 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:54.710231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c855f8-1522-4e21-b4e1-91513503fa22", "tag": "67a6d353-0404-4909-8635-c706fab0d00d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:54.730769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:54.744821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:54.745300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:54.746152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:54.774808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] Creating event network-changed:67a6d353-0404-4909-8635-c706fab0d00d for instance e0c855f8-1522-4e21-b4e1-91513503fa22 on n-h1-858384-11 Oct 13 08:46:54.783456 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-aeab234e-d325-4cb7-9e12-7f0f47c55f72 req-b6779006-1c06-408c-8025-f82b13ed9916 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078164 Oct 13 08:46:54.790091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1766/3303] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:46:55.000932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b7a8c79-fdcd-40fd-bb3c-a9b89f319ca1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5376696ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:55.203140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b7a8c79-fdcd-40fd-bb3c-a9b89f319ca1 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.208374 Oct 13 08:46:55.203908 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1767/3304] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:54 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:55.229540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:55.231796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:55.260846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:55.266534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:55.271054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:55.275725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:55.277285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:55.278983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:55.533472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:55.546884 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-288e93a1-86bf-4a36-8c5b-0b8323b2a3ff tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1225 microversion: 2.1 time: 0.341856 Oct 13 08:46:55.563806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1768/3305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:55 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1225 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:55.587566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:55.595325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:55.609436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:55.610290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:55.612876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:55.613898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:55.623064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:55.623865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:55.703384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:55.711853 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b20303d3-23b7-445b-bdcc-4ed458025e50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 2.053878 Oct 13 08:46:55.715531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1538/3306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:53 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:56.211455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb60673-11e1-4222-88a5-514d66ab9ee5", "tag": "3e9c8ed0-7d8f-4a1d-bbe7-330230344053"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:56.241253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:56.244435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:56.246101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:56.302341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] Creating event network-changed:3e9c8ed0-7d8f-4a1d-bbe7-330230344053 for instance acb60673-11e1-4222-88a5-514d66ab9ee5 on n-h1-858384-11 Oct 13 08:46:56.313188 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-434f85a6-1920-436e-ae22-85478dab28be req-bc898eb5-668d-4023-8fb3-c31d5c5b8098 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105828 Oct 13 08:46:56.315199 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1539/3307] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:56.341982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96c2a33d-8664-4d0a-9cd2-7544821a44ac tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375cd3310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:56.463038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96c2a33d-8664-4d0a-9cd2-7544821a44ac tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.144197 Oct 13 08:46:56.471431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1540/3308] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:56 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:56.586805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:56.587670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:56.606124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:56.606667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:56.619016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:56.619973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:56.620471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:56.620914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:56.718846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:56.725638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:46:56.741934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7fa4310c-03c4-4138-91cf-7255a56fce6e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1209 microversion: 2.1 time: 1.176286 Oct 13 08:46:56.750501 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1769/3309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:55 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1209 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:56.763936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:56.775526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:56.803954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:56.804786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:56.806539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:56.807462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:56.812868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:56.815014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:56.917067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:56.927695 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61c54ac1-6952-4900-8499-78e4fcaecd3f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1273 microversion: 2.1 time: 0.353471 Oct 13 08:46:56.928851 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1541/3310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:56 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:57.479532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f62cc5db-d741-49f0-bacb-674f228cb4c4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375e9ee50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:57.524989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:57.540234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68e57f7a-d778-4d8a-87a3-a5138ca91bd1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.786196 Oct 13 08:46:57.545066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1770/3311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:56 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:57.565272 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f62cc5db-d741-49f0-bacb-674f228cb4c4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.090756 Oct 13 08:46:57.566332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1542/3312] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:57 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:57.773592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:57.774594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:57.791663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:57.796084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:57.799136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:57.802279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:57.805854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:57.806556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:57.909016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:57.921528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbdf611d-8d56-4351-8da0-ba4d31c1f4c2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1265 microversion: 2.1 time: 0.152071 Oct 13 08:46:57.923372 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1771/3313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:57 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:57.951930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:57.952731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:57.966925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:57.967495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:57.968050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:57.968955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:57.969534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:57.970063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:58.122007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-plugged", "status": "completed", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:58.146474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:58.147136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:58.147679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:58.177080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] Creating event network-vif-plugged:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:46:58.186214 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-604d4923-6fd1-4908-9b1a-53e5c22a6809 req-a6111348-9736-4156-9173-5f6390803a9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069257 Oct 13 08:46:58.195770 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1772/3314] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 13 08:46:58.574781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:58.576241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:58.585141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:58.587563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:58.590187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:58.591558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:58.592253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:58.592920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:58.787285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:58.802885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f54f90e-88ea-4cbf-a428-dafeddf1676e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1279 microversion: 2.1 time: 0.854506 Oct 13 08:46:58.804123 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1543/3315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:57 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1279 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:58.818434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-633cb522-5713-4bbf-8f96-fcb7c41e2252 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f04dc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:58.924309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-633cb522-5713-4bbf-8f96-fcb7c41e2252 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.118659 Oct 13 08:46:58.927758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1544/3316] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:46:58 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:58.945625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730d86ac-3f52-43e8-a302-849e197aee26", "tag": "d305a2ac-3216-429f-a8ee-8f2f20829d83"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:58.983931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:58.987349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:58.988022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:59.023173 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] Creating event network-changed:d305a2ac-3216-429f-a8ee-8f2f20829d83 for instance 730d86ac-3f52-43e8-a302-849e197aee26 on n-h2-858384-11 Oct 13 08:46:59.050833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6c8afee3-3b64-42ba-a6f7-a31998cd1ede req-2789dafb-fd98-4238-9480-5a00b901d73b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107481 Oct 13 08:46:59.052837 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1545/3317] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:46:59.072514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:59.077822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:59.109762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:59.110530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:59.114858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:59.115914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:59.116634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:59.117292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:59.164806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:59.179331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ba3c4b7-5a90-4089-a738-d39bc4179604 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.611461 Oct 13 08:46:59.186190 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1773/3318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:58 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:46:59.716489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1966923664", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "31da2796-9c2b-47aa-80b7-a5c66f373842"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:46:59.833728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] validate_networks() for [('31da2796-9c2b-47aa-80b7-a5c66f373842', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:46:59.873768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:46:59.889359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1ca4705-3ba3-4498-ae5a-cad38ed43a72 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1283 microversion: 2.1 time: 0.833604 Oct 13 08:46:59.907429 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1546/3319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:59 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1283 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:46:59.918238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:46:59.921675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:46:59.940216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:59.943006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:59.943627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:46:59.944550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:46:59.947032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:46:59.947655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.172547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:00.185948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-34339cf2-dae5-4a69-90bd-cb528c98eb1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1279 microversion: 2.1 time: 0.276882 Oct 13 08:47:00.187799 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1547/3320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:46:59 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:00.198759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8b8d41b-e1d8-42a0-882d-3d65478979fd tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f59280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:00.312967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8b8d41b-e1d8-42a0-882d-3d65478979fd tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.123452 Oct 13 08:47:00.314614 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1548/3321] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:00 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:00.327696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:00.339216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:00.349881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.355202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.355886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.357435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.360473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.361099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.563718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:00.564858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:00.565508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:00.566074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:00.566692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:00.580778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.582487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.585857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.588579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.589246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.591054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.673520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Getting quotas for project 55cf31a244f6454aac8efa6e44c3f449. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:47:00.699565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Getting quotas for user 16a48728ca0a40b083d4b54bcdd51beb and project 55cf31a244f6454aac8efa6e44c3f449. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:47:00.740222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:47:00.743275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:47:00.799387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-397b597c-ff18-432c-b8bc-ad5dbe5fffae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191744 Oct 13 08:47:00.807910 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1774/3322] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:47:00.814722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97b95136-d1c3-4b9c-8ef0-4819d7b63cf7 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:00.815680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97b95136-d1c3-4b9c-8ef0-4819d7b63cf7 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:00.898313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97b95136-d1c3-4b9c-8ef0-4819d7b63cf7 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:00.909290 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97b95136-d1c3-4b9c-8ef0-4819d7b63cf7 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1225 microversion: 2.1 time: 0.099992 Oct 13 08:47:00.923986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1775/3323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:00 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:00.933972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:00.934884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:00.944512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.945230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.945851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:00.946838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:00.947461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:00.948068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:01.034816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:01.052644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb6de993-6b27-40b5-bba6-301fdfb851f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1271 microversion: 2.1 time: 0.127457 Oct 13 08:47:01.053978 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1776/3324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:00 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:01.211987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:01.212607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:01.229728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:01.230386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:01.232189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:01.243657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:01.244378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:01.245472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:01.330472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:01.341336 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89bc1519-805f-4e10-ac9c-ed3abb9b4d50 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1279 microversion: 2.1 time: 0.134907 Oct 13 08:47:01.351881 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1777/3325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:01 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:01.362220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9bab930-1ffa-46f7-a588-4b97c3dee441 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5376cfddc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:01.458793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9bab930-1ffa-46f7-a588-4b97c3dee441 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.105119 Oct 13 08:47:01.467339 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1778/3326] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:01 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:01.552056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:01.554691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:01.575109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-803ab8e1-5027-463f-9dfd-121a5c07d58a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 1.246372 Oct 13 08:47:01.576490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1549/3327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:00 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:01.938185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:01.947183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:01.961222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:01.961823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:01.962340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:01.965380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:01.967123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:01.970477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.081297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:02.082869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:02.095981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:02.096554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.097243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.097893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.103037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.103952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7987871f-8406-449c-9bb6-f0e79d8a5cae tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1221 microversion: 2.1 time: 0.170161 Oct 13 08:47:02.104866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.105817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.108565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1779/3328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:01 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1221 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:02.369517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:02.370565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:02.409378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.409948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.411132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.411936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.412499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.413503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.462309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:02.485885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a79ab72d-fb40-4497-9637-4320701a0ddf tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1271 microversion: 2.1 time: 0.410680 Oct 13 08:47:02.501414 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1550/3329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:02 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1271 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:02.508302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf707762-8106-4aa9-9295-c68b05641702 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375ed2940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:02.563480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:02.581423 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84834150-c7c9-4c92-a962-d8ba2346c815 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1279 microversion: 2.1 time: 0.217995 Oct 13 08:47:02.594434 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf707762-8106-4aa9-9295-c68b05641702 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.082766 Oct 13 08:47:02.594997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1780/3330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:02 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:02.595090 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1551/3331] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:02 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:02.603157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:02.603769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:02.616458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.616953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.617391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.618138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:02.618713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:02.619140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:02.886370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:02.896775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04fc798a-60dc-4659-a7c2-130d447b7788 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.297457 Oct 13 08:47:02.913762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1781/3332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:02 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:03.132325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:03.132950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:03.153331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.153838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.154280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.172327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.172878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.173344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.460070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:03.509139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:03.509750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:03.518627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:03.518795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.519279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.519941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.520802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.521411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.522006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.525343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:03.548946 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95ae208b-bf0a-48bf-83ed-913ca61ceb6c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1277 microversion: 2.1 time: 0.420717 Oct 13 08:47:03.550511 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1552/3333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:03 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1277 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:03.605319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-33686fa9-5211-4f94-a3f3-f545a9ea9588 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f04670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:03.641556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:03.659560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9faf19f9-34be-4b72-ab04-a8b3160f345a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1271 microversion: 2.1 time: 0.154190 Oct 13 08:47:03.660152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1782/3334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:03 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:03.665514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:03.666984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:03.673297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.673995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.674624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.676446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.677299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.677641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.702727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-33686fa9-5211-4f94-a3f3-f545a9ea9588 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.103793 Oct 13 08:47:03.703719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1553/3335] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:03 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:03.737508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c855f8-1522-4e21-b4e1-91513503fa22", "name": "network-vif-plugged", "status": "completed", "tag": "67a6d353-0404-4909-8635-c706fab0d00d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:03.791651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.792149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.792597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.829599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:03.840700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] Creating event network-vif-plugged:67a6d353-0404-4909-8635-c706fab0d00d for instance e0c855f8-1522-4e21-b4e1-91513503fa22 on n-h1-858384-11 Oct 13 08:47:03.841309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebab24f7-6fe5-4e4f-a8a1-a820bb16fabd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1279 microversion: 2.1 time: 0.179120 Oct 13 08:47:03.847435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-19a659d9-60e9-4e87-bc22-d2408630aafa req-aae50c27-df08-49ff-9bb9-39dfebb5f61e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115077 Oct 13 08:47:03.855674 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1554/3336] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:03.863883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1783/3337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:03 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:03.927436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:03.929510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:03.950522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.951308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.951950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:03.952853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:03.953310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:03.953737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.455343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:04.466785 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aae6bb0d-8e9f-4f61-bbf2-adf455557100 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.547096 Oct 13 08:47:04.483103 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1555/3338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:03 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:04.578820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:04.579551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:04.590974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.595389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.596339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.600363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.600933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.601749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.685594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:04.687880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:04.697418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.711180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.713907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.716291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.717130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.736911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.791156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:04.840976 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2cc369e-e61c-4175-b765-0de13780e93c tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1277 microversion: 2.1 time: 0.265958 Oct 13 08:47:04.859198 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1784/3339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:04 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:04.859198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04609616-f0e5-415b-bf1e-5c2521578794 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765171f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:04.959054 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04609616-f0e5-415b-bf1e-5c2521578794 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.113719 Oct 13 08:47:04.960622 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1785/3340] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:04 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:04.972546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:04.973431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:04.988284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.991494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.991961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:04.992707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:04.993174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:04.993604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:05.287492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:05.299016 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5e8d51b-6bab-42a7-beac-3683b655edc1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.337301 Oct 13 08:47:05.302846 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1786/3341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:04 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:05.495570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:05.496193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:05.506709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:05.508120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:05.511622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:05.512647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:05.513118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:05.513570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:05.716191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:05.725407 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a60fa13d-66b5-43a1-8116-4047ecc17fdc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.233844 Oct 13 08:47:05.739434 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1787/3342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:05 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:05.872323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:05.873398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:05.880336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:05.881080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:05.881685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:05.882838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:05.883447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:05.884028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:05.955505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:05.968876 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b885db67-24eb-4782-ba21-c440fcfeaa65 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1283 microversion: 2.1 time: 0.107250 Oct 13 08:47:05.985149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1788/3343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:05 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:05.994672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2534080-aa36-404f-9a80-6efe22745775", "name": "network-vif-plugged", "status": "completed", "tag": "d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:05.998458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:06.006745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:06.007447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:06.008242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:06.008709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ba73026-e122-44ac-b2cc-f84fe06b487e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1313 microversion: 2.1 time: 1.326718 Oct 13 08:47:06.009806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1556/3344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:04 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1313 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:06.016116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dfc6a99-e5a3-4227-bff7-abf18e4515b0 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53768ee820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:06.031838 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] Creating event network-vif-plugged:d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d for instance b2534080-aa36-404f-9a80-6efe22745775 on n-h2-858384-11 Oct 13 08:47:06.062858 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9bc7187e-441b-435d-95de-3cf32b271286 req-9f7ccdc6-961f-4fde-a63c-cef6fa0215c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076081 Oct 13 08:47:06.066701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1789/3345] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:06.139614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dfc6a99-e5a3-4227-bff7-abf18e4515b0 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.127255 Oct 13 08:47:06.140892 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1557/3346] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:06 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:06.326753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:06.327783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:06.336014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:06.336912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:06.337517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:06.338435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:06.342923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:06.343608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:06.522610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:06.532005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2609335b-bca0-4f66-9bb2-7299e59cd715 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.209592 Oct 13 08:47:06.543791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1790/3347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:06 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:06.754645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:06.755541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:06.767096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:06.767583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:06.768022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:06.768727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:06.769182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:06.772050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:06.998444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:06.999678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:07.007126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.009617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.010468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:07.012093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.013209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.014234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:07.042886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:07.101794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:07.111507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-036ae878-1d8d-4831-9372-6f2c44406053 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1283 microversion: 2.1 time: 0.117076 Oct 13 08:47:07.112723 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1791/3348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:06 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:07.118975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:07.120473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:07.131287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.132066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.132678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:07.133547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.134161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.134898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:07.325017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:07.338587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c99ce658-7cfa-4702-b001-f414fc7032f5 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1313 microversion: 2.1 time: 0.223827 Oct 13 08:47:07.339180 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1792/3349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:07 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:07.344097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04a704ec-e72a-4c52-9d3e-a4526ced5933 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765195e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:07.401463 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04a704ec-e72a-4c52-9d3e-a4526ced5933 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.060894 Oct 13 08:47:07.402226 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1793/3350] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:07 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:07.411220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:07.420287 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d2c22b0-e251-4104-8440-49b8ae4376ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1309 microversion: 2.1 time: 0.670787 Oct 13 08:47:07.434439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1558/3351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:06 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1309 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:07.565624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:07.567847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:07.576959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.581600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.582399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:07.583804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:07.584551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:07.585247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.034720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:08.045788 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35655250-3b08-4803-b04a-eb4b6b15b663 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.490031 Oct 13 08:47:08.061867 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1794/3352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:07 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:08.136275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:08.136904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:08.149177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.149681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.150123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.150868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.151320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.156102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.362951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:08.364034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:08.376024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.385284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.386041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.386990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.387605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.388194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.483826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:08.501177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0820763-6712-4b8e-a071-62f2a9cdd4b3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1283 microversion: 2.1 time: 0.369539 Oct 13 08:47:08.518273 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1559/3353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:08 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1283 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:08.532164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-949fc26f-29a3-4df5-a55b-7bbcc107e525 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375cd33a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:08.600629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-949fc26f-29a3-4df5-a55b-7bbcc107e525 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.072613 Oct 13 08:47:08.602768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1560/3354] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:08 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:08.608724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:08.617858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:08.637558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.640870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.643860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.646776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.647440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.649787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.675368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:08.689333 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cfcb177-600c-47dd-8ad1-1a827c35dda7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1313 microversion: 2.1 time: 0.327749 Oct 13 08:47:08.702429 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1795/3355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:08 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:08.705032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730d86ac-3f52-43e8-a302-849e197aee26", "name": "network-vif-plugged", "status": "completed", "tag": "d305a2ac-3216-429f-a8ee-8f2f20829d83"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:08.732798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:08.739828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:08.740885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:08.767113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] Creating event network-vif-plugged:d305a2ac-3216-429f-a8ee-8f2f20829d83 for instance 730d86ac-3f52-43e8-a302-849e197aee26 on n-h2-858384-11 Oct 13 08:47:08.794841 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b25ce177-1e7e-4140-9c4f-8be010d98eb9 req-4cf59a00-4ce9-48bb-bb63-7a61716318b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100564 Oct 13 08:47:08.799611 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1796/3356] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:09.070171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:09.073502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:09.088656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:09.089153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:09.089601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:09.090333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:09.090851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:09.091250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:09.295426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:09.310886 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0d26f5f-e6b3-4caf-be64-f69ade9f45a3 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.245083 Oct 13 08:47:09.320484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1797/3357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:09 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:09.466208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:09.485069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ae36325-7fd1-4efa-9ab9-d488eaed9d14 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1491 microversion: 2.1 time: 0.872798 Oct 13 08:47:09.490991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1561/3358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:08 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1491 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:09.532872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:09.533521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:09.555684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:09.558521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:09.559183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:09.561689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:09.565055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:09.567038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:09.617272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-12ee5144-e933-4fe1-b398-c5d00b1c5542 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375e10700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:09.684712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-12ee5144-e933-4fe1-b398-c5d00b1c5542 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.071859 Oct 13 08:47:09.691300 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1562/3359] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:09 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:09.694781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1491157103", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:09.849678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:47:10.081820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:10.106268 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4cec9694-a72b-4198-af90-d1b12723f5dd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.571327 Oct 13 08:47:10.107167 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1798/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:09 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:10.120940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:10.130454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:10.150790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:10.157503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:10.159408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:10.165737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:10.167851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:10.168425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:10.554506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:10.569293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa6b3420-3ccb-41f5-a1d2-99a8e609ae69 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.460120 Oct 13 08:47:10.572070 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1799/3361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:10 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:10.590641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:10.594252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:10.610920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:10.611774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:10.612375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:10.613738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:10.614576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:10.615165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:10.634271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:10.907078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:11.265195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:11.276620 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-398cb22b-4e6a-4544-9879-a4d244ca0fba tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.700864 Oct 13 08:47:11.305503 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1800/3362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:10 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:11.312931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6edde616-693e-4495-bb35-acdb9bb016ee tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5376d08e50>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:11.384310 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6edde616-693e-4495-bb35-acdb9bb016ee tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.076711 Oct 13 08:47:11.388693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1801/3363] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:11 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:11.400463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455aa450-c1ca-46cb-8b4f-39b57359edd1", "tag": "66b5093d-2f5f-4584-9bec-035e45417be4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:11.420799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:11.421682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:11.422335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:11.442636 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] Creating event network-changed:66b5093d-2f5f-4584-9bec-035e45417be4 for instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 on n-h1-858384-11 Oct 13 08:47:11.448964 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1e5d0363-167c-4851-b485-7f9b51d92067 req-2149b5c9-aa55-40c7-abeb-2b7e019aa9a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058835 Oct 13 08:47:11.452424 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1802/3364] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:11.458169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:11.459405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:11.466989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:11.467714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:11.468354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:11.469416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:11.470114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:11.470992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:11.704199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:11.715983 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64f55ed5-5538-4dec-a442-bb6e3a670927 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.261571 Oct 13 08:47:11.719623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1803/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:11 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:11.724424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:11.725041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:11.752592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:11.753133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:11.753630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:11.754386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:11.755229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:11.755365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:11.956949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:11.968252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-564de6a1-5090-4f03-9f84-c555bb2e80d4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.247521 Oct 13 08:47:11.969042 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1804/3366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:11 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:12.305816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:12.306853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:12.320990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.322250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.322804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.327208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.327770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.328441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.511107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:12.523943 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7a634fa-8737-42f1-bc99-9221d76bf343 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.222039 Oct 13 08:47:12.525127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1805/3367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:12 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:12.530169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc902708-ec18-4154-8728-de758e6d89cc tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5376d08940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:12.584511 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc902708-ec18-4154-8728-de758e6d89cc tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.058256 Oct 13 08:47:12.585204 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1806/3368] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:12 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:12.654193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:12.655210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:12.655854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:12.656491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:12.658911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:12.694910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.695609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.696363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.697503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.698257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.699011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.723254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:47:12.728796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:47:12.742047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:47:12.743301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:12.743991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:12.744407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:47:12.759378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.761688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.761873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.764010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:12.765332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:12.767810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:12.803156 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57f4bf00-548c-48bc-8661-d0ac7c23d7aa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.116124 Oct 13 08:47:12.805606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1563/3369] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:47:12.819986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-137b0dcd-46b8-46d0-9133-7d49472a84f1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:12.821703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-137b0dcd-46b8-46d0-9133-7d49472a84f1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:13.033547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-137b0dcd-46b8-46d0-9133-7d49472a84f1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:13.041781 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-137b0dcd-46b8-46d0-9133-7d49472a84f1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1209 microversion: 2.1 time: 0.228204 Oct 13 08:47:13.046003 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1564/3370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:12 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1209 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:13.063292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:13.064066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:13.070735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:13.085720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:13.086514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:13.087383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:13.088094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:13.088764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:13.218460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:13.234800 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a6ed177f-1630-4475-9dbc-ad39a782cd18 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.497343 Oct 13 08:47:13.239845 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1807/3371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:12 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:13.550940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:13.552754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:13.565579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:13.567711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:13.570864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:13.572572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:13.573736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:13.574692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5a8cd051-9c30-4a82-98a1-6cc9aa2bef3b tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.527263 Oct 13 08:47:13.575459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:13.577123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:13.582819 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1565/3372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:13 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:13.601284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78b63396-5b9d-4dd7-86e2-9035b53bf21f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f595e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:13.734207 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78b63396-5b9d-4dd7-86e2-9035b53bf21f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1424 microversion: 2.1 time: 0.135355 Oct 13 08:47:13.751382 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1566/3373] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:13 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:13.772564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:13.792787 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12a7d70a-d61d-4056-8f67-46ca25cab7ec tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.246038 Oct 13 08:47:13.793401 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1808/3374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:13 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:14.072917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:14.074761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:14.083197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.084184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.084888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.085634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.086295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.086756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.248398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:14.262501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:14.263729 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe643c85-fecf-4e0e-b110-9c603dd41b3f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1205 microversion: 2.1 time: 0.195073 Oct 13 08:47:14.264129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:14.264322 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1567/3375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:14 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1205 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:14.282793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.283753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.285345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.287130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.287895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.288498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.301655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33450b61-1868-4553-9303-b7ca2520a3d8", "tag": "404bbba6-eab4-4d6a-8e1e-088c7392dee5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:14.319630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.320117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.322508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.353426 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] Creating event network-changed:404bbba6-eab4-4d6a-8e1e-088c7392dee5 for instance 33450b61-1868-4553-9303-b7ca2520a3d8 on n-h2-858384-11 Oct 13 08:47:14.363459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bed2c111-3210-4740-856c-c9b88129216f req-08619b61-b16f-4125-90c0-baa4d1863deb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066095 Oct 13 08:47:14.364755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1568/3376] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:14.601826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:14.603058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:14.611089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.612006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.612901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.614486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.615467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.616250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.841353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:14.849254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-786b4f0b-2edb-49da-ba57-be9b2f2dbfc8 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.592976 Oct 13 08:47:14.850138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1809/3377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:14 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:14.854890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ef7a904-ae54-4966-911b-d958ce917f95 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765720d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:14.901011 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ef7a904-ae54-4966-911b-d958ce917f95 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1433 microversion: 2.1 time: 0.049600 Oct 13 08:47:14.901592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1810/3378] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:14 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1433 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:14.914684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:14.915309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:14.921674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.922162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.922626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:14.923406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:14.923868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:14.924423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.063795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:15.075144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79491552-5bf2-46d7-a1db-b78b109015e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.171834 Oct 13 08:47:15.076147 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1811/3379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:14 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:15.081373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8417e34-a720-4f99-b4b2-a9702ff3aba9 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765d3820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.156047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8417e34-a720-4f99-b4b2-a9702ff3aba9 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 200 len: 1433 microversion: 2.1 time: 0.078407 Oct 13 08:47:15.170662 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1812/3380] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 1433 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:15.180398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.181669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:15.189026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.189844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.190592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.192177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.192816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.193397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.438238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:15.446688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:15.450024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9b592a19-1b83-4259-a013-cc87e3f3b9be tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.852587 Oct 13 08:47:15.451272 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1569/3381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:14 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:15.457448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.458417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:15.459302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f68efe5b-75db-429d-8fd6-51aaeef2bfad tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1466 microversion: 2.1 time: 0.285349 Oct 13 08:47:15.460358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1813/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1466 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:15.466112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.466830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.467462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.468202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.468817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.469469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.487658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd23c9a9-5062-4e03-9c98-5f665c9c8780 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53765d3790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.548339 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd23c9a9-5062-4e03-9c98-5f665c9c8780 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375" status: 200 len: 784 microversion: 2.1 time: 0.069177 Oct 13 08:47:15.549313 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1814/3383] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:15.564480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ebfc268-bf01-4682-8a63-fd0ccdc0566d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.585810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ebfc268-bf01-4682-8a63-fd0ccdc0566d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025732 Oct 13 08:47:15.586790 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1815/3384] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:15.600931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4831bd6-d80a-4ad5-8624-d1e4bdc29737 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537ab34820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.730770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:15.747252 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-192fb96e-a93d-42e8-8861-bcdfcdc6a383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1267 microversion: 2.1 time: 0.294163 Oct 13 08:47:15.758866 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1570/3385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:15.873552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:15.874173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:15.882178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.882704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.883146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:15.883855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:15.886816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:15.887450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.402386 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4831bd6-d80a-4ad5-8624-d1e4bdc29737 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "DELETE /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 204 len: 0 microversion: 2.1 time: 0.807101 Oct 13 08:47:16.403126 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1816/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:15 2022] DELETE /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:47:16.410607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:16.411451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:16.422950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.423418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.423823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.428357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.429031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.429883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.470161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:16.495313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:16.510285 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-72c2f54c-18de-43c8-b6b3-ad70fe928adc tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.640744 Oct 13 08:47:16.512048 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1571/3387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:15 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:16.518435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "tag": "4094b4ba-7f32-483d-98b3-c4ff87fd5580"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:16.534480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.536026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.536708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.567083 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] Creating event network-changed:4094b4ba-7f32-483d-98b3-c4ff87fd5580 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:16.602992 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5eb89399-ae55-48fa-be86-95c02a0d213f req-c68192af-f53d-494f-a859-3a6293fb57fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088969 Oct 13 08:47:16.604605 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1572/3388] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:16.613694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8c76614-ee94-49cb-81b3-e02eadd9a7c8 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375e10040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:16.650839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a8c76614-ee94-49cb-81b3-e02eadd9a7c8 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] HTTP exception thrown: Image not found. Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8c76614-ee94-49cb-81b3-e02eadd9a7c8 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Request method failure captured: Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 HTTP/1.1 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BbeLpErdgJyi6z8KdMPoeFE-owlHssm-cYxvKuTCV9qWuOJtYNMuGOMjecNu92P0bU_ZRc7ii9XweeFWfLBLzdAHx99YiEYqAdRziGb8_5bKWZY4tTaMo7s92pNqoC4bFddfocTRtvJr0WWMvesk8O_8j1I-ts5eUG2jaxkFZ3T1o Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 2077f75835184be788773e1eeb0b0f47 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '199efdde-13c6-4c1d-97aa-44b1e1db9d30'} Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 199efdde-13c6-4c1d-97aa-44b1e1db9d30 Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 13 08:47:16.655424 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 199efdde-13c6-4c1d-97aa-44b1e1db9d30 could not be found. Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:47:16.663953 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:16.673206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8c76614-ee94-49cb-81b3-e02eadd9a7c8 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:16.674706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8c76614-ee94-49cb-81b3-e02eadd9a7c8 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 404 len: 62 microversion: 2.1 time: 0.067572 Oct 13 08:47:16.686949 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1573/3389] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:16 2022] GET /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:47:16.695286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:16.696339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:16.707737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.709465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.710232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.712134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.712795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.713774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.750320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:16.761428 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1adbe292-7975-4bd5-98a6-812f177e6bde tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.357076 Oct 13 08:47:16.764336 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1817/3390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:16 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:16.776143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1388045868"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:16.779002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:16.786050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:16.794380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.794900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.795346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:16.796063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:16.796519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:16.796947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.149469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-652ad5d1-7002-4d51-a1de-6132868ae1c2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "POST /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626/action" status: 202 len: 0 microversion: 2.1 time: 0.383729 Oct 13 08:47:17.150319 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1818/3391] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:47:16 2022] POST /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 08:47:17.176533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:17.177241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:17.188750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.189262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.189920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.190695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.191688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.192268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.273045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:17.284002 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cea5e53e-ef47-457e-9f0b-b7b85c943db3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1267 microversion: 2.1 time: 0.132286 Oct 13 08:47:17.286826 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1819/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:17 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:17.305777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50b8c603-384c-4aca-82ae-12663be91976 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537abc1550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:17.359989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50b8c603-384c-4aca-82ae-12663be91976 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.071914 Oct 13 08:47:17.366462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1820/3393] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:17 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:17.388542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:17.397722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-019dfa36-6379-45ca-aeb3-fe7175f91fb8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.709249 Oct 13 08:47:17.398387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1574/3394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:16 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:17.538825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:17.539436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:17.546582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.547558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.548223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.549930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.551288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.551821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.790010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:17.792761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:17.803977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.805080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.810350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.811707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:17.812349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:17.813490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:17.938291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:17.957746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-019f534c-f94e-4f96-aa3a-f3a41f971c83 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.423660 Oct 13 08:47:17.957746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1821/3395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:17 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:18.094526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:18.106359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d1ff6dc-15c8-49ea-b002-d5b19f4ad1b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.319766 Oct 13 08:47:18.107713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1575/3396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:17 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:18.148075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455aa450-c1ca-46cb-8b4f-39b57359edd1", "name": "network-vif-plugged", "status": "completed", "tag": "66b5093d-2f5f-4584-9bec-035e45417be4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:18.163254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.163743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.164181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.175940 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] Creating event network-vif-plugged:66b5093d-2f5f-4584-9bec-035e45417be4 for instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 on n-h1-858384-11 Oct 13 08:47:18.182124 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a277bec1-6a61-4779-869e-b5f8fa92dd99 req-d1debcaf-e4bd-44b5-b6ab-e16af391162c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038143 Oct 13 08:47:18.184358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1822/3397] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:18.309547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:18.310257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:18.320910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.321845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.326028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.327817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.328677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.329480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.376982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-627967c2-00e4-4a05-acd3-1e3f1b487dc7 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537abc1700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:18.437590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-627967c2-00e4-4a05-acd3-1e3f1b487dc7 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.064677 Oct 13 08:47:18.438960 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1823/3398] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:18 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:18.450164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:18.450940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:18.465251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.466900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.467552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.469625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.470435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.471727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.774632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:18.787645 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-043f8676-0a86-4ce6-9dfd-ab70eaa83da0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.346238 Oct 13 08:47:18.788866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1824/3399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:18 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:18.828824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "tag": "c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:18.840092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:18.840840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:18.841719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:18.854216 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] Creating event network-changed:c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:18.860084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-97e4ae53-f939-46ba-bd8a-707d69ef85c7 req-b5c7d0f6-a652-4a77-9d71-6c873edf2e04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035147 Oct 13 08:47:18.860968 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1825/3400] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:18.981815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:18.982790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:18.999788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.001900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.007180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:19.008399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.017511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.018665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:19.242072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:19.250823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2600e8ae-bdb9-4d01-b6e9-014e71d5c16e tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.273569 Oct 13 08:47:19.251794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1826/3401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:18 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:19.258453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:19.259229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:19.271813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.272714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.273259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:19.274150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.274654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.275186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:19.280905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:19.292499 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-816f26be-b82f-4d27-9182-a5c602cea48e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.986843 Oct 13 08:47:19.293891 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1576/3402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:18 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:19.447709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:19.453218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eaf51d5a-a579-4b9e-820e-e399b0028d2a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375c03430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:19.459700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ecf70a2-d0dd-4bd5-a73e-29a5996f5e28 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.205900 Oct 13 08:47:19.460647 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1827/3403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:19 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:19.505446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eaf51d5a-a579-4b9e-820e-e399b0028d2a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.056051 Oct 13 08:47:19.506460 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1577/3404] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:19 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:19.812636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:19.813944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:19.823323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.823913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.824426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:19.825210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:19.825739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:19.826235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.015800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:20.029429 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfe118d6-809f-443f-a69e-71a1940f246c tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.220479 Oct 13 08:47:20.030911 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1828/3405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:19 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:20.203209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-unplugged", "status": "completed", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:20.209258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:20.216700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.217549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.218158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.223481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:20.233343 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] Creating event network-vif-unplugged:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:47:20.239880 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-480f414d-1a6d-42f7-9aa2-035bf82e14e6 req-970efc83-d00d-41a9-9801-a895a0b0a4a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040158 Oct 13 08:47:20.241055 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1578/3406] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:20.273952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:20.274775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:20.281528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.282100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.282847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.283672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.284280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.285037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.324016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:20.324823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:20.352898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.356147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.356872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.358312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.359852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.364243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.518039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:20.527498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e7f7758-d2c7-49dc-b640-c01ad75a9585 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.258049 Oct 13 08:47:20.544984 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1829/3407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:20 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:20.551592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:20.552464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:20.560074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.560835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.561758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.563356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:20.564047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:20.564715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:20.784278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:20.791736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:20.793727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49cde3fd-3ee8-4e0a-8363-87efc3670095 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1321 microversion: 2.1 time: 0.247251 Oct 13 08:47:20.806568 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1830/3408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:20 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:20.806778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b14f359b-32ef-453b-a076-152bf1c9beae tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.481945 Oct 13 08:47:20.806778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1579/3409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:20 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:20.806932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61282dd2-55a8-4db1-a3b3-9f99158e8615 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537abc1280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:20.855643 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61282dd2-55a8-4db1-a3b3-9f99158e8615 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.059516 Oct 13 08:47:20.863953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1831/3410] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:20 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:21.055129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:21.055948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:21.062677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.063834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.064684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.065610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.066819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.067443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.558177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:21.558939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:21.567826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.570966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.572161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.575591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.576477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.578005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.860780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:21.866707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:21.874285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-63b90c03-205c-4630-9f72-34e51e6eae94 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.323375 Oct 13 08:47:21.874472 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f5a88a2-622f-4d6f-a3b4-2986f879dac7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.825009 Oct 13 08:47:21.875040 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1580/3411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:21 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:21.889340 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1832/3412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:21 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:21.892322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4420b5-da0a-4d63-9022-f352c79fe4f2", "tag": "a230acc8-73aa-422c-a1be-57d5082262ff"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:21.906888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.907371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.907846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.931013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:21.933398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:21.940405 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] Creating event network-changed:a230acc8-73aa-422c-a1be-57d5082262ff for instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 on n-h2-858384-11 Oct 13 08:47:21.949271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-873d89aa-91ce-4429-ba69-dc1ab8c95217 req-12a4dae4-1df9-4b95-bd81-ea4fab3c92a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072923 Oct 13 08:47:21.949474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.950203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1581/3413] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:21.951718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.952376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.955359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:21.956065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:21.960476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.961047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.961501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.974836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.975234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.975680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:21.976394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:21.976857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:21.977281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.229373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:22.245879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca474506-910e-4ca3-8578-e46e5f745d1a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1511 microversion: 2.1 time: 0.327553 Oct 13 08:47:22.261888 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1833/3414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:21 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:22.272061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7cc9e9a5-aefb-4051-9092-daf56bffe1fa tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537ab34790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:22.352077 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7cc9e9a5-aefb-4051-9092-daf56bffe1fa tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.088119 Oct 13 08:47:22.358818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:22.366268 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1834/3415] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:22 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:22.370265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dab4bc78-8c95-46f7-97e5-73f5dfbf10af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.418711 Oct 13 08:47:22.370898 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1582/3416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:21 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:22.375464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:22.377071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:22.389198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.389997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.390809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.392025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.393031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.393615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.565996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:22.574282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a73a1866-4d75-45a0-bd43-87a51187b4e5 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1510 microversion: 2.1 time: 0.205757 Oct 13 08:47:22.580843 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1835/3417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:22 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:22.612180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:22.612495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:22.624728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.625775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.636137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.637171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.637810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.638419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.714153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:22.715148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33450b61-1868-4553-9303-b7ca2520a3d8", "name": "network-vif-plugged", "status": "completed", "tag": "404bbba6-eab4-4d6a-8e1e-088c7392dee5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:22.734411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.735197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.735954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.750138 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] Creating event network-vif-plugged:404bbba6-eab4-4d6a-8e1e-088c7392dee5 for instance 33450b61-1868-4553-9303-b7ca2520a3d8 on n-h2-858384-11 Oct 13 08:47:22.757950 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bf8666ff-0800-47d1-89fa-3c1dc1178092 req-2b57c8c8-6405-418d-877e-11a3aa1299c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047125 Oct 13 08:47:22.759889 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1836/3418] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:22.916178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:22.917823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:22.928431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.929290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.929824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:22.930660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:22.931332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:22.943911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.045964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:23.062748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.099962 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0040fad-e941-4c62-84a3-9b997f39bd10 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1510 microversion: 2.1 time: 0.491828 Oct 13 08:47:23.100593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1583/3419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:22 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:23.108816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:23.109432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:23.121907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.122672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.123263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.124512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.125225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.125810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.207563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.215639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74010750-6dcf-465f-8f75-780b35f2fe97 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.305624 Oct 13 08:47:23.216200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1837/3420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:22 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:23.221011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:23.226791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.227857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:23.241260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.242169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.242917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.243795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.244399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.245001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.356911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:23.380781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:23.462496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.470856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.471342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.481066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.563760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.572048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4894fb42-a354-4b94-8c36-60c69b139298 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.470366 Oct 13 08:47:23.586863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1584/3421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:23 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:23.601042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f14d04dd-fb8b-462a-8a4b-5a6dd657704d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f42ca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:23.699972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f14d04dd-fb8b-462a-8a4b-5a6dd657704d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.111649 Oct 13 08:47:23.700806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1585/3422] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:23 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:23.709140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:23.719251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:23.729738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.735040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.735741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.736644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.737277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.738504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.747285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67a7317a-d982-4126-99ee-c25de0ca66b0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.529678 Oct 13 08:47:23.748203 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1838/3423] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:47:23 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:23.776774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:23.782309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:23.785832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-517164726', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:23.809346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.810892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.812338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:23.815836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:23.817030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:23.817030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.040182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:24.209124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.222857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11021baf-d724-4893-8989-1c4d998f7a13 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.518270 Oct 13 08:47:24.241203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.243654 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1586/3424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:23 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:24.249439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:24.250259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:24.257919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.258231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.258640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.259081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.259206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.259777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.260656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.261331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.261908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.445364 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5333285a-5563-471d-a800-f882171c6082 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-517164726" status: 200 len: 1513 microversion: 2.1 time: 0.673116 Oct 13 08:47:24.447916 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1839/3425] 10.222.0.23 () {58 vars in 1261 bytes} [Thu Oct 13 08:47:23 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-517164726 => generated 1513 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:24.609459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.622024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc166de9-2ca6-4bf0-9828-7d3db08ee4f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.372287 Oct 13 08:47:24.625004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1587/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:24 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:24.636333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:24.641677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Calling method '.version_select at 0x7f537ab53280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:24.657170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.660732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:24.668731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.669492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.670085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.672532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:47:24.673263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Neutron security group 94d8e4a8-9c4d-4477-a261-a7a803659222 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:47:24.674172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] HTTP exception thrown: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.674172 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Request method failure captured: Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-groups/94d8e4a8-9c4d-4477-a261-a7a803659222 HTTP/1.1 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9CcSKsLD_5LZ7GG-1URXXNduGXqlJoZaxZq60FrzEOP2JYBwzj1XtVuAu1YPPsSJaePoAvYSyp7Gb8vVI1jyDD2EjIYw6A1HWkN0Ti4L6sxv9o8oTy0zj2JWjIeT46TXzXvrNXq_sLKsCBwFlCvgdPYacdqvyi2mzIETX18WZumB1U Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: bf5b27ef46f14a0da59433889bbd6323 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '94d8e4a8-9c4d-4477-a261-a7a803659222'} Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:47:24.676498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] Oct 13 08:47:24.680345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:24.684699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Returning 404 to user: Security group 94d8e4a8-9c4d-4477-a261-a7a803659222 does not exist Oct 13 08:47:24.684699 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-9bad7cf5-2b80-471e-b8ef-af0a819114bf'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:24.685913 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e478b054-09dd-4dfe-bdd5-5755d7daf9d4 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/94d8e4a8-9c4d-4477-a261-a7a803659222" status: 404 len: 194 microversion: 2.1 time: 0.236887 Oct 13 08:47:24.687248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1840/3427] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:47:24 2022] DELETE /compute/v2.1/os-security-groups/94d8e4a8-9c4d-4477-a261-a7a803659222 => generated 194 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:24.691443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.694876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.695570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.700546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:24.701474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:24.717266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.718119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.718792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.719739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.723437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.724736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.879401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:24.971502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.979193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:24.979678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:24.980377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:24.982136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:24.996810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9afdaeb0-25d3-4376-8c7c-099ecb102778 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.305846 Oct 13 08:47:24.997760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1841/3428] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:24 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.002986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1786f0db-e235-46ba-ba2f-77cdba4dbab0 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004010 Oct 13 08:47:25.004689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1842/3429] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Oct 13 08:47:24 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 08:47:25.011504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc5e8921-5f73-4a42-8b0a-6c003ce1f88c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53764c11f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.111056 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc5e8921-5f73-4a42-8b0a-6c003ce1f88c tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.104685 Oct 13 08:47:25.120554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1843/3430] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.125624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-plugged", "status": "completed", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:25.144944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.146084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.146703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.160328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] Creating event network-vif-plugged:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:47:25.169425 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ce52da32-1c0b-4dca-b406-32cd13ef5df3 req-5d961f8e-80e1-474a-aa52-7bb50ebb1019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045235 Oct 13 08:47:25.170435 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1844/3431] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:25.177145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b89fb96-85a6-4548-ab3f-817e725aedca tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Calling method '.version_select at 0x7f537abb10d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.296053 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c5f0955-7004-4463-ad7d-1b49c08d29fa tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.666393 Oct 13 08:47:25.296974 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1588/3432] 10.222.0.23 () {58 vars in 1173 bytes} [Thu Oct 13 08:47:24 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.302071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.303003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:25.313246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.313941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.314567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.315461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.316108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.316693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.428823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b89fb96-85a6-4548-ab3f-817e725aedca tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.257042 Oct 13 08:47:25.429752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1845/3433] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:25.435810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.452711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:25.453426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.servers [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Removing options 'limit' from query {{(pid=127030) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 13 08:47:25.457180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:25.470531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.471139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.475461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.478933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.480956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.481497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.549311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:25.557134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.558017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.559159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.568331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:25.577688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16eb8b67-e499-4d34-9f33-d0b481d314f2 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.279474 Oct 13 08:47:25.593496 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1589/3434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.602051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Calling method '.version_select at 0x7f5375e9e8b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.701140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77f6432c-a096-48d6-9eca-c9f880a0dba7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.270004 Oct 13 08:47:25.702991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1846/3435] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.709631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.714147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:25.723308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.723937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.724552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.725427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.725986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.726635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.888504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:47:25.889426 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 13 08:47:25.889426 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Request method failure captured: Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/33d78a96-2ea4-4c14-9658-ac1d4d2007ce HTTP/1.1 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9CcSKsLD_5LZ7GG-1URXXNduGXqlJoZaxZq60FrzEOP2JYBwzj1XtVuAu1YPPsSJaePoAvYSyp7Gb8vVI1jyDD2EjIYw6A1HWkN0Ti4L6sxv9o8oTy0zj2JWjIeT46TXzXvrNXq_sLKsCBwFlCvgdPYacdqvyi2mzIETX18WZumB1U Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: bf5b27ef46f14a0da59433889bbd6323 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: exception: Insufficient rights for removing default security group. Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '33d78a96-2ea4-4c14-9658-ac1d4d2007ce'} Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:47:25.892456 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] Oct 13 08:47:25.896962 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.902164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:25.903237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 13 08:47:25.903237 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-fc0cca4c-e0fb-4fff-b48b-07cade753e91'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:25.905026 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b2c7162-d605-4650-8082-74bad61cebd2 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/33d78a96-2ea4-4c14-9658-ac1d4d2007ce" status: 400 len: 182 microversion: 2.1 time: 0.310207 Oct 13 08:47:25.906164 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1590/3436] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:47:25 2022] DELETE /compute/v2.1/os-security-groups/33d78a96-2ea4-4c14-9658-ac1d4d2007ce => generated 182 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:47:25.911096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.917209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6a31442-aec4-44da-810e-1cd470e53a81 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.212811 Oct 13 08:47:25.930460 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1847/3437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:25.930460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Calling method '.version_select at 0x7f537abc6d30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:25.932691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:25.933718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:25.943756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.944500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.945089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.946050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:25.946919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:25.947508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:25.949244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:47:25.949949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Neutron security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:47:25.950611 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] HTTP exception thrown: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.950611 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Request method failure captured: Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-security-groups/c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 HTTP/1.1 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9CcSKsLD_5LZ7GG-1URXXNduGXqlJoZaxZq60FrzEOP2JYBwzj1XtVuAu1YPPsSJaePoAvYSyp7Gb8vVI1jyDD2EjIYw6A1HWkN0Ti4L6sxv9o8oTy0zj2JWjIeT46TXzXvrNXq_sLKsCBwFlCvgdPYacdqvyi2mzIETX18WZumB1U Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: bf5b27ef46f14a0da59433889bbd6323 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c4cdbdd6-3ccf-4b68-b3dc-3f744227c553'} Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:47:25.952732 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] Oct 13 08:47:25.957589 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:25.962880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Returning 404 to user: Security group c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 does not exist Oct 13 08:47:25.962880 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75bcd036-eb72-435a-bedc-9a458dbd32f6'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:25.962880 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-59e706f9-d153-4352-b60d-2709e768f3dd tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/c4cdbdd6-3ccf-4b68-b3dc-3f744227c553" status: 404 len: 194 microversion: 2.1 time: 0.043104 Oct 13 08:47:25.966435 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1848/3438] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/os-security-groups/c4cdbdd6-3ccf-4b68-b3dc-3f744227c553 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:25.973865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Action: 'update', calling method: .version_select at 0x7f537abb15e0>, body: {"security_group": {"name": "tempest-sg-275900787", "description": "tempest-description-1260875911"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:26.000442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:47:26.000864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:26.001166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Neutron security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:47:26.001766 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] HTTP exception thrown: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.001766 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Request method failure captured: Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/os-security-groups/464379fd-0f40-4341-b6ed-93ed78d6fe64 HTTP/1.1 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 101 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9CcSKsLD_5LZ7GG-1URXXNduGXqlJoZaxZq60FrzEOP2JYBwzj1XtVuAu1YPPsSJaePoAvYSyp7Gb8vVI1jyDD2EjIYw6A1HWkN0Ti4L6sxv9o8oTy0zj2JWjIeT46TXzXvrNXq_sLKsCBwFlCvgdPYacdqvyi2mzIETX18WZumB1U Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ffb3365ac810419dbd90ccaaacff02c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ffb3365ac810419dbd90ccaaacff02c8 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-979630399 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: bf5b27ef46f14a0da59433889bbd6323 Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-979630399-project Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: {"security_group": {"name": "tempest-sg-275900787", "description": "tempest-description-1260875911"}} Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '464379fd-0f40-4341-b6ed-93ed78d6fe64', 'body': {'security_group': {'name': 'tempest-sg-275900787', 'description': 'tempest-description-1260875911'}}} Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:47:26.003763 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] Returning 404 to user: Security group 464379fd-0f40-4341-b6ed-93ed78d6fe64 does not exist Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-bf9d5a56-3697-4f88-a64b-33560d76f6f5'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebd4468e-c385-4f48-aef7-f978ce5ef716 tempest-SecurityGroupsNegativeTestJSON-979630399 tempest-SecurityGroupsNegativeTestJSON-979630399-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/464379fd-0f40-4341-b6ed-93ed78d6fe64" status: 404 len: 194 microversion: 2.1 time: 0.036840 Oct 13 08:47:26.007503 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1849/3439] 10.222.0.23 () {60 vars in 1290 bytes} [Thu Oct 13 08:47:25 2022] PUT /compute/v2.1/os-security-groups/464379fd-0f40-4341-b6ed-93ed78d6fe64 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:26.023733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.023733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:26.031026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.031664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.032211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.033112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.033634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.034147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.093138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be86faff-25aa-4297-8dba-e0ae0744c1de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.185665 Oct 13 08:47:26.094077 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1591/3440] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:47:25 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:26.109659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.116252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.122213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.servers [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Removing options 'limit' from query {{(pid=127031) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 13 08:47:26.123873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:26.150522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.155028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.156430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.162093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.162886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.169693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.215278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:26.227148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.237302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dedf0f4d-734b-4a7f-a9b3-40a5afd619e3 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1325 microversion: 2.1 time: 0.219976 Oct 13 08:47:26.237950 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1850/3441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:26.250973 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b15133eb-ba94-42bd-80c5-cdd46a729a93 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.145635 Oct 13 08:47:26.254441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7288b244-e1d8-4424-a68f-adfd5cb2dcf2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375c4c940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.255569 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1592/3442] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:26.273088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.280381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.281370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:26.287612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.289194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.289884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.290892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.291575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.292238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.329811 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7288b244-e1d8-4424-a68f-adfd5cb2dcf2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.090775 Oct 13 08:47:26.334085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:26.339032 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1851/3443] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:26.369631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e72b1202-2e84-4c78-9077-fef004a4834e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.102392 Oct 13 08:47:26.381073 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1593/3444] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers => generated 1010 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:26.385199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.391396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.392085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:26.442949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.459831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.460281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.461095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.461551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.461972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.609591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.610634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:26.630982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.633568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.638425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.640538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.642980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.653811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.670935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:26.784756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7bb44be0-3283-408b-a388-9492666719f0 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.403253 Oct 13 08:47:26.794169 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1852/3445] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:26.799316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.811190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.811774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.servers [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Removing options 'limit' from query {{(pid=127030) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 13 08:47:26.812565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:26.818506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.819143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.819679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.820494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.821051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.822058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.865627 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7699bca7-469d-4594-9039-2bde557ec31a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.068461 Oct 13 08:47:26.874626 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1853/3446] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:26.880742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:26.890966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:26.896111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-517164726', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:26.902043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.902681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.903219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:26.904595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:26.905587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:26.906118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.073976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:27.196590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af37e4c1-d59f-44b2-87c2-fd10a5019d94 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-517164726" status: 200 len: 345 microversion: 2.1 time: 0.320097 Oct 13 08:47:27.206528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1854/3447] 10.222.0.23 () {58 vars in 1240 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-517164726 => generated 345 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:27.211887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:27.212624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:27.220431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:27.220785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:27.221777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.222772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:27.223321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:27.223843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.516194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:27.550057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e4df1d5-e44f-4ffe-b079-8700dc8be3bb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.342166 Oct 13 08:47:27.572467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:27.588544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1855/3448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:27 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:27.595838 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b6388e9-2b87-40b7-8b76-82f9f7163be3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.985446 Oct 13 08:47:27.597155 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1594/3449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:26 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:27.600200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:27.604229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:27.617686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:27.644840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:27.648151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:27.648617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.658024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:27.658543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:27.658987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.660251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:27.660707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:27.661130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:27.696575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:47:27.853144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-30698974-32f0-4386-8331-7964f1287da8 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "POST /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26/action" status: 202 len: 0 microversion: 2.1 time: 0.260787 Oct 13 08:47:27.868768 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1856/3450] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:47:27 2022] POST /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:47:27.889433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90672ddf-e393-4b89-ae75-84d7bf43a8b9 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375d12c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:27.984912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90672ddf-e393-4b89-ae75-84d7bf43a8b9 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.111475 Oct 13 08:47:27.986614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1857/3451] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:27 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:27.994390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:27.995653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:28.006649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.007178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.007613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.008753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.009228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.009661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.220951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:28.235337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15c50cdb-9329-42d0-a192-e17410c3d1be tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1520 microversion: 2.1 time: 0.245110 Oct 13 08:47:28.236739 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1858/3452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:27 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:28.575175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:28.575891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:28.585702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.587904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.588456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.589272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.590958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.592342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.746020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:28.762548 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77900eab-4100-4750-a352-27166cc443e0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1523 microversion: 2.1 time: 1.162266 Oct 13 08:47:28.765453 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1595/3453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:27 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1523 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:28.787374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:28.789126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:28.814082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.816414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.817180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.818209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.821303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.822426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.890488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:28.947438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:28.960369 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-216453e9-300b-4148-8219-f31793c460b7 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.388785 Oct 13 08:47:28.975836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1859/3454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:28 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:28.984403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:28.986146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:28.993477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.994522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.996200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:28.997393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:28.998112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:28.999097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.070648 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] HTTP exception thrown: Instance is not a member of specified network Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Request method failure captured: Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8/ips/invalid HTTP/1.1 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9CDjL_Wz2hF_WCHeQMkM83UDgTl6oQt03sH-ugz0VoD0J3__W9ABEYC2yxN1kQGokNZDJ6q5tI1cksaGO9bi_dls7kVsuN2Dfke_YSnEN5YzhFXNxM_-4M3VnM4Ap2mSm6ZPB_3b249-kD_hKqbWVCw92VhgRHmOX3ajEg7nfyq5Ys Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 16a48728ca0a40b083d4b54bcdd51beb Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance is not a member of specified network Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': '33450b61-1868-4553-9303-b7ca2520a3d8', 'id': 'invalid'} Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 13 08:47:29.081135 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.086056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:29.087727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa1110c3-6313-48cd-9e08-696d83a7dcce tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.109788 Oct 13 08:47:29.088631 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1860/3455] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:47:28 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8/ips/invalid => generated 91 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:47:29.093336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee63071e-a301-4743-bb3d-8bdc88cec8a4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375893430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.151422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee63071e-a301-4743-bb3d-8bdc88cec8a4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.061672 Oct 13 08:47:29.152232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1861/3456] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:29 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:29.158123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.159018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Failed to fetch instance by id 999 {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:47:29.160807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] HTTP exception thrown: Instance 999 could not be found. Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Request method failure captured: Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9CDjL_Wz2hF_WCHeQMkM83UDgTl6oQt03sH-ugz0VoD0J3__W9ABEYC2yxN1kQGokNZDJ6q5tI1cksaGO9bi_dls7kVsuN2Dfke_YSnEN5YzhFXNxM_-4M3VnM4Ap2mSm6ZPB_3b249-kD_hKqbWVCw92VhgRHmOX3ajEg7nfyq5Ys Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 16a48728ca0a40b083d4b54bcdd51beb Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 999 could not be found. Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': '999'} Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 13 08:47:29.163111 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:29.170365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:29.171355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:29.172449 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2e1a915-0bf3-496e-86a0-e4aee62ed814 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018771 Oct 13 08:47:29.173755 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1862/3457] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:47:29 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:47:29.186163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.186330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbf3ae6f-b99e-4dbb-ba8a-67c982444998 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.418478 Oct 13 08:47:29.187178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1596/3458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:28 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:29.187601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:29.195719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.196502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.197260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.198332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.199022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.200064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.231767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:29.250545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:29.266150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.266842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:29.280415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.281170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.287118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.288198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.288834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.289491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.339991 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-228ab7a0-66e5-4967-8b77-91a77043e475 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "DELETE /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 204 len: 0 microversion: 2.1 time: 0.160033 Oct 13 08:47:29.342194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1863/3459] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:29 2022] DELETE /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:29.357971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.361158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:29.375358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.375824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.376339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.377377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:29.378020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:29.379104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:29.567271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:29.578891 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28fdc013-1968-4222-94e3-0043f83076cd tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1529 microversion: 2.1 time: 0.231793 Oct 13 08:47:29.580633 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1864/3460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:29 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1529 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:29.693829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:29.708464 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a375f609-0927-44dd-84f4-510db4c73df7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1520 microversion: 2.1 time: 0.449264 Oct 13 08:47:29.727453 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1597/3461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:29 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:29.990642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:29.991442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:30.003965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.004718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.005414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.007989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.008572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.009147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.170369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37b5dbc0-26a8-47ae-ac37-9867948b0906 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375e103a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:30.210022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:30.220168 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07cfcafc-7afb-4f59-86e4-2c1aa13ccf17 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.233423 Oct 13 08:47:30.234437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1865/3462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:29 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:30.234437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:30.234437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:30.253876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.254415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.256193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.256931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.257389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.257816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.274065 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37b5dbc0-26a8-47ae-ac37-9867948b0906 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.109716 Oct 13 08:47:30.279245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1598/3463] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:30 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:30.603207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:30.604044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:30.614598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.616193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.620283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.621178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.621755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.622296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.639597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:30.649938 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-057a055c-1ac3-4e1e-9e9f-79c20dc04f2e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.427715 Oct 13 08:47:30.653317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1866/3464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:30 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:30.733002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:30.733886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:30.743129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.745266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.749551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.750556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:30.751178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:30.751777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:30.781784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:30.793323 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f008e93-ead2-41af-be6e-04d1d776f1a0 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1529 microversion: 2.1 time: 0.193706 Oct 13 08:47:30.794633 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1599/3465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:30 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1529 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:30.998629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:31.013822 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c03b6fc-a40d-42f7-b7ab-b517ee552e25 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1520 microversion: 2.1 time: 0.284427 Oct 13 08:47:31.016672 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1867/3466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:30 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:31.251133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:31.253456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:31.264504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:31.278712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:31.279437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:31.281097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:31.281752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:31.282495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:31.283093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4420b5-da0a-4d63-9022-f352c79fe4f2", "name": "network-vif-plugged", "status": "completed", "tag": "a230acc8-73aa-422c-a1be-57d5082262ff"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:31.311119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:31.311687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:31.312204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:31.368773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] Creating event network-vif-plugged:a230acc8-73aa-422c-a1be-57d5082262ff for instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 on n-h2-858384-11 Oct 13 08:47:31.381526 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0009a773-1cf3-4360-a5f5-e453c7692860 req-5702b85f-9706-4840-ab2a-cfea30fb0f4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099813 Oct 13 08:47:31.382874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1868/3467] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:31.398397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-902ac391-d1bc-4502-b100-3dee15faf259 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375880040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:31.499673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-902ac391-d1bc-4502-b100-3dee15faf259 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.114945 Oct 13 08:47:31.501270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1869/3468] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:31 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:31.521246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c86f0005-ecf7-4409-a315-35c9f33759a0"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:31.528262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:31.551359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:31.552033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:31.552371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:31.553474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:31.554263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:31.554872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:31.957790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:31.968135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-856f9a71-b82a-4d79-920f-6ca1237c8ae8 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.721707 Oct 13 08:47:31.968730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1600/3469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:31 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:32.002228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:32.002876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:32.028355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.033125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.033598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.034343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.035020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.035455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.153447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ceee625a-996d-4511-92c5-da78aa701166 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "POST /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642305 Oct 13 08:47:32.155907 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1870/3470] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:47:31 2022] POST /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:32.189749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:32.190479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:32.209794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.210341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.211925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.215120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.215888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.218375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.497972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:32.514930 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a908578-84ae-446e-953e-f3fab600ffc1 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.533262 Oct 13 08:47:32.523893 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1601/3471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:31 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:32.541316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:32.541959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:32.565867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.566485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.566932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.570017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.572253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.573014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.673647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:32.688487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71797c3d-62df-4172-a2b1-ef3bd65ab15a tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1529 microversion: 2.1 time: 0.530069 Oct 13 08:47:32.702437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1871/3472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:32 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1529 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:32.702437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17d5aff0-4253-4bda-a85f-eb6f236eabf2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53758a08b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:32.798612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17d5aff0-4253-4bda-a85f-eb6f236eabf2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.105932 Oct 13 08:47:32.799274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1872/3473] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:32 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:32.892508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33450b61-1868-4553-9303-b7ca2520a3d8", "name": "network-vif-deleted", "tag": "404bbba6-eab4-4d6a-8e1e-088c7392dee5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:32.916206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:32.916691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:32.917129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:32.937550 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] Creating event network-vif-deleted:404bbba6-eab4-4d6a-8e1e-088c7392dee5 for instance 33450b61-1868-4553-9303-b7ca2520a3d8 on n-h2-858384-11 Oct 13 08:47:32.946595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:32.955712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39488bd9-4924-4cab-a8b6-6900ef8c0e70 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1520 microversion: 2.1 time: 0.429284 Oct 13 08:47:32.956369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1602/3474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:32 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:32.960400 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-341d80a5-ccb2-4a09-bed2-7dbe1648b3b6 req-3e7e0e97-707e-408f-9195-3f3ee0cf9df7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076319 Oct 13 08:47:32.966779 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1873/3475] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:32.993503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:32.994513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:33.005737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.006652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.007320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.008265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.012878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.015642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.287344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:33.298150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e68df058-3f6e-4495-b3ea-08908262590e tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.308209 Oct 13 08:47:33.311516 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1603/3476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:32 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:33.432609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "name": "network-vif-plugged", "status": "completed", "tag": "4094b4ba-7f32-483d-98b3-c4ff87fd5580"}, {"server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "name": "network-vif-plugged", "status": "completed", "tag": "c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:33.445304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.446056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.446691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.464495 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Creating event network-vif-plugged:4094b4ba-7f32-483d-98b3-c4ff87fd5580 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:33.465252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] Creating event network-vif-plugged:c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:33.471218 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7f77fff8-0eee-418c-8689-62964fb6b606 req-7ad7990a-a587-4035-9c2d-94260c4e2e63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042758 Oct 13 08:47:33.472218 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1874/3477] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:33.539140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:33.540608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:33.552769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.553537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.554179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.555103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.561303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.562165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.720271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:33.720980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:33.736314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.743230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.744036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.748598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.749331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.750003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.861988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:33.866535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:33.868156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:33.868683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:33.869147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lazy-loading 'fault' on Instance uuid 33450b61-1868-4553-9303-b7ca2520a3d8 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:33.985544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:34.000757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66a9ffcf-01a7-4105-944c-c30fcaae7049 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1309 microversion: 2.1 time: 0.466362 Oct 13 08:47:34.001962 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1604/3478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:33 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:34.014850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e97184cd-6e55-41ae-853d-21af5e38c392 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375eb2700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:34.069222 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e97184cd-6e55-41ae-853d-21af5e38c392 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.065903 Oct 13 08:47:34.070595 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1605/3479] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:34 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:34.075596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:34.076942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:34.084792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.085608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.086399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.086790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a48728ca0a40b083d4b54bcdd51beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cf31a244f6454aac8efa6e44c3f449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:34.088607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.089294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.090063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.100386 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74b1e7ef-92b4-45ac-8e86-fa6ca428122f tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 200 len: 1315 microversion: 2.1 time: 0.381331 Oct 13 08:47:34.118693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1875/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:33 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:34.325595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:34.334989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:34.336664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:34.358068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c690df4-3746-4ce0-ad06-cc36c57b569f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1497 microversion: 2.1 time: 0.286097 Oct 13 08:47:34.358982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1606/3481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:34 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:34.382425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.383110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.383569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.385123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.386126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.386722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.390087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:34.395240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:34.402097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:34.424340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.425250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.426458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.427436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.429598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.430270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.530233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:34.587185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-524fb0e2-e370-4957-b0a6-b99046a464c9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.203522 Oct 13 08:47:34.590782 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1607/3482] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Oct 13 08:47:34 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:34.603891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:34.611210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.612084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.612839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.685996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Going to try to start instance {{(pid=127031) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 08:47:34.753832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-547c22e0-0ef6-4684-bf85-617016c234bf tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "POST /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26/action" status: 202 len: 0 microversion: 2.1 time: 0.157516 Oct 13 08:47:34.755438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1608/3483] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:47:34 2022] POST /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:47:34.808606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:34.810556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:34.824094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.824874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.825550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.828800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:34.829744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:34.830557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:34.859607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:34.868685 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a49ec6c-0d4a-4bb7-beb0-7a1ed0e840a6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1334 microversion: 2.1 time: 0.548417 Oct 13 08:47:34.882823 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1876/3484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:34 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1334 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:34.968029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:35.025008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.025520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:35.036606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.037101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.038941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.040865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.043687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.044510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.133085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:35.144645 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75de90f7-0465-4e82-bbd7-76894d836a55 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1506 microversion: 2.1 time: 0.368933 Oct 13 08:47:35.147658 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1609/3485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:34 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:35.153032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d0458b7-8aba-41ac-b8ee-190a007b0b0a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f44d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.210961 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d0458b7-8aba-41ac-b8ee-190a007b0b0a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.062046 Oct 13 08:47:35.211803 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1610/3486] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:35.219910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.220780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] [instance: 33450b61-1868-4553-9303-b7ca2520a3d8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:35.228670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.229423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.230039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.231006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.231612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.232226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.246986 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] HTTP exception thrown: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Request method failure captured: Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 HTTP/1.1 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9CDjL_Wz2hF_WCHeQMkM83UDgTl6oQt03sH-ugz0VoD0J3__W9ABEYC2yxN1kQGokNZDJ6q5tI1cksaGO9bi_dls7kVsuN2Dfke_YSnEN5YzhFXNxM_-4M3VnM4Ap2mSm6ZPB_3b249-kD_hKqbWVCw92VhgRHmOX3ajEg7nfyq5Ys Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/55cf31a244f6454aac8efa6e44c3f449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 55cf31a244f6454aac8efa6e44c3f449 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1933412288 Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 16a48728ca0a40b083d4b54bcdd51beb Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1933412288-project Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '33450b61-1868-4553-9303-b7ca2520a3d8'} Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:35.248989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. Oct 13 08:47:35.254208 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:35.255872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] Returning 404 to user: Instance 33450b61-1868-4553-9303-b7ca2520a3d8 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:35.256951 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec19213e-0702-4c9f-a756-160d9cbdb922 tempest-ServerAddressesNegativeTestJSON-1933412288 tempest-ServerAddressesNegativeTestJSON-1933412288-project] 10.222.0.23 "GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8" status: 404 len: 111 microversion: 2.1 time: 0.041713 Oct 13 08:47:35.258077 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1611/3487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/servers/33450b61-1868-4553-9303-b7ca2520a3d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:35.361751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:35.374829 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-936028a7-fab4-4053-b31f-7051b2b6e440 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1491 microversion: 2.1 time: 0.353557 Oct 13 08:47:35.398553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1877/3488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1491 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:35.408062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.408683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:35.419592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.420091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.420529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.421229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.421687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.422116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.850538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:35.858503 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e630b84-5925-4abb-9331-a433462c9429 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1491 microversion: 2.1 time: 0.454423 Oct 13 08:47:35.859082 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1612/3489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1491 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:35.885126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.885583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:35.890619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:35.894630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:35.895293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:35.904264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.905302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.906576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.907511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.908182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.908816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.912360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.912875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.913321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:35.914036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:35.914548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:35.914981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.211101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:36.223708 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1768451d-ccce-4834-8ab8-9715285acafa tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1491 microversion: 2.1 time: 0.343209 Oct 13 08:47:36.224314 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1878/3490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1491 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:36.239119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.239119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.241580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.242511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.243190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.244112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.244957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.245594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.306718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:36.320136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3948489e-68be-4ead-8d2e-59ec80747af9 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1667 microversion: 2.1 time: 0.430605 Oct 13 08:47:36.320740 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1613/3491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:35 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1667 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:36.338316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bace77ba-761f-4011-b7dd-1aae962abbd2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f39a60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.454623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bace77ba-761f-4011-b7dd-1aae962abbd2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.132767 Oct 13 08:47:36.463832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1614/3492] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:36 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:36.470821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.471614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.479122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.479902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.480847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.481793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.482466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.483079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.518378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:36.522236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:36.530199 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e736f007-4651-44ea-b132-3fe5acbcbc1d tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1506 microversion: 2.1 time: 0.300040 Oct 13 08:47:36.535326 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1879/3493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:36 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:36.541358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.541854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.563776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.564542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.565197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.566320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.574994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:36.582668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.585301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.646913 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37b8170e-0289-4560-b7bf-f3dcf8210b8f tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e/ips" status: 200 len: 177 microversion: 2.1 time: 0.110389 Oct 13 08:47:36.651832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1880/3494] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:47:36 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e/ips => generated 177 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:36.657840 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f76d154-35af-4c1a-ae25-bf1e7ed35ed5 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 204 len: 0 microversion: 2.1 time: 0.192443 Oct 13 08:47:36.664168 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1615/3495] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:36 2022] DELETE /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:36.666506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.673466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.673672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.691592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.710065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.710879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.711735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.712638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.713280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.713900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.718757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.719395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.719917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.724294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.724860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.725423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.775457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:36.779427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:36.934885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cdda283-2f60-4aba-8189-90f23827e6f0 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 204 len: 0 microversion: 2.1 time: 0.275770 Oct 13 08:47:36.936188 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1881/3496] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:36 2022] DELETE /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:36.947554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:36.948381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:36.958214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.960301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.961126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:36.962014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:36.962527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:36.964246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:37.013986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:37.018371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:37.041241 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6a01fd8-2867-4bcf-9d17-8b5aee24cbbf tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1497 microversion: 2.1 time: 0.372416 Oct 13 08:47:37.041852 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1616/3497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:36 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1497 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:37.313924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:37.327459 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6f7138a-237f-4f4e-bad1-931154d25cc6 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1673 microversion: 2.1 time: 0.384762 Oct 13 08:47:37.330133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1882/3498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:36 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1673 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:37.480547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4894b088-d283-425c-82dd-ef4c5567e7f4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f39e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:37.562674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:37.563560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:37.573177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:37.573667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:37.574156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:37.575000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:37.575457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:37.575876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:37.590322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4894b088-d283-425c-82dd-ef4c5567e7f4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.115841 Oct 13 08:47:37.590966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1617/3499] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:37 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:37.782527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:37.791610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7330335-a60a-44ba-8ce8-5ebbdf4e33de tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1506 microversion: 2.1 time: 0.234126 Oct 13 08:47:37.792207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1883/3500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:37 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:38.069579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:38.070926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:38.081871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.088112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.088830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.089818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.098331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.099111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.356408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:38.356947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:38.388419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.390055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.390759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.391694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.392360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.394077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.532970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:38.550535 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ce5a0b0f-0e4a-46e7-82e0-5b08f1839634 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1497 microversion: 2.1 time: 0.485291 Oct 13 08:47:38.551416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1618/3501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:38 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1497 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:38.612145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b617c8b6-db0b-4f94-a335-e03eeb5e1ca4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375f39e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:38.719182 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b617c8b6-db0b-4f94-a335-e03eeb5e1ca4 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.111410 Oct 13 08:47:38.719927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1619/3502] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:38 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:38.817887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:38.819007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:38.829484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.830743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.832982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.835866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:38.839807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:38.840722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:38.894574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:38.906362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61509788-e851-455b-a97e-3e3dff58a248 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1673 microversion: 2.1 time: 0.553795 Oct 13 08:47:38.907150 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1884/3503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:38 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1673 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:39.287012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:39.299138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11ce3658-ad91-407a-bce0-89de4f2d937c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1510 microversion: 2.1 time: 0.483537 Oct 13 08:47:39.318829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1620/3504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:38 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:39.332858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:39.338355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:39.343038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.servers [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Removing options 'limit' from query {{(pid=127030) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 13 08:47:39.343958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:39.345244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.351041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.351636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.352519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.353080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.353748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.355578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2917bebc-a3ab-4522-b899-d78b57033938 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026547 Oct 13 08:47:39.356705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1885/3505] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 08:47:39 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:47:39.369377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:39.370357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:39.379702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.380950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.382990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.384015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.387223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.387954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.573614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:39.574554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:39.588342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.590795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.591451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.594264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:39.599067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:39.599762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:39.913638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:39.924305 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07c685fe-e8cc-404c-b7a1-957f41157213 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1497 microversion: 2.1 time: 0.354378 Oct 13 08:47:39.950615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1886/3506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:39 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1497 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:39.955927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd12a084-3612-4af7-a8c8-2b532a8a256a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f53758a0790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:40.030717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd12a084-3612-4af7-a8c8-2b532a8a256a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.078427 Oct 13 08:47:40.031763 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1887/3507] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:39 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:40.042243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:40.042243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:40.057286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.057946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.058548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.062321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.062980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.063533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.142927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:40.153044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d8497e67-6151-4dde-9991-52212f64b29e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1510 microversion: 2.1 time: 0.787547 Oct 13 08:47:40.157045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1621/3508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:39 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1510 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:40.180757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:40.181738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:40.195581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.197058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.198902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.199765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.206636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.212159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.438622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:40.449808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba5bba2d-e429-4800-8ce2-08306359aeeb tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1673 microversion: 2.1 time: 0.416888 Oct 13 08:47:40.453760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1888/3509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:40 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1673 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:40.553933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4420b5-da0a-4d63-9022-f352c79fe4f2", "name": "network-vif-deleted", "tag": "a230acc8-73aa-422c-a1be-57d5082262ff"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:40.591435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.592591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.593994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.644625 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] Creating event network-vif-deleted:a230acc8-73aa-422c-a1be-57d5082262ff for instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 on n-h2-858384-11 Oct 13 08:47:40.663581 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e3fcf573-bf29-4322-a857-3e860168bcfb req-27ca8795-7609-4089-b2e8-8e238f05a7b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115035 Oct 13 08:47:40.666028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1889/3510] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:40.876541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:40.894012 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae7734f1-6932-46c6-8f46-cb1fe74b8e66 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1510 microversion: 2.1 time: 0.716458 Oct 13 08:47:40.901170 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1622/3511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:40 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:40.926795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:40.927214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:40.949530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:40.949672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.950094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.950514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:40.950656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.951260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.951717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.955765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.959923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.961596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.968024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:40.971515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:40.972174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:40.972750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:41.138729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:41.139512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:41.139984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:41.140451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lazy-loading 'fault' on Instance uuid 8c4420b5-da0a-4d63-9022-f352c79fe4f2 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:41.258388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:41.270245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca63025d-ebe2-4c2d-ad01-91da2eff6058 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 200 len: 1299 microversion: 2.1 time: 0.324798 Oct 13 08:47:41.294507 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1623/3512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:40 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 1299 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:41.300172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46c55d7f-17a5-471d-8c38-78213007d6af tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375fb40d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:41.396846 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46c55d7f-17a5-471d-8c38-78213007d6af tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.087747 Oct 13 08:47:41.396846 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1624/3513] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:41 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:41.452788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:41.501559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-747b07e9-113a-409a-8822-04b60fa02cea tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1511 microversion: 2.1 time: 0.582248 Oct 13 08:47:41.503490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1890/3514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:40 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:41.529030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:41.534803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:41.538161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:41.538875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:41.539558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:41.558052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:41.560975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:41.562232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:41.563061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:41.563538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:41.563975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:41.895176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:41.907428 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b17a01f-9107-4437-b276-780be879b4d3 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1652 microversion: 2.1 time: 0.427889 Oct 13 08:47:41.908352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1625/3515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:41 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1652 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:42.247919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.248414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.248853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.249667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.250123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.250660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.300539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:42.301255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:42.321961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.322492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.322940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.323666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.324132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.324567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.367990 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 HTTP/1.1 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8c4420b5-da0a-4d63-9022-f352c79fe4f2'} Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:42.369698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:42.374178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:42.387455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35d7ffc2-4346-4890-90f7-bfc09d1c6ac3 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 404 len: 111 microversion: 2.1 time: 0.091684 Oct 13 08:47:42.394840 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1626/3516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:42 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:47:42.404257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b52d61e0-ff4c-4870-88e4-f5078dd2b04a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375d903a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:42.506301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b52d61e0-ff4c-4870-88e4-f5078dd2b04a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.105681 Oct 13 08:47:42.506927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1627/3517] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:42 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:42.520587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:42.521072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:42.543965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.544689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.548281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.549395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.550627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.559441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.609669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:42.833162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0501032-0da1-4a80-881c-bcf8fd3d1360 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 204 len: 0 microversion: 2.1 time: 0.324935 Oct 13 08:47:42.834028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1628/3518] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:42 2022] DELETE /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:42.845502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "name": "network-vif-deleted", "tag": "4094b4ba-7f32-483d-98b3-c4ff87fd5580"}, {"server_uuid": "e30bea5c-945f-4020-9cee-8ff3ceb86e4e", "name": "network-vif-deleted", "tag": "c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:42.882295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:42.889726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:42.890503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:42.946959 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Creating event network-vif-deleted:4094b4ba-7f32-483d-98b3-c4ff87fd5580 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:42.947599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] Creating event network-vif-deleted:c902aae5-0aa2-4e0b-a22e-20b9bb3c6a17 for instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e on n-h1-858384-11 Oct 13 08:47:42.961588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3e03120a-d79e-4721-a9d1-f5bb763d9620 req-3f6e873b-4c6a-4faa-a8d4-a9e83eb79c4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119877 Oct 13 08:47:42.964074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1629/3519] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:42.998063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:42.998805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:43.006940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:43.019894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.020502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.020952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.026439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:43.027378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.027976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.032461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.137461 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1be93c44-a31f-43b5-9978-411a3cd4e4e9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 345 microversion: 2.1 time: 1.613507 Oct 13 08:47:43.151629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1891/3520] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:47:41 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 345 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:43.156464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:43.157083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:43.164011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.164495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.164929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.165630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.166075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.166549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.214614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.215100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.215534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.215983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lazy-loading 'fault' on Instance uuid e30bea5c-945f-4020-9cee-8ff3ceb86e4e {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:43.330626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:43.342939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a32b0d59-d7eb-46af-b3f1-6d92f079dd4d tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1497 microversion: 2.1 time: 0.370903 Oct 13 08:47:43.358918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121483ba66f145de9e50420bd52cf669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba45f45bd464b9889a06f8573e15495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:43.360522 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1630/3521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:42 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1497 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:43.361662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76b3043a-d0e0-4feb-a8c2-aae602ea657d tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 200 len: 1303 microversion: 2.1 time: 0.208832 Oct 13 08:47:43.367988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:43.368809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:43.376334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.377065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.377723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.379174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.380671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.381273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.383264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1892/3522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:43 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:43.523485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f6069d2-58cd-4ff5-8bea-b1c7546e1e8a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537ab53ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:43.656070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f6069d2-58cd-4ff5-8bea-b1c7546e1e8a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1429 microversion: 2.1 time: 0.137223 Oct 13 08:47:43.657354 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1893/3523] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:43 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:43.761720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:43.771160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-28882ee5-f376-467f-84cc-a72a68ff08f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1510 microversion: 2.1 time: 0.409129 Oct 13 08:47:43.776166 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1631/3524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:43 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:43.804435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:43.805270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:43.813700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.816338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.816922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:43.819063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:43.819612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:43.820832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.103873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:44.111934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2861d790-be23-407f-b735-cbe4654678da tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1510 microversion: 2.1 time: 0.312621 Oct 13 08:47:44.113321 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1894/3525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:43 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:44.136313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:44.137910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:44.145147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.145880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.146506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.147401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.148193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.148771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.355020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:44.367161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:44.368059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:44.368213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8da90891-d016-4d00-8960-d3441e188499 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1511 microversion: 2.1 time: 0.235859 Oct 13 08:47:44.371467 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1632/3526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:44.379206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.380438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.380902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.381633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.382110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.382591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.400912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:44.402869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:44.424866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.428010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.428662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.429559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.432632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.433677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.465346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:44.470715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e HTTP/1.1 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e30bea5c-945f-4020-9cee-8ff3ceb86e4e'} Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:44.474874 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:44.479741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:44.482535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:44.485233 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8275e63e-fbe6-444a-bb00-4847b4d7e790 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 404 len: 111 microversion: 2.1 time: 0.095982 Oct 13 08:47:44.486192 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1633/3527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:44.498183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:44.505125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:44.508513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:44.520369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.523076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.528297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.529618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.530011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.530529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.608037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:44.699400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:44.708425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:44.709188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:44.709633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:44.719562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:44.829935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:44.840587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5660dec6-ebcc-4eff-88e2-74b6276cde71 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1497 microversion: 2.1 time: 0.477582 Oct 13 08:47:44.859543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1895/3528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:44.883487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc55de3d-7013-48f9-92f1-006ae537606b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537ab34550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:44.970287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc55de3d-7013-48f9-92f1-006ae537606b tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1438 microversion: 2.1 time: 0.100029 Oct 13 08:47:44.972249 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1896/3529] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:45.015590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c9ee853-26db-406d-8551-c4b95d30b695 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537ab53ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:45.117263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c9ee853-26db-406d-8551-c4b95d30b695 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 200 len: 1438 microversion: 2.1 time: 0.118101 Oct 13 08:47:45.133969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1897/3530] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:45.139933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:45.140758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:45.148850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:45.149635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:45.150336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:45.151384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:45.152000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:45.152581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:45.692273 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-34ed9e76-2121-4c2d-afa0-92c1a209174a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 1.204770 Oct 13 08:47:45.693318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1634/3531] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:47:44 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:45.720936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:45.727494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:45.728454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:45.808599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:45.837046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7cce28a6-c1dc-40f8-b7eb-5a9c457df18f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1466 microversion: 2.1 time: 0.701827 Oct 13 08:47:45.840212 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1898/3532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:45 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1466 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:45.883375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:45.885650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:45.907325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:45.913519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:45.914042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:45.914796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:45.915256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:45.915686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.077223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.077825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.078289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.079120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.079594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.080329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.295291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:46.307941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2634a49-3083-4ff7-bb92-49d2f84c0f03 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1497 microversion: 2.1 time: 0.447510 Oct 13 08:47:46.308532 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1899/3533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:45 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1497 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:46.316164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:46.320293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b77c832b-1569-442e-ad73-0fea47c3c99f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f537abc1700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:46.394384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-34cc4072-4e90-4c27-8a88-8aa437065f62 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.677244 Oct 13 08:47:46.395837 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1635/3534] 10.222.0.23 () {58 vars in 1150 bytes} [Thu Oct 13 08:47:45 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:46.412367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:46.424983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:46.425687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:46.437443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.438341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.439111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.440030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.441250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.441851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.586427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:46.744786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-41192c98-340c-468f-a03c-8c92d7621294 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.339011 Oct 13 08:47:46.753768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1636/3535] 10.222.0.23 () {58 vars in 1212 bytes} [Thu Oct 13 08:47:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:46.759746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:46.769127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:46.769646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:46.786721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.787349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.787809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:46.788465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:46.788918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:46.789343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.057198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:47.284879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76766f51-1648-4b99-9310-d7fb11c5a822 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.527860 Oct 13 08:47:47.286862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1637/3536] 10.222.0.23 () {58 vars in 1196 bytes} [Thu Oct 13 08:47:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:47.306052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:47.311748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:47.312434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': '-517164726', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:47.318486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.319047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.319489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.320209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.320769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.321293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.439661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b77c832b-1569-442e-ad73-0fea47c3c99f tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "DELETE /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd" status: 204 len: 0 microversion: 2.1 time: 1.123323 Oct 13 08:47:47.441161 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1900/3537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:46 2022] DELETE /compute/v2.1/images/765a9775-d8c6-48c1-9682-22b4b41c06bd => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:47.447358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:47.448334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:47.466887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.467424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.467877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.468614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.476445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.477036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.541966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:47.708652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:47.717848 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2bfdb01-5091-43f4-a78c-d8a414c1567c tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-517164726" status: 200 len: 345 microversion: 2.1 time: 0.420739 Oct 13 08:47:47.728753 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1638/3538] 10.222.0.23 () {58 vars in 1156 bytes} [Thu Oct 13 08:47:47 2022] GET /compute/v2.1/servers?name=-517164726 => generated 345 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:47.733441 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed2d876e-2a97-4458-996a-a20351c24913 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 200 len: 1455 microversion: 2.1 time: 0.286346 Oct 13 08:47:47.740125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1901/3539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:47 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 1455 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:47.749955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-315f0762-4f48-465c-a9ab-5b65247a82be tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '.version_select at 0x7f5375ee7700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:47.753707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2534080-aa36-404f-9a80-6efe22745775", "name": "network-vif-deleted", "tag": "d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:47.792744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.795869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.796641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.825483 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] Creating event network-vif-deleted:d2b2cca4-80e5-4c76-bbf4-2dc34e0e244d for instance b2534080-aa36-404f-9a80-6efe22745775 on n-h2-858384-11 Oct 13 08:47:47.825868 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-315f0762-4f48-465c-a9ab-5b65247a82be tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] HTTP exception thrown: Image not found. Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-315f0762-4f48-465c-a9ab-5b65247a82be tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Request method failure captured: Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 HTTP/1.1 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BbeLpErdgJyi6z8KdMPoeFE-owlHssm-cYxvKuTCV9qWuOJtYNMuGOMjecNu92P0bU_ZRc7ii9XweeFWfLBLzdAHx99YiEYqAdRziGb8_5bKWZY4tTaMo7s92pNqoC4bFddfocTRtvJr0WWMvesk8O_8j1I-ts5eUG2jaxkFZ3T1o Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 2077f75835184be788773e1eeb0b0f47 Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: exception: Image not found. Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '199efdde-13c6-4c1d-97aa-44b1e1db9d30'} Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 199efdde-13c6-4c1d-97aa-44b1e1db9d30 to delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 199efdde-13c6-4c1d-97aa-44b1e1db9d30 could not be found. Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.828168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-315f0762-4f48-465c-a9ab-5b65247a82be tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Returning 404 to user: Image not found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-315f0762-4f48-465c-a9ab-5b65247a82be tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "DELETE /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30" status: 404 len: 62 microversion: 2.1 time: 0.100002 Oct 13 08:47:47.836838 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1639/3540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:47 2022] DELETE /compute/v2.1/images/199efdde-13c6-4c1d-97aa-44b1e1db9d30 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:47:47.842005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:47.857061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:47.858714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:47.859010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f29ca169-9736-4ccb-a3aa-1137a33cbdc5 req-54523b9e-865a-4c05-9274-bc2cd6107de2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114936 Oct 13 08:47:47.860981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1902/3541] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:47.869586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:47.870537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.870980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:47.871147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.879808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.880663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.881536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.886018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.886824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.889500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.890077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.893559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:47.894672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:47.895939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:47.928065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:47.951850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:48.201635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e8e558c-57f4-4a74-8bf8-49c25cd2f863 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 204 len: 0 microversion: 2.1 time: 0.329140 Oct 13 08:47:48.204120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1903/3542] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:47 2022] DELETE /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:48.230134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.230886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:48.269612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.270063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.270576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.274603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.276538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:48.280839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.281629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.465413 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cdac671a-eb62-4354-acd6-ca80a31b115b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.631751 Oct 13 08:47:48.466779 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1640/3543] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Oct 13 08:47:47 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:48.480034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.493063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:48.494486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-51716472', 'deleted': False, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:47:48.514330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.514864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.515295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.516034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.516486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.516901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.683469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:48.701288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84818fa9-f8bb-4ee3-bfde-e504c1d0ee7e tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1472 microversion: 2.1 time: 0.492255 Oct 13 08:47:48.702082 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1904/3544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:48 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:48.715087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.717764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:48.739423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.739941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.740369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.741086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.741594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.741947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.795950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:47:48.813055 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5615a8a2-0e70-47b0-9e7f-449675da1558 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109686 Oct 13 08:47:48.818163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1905/3545] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:47:48 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:48.830967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.832151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:48.847897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.848543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.865616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.867786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.872248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.876625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.900798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-68d20bc0-3a36-4d21-bc99-cc5c45d9c947 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-51716472" status: 200 len: 345 microversion: 2.1 time: 0.424938 Oct 13 08:47:48.902215 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1641/3546] 10.222.0.23 () {58 vars in 1226 bytes} [Thu Oct 13 08:47:48 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-51716472 => generated 345 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:47:48.908118 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:47:48.910817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.911411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 HTTP/1.1 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b2534080-aa36-404f-9a80-6efe22745775'} Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:48.912952 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:47:48.917275 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:48.920472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.921148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.921671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.922652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.923301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.923940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.928085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:48.929125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a158ce4b-7116-414e-8a47-0c7fbb097d38 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 404 len: 111 microversion: 2.1 time: 0.109664 Oct 13 08:47:48.934097 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1906/3547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:48 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:48.939371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:48.940829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:48.959679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.962741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.963548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:48.964656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:48.966848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:48.968212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:49.051582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:49.115621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lazy-loading 'services' on Instance uuid acb60673-11e1-4222-88a5-514d66ab9ee5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:49.267131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20cc0811-a6f1-4416-87bd-575aa15bb2db tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments/c86f0005-ecf7-4409-a315-35c9f33759a0" status: 202 len: 0 microversion: 2.1 time: 0.363357 Oct 13 08:47:49.268486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1642/3548] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:47:48 2022] DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments/c86f0005-ecf7-4409-a315-35c9f33759a0 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:47:49.280196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-608377265", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:49.334018 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb6cb64e-54db-47cf-acde-c47cc3a03d32 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "DELETE /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 204 len: 0 microversion: 2.1 time: 0.398084 Oct 13 08:47:49.334859 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1907/3549] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:48 2022] DELETE /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:49.343541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:49.348299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:49.371003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:47:49.372639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:49.373223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:49.373740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:49.375934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:49.376689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:49.378753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:49.641879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:49.650096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbb8f49c-1396-4f49-853e-2ed785efc089 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1517 microversion: 2.1 time: 0.310664 Oct 13 08:47:49.662854 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1908/3550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:49 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:49.673442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-unplugged", "status": "completed", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:49.696556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:49.697203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:49.698690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:49.727745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] Creating event network-vif-unplugged:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:47:49.735279 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0d297e33-e7cf-4103-aa7a-550fe7d99bba req-c9314f6d-1cf6-4527-afd0-5dd8f3d3d007 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071069 Oct 13 08:47:49.739744 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1909/3551] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:49.747351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:49.748259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:49.756799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:49.757331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:49.758011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:49.759134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:49.759759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:49.760372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.075867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:50.087095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86ebb098-a81f-4963-a69d-b4fcf141852a tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1472 microversion: 2.1 time: 0.345347 Oct 13 08:47:50.088451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1910/3552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:49 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:50.313574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-719029936", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:50.317578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:50.318117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:50.318621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:50.319249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:50.320037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:50.339418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.340657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.353423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.354346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.356793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.357316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.388042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:50.388454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:50.388941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:50.389349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:50.389758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:50.393929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:47:50.403307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:47:50.410732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.415006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.417623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.418590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.419875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.422184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.431062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:47:50.435448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:47:50.446058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Getting quotas for project fe691d8e71d84c4ea19b341239890b72. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:47:50.463435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Getting quotas for user a4cd8b9a8a4b4c57955de7f5f36ad698 and project fe691d8e71d84c4ea19b341239890b72. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:47:50.497440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:47:50.501644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:47:50.596378 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7403beb8-e4cc-4bcc-be75-69cb202db508 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321172 Oct 13 08:47:50.597316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1643/3553] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:47:50.610255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5c5808f-3de7-41f3-acbb-553dcd6eca11 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:50.611182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5c5808f-3de7-41f3-acbb-553dcd6eca11 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:50.646081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdebe524-ed74-4b2d-9363-f3c5f8d7f986 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.553926 Oct 13 08:47:50.651096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1911/3554] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:47:50.662991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:50.663467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:50.745481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5c5808f-3de7-41f3-acbb-553dcd6eca11 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:50.754967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5c5808f-3de7-41f3-acbb-553dcd6eca11 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1208 microversion: 2.1 time: 0.149565 Oct 13 08:47:50.759542 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1644/3555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:50 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:50.778118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:50.781518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:50.799386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.801601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.803684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.806287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:50.809305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:50.809686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:50.972214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:50.983830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:50.992041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:50.993871 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c9e7691-13de-4658-9c07-3dd40cbba8a8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1277 microversion: 2.57 time: 0.338423 Oct 13 08:47:51.006452 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1912/3556] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:50 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1277 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:47:51.006452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.006452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.013759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.029916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e HTTP/1.1 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e30bea5c-945f-4020-9cee-8ff3ceb86e4e'} Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:51.031860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.037326 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.039954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:51.041080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c76dd2d-9cd1-460a-b38e-b1c313be2ec2 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 404 len: 111 microversion: 2.1 time: 0.045290 Oct 13 08:47:51.045081 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1913/3557] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:50 2022] DELETE /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:51.123882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-10191349", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:51.149004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:51.160791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:51.185242 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69cb2cf9-dc36-475a-8906-b4a2e164080b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1517 microversion: 2.1 time: 0.424347 Oct 13 08:47:51.191458 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1645/3558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:50 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:51.207445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.213778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: e30bea5c-945f-4020-9cee-8ff3ceb86e4e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.227672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.228450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.229124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.229282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:47:51.230203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.230934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.232297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.275177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e HTTP/1.1 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e30bea5c-945f-4020-9cee-8ff3ceb86e4e'} Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.277149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance e30bea5c-945f-4020-9cee-8ff3ceb86e4e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dbcb3c1f-484e-4182-92ab-3723ece1db0a tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e" status: 404 len: 111 microversion: 2.1 time: 0.084901 Oct 13 08:47:51.282047 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1646/3559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:51 2022] GET /compute/v2.1/servers/e30bea5c-945f-4020-9cee-8ff3ceb86e4e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:51.285472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.286093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.292107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.292593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.293015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.293710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.294483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.295325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.492072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:51.503003 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55a7d1f0-7faa-4485-b1ed-25680e4f0b66 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1472 microversion: 2.1 time: 0.221925 Oct 13 08:47:51.503831 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1647/3560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:51 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:51.517492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.519025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.534318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.536295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.537209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.541573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.542241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.543042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.570035 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be HTTP/1.1 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '71af2c59-068c-4250-8575-6da00105d0be'} Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:51.571659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5114ba5b-5644-4ddf-b41e-8de7575cb274 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 404 len: 111 microversion: 2.1 time: 0.067933 Oct 13 08:47:51.577148 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1648/3561] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:51 2022] DELETE /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:51.587934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.587934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] [instance: 71af2c59-068c-4250-8575-6da00105d0be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.609520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.610013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.612584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.613376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.613851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.614285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.642789 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] HTTP exception thrown: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Request method failure captured: Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be HTTP/1.1 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9A1E3ZUAk_hBV7ppKsAZX85Eq4TIje_3a1gE4RXyIp1G_unHTy1rCW2uCWDJpuWunygHb7S6ivHvInmLGX4kU6rvfCmGPxCfAqnDFNaw0FrhHHQKjMuUyBXPScxI8pgCYJpLrODkQjr0BaluaFWRv3i3qH98SqyimcqSFmyWmEuYMY Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ba45f45bd464b9889a06f8573e15495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ba45f45bd464b9889a06f8573e15495 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestMultiNic-408679791 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 121483ba66f145de9e50420bd52cf669 Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestMultiNic-408679791-project Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '71af2c59-068c-4250-8575-6da00105d0be'} Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:51.648335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] Returning 404 to user: Instance 71af2c59-068c-4250-8575-6da00105d0be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:51.652454 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-068bf373-dffc-4f76-b2fa-5177d0e36ba4 tempest-ServersTestMultiNic-408679791 tempest-ServersTestMultiNic-408679791-project] 10.222.0.23 "GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be" status: 404 len: 111 microversion: 2.1 time: 0.074228 Oct 13 08:47:51.659669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1649/3562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:51 2022] GET /compute/v2.1/servers/71af2c59-068c-4250-8575-6da00105d0be => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:51.789054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:51.790484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:51.802362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.803516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.804253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.805266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.805878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.806490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.878221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:51.878793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:51.879343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:51.879831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:51.880312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:51.905352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.905928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.906622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.907518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:51.907986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:51.916712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:51.955213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:47:51.962026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:47:51.986646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:47:51.988921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:47:52.081839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8518f2d-c902-4a73-9640-ef269c4fb5ba tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035212 Oct 13 08:47:52.090746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1914/3563] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:47:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:47:52.097170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:52.116068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:52.146678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.147593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.148058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.149876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.150350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.150981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.195406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.206984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b81c3e35-9d8a-4a5a-84c2-bfcda6491de9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1204 microversion: 2.1 time: 0.423690 Oct 13 08:47:52.207569 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1650/3564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:51 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1204 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:52.222608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9217c5b3-36e6-4a22-b96c-6e540cb9074b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:52.223503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9217c5b3-36e6-4a22-b96c-6e540cb9074b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:52.305317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.317547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.320043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.325188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61f1e612-122c-4856-93b6-bc5037c756ff tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1329 microversion: 2.57 time: 0.232179 Oct 13 08:47:52.326632 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1915/3565] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:52 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:52.371217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:52.378719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:52.383327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9217c5b3-36e6-4a22-b96c-6e540cb9074b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.391589 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9217c5b3-36e6-4a22-b96c-6e540cb9074b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1213 microversion: 2.1 time: 0.182797 Oct 13 08:47:52.393198 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1651/3566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:52 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:52.418473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.418993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.419534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.420134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.420590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.421015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.526951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:52.527562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:52.541588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.542779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.548818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.549983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:52.551359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:52.553771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:52.889232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:52.900965 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a787238a-34a4-46d0-b9b3-676ff30fa721 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1517 microversion: 2.1 time: 0.572522 Oct 13 08:47:52.921172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1916/3567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:52 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:53.234443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:53.235826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:53.247991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.249442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.250392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.255388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.256179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.256817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.442591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:53.457658 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-121fce12-17d0-4c9c-a095-3a72224ef248 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1260 microversion: 2.1 time: 0.227528 Oct 13 08:47:53.458555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1917/3568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:53 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:53.472332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:53.473389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:53.490924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.491835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.492777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.494477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.495181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.496199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.593518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:53.619099 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1fbcf0bc-62e2-4ff1-bc9a-79aa855d6568 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1472 microversion: 2.1 time: 1.095860 Oct 13 08:47:53.624614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:53.625883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1652/3569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:52 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1472 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:53.632695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:53.636446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:53.640621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:53.649965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:53.650333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.653722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.654198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.654978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.655153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e25e0ca-5904-4345-9797-1ee961a8b262 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1335 microversion: 2.57 time: 0.195191 Oct 13 08:47:53.655445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.655878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.670648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1918/3570] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:53 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1335 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:53.926821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:53.927946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:53.942766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.943266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.943715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:53.944438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:53.944901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:53.945410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.083019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:54.092373 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dec0321f-fa9d-4857-9159-8779eb69a3f4 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1475 microversion: 2.1 time: 0.169440 Oct 13 08:47:54.097810 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1919/3571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:53 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:54.407000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:54.411734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8edebc45-b0e0-401c-840c-3e0062ccb626", "name": "network-vif-deleted", "tag": "1da1e68f-76ba-449d-af12-53bbeb9a4d7d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:54.435452 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9865ff86-db82-4fb6-9b89-4ff89f48ddf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1265 microversion: 2.1 time: 0.807320 Oct 13 08:47:54.436069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1653/3572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:53 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1265 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:54.469875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.470760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.471524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.486203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:54.495524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:54.513377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] Creating event network-vif-deleted:1da1e68f-76ba-449d-af12-53bbeb9a4d7d for instance 8edebc45-b0e0-401c-840c-3e0062ccb626 on n-h1-858384-11 Oct 13 08:47:54.514011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.514814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.515249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.523358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.523925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.524371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.528197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-029b847f-3a0b-448e-a33b-182f3a446b94 req-d4492f09-226a-4452-acb4-08cdf1effbf9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128999 Oct 13 08:47:54.528813 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1920/3573] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:54.616845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:54.647658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:54.648918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:54.674891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.675430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.679481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.684003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.684558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.685126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.806698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.810648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.811251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.811727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lazy-loading 'fault' on Instance uuid 8edebc45-b0e0-401c-840c-3e0062ccb626 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:54.815443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:54.876560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:54.899654 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c928e84-da54-444d-9e3b-132c189f6a31 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1266 microversion: 2.1 time: 0.417412 Oct 13 08:47:54.902057 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1654/3574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:54 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1266 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:54.907589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:54.908395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:54.916137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.917079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.917753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:54.918977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:54.919659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:54.920228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.095862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.108097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.124613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.127883 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4eed5a3-4632-4dc1-8986-d8aa581a73ca tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1335 microversion: 2.57 time: 0.224429 Oct 13 08:47:55.143665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1655/3575] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:54 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:55.143665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:55.153940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:55.162374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.162905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.163349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.164063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.164520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.164950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.178534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2077f75835184be788773e1eeb0b0f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16aeb065971b44dd88f56cc3c5c10ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.188979 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b031747b-4ba3-46be-9ba3-8bd1c5c8d68d tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 200 len: 1307 microversion: 2.1 time: 0.547223 Oct 13 08:47:55.202883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1921/3576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:54 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:55.229289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.231297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.234059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.234791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lazy-loading 'fault' on Instance uuid 455aa450-c1ca-46cb-8b4f-39b57359edd1 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:47:55.328589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.341326 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-013bea58-e04d-40f7-915c-af7bb547c44f tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 200 len: 1311 microversion: 2.1 time: 0.208101 Oct 13 08:47:55.371057 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1656/3577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:55 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:55.460388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:55.461842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:55.475020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.476869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.477269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.481381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.481955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.482417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.740717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:55.755277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aeacf19e-5c4f-427c-88d9-c7396478dd0f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1271 microversion: 2.1 time: 0.300334 Oct 13 08:47:55.772836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1922/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:55 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:55.930293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:55.932239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:55.946116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.946944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.949088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:55.950375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:55.952164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:55.952870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.118817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:56.128727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c07b643-9e17-4912-afd7-3f6146e95270 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1266 microversion: 2.1 time: 0.202960 Oct 13 08:47:56.138481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1657/3579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:55 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:56.165108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.165929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.180554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.181655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.183307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.184456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.195742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.196313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.218763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.219629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] [instance: 8edebc45-b0e0-401c-840c-3e0062ccb626] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.234154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.234936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.235916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.238811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.239579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.240182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.275002 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] HTTP exception thrown: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Request method failure captured: Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 HTTP/1.1 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9BbeLpErdgJyi6z8KdMPoeFE-owlHssm-cYxvKuTCV9qWuOJtYNMuGOMjecNu92P0bU_ZRc7ii9XweeFWfLBLzdAHx99YiEYqAdRziGb8_5bKWZY4tTaMo7s92pNqoC4bFddfocTRtvJr0WWMvesk8O_8j1I-ts5eUG2jaxkFZ3T1o Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/16aeb065971b44dd88f56cc3c5c10ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 16aeb065971b44dd88f56cc3c5c10ee7 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1329148713 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 2077f75835184be788773e1eeb0b0f47 Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ImagesOneServerTestJSON-1329148713-project Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8edebc45-b0e0-401c-840c-3e0062ccb626'} Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:56.280198 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. Oct 13 08:47:56.285579 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.287628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] Returning 404 to user: Instance 8edebc45-b0e0-401c-840c-3e0062ccb626 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:56.289483 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3dd0ed5-6f63-4758-9d10-dfae80dd6ad2 tempest-ImagesOneServerTestJSON-1329148713 tempest-ImagesOneServerTestJSON-1329148713-project] 10.222.0.23 "GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626" status: 404 len: 111 microversion: 2.1 time: 0.075829 Oct 13 08:47:56.290812 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1658/3580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:56 2022] GET /compute/v2.1/servers/8edebc45-b0e0-401c-840c-3e0062ccb626 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:56.371621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.373631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 455aa450-c1ca-46cb-8b4f-39b57359edd1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.383699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.384467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.385082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.385959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.386624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.387353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.406670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] HTTP exception thrown: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Request method failure captured: Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 HTTP/1.1 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Bz4bxEkzcXC-t35YILH-dUEO8DaYdGyuD4BjD_jEmDMPNFfKizW1LLDWHAVlmIoUVZIlk7Te_ja5xIGFrQzR9Jz6tRi63lGTwlm6gEQYdBt1QS2pxujFvZ1BNUALmw8N821YgYANLL_rlXg0qau0oC2H1Uk6kCl1fO1y_hhleN1jY Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 0b27726e98ef45d197945672a6e66f22 Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '455aa450-c1ca-46cb-8b4f-39b57359edd1'} Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:47:56.408597 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. Oct 13 08:47:56.415293 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:47:56.421063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Returning 404 to user: Instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:47:56.422709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-705119ff-95f6-4986-8cf9-9a9d608913c7 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1" status: 404 len: 111 microversion: 2.1 time: 0.060938 Oct 13 08:47:56.430372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1659/3581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:56 2022] GET /compute/v2.1/servers/455aa450-c1ca-46cb-8b4f-39b57359edd1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:47:56.435650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.436481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.444209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.445022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.445612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.446554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.447178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.447916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.518297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:47:56.681422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:56.695576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6dfeb428-473d-462d-9195-f03a31cdef07 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 204 len: 0 microversion: 2.1 time: 0.262981 Oct 13 08:47:56.695796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:56.697309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:56.698752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1660/3582] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:47:56 2022] DELETE /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:47:56.700793 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3791112c-4966-47ef-911b-224d8ccac90c tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1335 microversion: 2.57 time: 0.537590 Oct 13 08:47:56.701628 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1923/3583] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:56 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1335 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:56.714873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455aa450-c1ca-46cb-8b4f-39b57359edd1", "name": "network-vif-deleted", "tag": "66b5093d-2f5f-4584-9bec-035e45417be4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:56.726868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.727488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.728632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.731497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.732127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.748111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] Creating event network-vif-deleted:66b5093d-2f5f-4584-9bec-035e45417be4 for instance 455aa450-c1ca-46cb-8b4f-39b57359edd1 on n-h1-858384-11 Oct 13 08:47:56.748780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.749519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.750042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.752248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.752840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.753284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.759108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-862a5962-0873-49da-9a93-19286900e821 req-3fe7f750-87e3-4075-b305-b53a5a75c541 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057022 Oct 13 08:47:56.764222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1661/3584] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:47:56.782707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:56.783752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:56.799107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.801365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.802029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.819003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:56.820812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:56.821919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:56.980673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:56.990180 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a7d27c7-0967-47ee-b55c-2646cbfabd0e tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1516 microversion: 2.1 time: 0.273944 Oct 13 08:47:57.009415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1924/3585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:56 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:57.163938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:57.164548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:57.176110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:57.181036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:57.181491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:57.182586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:57.183168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:57.183599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:57.239427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:57.247899 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-254b9a1d-9794-4f92-9316-13316019fb9d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.471061 Oct 13 08:47:57.263850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1662/3586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:56 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:57.294292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:57.306696 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d9021cb-5d13-4c3a-bc99-71c5bf34c4f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1266 microversion: 2.1 time: 0.149322 Oct 13 08:47:57.307671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1925/3587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:57 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:47:57.732281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:57.733111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:57.746314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:57.751120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:57.751591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:57.752891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:57.753678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:57.754601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.015796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:58.016577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:58.036942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.038238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.041692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.043511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.047198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.047920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.152898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:58.189649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:58.191245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:58.192430 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84fcf6aa-1b61-49b3-b701-e9753e0c96d1 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1356 microversion: 2.57 time: 0.464446 Oct 13 08:47:58.202459 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1663/3588] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:57 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1356 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:58.224643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:47:58.227603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:58.243160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.243815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.244138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.244870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.263103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.263561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.477110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:47:58.487238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:47:58.487752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:47:58.488175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:47:58.488603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:47:58.623022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:58.631039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.632019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.633464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.634367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.635664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.636363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.685143 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2722130-cf1d-4756-8f6e-b7f7c848338a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "POST /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091/action" status: 202 len: 1137 microversion: 2.57 time: 0.464518 Oct 13 08:47:58.686466 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1664/3589] 10.222.0.23 () {62 vars in 1320 bytes} [Thu Oct 13 08:47:58 2022] POST /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091/action => generated 1137 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 13 08:47:58.694462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:58.695334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:58.708777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.709878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.710507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.711561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.712173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.712865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.894774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:58.907521 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52826fb3-a015-4812-a6a7-bef931d87d9a tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1516 microversion: 2.1 time: 0.891957 Oct 13 08:47:58.922828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1926/3590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:58 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1516 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:58.931238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:58.947669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:58.974286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.975101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.975736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:58.976628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:58.977655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:58.977830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.535411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:59.553661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31b6ba38-458a-43bb-afab-237147fbd1af tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.619397 Oct 13 08:47:59.554716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1927/3591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:58 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:59.596475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:59.597235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:59.608423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.609734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.610345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.611258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.612453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.613050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.730659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:59.741470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:59.743953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:59.745372 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69f062cb-1e30-4e95-b691-37098796f7ec tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.176346 Oct 13 08:47:59.746431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1928/3592] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:47:59 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:47:59.751013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:47:59.762752 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-edab9cf2-211b-425f-ba80-1f4c9b547c31 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 1.074733 Oct 13 08:47:59.766825 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1665/3593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:58 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:47:59.773832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:59.776278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:59.783648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:47:59.787615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.788298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.789216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.791638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.792286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.792884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.838571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df1f11c4-a827-4176-9221-2214f61c2013 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070450 Oct 13 08:47:59.839962 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1666/3594] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:47:59 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:47:59.926023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:59.930267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:47:59.939702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.941383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.942078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.943054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:47:59.944015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:47:59.944666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:47:59.974209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b478481b-31a3-4744-a9eb-3bf8017692f7 tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] Calling method '.version_select at 0x7f537abb19d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:47:59.986448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-15f6f3ed-2f01-4964-aa41-cba9370ced36 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063725 Oct 13 08:47:59.993616 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1667/3595] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:47:59 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:48:00.003736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.005050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.011909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.012714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.013372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.014901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.015600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.016964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.063966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b478481b-31a3-4744-a9eb-3bf8017692f7 tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] 10.222.0.23 "GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375" status: 200 len: 784 microversion: 2.1 time: 0.316324 Oct 13 08:48:00.064544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1929/3596] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Oct 13 08:47:59 2022] GET /compute/v2.1/images/312a3023-32f8-4474-bfa0-ae0f09977375 => generated 784 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:00.089936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f3c328e-6814-4b67-af41-8a2b2195fc84 tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] Calling method '.version_select at 0x7f5376927040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.210960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f3c328e-6814-4b67-af41-8a2b2195fc84 tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.125365 Oct 13 08:48:00.212291 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1930/3597] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/images => generated 871 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:48:00.218167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.220989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.228027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.228521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.229053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.229753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.230428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.231046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.257650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:00.370079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6bc9d55-254c-4ae5-a21a-bfd530ea9395 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 204 len: 0 microversion: 2.1 time: 0.156281 Oct 13 08:48:00.370746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1931/3598] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:48:00 2022] DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:48:00.385266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "517b0740-2577-400f-85ee-7699ad247c0d", "tag": "b11c2a16-58e5-4075-b76c-b4d9959bbee5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:00.386014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:00.396893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:00.397989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.398557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.398998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.409982 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b3d481e-2f30-4817-8aeb-de236a697cb1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1516 microversion: 2.1 time: 0.416164 Oct 13 08:48:00.414311 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1668/3599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:47:59 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:00.422729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] Creating event network-changed:b11c2a16-58e5-4075-b76c-b4d9959bbee5 for instance 517b0740-2577-400f-85ee-7699ad247c0d on n-h1-858384-11 Oct 13 08:48:00.427212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-af56f632-4b81-48a4-ab5e-6b9ebed31cfb tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] Calling method '.version_select at 0x7f5375d28e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.435974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-31401522-9c53-42ac-944b-2217b20c3815 req-9d0be925-cf86-4622-b089-a19d49382d87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055470 Oct 13 08:48:00.436852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1932/3600] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:00.447431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.448155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.471105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.472765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.473406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.478653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.479396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.480016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.520318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-af56f632-4b81-48a4-ab5e-6b9ebed31cfb tempest-ListImagesTestJSON-1712793280 tempest-ListImagesTestJSON-1712793280-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.104416 Oct 13 08:48:00.535717 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1669/3601] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:00.581351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.582315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.590152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.590677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.591119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.591837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.592296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.592741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.616458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:00.712470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:00.720590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4425c430-eb9e-45a0-ae6b-5cb09ef38061 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1681 microversion: 2.1 time: 0.282780 Oct 13 08:48:00.721208 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1933/3602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:00.725664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c855f8-1522-4e21-b4e1-91513503fa22", "name": "network-vif-deleted", "tag": "67a6d353-0404-4909-8635-c706fab0d00d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:00.736885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.737495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.738173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.751343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] Creating event network-vif-deleted:67a6d353-0404-4909-8635-c706fab0d00d for instance e0c855f8-1522-4e21-b4e1-91513503fa22 on n-h1-858384-11 Oct 13 08:48:00.759043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cb84799b-f1ac-4ae2-a9a8-4ebaf93330db req-968c7880-bc79-42bd-9fe1-3711e34612b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035155 Oct 13 08:48:00.760443 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1934/3603] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:00.771333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.772414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.780795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.781543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.782221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.783198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.786053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.786977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.879626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:00.891634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:00.893502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:00.894730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2973aab-bf03-4313-b44f-2342e8e12f63 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.128079 Oct 13 08:48:00.895308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1935/3604] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:00.899765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:00.900386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:00.917897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.919253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.919951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:00.920967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:00.921762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:00.922366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.073017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.088030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-530d4efb-22cf-4ae4-a63e-a49b2c0d1904 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.510517 Oct 13 08:48:01.088979 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1670/3605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:01.213291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.225271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52c40388-f332-4f8c-83c5-e4c950ad4a73 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.328841 Oct 13 08:48:01.225887 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1936/3606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:00 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:01.371940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:01.381373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:01.389770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.390630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.391282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.392241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.392767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.393326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.421539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:01.439147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:01.441244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:01.453794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.457185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.458285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.459552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.462378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.463769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.529856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bff36e60-7911-4af5-ab90-39466c52ec37 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 204 len: 0 microversion: 2.32 time: 0.439509 Oct 13 08:48:01.530484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1671/3607] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:48:01 2022] DELETE /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:48:01.540376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:01.541406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:01.548607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.549286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.550327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.551067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.551526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.551953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.577256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.588820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93a31432-5446-483d-b791-ee84aec30597 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1474 microversion: 2.1 time: 0.155607 Oct 13 08:48:01.595192 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1937/3608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:01 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1474 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:01.744759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:01.745377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:01.751788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.752315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.752753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.753458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.754081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.754722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.882390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.892728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.895123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:01.896573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-670dd2d0-a939-4c2e-9a15-efb6367ddb77 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2954 microversion: 2.32 time: 0.360993 Oct 13 08:48:01.897261 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1672/3609] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:01 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2954 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:01.926587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:01.928667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:01.929395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:01.936792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.937612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.938028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.939161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:01.939626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:01.940081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:01.969957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=14 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:02.006389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.014754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.016203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.017611 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cc9f91e-2189-4f3a-8c49-1d99dc049df4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.093803 Oct 13 08:48:02.019315 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1673/3610] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:01 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:02.113729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:02.114575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:02.129644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.130468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.138534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.139317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.139785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.142250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.185771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.204132 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-782b50a4-013a-4331-95ef-28d6f60b2833 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1681 microversion: 2.1 time: 0.463194 Oct 13 08:48:02.204741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1938/3611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:01 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1681 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:02.254974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:02.255793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:02.265818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.266434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.266889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.267827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.268534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.269009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.391246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:02.456161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.472174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.472702 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a15534ba-57c0-4265-a18c-e5401f58c0d8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.360460 Oct 13 08:48:02.475930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:02.477074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1674/3612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:02 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:02.482207 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-55ae116a-ba0d-4f7d-857f-c0e2e54c64df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.235545 Oct 13 08:48:02.494791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1939/3613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:02 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:02.618915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:02.619531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:02.625766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.626254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.626718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.627483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.627937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.628363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.710220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:02.719578 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f2e4b30-9e19-44e6-a50a-46ba26747f73 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1305 microversion: 2.1 time: 0.104835 Oct 13 08:48:02.720623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1675/3614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:02 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:02.832575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00257390-2211-4b20-a485-fea5720afa6d", "tag": "f61ed5c2-43a7-4309-99b8-5c4245a35e89"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:02.844270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.845423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.846682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.864772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] Creating event network-changed:f61ed5c2-43a7-4309-99b8-5c4245a35e89 for instance 00257390-2211-4b20-a485-fea5720afa6d on n-h2-858384-11 Oct 13 08:48:02.870300 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1eecd158-f028-44df-987c-961ed19e516b req-2d96ff59-1de0-4f98-8104-8a48aaff95c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042119 Oct 13 08:48:02.871500 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1940/3615] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:02.929775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:02.930829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:02.943514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.944213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.944979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:02.945896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:02.946497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:02.947200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.053446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.054154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:03.061708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.062206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.062701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.063511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.064004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.064470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.146851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.155675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.156766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.157246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.158602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9967f7c7-3355-4601-a3c0-85cd92217c4a tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.112162 Oct 13 08:48:03.159250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1941/3616] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:03.187529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.189106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.190967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-06478bb7-c233-43a3-b02e-818036acbce2 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2954 microversion: 2.32 time: 0.268986 Oct 13 08:48:03.191725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1676/3617] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:02 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2954 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:03.227731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.228122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:03.234757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.235273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.235731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.236447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.236938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.237374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.374258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Calling method '.version_select at 0x7f5376513820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.386378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.386897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.387337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.388072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.388534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.388965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.389081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.400452 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b1d957f-9e5e-4282-8e86-c3758f10d765 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1681 microversion: 2.1 time: 0.177223 Oct 13 08:48:03.401350 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1677/3618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:03.411128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aec02b5f-a428-4950-9f61-ccc7fc557149 tempest-AbsoluteLimitsTestJSON-652542760 tempest-AbsoluteLimitsTestJSON-652542760-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.250548 Oct 13 08:48:03.412391 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1942/3619] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:03.497849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.499409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:03.506722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.507524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:03.511419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.512234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.512836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.513702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.514310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.515077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.515330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.516275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.516725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.518683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.519547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.520333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.699038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.707810 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98e7ec98-eb80-4115-80a3-09289142c41e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.214082 Oct 13 08:48:03.709332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1678/3620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:03.715706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.724262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed79aa64-76f9-41d5-8f99-8cc407a839b4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.222806 Oct 13 08:48:03.725229 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1943/3621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:03.743052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:03.743928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:03.750247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.750765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.751196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.752066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:03.753049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:03.753471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:03.835767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:03.851046 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be21946f-d10c-461d-af4d-23e05ead0126 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1305 microversion: 2.1 time: 0.112292 Oct 13 08:48:03.854037 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1679/3622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:03 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:04.184196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:04.185042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:04.200258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.200979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.201814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.204404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.206186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.206954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.220052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:04.221465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:04.233093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.237123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.239010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.239930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.242343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.242968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.404674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.420730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.422784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.425264 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f13086ef-a541-4c75-8272-28b2c6e37647 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.244577 Oct 13 08:48:04.427363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1944/3623] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:04 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:04.437490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:04.440469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:04.447699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.448212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.448642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.450043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.450557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.451045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.610725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.619375 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09ec07ee-d313-47f0-b1f9-f9b997258be1 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1681 microversion: 2.1 time: 0.190491 Oct 13 08:48:04.620178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1945/3624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:04 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:04.818204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.842546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.844564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:04.845794 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-683bc996-c9be-4f31-9fc4-2b9e7851ec6c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2954 microversion: 2.32 time: 0.629975 Oct 13 08:48:04.872643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1680/3625] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:04 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2954 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:04.877917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:04.878564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:04.884894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.885449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.885885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.886654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:04.887114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:04.887541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:04.938624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-136900556", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:05.001687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:48:05.002120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:48:05.002848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:48:05.003358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:48:05.003928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:48:05.015873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.016564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.017371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.020214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.021137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.021807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.042876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Getting quotas for project de9b209a4f7243b98236c02e09fa4e73. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:48:05.049782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Getting quotas for user 3d50b6a7dce745abaa49ad2bc661dc4c and project de9b209a4f7243b98236c02e09fa4e73. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:48:05.064721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:48:05.067178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:48:05.125462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:05.155642 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8976594f-e0bc-4659-9504-5ea5e5a90b27 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.533688 Oct 13 08:48:05.156551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1946/3626] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:48:05.165398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.166212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.173721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.175544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.176470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.177738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.178569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.179204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.213754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.224102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88bbd3d6-2e6f-4320-929a-4f82858e6a91 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.350040 Oct 13 08:48:05.225840 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1681/3627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:04 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:05.231785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.232620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.244252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.250821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.255220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.256149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.258005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.260596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.321422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.322090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.322807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.323511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lazy-loading 'fault' on Instance uuid e0c855f8-1522-4e21-b4e1-91513503fa22 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:05.500203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.512390 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-909016bc-b6d7-4e0a-9f4f-06cb32257181 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.354624 Oct 13 08:48:05.527214 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1947/3628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:05.540085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.541029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.544080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.557637 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47a965c4-790c-4d42-a42f-72c1c9ba7ee9 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 200 len: 1310 microversion: 2.1 time: 0.326407 Oct 13 08:48:05.559524 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1682/3629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 1310 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:05.567320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.574659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.585998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.586828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.587463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.591294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.592355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.593035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.725988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.735889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.744011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.745234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57b30ac3-7a9e-4234-9f7d-154f0ed05930 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1280 microversion: 2.47 time: 0.216976 Oct 13 08:48:05.745809 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1948/3630] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:05.767435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.768603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.790058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.790473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.791101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.791984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.792633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.793240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.947319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:05.957349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9db9da3-84d1-4eda-b5f4-7466a41ada53 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1614 microversion: 2.1 time: 0.210293 Oct 13 08:48:05.958206 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1949/3631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1614 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:05.964920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:05.965743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:05.974842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.975597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.976194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:05.977079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:05.977691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:05.978276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.253440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.261771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.263876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.265286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0981d037-ef81-40b8-9271-42740ab815cf tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.704653 Oct 13 08:48:06.283105 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1683/3632] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:06.289811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:06.290688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:06.297268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.298046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.298719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.300160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.301171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.301824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.459443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.470394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.471957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.473322 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8354b03-0b79-4c1e-bd60-1d32b1a0f7e0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2954 microversion: 2.32 time: 0.513381 Oct 13 08:48:06.474063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1950/3633] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:05 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2954 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:06.540889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:06.541598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:06.547815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.548515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.549077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.549852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.550381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.550930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.683961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.688283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:06.698365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f21d64f-0f7b-435e-9a03-c4630e4764ab tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.413763 Oct 13 08:48:06.699523 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1684/3634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:06 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:06.714774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:06.715353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: e0c855f8-1522-4e21-b4e1-91513503fa22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:06.724464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.725437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.726341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.727419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.728546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.729596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.735523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.745304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3270612-e2b2-4c00-bde3-e8484655e775 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.208493 Oct 13 08:48:06.745901 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1951/3635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:06 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:06.753700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] HTTP exception thrown: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Request method failure captured: Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 HTTP/1.1 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Bz4bxEkzcXC-t35YILH-dUEO8DaYdGyuD4BjD_jEmDMPNFfKizW1LLDWHAVlmIoUVZIlk7Te_ja5xIGFrQzR9Jz6tRi63lGTwlm6gEQYdBt1QS2pxujFvZ1BNUALmw8N821YgYANLL_rlXg0qau0oC2H1Uk6kCl1fO1y_hhleN1jY Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 0b27726e98ef45d197945672a6e66f22 Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e0c855f8-1522-4e21-b4e1-91513503fa22'} Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:06.755824 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:06.760950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Returning 404 to user: Instance e0c855f8-1522-4e21-b4e1-91513503fa22 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:06.761592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93ba2044-ba93-4e90-930c-9adddbecc71b tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22" status: 404 len: 111 microversion: 2.1 time: 0.058961 Oct 13 08:48:06.774044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:06.774919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:06.784045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.784749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.785422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.786440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.787907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.789826 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1685/3636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:06 2022] GET /compute/v2.1/servers/e0c855f8-1522-4e21-b4e1-91513503fa22 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:06.790001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.805709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:06.806225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:06.822180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.824199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.824653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.829422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:06.829977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:06.830726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:06.898439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:06.966304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.978483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.980180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:06.981466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b8cc97f-7705-4897-88b2-4c2e5411a54d tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1340 microversion: 2.47 time: 0.212851 Oct 13 08:48:06.982234 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1952/3637] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:06 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:06.987638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb60673-11e1-4222-88a5-514d66ab9ee5", "name": "network-vif-deleted", "tag": "3e9c8ed0-7d8f-4a1d-bbe7-330230344053"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:07.005170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.008197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.008902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.036115 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] Creating event network-vif-deleted:3e9c8ed0-7d8f-4a1d-bbe7-330230344053 for instance acb60673-11e1-4222-88a5-514d66ab9ee5 on n-h1-858384-11 Oct 13 08:48:07.054398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2f472a49-7a0e-44d0-99dd-1584a54c24e8 req-19f7af8d-c643-4d87-91d2-e181890a26f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062742 Oct 13 08:48:07.056356 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1953/3638] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:07.066025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.067452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.083561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52ab411f-698d-4b71-8233-1718ee7f0d24 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "DELETE /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 204 len: 0 microversion: 2.1 time: 0.292232 Oct 13 08:48:07.084417 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1686/3639] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:48:06 2022] DELETE /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:48:07.090078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.090621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.093447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.096865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.098590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.098730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.099084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.099584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.116932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.118533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.121548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.122615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.123308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.124055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.166036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.167154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.167517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.168167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lazy-loading 'fault' on Instance uuid acb60673-11e1-4222-88a5-514d66ab9ee5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:07.216252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.227759 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dbe7bc78-cb18-4913-b0be-b5e2b904b7fb tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1331 microversion: 2.1 time: 0.169247 Oct 13 08:48:07.228239 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1954/3640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:07.297614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.298388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.305857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.306353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.306884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.307605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.308199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.308764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.417605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.433677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.436273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.438771 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49c2bcd4-b2f8-4f30-adfb-81ba8e66f572 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.145432 Oct 13 08:48:07.450617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.452174 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1955/3641] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:07.459890 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d1e10b04-fab7-4f4e-be5e-14c64c98d4bd tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1516 microversion: 2.1 time: 0.370336 Oct 13 08:48:07.462247 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1687/3642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1516 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:07.503549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.504928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.514807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.515561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.516242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.517587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.518686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.519336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.722431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.722988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.730269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.732725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.733398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.734464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.735704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.736526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.858579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.883954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.890428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:07.891994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cecf4d94-c481-47e8-919a-f081a255f23d tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2933 microversion: 2.32 time: 0.394228 Oct 13 08:48:07.895941 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1956/3643] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2933 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:07.909157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:07.910784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:07.928098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.928609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.929062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:07.929797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:07.930288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:07.930753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.243171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.254823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7afb1647-68a8-4556-96f6-27566516e4df tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.356096 Oct 13 08:48:08.255623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1957/3644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:08.263415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:08.264023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:08.272245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.272768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.273203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.273970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.274635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.275062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.275696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.284214 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0a3dbe8-88da-47d9-86d6-c443156ae86e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.565157 Oct 13 08:48:08.297534 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1688/3645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:07 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:08.308637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:08.309243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:08.335066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.335555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.335988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.336684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.341899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.350054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.419598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.420065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.420499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.420955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lazy-loading 'fault' on Instance uuid acb60673-11e1-4222-88a5-514d66ab9ee5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:08.509478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae3cc2beac74abab5de2f8a722a2e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3040e47e475743a09cc51c365544bcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.521398 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82419215-9cba-48d8-89fb-82055791bb7c tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 200 len: 1331 microversion: 2.1 time: 0.228389 Oct 13 08:48:08.523040 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1689/3646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:08 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:08.538495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:08.539112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:08.547734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.548233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.548663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.555919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.556453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.556900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.672934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.682828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.684278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:08.693678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8102047-2fb6-479b-8677-908bdb509b71 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.168285 Oct 13 08:48:08.694445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1690/3647] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:08 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:08.699252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:08.699789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:08.716596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.717093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.717530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:08.718254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:08.718748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:08.719172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.435499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:09.436368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:09.444704 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3dc8b9b-0c9f-4106-a607-3405732e0596 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1516 microversion: 2.1 time: 0.749044 Oct 13 08:48:09.446706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:09.450295 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1691/3648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:08 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1516 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:09.451257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:09.452484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68b28780-340e-4e3e-98ae-275619a44c89 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1338 microversion: 2.47 time: 1.195391 Oct 13 08:48:09.459279 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1958/3649] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:08 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1338 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:09.464516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:09.467134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:09.489303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.490016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.490655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.491096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:09.491771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.492398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.492991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.496145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:09.515013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.521971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.523114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.527531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.529449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.532623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.895374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:09.902437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:09.905589 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c083d16e-df10-4e08-ad75-3fa1db073705 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.445039 Oct 13 08:48:09.913415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1959/3650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:09 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:09.926382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:09.928666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:09.948624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.949512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.950118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.951610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:09.952234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:09.954609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:09.970296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.005138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.009927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.011667 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0edb5e5b-8f18-4884-9b23-8e249b63ca51 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2912 microversion: 2.32 time: 0.560306 Oct 13 08:48:10.012250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1692/3651] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:09 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2912 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:10.021460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "1a9c62f1-0d81-4738-8c18-8f3da7ebbc42"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:10.031847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.032601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.033231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.061178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] Creating event network-vif-unplugged:1a9c62f1-0d81-4738-8c18-8f3da7ebbc42 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:10.072877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c02565b1-c22b-4bc7-a1cd-4f4a97a583aa req-37368d57-3e60-462d-b9bc-b5354be6a0e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057004 Oct 13 08:48:10.073504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1693/3652] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:10.079010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.079899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.088052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.088728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.089327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.090617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.091562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.092325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.108685 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] HTTP exception thrown: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Request method failure captured: Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 HTTP/1.1 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9AUDoAAkffuenH0TPFBHJGomAY6rLTBwah6JD8U-z_FHVunncUTf3gq70wdZqs2ZgccaDeVtcGu1S7NFbeo-gc3MzvbBzMRHgXw1jGnnYqrh9bJGGMTkckK7exzPpGpdhXadGPTl2fCAx9GA-OavD3fD5lkTaGyQpSEl5v0awwC9PI Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3040e47e475743a09cc51c365544bcef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: bae3cc2beac74abab5de2f8a722a2e0d Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'acb60673-11e1-4222-88a5-514d66ab9ee5'} Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:10.110353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Returning 404 to user: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0de25b66-1b44-44fa-afef-162cf156053d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 404 len: 111 microversion: 2.1 time: 0.037706 Oct 13 08:48:10.115679 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1694/3653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:10 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:10.117652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.118266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.124863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.125344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.125961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.126967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.127613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.128217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.224470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.243150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.247140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.249377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5418fb0-eedd-486f-9e56-9f7b162d9f98 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.135385 Oct 13 08:48:10.250242 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1695/3654] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:10 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:10.264700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37142c2e-e35f-430e-a730-b31978711d6d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '.version_select at 0x7f537572f9d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.265853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.278474 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd3d9cbf-1676-4b56-bc43-a8286af31783 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.362271 Oct 13 08:48:10.279857 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1960/3655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:09 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:10.344894 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37142c2e-e35f-430e-a730-b31978711d6d tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950684778" status: 202 len: 0 microversion: 2.1 time: 0.092487 Oct 13 08:48:10.351402 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1696/3656] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:48:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950684778 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:10.369843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730d86ac-3f52-43e8-a302-849e197aee26", "name": "network-vif-deleted", "tag": "d305a2ac-3216-429f-a8ee-8f2f20829d83"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:10.393107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.393818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.394027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.420124 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] Creating event network-vif-deleted:d305a2ac-3216-429f-a8ee-8f2f20829d83 for instance 730d86ac-3f52-43e8-a302-849e197aee26 on n-h2-858384-11 Oct 13 08:48:10.425950 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8bc4e9db-8442-4e53-90c8-a10d5a784cc8 req-15847a3a-24b8-492f-8a33-90ba30529f84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059852 Oct 13 08:48:10.427822 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1961/3657] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:10.478218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.478989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.490109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.491029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.499174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.503291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.503721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.503925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.504572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.505004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.505907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.506645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.506772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.512214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.520119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.520975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.581528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.582804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.583426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.585148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lazy-loading 'fault' on Instance uuid 730d86ac-3f52-43e8-a302-849e197aee26 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:10.746994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b27726e98ef45d197945672a6e66f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f564a6a72a37480ebd87a2c2f44950cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.759709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38a6a3d3-f13b-4ca3-bbfb-edc70d6db8c1 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 200 len: 1310 microversion: 2.1 time: 0.289461 Oct 13 08:48:10.776832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1697/3658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:10 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:10.855388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.868697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.870902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:10.872315 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b34376ce-b7f8-47f2-9f94-67a2a01c4b78 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1359 microversion: 2.47 time: 0.386842 Oct 13 08:48:10.873412 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1962/3659] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:10 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:10.905405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1650685357"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:10.908041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.918094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.918612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.919048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.919750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.920213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.920628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.941367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:10.942182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:10.983735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.984284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.984917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:10.985851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:10.987815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:10.988514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.487028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53b5a5af-1d95-4d5e-a6ba-18a4e6b1923b tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "POST /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618/action" status: 202 len: 52 microversion: 2.47 time: 0.585852 Oct 13 08:48:11.488212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1698/3660] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 08:48:10 2022] POST /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618/action => generated 52 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:48:11.504480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:11.505635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:11.518468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.518965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.519465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.520359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.522805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.523438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.630684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.641316 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3689d68-f98b-4c0e-84f2-fe626fc77a9a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.703868 Oct 13 08:48:11.643702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1963/3661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:10 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:11.654209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:11.654865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:11.662700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.663389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.663984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.664980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.665594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.677351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.852906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.871498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.873074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.879295 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78f79372-42a1-411d-906d-897cd4808b56 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2865 microversion: 2.32 time: 0.389446 Oct 13 08:48:11.882717 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1699/3662] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:11 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2865 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:11.891256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:11.894614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:11.906179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.906944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.907543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.907673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.909111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.909729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.910316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.927090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.928538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:11.929787 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8311a9d-e352-475d-bd6b-8abbff3bb143 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.283890 Oct 13 08:48:11.930712 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1964/3663] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:11 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:11.946080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:11.946755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:11.953252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.953996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.954649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:11.955648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:11.956321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:11.957000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.004979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:12.174952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-59ece5bf-3615-4c95-862f-6d6e90a96e09 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 204 len: 0 microversion: 2.47 time: 0.242892 Oct 13 08:48:12.175552 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1965/3664] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:48:11 2022] DELETE /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:48:12.181176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:12.191321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] [instance: 730d86ac-3f52-43e8-a302-849e197aee26] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:12.202734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.206020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.206609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.207442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.211429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.212010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.237723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] HTTP exception thrown: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Request method failure captured: Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 HTTP/1.1 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Bz4bxEkzcXC-t35YILH-dUEO8DaYdGyuD4BjD_jEmDMPNFfKizW1LLDWHAVlmIoUVZIlk7Te_ja5xIGFrQzR9Jz6tRi63lGTwlm6gEQYdBt1QS2pxujFvZ1BNUALmw8N821YgYANLL_rlXg0qau0oC2H1Uk6kCl1fO1y_hhleN1jY Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f564a6a72a37480ebd87a2c2f44950cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: f564a6a72a37480ebd87a2c2f44950cc Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2014617854 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0b27726e98ef45d197945672a6e66f22 Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServerFiltersTestJSON-2014617854-project Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '730d86ac-3f52-43e8-a302-849e197aee26'} Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:12.249465 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. Oct 13 08:48:12.253640 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:12.255988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] Returning 404 to user: Instance 730d86ac-3f52-43e8-a302-849e197aee26 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:12.257058 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1997d3b-c5f1-473b-b6c3-aaf5633a0202 tempest-ListServerFiltersTestJSON-2014617854 tempest-ListServerFiltersTestJSON-2014617854-project] 10.222.0.23 "GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26" status: 404 len: 111 microversion: 2.1 time: 0.080240 Oct 13 08:48:12.257802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1966/3665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:12 2022] GET /compute/v2.1/servers/730d86ac-3f52-43e8-a302-849e197aee26 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:12.266307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "c555c149-900f-4cd7-9963-b628600fa2f2"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "30cd392f-108c-4baf-b95e-e57d29d1dff1"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "20b58af7-2f8f-4193-b395-e685103fc228"}, {"server_uuid": "00257390-2211-4b20-a485-fea5720afa6d", "name": "network-vif-plugged", "status": "completed", "tag": "f61ed5c2-43a7-4309-99b8-5c4245a35e89"}, {"server_uuid": "517b0740-2577-400f-85ee-7699ad247c0d", "name": "network-vif-plugged", "status": "completed", "tag": "b11c2a16-58e5-4075-b76c-b4d9959bbee5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:12.300376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.300926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.301365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.334733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-unplugged:c555c149-900f-4cd7-9963-b628600fa2f2 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.335242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-unplugged:2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.335746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-unplugged:30cd392f-108c-4baf-b95e-e57d29d1dff1 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.336348 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-unplugged:20b58af7-2f8f-4193-b395-e685103fc228 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.336724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-plugged:f61ed5c2-43a7-4309-99b8-5c4245a35e89 for instance 00257390-2211-4b20-a485-fea5720afa6d on n-h2-858384-11 Oct 13 08:48:12.337215 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] Creating event network-vif-plugged:b11c2a16-58e5-4075-b76c-b4d9959bbee5 for instance 517b0740-2577-400f-85ee-7699ad247c0d on n-h1-858384-11 Oct 13 08:48:12.357769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7213a866-8c8d-49bc-9b2f-1948ac6fb856 req-7bdb2970-5ff1-419f-885f-3d7ab423c845 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1046 microversion: 2.1 time: 0.097868 Oct 13 08:48:12.367133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1967/3666] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 1046 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:12.373015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:12.374021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:12.396626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.397368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.397989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.399209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.399828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.400423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.519165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:12.522459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:12.536815 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8933bc4a-83bb-49e3-8b9c-6ef6d59abd33 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.651962 Oct 13 08:48:12.538545 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1700/3667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:11 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:12.557014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-deleted", "tag": "2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c"}, {"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-deleted", "tag": "30cd392f-108c-4baf-b95e-e57d29d1dff1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:12.573306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.574466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.575203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.594119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Creating event network-vif-deleted:2fe4e14f-1d99-4d0b-af51-f7c7468f2e4c for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.594980 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] Creating event network-vif-deleted:30cd392f-108c-4baf-b95e-e57d29d1dff1 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:12.603832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4234bc56-db88-47fb-8174-85699e2b657f req-7880577a-3204-4bf2-b85a-85748936b7d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063700 Oct 13 08:48:12.604848 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1701/3668] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:12.667627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:12.668801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:12.681991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.683778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.684461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.686118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.688001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.691129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.901491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:12.910250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:12.920013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:12.921264 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73c6f076-d2c8-4c82-bb8a-1a06a76ad72a tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1365 microversion: 2.47 time: 0.552684 Oct 13 08:48:12.921983 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1968/3669] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:12 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1365 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:12.950572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:12.951773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:12.965538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.971230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.971902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:12.972831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:12.973450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:12.974037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.322019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.336379 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae508228-a8a0-46a7-a2e4-20be1da969c3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.674008 Oct 13 08:48:13.340283 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1702/3670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:12 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:13.346766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:13.347377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:13.372744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.373239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.373672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.374375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.374852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.375279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.483718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.496644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.500111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.501590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b89dea32-3faf-48a8-b491-e59248de9566 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2590 microversion: 2.32 time: 0.578428 Oct 13 08:48:13.502769 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1969/3671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:12 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2590 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:13.565928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:13.566722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:13.573682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.574454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.574981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.575806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.576482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.577113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.786130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.804061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71c4c7c2-7f6c-4ba5-8ae9-f0333f4e8e0b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1308 microversion: 2.1 time: 0.242335 Oct 13 08:48:13.805272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1970/3672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:13 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:13.839677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.854805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.857071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:13.859245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec06c12d-b8ed-4119-82b6-ce82b8a7992d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.517262 Oct 13 08:48:13.859951 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1703/3673] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:13 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:13.953426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:13.954038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:13.962747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.963506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.963956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:13.964675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:13.965130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:13.965737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.050522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.061087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.063215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.065434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae1a2d6a-1827-4769-b813-9657b3a4a1d2 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1365 microversion: 2.47 time: 0.115857 Oct 13 08:48:14.079594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1971/3674] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:13 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:14.361216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:14.361919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:14.371341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.372249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.372957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.373900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.374639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.375327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.530004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:14.530687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:14.546032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.546918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.547558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.555236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.557235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.557927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.798390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.800200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.831482 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-711d2750-ad6c-4423-b173-bdaa5a61fee6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1313 microversion: 2.1 time: 0.474000 Oct 13 08:48:14.835013 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1704/3675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:14 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:14.836877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.843529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:14.846310 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-59a7ab30-c3ed-4222-9e83-b7372a7a3866 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2543 microversion: 2.32 time: 0.321187 Oct 13 08:48:14.847121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-deleted", "tag": "1a9c62f1-0d81-4738-8c18-8f3da7ebbc42"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:14.849061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1972/3676] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:14 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2543 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:14.860945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.862552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.868659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:14.869741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:14.874012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.881121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.881955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.883182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.885391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.886144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.887468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.904234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] Creating event network-vif-deleted:1a9c62f1-0d81-4738-8c18-8f3da7ebbc42 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:14.920183 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-db10ec89-c62c-4aab-96a3-c497e03e34ec req-db1dc1fd-c740-443f-9789-bda4e7135a4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083486 Oct 13 08:48:14.921421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1705/3677] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:14.937414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:14.938808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:14.955082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.957120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.958813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:14.960448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:14.962269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:14.963264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.032665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:15.178183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.190697 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dcad807a-107b-4674-9f4f-a71647ccf9c7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1489 microversion: 2.1 time: 0.337025 Oct 13 08:48:15.190697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1973/3678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:14 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1489 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:15.194690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:15.195655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:15.203276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.204163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.204930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.206049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.206909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.207688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.291964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.322774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.324602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d50b6a7dce745abaa49ad2bc661dc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b209a4f7243b98236c02e09fa4e73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.327188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebb2c481-8cf0-4073-b530-ff99041f358f tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 200 len: 1365 microversion: 2.47 time: 0.137455 Oct 13 08:48:15.350075 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1974/3679] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:15 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:15.359108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:15.363993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:15.373389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.374158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.374860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.376034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.376725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.377450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.458724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-106e1069-a8d3-45af-8182-99383e7fdd57 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "PUT /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1084 microversion: 2.1 time: 0.106041 Oct 13 08:48:15.473728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1975/3680] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:48:15 2022] PUT /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1084 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:15.493933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:15.494633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:15.503364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.503862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.504326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.505142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.505854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.506313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.524664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.544493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.548000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.553237 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a180b5b-7fe0-4cf5-a83b-70f10a4bea60 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.630021 Oct 13 08:48:15.554069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1706/3681] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:14 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:15.568289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:15.731408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:15.809517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:15.824548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26ee48d3-9fd1-4366-bcee-1c18f80764ac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1510 microversion: 2.1 time: 0.344985 Oct 13 08:48:15.825779 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1976/3682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:15 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:15.856623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:15.857499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:15.857697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:15.858356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:15.860868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:15.876417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.877611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.878105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.878872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.879923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.882138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.882941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.883396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.885298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:15.886166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:15.886743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:15.887348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.157061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:16.165751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f03501dd-efd6-4097-9af8-795c23569fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1501 microversion: 2.1 time: 0.311856 Oct 13 08:48:16.166361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1977/3683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:15 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1501 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:16.179993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:16.180626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:16.197066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.200618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.201343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.202283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.203456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.208185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.484324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:16.509910 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da7f2af6-d2f9-4e02-9748-c29a98b8282a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1510 microversion: 2.1 time: 0.663945 Oct 13 08:48:16.510991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1707/3684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:15 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1510 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:16.517713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:16.518615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:16.540352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.541610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.542976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.543927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.545841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.553649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.617060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:16.632390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:16.633837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:16.643410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:16.643570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a3e40bc5-e4cb-41b9-a2d9-471e3ff9dfc7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2385 microversion: 2.32 time: 0.475214 Oct 13 08:48:16.667630 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1978/3685] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:16 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2385 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:16.681862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:16.684181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] [instance: 4124d18b-ec76-47a0-be93-6ec321014618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:16.698829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.702698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.705136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.708492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.708492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.708492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.740774 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] HTTP exception thrown: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Request method failure captured: Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 HTTP/1.1 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9DEmZu18VUU1NrdbUrTUuoHr0_WflcXIGqTs8H0e0xNMCTZxHyqsy-cvAgyPNza5NuG42xjv53iP4GXsDbz0qrBUgLPzQhMh-PlQBnC0kO37DhgY3TcxSGjdye5u2SGd6SYri7gVqx6xDz3juVe0yZz0o8nyuIdJT-yx1viU-Pjszk Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.47 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: de9b209a4f7243b98236c02e09fa4e73 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAaction247Test-1336063333 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de9b209a4f7243b98236c02e09fa4e73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_de9b209a4f7243b98236c02e09fa4e73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/de9b209a4f7243b98236c02e09fa4e73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/de9b209a4f7243b98236c02e09fa4e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAaction247Test-1336063333 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: de9b209a4f7243b98236c02e09fa4e73 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAaction247Test-1336063333 Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAaction247Test-1336063333-project Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3d50b6a7dce745abaa49ad2bc661dc4c Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAaction247Test-1336063333-project Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4124d18b-ec76-47a0-be93-6ec321014618'} Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:16.746890 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:16.753585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] Returning 404 to user: Instance 4124d18b-ec76-47a0-be93-6ec321014618 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:16.754814 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93173556-1f03-44a8-833d-8148e68ed632 tempest-ServersAaction247Test-1336063333 tempest-ServersAaction247Test-1336063333-project] 10.222.0.23 "GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618" status: 404 len: 111 microversion: 2.47 time: 0.084933 Oct 13 08:48:16.754814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1979/3686] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:16 2022] GET /compute/v2.1/servers/4124d18b-ec76-47a0-be93-6ec321014618 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:16.767308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:16.768048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:16.781419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.781898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.784345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.787939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.790972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.792140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.878065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:16.920530 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bb95398-9159-44e6-bf27-62315db51b60 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 204 len: 0 microversion: 2.1 time: 0.402017 Oct 13 08:48:16.921821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1708/3687] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:48:16 2022] DELETE /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:48:16.946669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:16.947493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:16.968314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.968810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.969247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:16.973733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:16.974219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:16.978191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.092002 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c2a011e1-0485-47e1-9c8a-86069ff4b6ee tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 204 len: 0 microversion: 2.1 time: 0.335892 Oct 13 08:48:17.098476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1980/3688] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:48:16 2022] DELETE /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:48:17.108845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:17.111758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:17.124785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.125275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.134038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.135124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.135372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.135812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.336701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:17.348642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:17.351670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:17.353236 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-13cd0228-9e1c-4715-bbdc-8d878097fec3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.425397 Oct 13 08:48:17.354549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1709/3689] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:16 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:17.360421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:17.361460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:17.375176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.376046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.376705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.378207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.378899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.381080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.508243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:17.525653 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-289e996e-cb5d-4da9-9de4-ab4921cdadd8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1507 microversion: 2.1 time: 0.416877 Oct 13 08:48:17.539637 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1981/3690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:17 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:17.681508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:17.682184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:17.700876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.711338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.716829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:17.717847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:17.718547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:17.723998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:18.106999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.136406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.142706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.144121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-299670ea-4d9c-47d6-a2f0-a45d85adaf1f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2338 microversion: 2.32 time: 0.468523 Oct 13 08:48:18.144703 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1982/3691] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:17 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2338 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:18.166837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-deleted", "tag": "c555c149-900f-4cd7-9963-b628600fa2f2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:18.207108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:18.207627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:18.208073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:18.228739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] Creating event network-vif-deleted:c555c149-900f-4cd7-9963-b628600fa2f2 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:18.239357 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c851bd25-6ef0-4f3c-a692-73ce49c44a37 req-0d3fd3e1-ff67-44f1-bef4-1c97481fee33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082254 Oct 13 08:48:18.240992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1983/3692] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:18.387736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:18.388943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:18.418532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:18.426829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:18.428241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:18.431526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:18.432294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:18.434186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:18.658595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.678030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.684081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:18.688828 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47cec414-c3b6-4194-ba97-118c451f950d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.313542 Oct 13 08:48:18.692569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1984/3693] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:18 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:18.710063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:18.712607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:18.729434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:18.733921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:18.734979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:18.736790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:18.740093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:18.740736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:19.052863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:19.067298 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb7d6d06-49e3-4b33-ac43-bab118985569 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1516 microversion: 2.1 time: 1.711384 Oct 13 08:48:19.071238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1710/3694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:17 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1516 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:19.197610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:19.198933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:19.216782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:19.218929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:19.220054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:19.221622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:19.222877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:19.223957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:19.324234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:19.333515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4f16e0d-d182-4ddf-87bb-7b54267f5999 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1507 microversion: 2.1 time: 0.639625 Oct 13 08:48:19.334361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1985/3695] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:18 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:19.729007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:19.731906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:19.766907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:19.767495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:19.767948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:19.768694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:19.770480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:19.771251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:19.975607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:19.987290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:19.988820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:19.990070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-072a54aa-6573-4c3e-9c0c-ba0c3e530f70 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.272828 Oct 13 08:48:20.003084 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1986/3696] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:19 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:20.003084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517b0740-2577-400f-85ee-7699ad247c0d", "name": "network-vif-deleted", "tag": "b11c2a16-58e5-4075-b76c-b4d9959bbee5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:20.019480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.020401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.022935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.053165 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] Creating event network-vif-deleted:b11c2a16-58e5-4075-b76c-b4d9959bbee5 for instance 517b0740-2577-400f-85ee-7699ad247c0d on n-h1-858384-11 Oct 13 08:48:20.063988 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-61d3077f-e39c-4363-91fb-dbd108b4a648 req-4d3197df-b181-451a-912c-d91c938e50f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070539 Oct 13 08:48:20.084302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1987/3697] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:20.113992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:20.117047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:20.124882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:20.134262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.149928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.150525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.153314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.155068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.159879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.315848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:20.349548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:20.351721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:20.362121 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1df94e4-3b95-4b73-b71c-db6f65b29b8f tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 2051 microversion: 2.32 time: 1.185779 Oct 13 08:48:20.365164 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1711/3698] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:19 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 2051 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:20.377460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:20.378532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:20.392641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.395401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.396069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.397058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.399105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.399785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.498856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.506073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.507727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.508370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lazy-loading 'fault' on Instance uuid 517b0740-2577-400f-85ee-7699ad247c0d {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:20.628952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:20.638217 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19747b64-2a32-4669-a89f-e072f415b800 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 200 len: 1303 microversion: 2.1 time: 0.271683 Oct 13 08:48:20.638829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1712/3699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:20 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:20.672355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:20.684469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-373129d5-3d1a-40bc-84f4-c9dea7e5f468 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1516 microversion: 2.1 time: 0.591175 Oct 13 08:48:20.687599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1988/3700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:20 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1516 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:20.761362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e316a8-6072-4463-b589-7454946d3bb6", "name": "network-vif-deleted", "tag": "20b58af7-2f8f-4193-b395-e685103fc228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:20.781950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:20.784573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:20.787368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:20.823799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] Creating event network-vif-deleted:20b58af7-2f8f-4193-b395-e685103fc228 for instance 38e316a8-6072-4463-b589-7454946d3bb6 on n-h1-858384-11 Oct 13 08:48:20.853291 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-51980c3b-2118-44af-9c28-58cfa63984d8 req-94c2ac84-d283-4d81-a58c-e41fcffa39cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097484 Oct 13 08:48:20.862109 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1989/3701] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:21.017320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.018045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.055705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.057084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.057553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.058286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.058778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.059207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.231118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.263675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.271594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.273173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b71a105c-fe21-40ba-92d5-24da6b76abc3 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.260295 Oct 13 08:48:21.274989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1990/3702] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:21 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:21.335518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab736e97-b96e-40e0-a079-27fb917e2fdd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f537a9bf430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-947417714", "description": "tempest-description-141165662"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:21.372809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.373311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.389683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.395690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.399037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.401311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.404396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.409975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.462197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] HTTP exception thrown: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Request method failure captured: Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 HTTP/1.1 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9AUDoAAkffuenH0TPFBHJGomAY6rLTBwah6JD8U-z_FHVunncUTf3gq70wdZqs2ZgccaDeVtcGu1S7NFbeo-gc3MzvbBzMRHgXw1jGnnYqrh9bJGGMTkckK7exzPpGpdhXadGPTl2fCAx9GA-OavD3fD5lkTaGyQpSEl5v0awwC9PI Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3040e47e475743a09cc51c365544bcef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: bae3cc2beac74abab5de2f8a722a2e0d Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'acb60673-11e1-4222-88a5-514d66ab9ee5'} Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:21.471457 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.476852 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.482894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Returning 404 to user: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:21.483944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcb37c35-8e7a-4971-a43b-9dd0154d9301 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 404 len: 111 microversion: 2.1 time: 0.115418 Oct 13 08:48:21.492585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1991/3703] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:48:21 2022] DELETE /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:48:21.500236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.516284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.540519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.545888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.546522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.547390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.549863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.553020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.686926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.700829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.702307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:21.708058 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93e7d969-e660-437c-ab4c-5223b099e51a tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.214073 Oct 13 08:48:21.714606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1992/3704] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:21 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:21.721888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.728558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] [instance: acb60673-11e1-4222-88a5-514d66ab9ee5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.751187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.756188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.756822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.758425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.760067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.765694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.795672 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab736e97-b96e-40e0-a079-27fb917e2fdd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.155766 Oct 13 08:48:21.796482 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1713/3705] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:48:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:21.799438 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] HTTP exception thrown: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Request method failure captured: Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 HTTP/1.1 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9AUDoAAkffuenH0TPFBHJGomAY6rLTBwah6JD8U-z_FHVunncUTf3gq70wdZqs2ZgccaDeVtcGu1S7NFbeo-gc3MzvbBzMRHgXw1jGnnYqrh9bJGGMTkckK7exzPpGpdhXadGPTl2fCAx9GA-OavD3fD5lkTaGyQpSEl5v0awwC9PI Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3040e47e475743a09cc51c365544bcef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3040e47e475743a09cc51c365544bcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3040e47e475743a09cc51c365544bcef Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-604718410 Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: bae3cc2beac74abab5de2f8a722a2e0d Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-604718410-project Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'acb60673-11e1-4222-88a5-514d66ab9ee5'} Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.802221 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] Returning 404 to user: Instance acb60673-11e1-4222-88a5-514d66ab9ee5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e675fe4e-4a7d-43c2-affa-e926b4349559 tempest-AttachSCSIVolumeTestJSON-604718410 tempest-AttachSCSIVolumeTestJSON-604718410-project] 10.222.0.23 "GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5" status: 404 len: 111 microversion: 2.1 time: 0.087845 Oct 13 08:48:21.806315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1993/3706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:21 2022] GET /compute/v2.1/servers/acb60673-11e1-4222-88a5-514d66ab9ee5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:21.810073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.811094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.812770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:21.813403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:21.837626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.838156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.838602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.842573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.843389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.846317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.851269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.852133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.852628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.854671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.862784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:21.864479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:21.907116 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d HTTP/1.1 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '517b0740-2577-400f-85ee-7699ad247c0d'} Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:21.916545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:48:21.921902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:21.923777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:21.926347 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8a77de2-3df9-4bd4-84e4-7108216eae3b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 404 len: 111 microversion: 2.1 time: 0.127127 Oct 13 08:48:21.927166 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1714/3707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:21 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:21.962137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9b3fb16-0fbb-4c39-b4d5-b6edc59d2ebf tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f537aa8c670>, body: {"security_group_rule": {"parent_group_id": "ad09cee1-7141-4135-ac86-6a5b78ff7a17", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:21.986433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:21.995750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:22.002582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:22.003979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lazy-loading 'fault' on Instance uuid 00257390-2211-4b20-a485-fea5720afa6d {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:22.240506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:22.244177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:22.263453 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d3c0a42-f837-45b5-91fc-f76093994484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 200 len: 1319 microversion: 2.1 time: 0.458147 Oct 13 08:48:22.264365 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1994/3708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:21 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:22.289732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1824138942", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:22.371014 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9b3fb16-0fbb-4c39-b4d5-b6edc59d2ebf tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.435840 Oct 13 08:48:22.372048 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1715/3709] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:22.377928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:22.378687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:22.400760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:22.401658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:22.402329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:22.406370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:22.407359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:22.408587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:22.424850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:48:22.523614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:22.534877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:22.537347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:22.539767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-861a50de-82c0-4600-adb9-7084e8ac7afe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.166157 Oct 13 08:48:22.541659 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1716/3710] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:22 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:22.547648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09a09b3e-0423-478e-a3e1-a6b4a617da9d tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5375678280>, body: {"security_group_rule": {"parent_group_id": "ad09cee1-7141-4135-ac86-6a5b78ff7a17", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:22.600542 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-09a09b3e-0423-478e-a3e1-a6b4a617da9d tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09a09b3e-0423-478e-a3e1-a6b4a617da9d tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 138 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "ad09cee1-7141-4135-ac86-6a5b78ff7a17", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: exception: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad09cee1-7141-4135-ac86-6a5b78ff7a17', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:22.602200 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:22.607096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:22.607096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:22.607096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 Oct 13 08:48:22.607096 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:22.607453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09a09b3e-0423-478e-a3e1-a6b4a617da9d tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: This rule already exists in group ad09cee1-7141-4135-ac86-6a5b78ff7a17 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:22.608587 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09a09b3e-0423-478e-a3e1-a6b4a617da9d tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.065588 Oct 13 08:48:22.609713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1717/3711] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:22.617811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c505608-d002-470d-9991-04f0656998cf tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f5376094ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:22.889698 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c505608-d002-470d-9991-04f0656998cf tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/699f975d-a8c8-42b3-abee-ead8605ca691" status: 202 len: 0 microversion: 2.1 time: 0.275660 Oct 13 08:48:22.891300 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1718/3712] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Oct 13 08:48:22 2022] DELETE /compute/v2.1/os-security-group-rules/699f975d-a8c8-42b3-abee-ead8605ca691 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:22.897814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:22.898619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:22.916100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:22.918217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:22.920115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:22.921617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:22.922963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:22.925295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.074688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.089173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.090710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.092007 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-684abb3a-bcc0-4bac-be17-31ad781cc6c1 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.199663 Oct 13 08:48:23.106798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1719/3713] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:22 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:23.118128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa66bac2-e084-449b-8f49-c27cb4514471 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376094e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1790903369", "description": "tempest-description-191511366"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:23.508146 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa66bac2-e084-449b-8f49-c27cb4514471 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.399817 Oct 13 08:48:23.508758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1720/3714] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:48:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:23.517069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00257390-2211-4b20-a485-fea5720afa6d", "name": "network-vif-deleted", "tag": "f61ed5c2-43a7-4309-99b8-5c4245a35e89"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:23.543683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.544381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.545048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.569379 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] Creating event network-vif-deleted:f61ed5c2-43a7-4309-99b8-5c4245a35e89 for instance 00257390-2211-4b20-a485-fea5720afa6d on n-h2-858384-11 Oct 13 08:48:23.582897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-efb65005-21b1-4414-a659-ebc1bd619db9 req-84e58020-d8ef-400d-9b54-141cfb77c723 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072844 Oct 13 08:48:23.586564 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1721/3715] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:23.610762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:23.613439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:23.626460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.628010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.628915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.631643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.633300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.633472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:48:23.634461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:48:23.635128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:48:23.635711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:48:23.636307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:48:23.636570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.654091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.654820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.655430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.656954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.659312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.659979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.667631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d HTTP/1.1 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '00257390-2211-4b20-a485-fea5720afa6d'} Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.670367 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:48:23.676182 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.677298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:23.680716 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f423727-8813-41d4-bea0-07fd420b392c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 404 len: 111 microversion: 2.1 time: 0.088085 Oct 13 08:48:23.681424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1722/3716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:23 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:23.690637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ec3b2f0-5ffe-4722-a0e6-32e950138ddd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376094310>, body: {"security_group_rule": {"parent_group_id": "1ad28179-432d-4751-892b-75d3f99c016f", "ip_protocol": "tcp", "from_port": 1818199229, "to_port": 22}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:23.733893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:48:23.745945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:48:23.773900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:48:23.776693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:48:23.782162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5ec3b2f0-5ffe-4722-a0e6-32e950138ddd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Invalid port range 1818199229:22. Former value cannot be greater than the later Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ec3b2f0-5ffe-4722-a0e6-32e950138ddd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 146 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "1ad28179-432d-4751-892b-75d3f99c016f", "ip_protocol": "tcp", "from_port": 1818199229, "to_port": 22}} Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid port range 1818199229:22. Former value cannot be greater than the later Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1ad28179-432d-4751-892b-75d3f99c016f', 'ip_protocol': 'tcp', 'from_port': 1818199229, 'to_port': 22}}} Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1818199229:22. Former value cannot be greater than the later Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1818199229:22. Former value cannot be greater than the later Oct 13 08:48:23.783959 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1818199229:22. Former value cannot be greater than the later Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.788930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ec3b2f0-5ffe-4722-a0e6-32e950138ddd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: Invalid port range 1818199229:22. Former value cannot be greater than the later {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:23.790782 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ec3b2f0-5ffe-4722-a0e6-32e950138ddd tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.108097 Oct 13 08:48:23.791478 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1723/3717] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:23 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:23.799937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:23.801034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:23.808831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.810079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.810802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.812029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:23.812710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:23.813361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:23.894614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.898202 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6467636a-3fc5-4819-ab8f-7e9bf9eed921 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630543 Oct 13 08:48:23.903623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:23.908701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1995/3718] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:48:23.916931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09a3c979-6d0f-4521-9d05-62ad4dd96422 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376dad670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-214708442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:23.919974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-09a3c979-6d0f-4521-9d05-62ad4dd96422 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Security group id should be uuid Oct 13 08:48:23.921000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09a3c979-6d0f-4521-9d05-62ad4dd96422 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 130 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-214708442", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group id should be uuid Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-214708442', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:23.922699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:23.927676 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 13 08:48:23.927676 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:23.930038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:23.930904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09a3c979-6d0f-4521-9d05-62ad4dd96422 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: Security group id should be uuid {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:23.931940 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09a3c979-6d0f-4521-9d05-62ad4dd96422 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021678 Oct 13 08:48:23.932977 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1996/3719] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:23 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:48:23.933488 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ce5f3f61-2c06-4a71-8bf9-b6b7c8438c02 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.139755 Oct 13 08:48:23.936403 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1724/3720] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:23 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:23.943728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29d7aaea-015d-46b5-a6e4-d206dcea0c18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:23.944709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29d7aaea-015d-46b5-a6e4-d206dcea0c18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:23.965317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-369616962", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "24840ecc-e53a-4ecf-89d0-4ba3bd975545"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:24.032503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29d7aaea-015d-46b5-a6e4-d206dcea0c18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:24.045107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29d7aaea-015d-46b5-a6e4-d206dcea0c18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1215 microversion: 2.1 time: 0.107268 Oct 13 08:48:24.046800 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1725/3721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:23 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:24.058432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba88104a-0178-4b80-b277-402cd11054c4 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f53760943a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1544937986", "description": "tempest-description-873091390"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:24.092417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] validate_networks() for [('24840ecc-e53a-4ecf-89d0-4ba3bd975545', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:48:24.342636 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba88104a-0178-4b80-b277-402cd11054c4 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.293909 Oct 13 08:48:24.343706 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1726/3722] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:48:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:24.349157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:24.349938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:24.370978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:24.372758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:24.374314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:24.377341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:24.377841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:24.380175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:24.709636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:24.728026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:24.734904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:24.736867 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c4fb437-492d-4f43-b79f-3037f1313d17 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.391878 Oct 13 08:48:24.740334 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1727/3723] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:24 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:24.748023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0700b93-a539-4ab5-9d43-aa71a5b5a3d8 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376094af0>, body: {"security_group_rule": {"parent_group_id": "0977c7bf-d254-4ede-905e-c6bc096ef465", "ip_protocol": "tempest-999-1447235783", "from_port": 22, "to_port": 22}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:24.975142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d0700b93-a539-4ab5-9d43-aa71a5b5a3d8 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Invalid IP protocol tempest-999-1447235783. Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0700b93-a539-4ab5-9d43-aa71a5b5a3d8 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 157 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "0977c7bf-d254-4ede-905e-c6bc096ef465", "ip_protocol": "tempest-999-1447235783", "from_port": 22, "to_port": 22}} Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid IP protocol tempest-999-1447235783. Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0977c7bf-d254-4ede-905e-c6bc096ef465', 'ip_protocol': 'tempest-999-1447235783', 'from_port': 22, 'to_port': 22}}} Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1447235783. Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1447235783. Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:24.977545 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1447235783. Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0700b93-a539-4ab5-9d43-aa71a5b5a3d8 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: Invalid IP protocol tempest-999-1447235783. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:24.982288 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0700b93-a539-4ab5-9d43-aa71a5b5a3d8 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.236322 Oct 13 08:48:24.984078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1728/3724] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:24 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:48:24.989425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:24.992280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:25.022835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.023745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.024536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.025920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.026625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.027685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.292932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:25.309314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:25.312013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:25.318328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-115c8368-cb11-4c43-83be-fef3ff79ecb4 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1365 microversion: 2.57 time: 0.332028 Oct 13 08:48:25.320099 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1729/3725] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:24 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:25.329426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3b8b390-87b5-498f-858c-7190d7afb89c tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376094160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-909329159", "description": "tempest-description-1550066142"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:25.806488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:48:25.807659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:48:25.808306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:48:25.808908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:48:25.809481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:48:25.863911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.864528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.864977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.865803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.866262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.866726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.941002 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3b8b390-87b5-498f-858c-7190d7afb89c tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.615688 Oct 13 08:48:25.943078 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1730/3726] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:48:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:25.949161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:25.950265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:25.967287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.968425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.969600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:48:25.970492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.972230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:25.973095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:25.973789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:25.998199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Getting quotas for user 4133b88d56d448f08fa91ca83abff2ad and project bcc055633d3144829dd046c34e58aaaf. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:48:26.054430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:48:26.056823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:48:26.132026 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0992041e-f39c-4596-9d26-3d39127361da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197479 Oct 13 08:48:26.140055 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1997/3727] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:48:26.145835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:26.146763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:26.156618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:26.157329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:26.158567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:26.160469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:26.161265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:26.161868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:26.236012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.246930 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c133d936-013e-4f4a-8bc2-267a7d568228 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1285 microversion: 2.1 time: 0.302365 Oct 13 08:48:26.247548 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1731/3728] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:25 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1285 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:26.260310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ab4196e-40dc-4c40-b97f-c23cf7e84d7f tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f53760c2430>, body: {"security_group_rule": {"parent_group_id": "1c8cfbc4-c845-43ef-96f4-c504a530db8a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:26.350053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.371723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.373562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.380748 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a61ab1b-d3b8-4def-bae1-24cb888007db tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.237289 Oct 13 08:48:26.418919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1998/3729] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:26 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:26.433338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-823dceba-bc99-47a9-b242-564d1cd1121a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:26.435189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-823dceba-bc99-47a9-b242-564d1cd1121a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:26.538327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8ab4196e-40dc-4c40-b97f-c23cf7e84d7f tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ab4196e-40dc-4c40-b97f-c23cf7e84d7f tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 138 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "1c8cfbc4-c845-43ef-96f4-c504a530db8a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1c8cfbc4-c845-43ef-96f4-c504a530db8a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 13 08:48:26.539958 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ab4196e-40dc-4c40-b97f-c23cf7e84d7f tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ab4196e-40dc-4c40-b97f-c23cf7e84d7f tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.292844 Oct 13 08:48:26.544142 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1732/3730] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:26 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:26.547498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:26.547498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:26.584908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:26.585409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:26.585856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:26.586691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:26.587167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:26.587606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:26.640035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-823dceba-bc99-47a9-b242-564d1cd1121a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.652071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-823dceba-bc99-47a9-b242-564d1cd1121a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1208 microversion: 2.1 time: 0.230659 Oct 13 08:48:26.657524 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 1999/3731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:26 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:26.677589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eaae98c4-1802-43d8-8e74-cbe9844f6355 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f53770371f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1125618802", "description": "tempest-description-1221818969"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:26.834791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.852891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.855037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:26.856614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8fda15f-5094-44ed-abbb-56daa833ef03 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1371 microversion: 2.57 time: 0.313355 Oct 13 08:48:26.858236 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1733/3732] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:26 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:27.232334 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eaae98c4-1802-43d8-8e74-cbe9844f6355 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.572872 Oct 13 08:48:27.233501 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2000/3733] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:48:26 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:27.247267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6ecffe0-4a1f-40c8-9ef2-a4753c69e490 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f537a99f5e0>, body: {"security_group_rule": {"parent_group_id": "28ab1c39-242a-4d31-9a1a-657caf44d12d", "ip_protocol": "tcp", "from_port": 22, "to_port": 510586413}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:27.276419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:27.277673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:27.300006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.301369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.302066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.303260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.305616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.306441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.383388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c6ecffe0-4a1f-40c8-9ef2-a4753c69e490 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6ecffe0-4a1f-40c8-9ef2-a4753c69e490 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 145 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "28ab1c39-242a-4d31-9a1a-657caf44d12d", "ip_protocol": "tcp", "from_port": 22, "to_port": 510586413}} Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': '28ab1c39-242a-4d31-9a1a-657caf44d12d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 510586413}}} Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 Oct 13 08:48:27.386396 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6ecffe0-4a1f-40c8-9ef2-a4753c69e490 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 400 to user: Invalid port range 22:510586413. Valid TCP ports should be between 1-65535 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6ecffe0-4a1f-40c8-9ef2-a4753c69e490 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.147097 Oct 13 08:48:27.392849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1734/3734] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:27 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:27.401431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Action: 'create', calling method: .version_select at 0x7f5376094f70>, body: {"security_group_rule": {"parent_group_id": "ae2aafa3-420c-4cb3-b0b6-279dda9f69c3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:27.476298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:48:27.477243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Neutron security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:48:27.478004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.478004 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 138 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: {"security_group_rule": {"parent_group_id": "ae2aafa3-420c-4cb3-b0b6-279dda9f69c3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ae2aafa3-420c-4cb3-b0b6-279dda9f69c3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:48:27.482221 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] Oct 13 08:48:27.488056 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.494429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 404 to user: Security group ae2aafa3-420c-4cb3-b0b6-279dda9f69c3 does not exist Oct 13 08:48:27.494429 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-952193cc-5bb4-4b11-ae51-5550c4741f36'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:27.494429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a251eca1-f87e-40aa-9289-63839b2b2049 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095856 Oct 13 08:48:27.494429 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1735/3735] 10.222.0.23 () {60 vars in 1195 bytes} [Thu Oct 13 08:48:27 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:48:27.506156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:27.517633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:27.526333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:27.537884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.539371 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f559ff7b-faaa-4638-ac1c-9c5947c1c4e1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1273 microversion: 2.1 time: 0.267406 Oct 13 08:48:27.541555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.543179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2001/3736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:27 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:27.543773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.544541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.545012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.545449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.562138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f537abc1550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:27.621019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:48:27.621912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Neutron security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf not found {{(pid=127030) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 13 08:48:27.622718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] HTTP exception thrown: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.622718 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Request method failure captured: Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-group-rules/40fa48d9-03e8-4276-9209-b3ecbd1574bf HTTP/1.1 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9DU1_q-MQ4vrtsoJTZ9RSwQGEo9F9DVbQRA5hRLvKOIE9LX9Beo6tRYRxeeVF6t2hAP1DXKaU1GaV3t9QLN3Ro2RF25QkpLlMsWO5wU2gONqz0DZpvrDXy-F88evx-tgfcueoSVjZjb-N32XF3mwGJN44AKYygvkTMH2IqNGGd4aoA Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b83b8c140be342aea569c5b1b3260b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b83b8c140be342aea569c5b1b3260b31 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 01b3556be16c44b4938825dc4acbd9b7 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-515950421-project Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '40fa48d9-03e8-4276-9209-b3ecbd1574bf'} Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:48:27.624958 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] Oct 13 08:48:27.630395 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:27.633727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Returning 404 to user: Security group rule 40fa48d9-03e8-4276-9209-b3ecbd1574bf does not exist Oct 13 08:48:27.633727 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-fb4ac9c4-657e-49f7-8425-a9486b3cfc3b'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:27.637635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea370180-0ed8-42fe-8b7a-7a5cb1c11fe5 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/40fa48d9-03e8-4276-9209-b3ecbd1574bf" status: 404 len: 199 microversion: 2.1 time: 0.089883 Oct 13 08:48:27.637635 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2002/3737] 10.222.0.23 () {58 vars in 1287 bytes} [Thu Oct 13 08:48:27 2022] DELETE /compute/v2.1/os-security-group-rules/40fa48d9-03e8-4276-9209-b3ecbd1574bf => generated 199 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:48:27.650144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f80840db-266e-41e9-a8c8-eaefc05412ab tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f537667caf0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:27.739365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:27.753678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:27.755196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:27.756431 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c43c0b6c-af36-40fd-815d-1a56156faafe tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.261794 Oct 13 08:48:27.767774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1736/3738] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:27 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:27.774505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:27.775123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:27.794855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.796989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.798136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.799542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:27.800273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:27.801270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:27.998514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:28.014349 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-addda8de-e466-4676-a31f-c1e7fdc7d5f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1260 microversion: 2.1 time: 0.245044 Oct 13 08:48:28.049706 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1737/3739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:27 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:28.055255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:28.056063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:28.063850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.064867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.065462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:28.066433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.067049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.067634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:28.442999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:28.457964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:28.463382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:28.464656 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-449580de-b69e-4891-b9c3-cbd5e23ee6fe tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1371 microversion: 2.57 time: 0.413241 Oct 13 08:48:28.469466 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1738/3740] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:28 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:28.567010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:28.568577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:28.577607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.580467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.582114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:28.586923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.587622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.589324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:28.818889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:28.839137 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-947d87ad-67da-4162-9bd1-7332a01c6598 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1273 microversion: 2.1 time: 0.276518 Oct 13 08:48:28.839740 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1739/3741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:28 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:28.844541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:28.845248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:28.864485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.864995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.865439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:28.866158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:28.866645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:28.867632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.041672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.055460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.065538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.067098 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-03a56df0-16df-472e-b487-cffaabf7fe4c tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.226403 Oct 13 08:48:29.067859 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1740/3742] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:28 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:29.072894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:29.080477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:29.097739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.098597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.099273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.100168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.101102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.101778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.428449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.443004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-626d41f9-f0da-4983-ab42-70727364b518 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1266 microversion: 2.1 time: 0.372447 Oct 13 08:48:29.446098 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1741/3743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:29 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:29.504022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:29.505512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:29.536382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.544365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.544997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.546643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.547873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.549368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.713524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f80840db-266e-41e9-a8c8-eaefc05412ab tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/28ab1c39-242a-4d31-9a1a-657caf44d12d" status: 202 len: 0 microversion: 2.1 time: 2.072954 Oct 13 08:48:29.717993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2003/3744] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:48:27 2022] DELETE /compute/v2.1/os-security-groups/28ab1c39-242a-4d31-9a1a-657caf44d12d => generated 0 bytes in 2077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:29.723726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58fd44a8-4814-4d41-bdd1-109a8d225255 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f5376555a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:29.732112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.745214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.747001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:29.749499 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7cfce36e-5f54-44f1-a2a6-185fbf847551 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1371 microversion: 2.57 time: 0.258567 Oct 13 08:48:29.750653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1742/3745] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:29 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:29.865273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:29.865958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:29.877073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.877736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.879502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:29.880488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:29.881076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:29.881647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.300190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:31.314095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9eb3f75-ad87-4c68-be7a-7675bec9f616 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 1.453103 Oct 13 08:48:31.326842 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1743/3746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:29 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:31.343153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:31.343780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:31.359488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.359991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.360546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.361881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.362349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.362816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.672553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58fd44a8-4814-4d41-bdd1-109a8d225255 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1c8cfbc4-c845-43ef-96f4-c504a530db8a" status: 202 len: 0 microversion: 2.1 time: 1.953010 Oct 13 08:48:31.673164 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2004/3747] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:48:29 2022] DELETE /compute/v2.1/os-security-groups/1c8cfbc4-c845-43ef-96f4-c504a530db8a => generated 0 bytes in 1955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:31.681463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:31.682477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:31.695511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.698820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.701398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.702368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.703014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.705568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.724187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:31.736517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:31.739965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:31.741982 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb2435df-d3f5-4901-b772-b93fa6ccfc48 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.413613 Oct 13 08:48:31.772696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1744/3748] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:31 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:31.779035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:31.780140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:31.788703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.789483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.790177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.791613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:31.792376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:31.792973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:31.891362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:31.908516 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d19e128f-d945-4c76-b5b1-e489c02c4670 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1266 microversion: 2.1 time: 0.233944 Oct 13 08:48:31.909116 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2005/3749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:31 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:31.942448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-badf3e8a-c5fa-40b6-81d7-6706678b6220 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f5376655310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:32.041262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:32.052555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:32.065485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:32.066952 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89b1881f-868a-4136-8cbb-938d8891ecab tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1356 microversion: 2.57 time: 0.292942 Oct 13 08:48:32.068421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1745/3750] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:31 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1356 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:32.102714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:32.103477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:32.119819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.123498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.124135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:32.125795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.132383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.133112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:32.223521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:48:32.395457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:32.484575 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61e28619-7266-46a2-9a48-9f4a4736bbdc tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 204 len: 0 microversion: 2.57 time: 0.385827 Oct 13 08:48:32.485180 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1746/3751] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:48:32 2022] DELETE /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 08:48:32.503566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:32.510931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:32.539244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.540296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.540924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:32.544033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.544882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.545516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:32.723515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-badf3e8a-c5fa-40b6-81d7-6706678b6220 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0977c7bf-d254-4ede-905e-c6bc096ef465" status: 202 len: 0 microversion: 2.1 time: 0.805391 Oct 13 08:48:32.724517 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2006/3752] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:48:31 2022] DELETE /compute/v2.1/os-security-groups/0977c7bf-d254-4ede-905e-c6bc096ef465 => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:32.729565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:32.730764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:32.743204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.744651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.745412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:32.746435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:32.747077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:32.749063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:33.072743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.096232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.098892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.100438 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57755950-4a3b-4b91-bce3-65be7f8327d8 tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1362 microversion: 2.57 time: 0.374903 Oct 13 08:48:33.118797 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2007/3753] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:32 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:33.124991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c48baa1f-df15-4609-a652-e6032111de50 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f5376e08af0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:33.335511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.350228 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62d7ab15-8509-4fa7-a1cd-4897117e8b79 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 0.854192 Oct 13 08:48:33.355828 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1747/3754] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:32 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:33.390787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:33.391421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:33.415587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:33.417162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:33.418376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:33.447239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:33.451246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:33.451717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:33.778945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.795962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.802348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:33.804591 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f5850f9-5bb9-4601-96d3-ee9cad042213 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.428341 Oct 13 08:48:33.805862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1748/3755] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:33 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:33.812192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:33.813013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:33.828404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:33.830826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:33.831472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:33.832371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:33.833015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:33.833691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:34.043857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:34.141583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c48baa1f-df15-4609-a652-e6032111de50 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1ad28179-432d-4751-892b-75d3f99c016f" status: 202 len: 0 microversion: 2.1 time: 1.023987 Oct 13 08:48:34.142740 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2008/3756] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:48:33 2022] DELETE /compute/v2.1/os-security-groups/1ad28179-432d-4751-892b-75d3f99c016f => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:34.150553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9c0797-7694-42d0-8b3e-c09727df6bc4", "tag": "c926a71a-814d-4071-830b-43ff1994b860"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:34.179805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:34.180687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:34.181376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:34.208113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] Creating event network-changed:c926a71a-814d-4071-830b-43ff1994b860 for instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 on n-h1-858384-11 Oct 13 08:48:34.224206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-59d4114b-b2f0-4b0a-a603-8ac263364ffe req-b0475d41-9a90-4e1b-909f-e06abb8bc5ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079278 Oct 13 08:48:34.225523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2009/3757] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:34.231992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:34.232878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:34.255524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:34.256315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:34.257594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:34.259220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:34.261944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:34.262635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:34.427311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:34.443068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:34.450432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:34.452962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3626354-78e7-4e82-bc26-8b782946932f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1362 microversion: 2.57 time: 0.225664 Oct 13 08:48:34.468511 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2010/3758] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:34 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:34.484392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b60692fe-9fab-47ec-9adb-679610af9775 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] Calling method '.version_select at 0x7f5376e49dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:34.505899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:34.536738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1960f07a-29c1-490c-b238-8c490eff40b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 0.716218 Oct 13 08:48:34.537661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1749/3759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:33 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:34.549605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:34.550939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:34.575363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:34.578172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:34.579845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:34.582155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:34.583821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:34.587865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.108208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.116819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4376f3d-7a99-4bd8-8152-42c258a169e2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 0.577828 Oct 13 08:48:35.121589 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1750/3760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:34 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:35.133714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:35.134584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:35.152554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.153342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.153953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.154945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.155569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.156164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.278773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.289362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.296244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.299683 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-240e8c5f-4946-4eba-9dbc-11f7aab280ca tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.176855 Oct 13 08:48:35.304512 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1751/3761] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:35 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:35.445723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b60692fe-9fab-47ec-9adb-679610af9775 tempest-SecurityGroupRulesNegativeTestJSON-515950421 tempest-SecurityGroupRulesNegativeTestJSON-515950421-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ad09cee1-7141-4135-ac86-6a5b78ff7a17" status: 202 len: 0 microversion: 2.1 time: 0.968097 Oct 13 08:48:35.447361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2011/3762] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:48:34 2022] DELETE /compute/v2.1/os-security-groups/ad09cee1-7141-4135-ac86-6a5b78ff7a17 => generated 0 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:35.485111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:35.485816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:35.499490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.500266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.500897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.502600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.504913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.506833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.564583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:35.565258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:35.578352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.583428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.585862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.604899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.605677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.606304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.627278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.641059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.644246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.644953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lazy-loading 'fault' on Instance uuid 12345c0e-1b4d-44e9-a1af-9d40042a3091 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:35.759208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.776236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.782439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4cd8b9a8a4b4c57955de7f5f36ad698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe691d8e71d84c4ea19b341239890b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:35.785146 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f300453d-0006-4b35-886c-146c24ac936f tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 200 len: 1367 microversion: 2.57 time: 0.305097 Oct 13 08:48:35.787467 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1752/3763] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:35 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:35.907076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96702275-6276-4e96-9127-1a9f8b4e9bfc", "tag": "d5f8c795-9c7f-407b-919e-3cec523fdf2d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:35.918934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:35.919201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:35.921253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:35.921977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:35.936813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] Creating event network-changed:d5f8c795-9c7f-407b-919e-3cec523fdf2d for instance 96702275-6276-4e96-9127-1a9f8b4e9bfc on n-h1-858384-11 Oct 13 08:48:35.944985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e688ef92-d515-40a8-b257-f9b631cfbcc0 req-09e05602-5d9f-4d06-ac14-da69aac55d38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041279 Oct 13 08:48:35.945615 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1753/3764] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:48:36.149816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:36.150589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:36.172191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:36.173356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:36.178659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:36.179581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:36.180075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:36.184652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:36.640456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:36.668630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=14 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:36.674252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e8c6276-e580-485a-a1a3-ede673956d26 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 1.114214 Oct 13 08:48:36.674892 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2012/3765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:35 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:36.703325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:36.703960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:36.722950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:36.723450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:36.724057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:36.724919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:36.725382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:36.725810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:37.018240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:37.043483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:37.050605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:37.061359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80fb5f90-f2a1-4e89-955d-3e136d931d89 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.383889 Oct 13 08:48:37.079076 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2013/3766] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:36 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:37.079076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:37.079076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] [instance: 12345c0e-1b4d-44e9-a1af-9d40042a3091] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:37.087829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:37.087829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:37.088258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:37.092470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:37.092983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:37.093422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:37.125684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] HTTP exception thrown: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Request method failure captured: Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 HTTP/1.1 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C1SdmvJMN0Sa0mc7fZwec5Uu8mcJax2l_xfG11g7V5bE1bScTvk5o6hRXTiA4tyaMpWTjnN_fZG-aR2zmmlvsB9Rwj4NjoSVY2X5Mac90ACzQAczY43YIaouBRRQdIABBjTgNzBjnCcq2G1qo6-0h6IdTbYay2na9EPsabyAwYGuA Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.57 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: fe691d8e71d84c4ea19b341239890b72 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerShowV257Test-1419685650 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe691d8e71d84c4ea19b341239890b72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fe691d8e71d84c4ea19b341239890b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fe691d8e71d84c4ea19b341239890b72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fe691d8e71d84c4ea19b341239890b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerShowV257Test-1419685650 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: fe691d8e71d84c4ea19b341239890b72 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerShowV257Test-1419685650 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerShowV257Test-1419685650-project Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a4cd8b9a8a4b4c57955de7f5f36ad698 Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerShowV257Test-1419685650-project Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '12345c0e-1b4d-44e9-a1af-9d40042a3091'} Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:37.135691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. Oct 13 08:48:37.141200 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:37.143940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] Returning 404 to user: Instance 12345c0e-1b4d-44e9-a1af-9d40042a3091 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:37.144980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a655b1d-1425-40ef-9180-1c2ebe5a1c3d tempest-ServerShowV257Test-1419685650 tempest-ServerShowV257Test-1419685650-project] 10.222.0.23 "GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091" status: 404 len: 111 microversion: 2.57 time: 0.079467 Oct 13 08:48:37.148995 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2014/3767] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:37 2022] GET /compute/v2.1/servers/12345c0e-1b4d-44e9-a1af-9d40042a3091 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:37.183083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:37.192061 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c1b64e2-6af2-4e23-8cdb-cd23fb6bfaf7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 1.047780 Oct 13 08:48:37.199879 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1754/3768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:36 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:37.699456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:37.700068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:37.713862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:37.714369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:37.719017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:37.720594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:37.721226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:37.728856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:38.095572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:38.096259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:38.108366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:38.108885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:38.109336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:38.111988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:38.112466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:38.112895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:38.495446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:38.508966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:38.509918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:38.520993 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-179aa7cc-7a49-458e-a7ea-5bca9096006e tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.429797 Oct 13 08:48:38.521903 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1755/3769] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:38 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:38.526601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:38.528837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:38.546838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:38.547345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:38.548990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:38.549714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:38.550174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:38.550639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:38.967871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:38.976196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d5afcab-277d-4e48-ab0c-eda9afc00a9e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 1.280698 Oct 13 08:48:38.983674 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2015/3770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:37 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:39.167930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:39.182349 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bc99925-aa47-47b8-ab56-1b0614fe1e22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 0.659235 Oct 13 08:48:39.189178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1756/3771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:38 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:39.396297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9c0797-7694-42d0-8b3e-c09727df6bc4", "name": "network-vif-plugged", "status": "completed", "tag": "c926a71a-814d-4071-830b-43ff1994b860"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:39.420535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:39.424777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:39.428958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:39.501343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] Creating event network-vif-plugged:c926a71a-814d-4071-830b-43ff1994b860 for instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 on n-h1-858384-11 Oct 13 08:48:39.515638 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-282832c2-dcd8-481f-9c97-7c607262c890 req-2d9f3b4e-ee4e-4655-9284-c2df28bbbd8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119352 Oct 13 08:48:39.516263 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2016/3772] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:39.551045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:39.552383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:39.569692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:39.572136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:39.575569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:39.579708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:39.580817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:39.582121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:39.725924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:39.748172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:39.750105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:39.753350 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40b47485-ee1d-473b-b341-b06ec0157fb9 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.207539 Oct 13 08:48:39.759033 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1757/3773] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:39 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:40.008844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:40.009668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:40.040990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:40.050765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:40.052547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:40.054399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:40.055374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:40.060352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:40.214946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:40.215762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:40.236447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:40.242648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:40.245775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:40.246858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:40.250662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:40.251684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:40.985121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:40.997828 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60977daa-482c-4488-95cd-88ab994255a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1315 microversion: 2.1 time: 0.786985 Oct 13 08:48:40.998503 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1758/3774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:40 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:41.011785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:41.015234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:41.026337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:41.029430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:41.030970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:41.031945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:41.033451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:41.037675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:41.283036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:41.306129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:41.315737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:41.324658 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.321415 Oct 13 08:48:41.328252 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1759/3775] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:41 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:41.384060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:41.402367 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 1.399701 Oct 13 08:48:41.420178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2017/3776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:40 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:41.586496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:41.588273 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001598 Oct 13 08:48:41.588747 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1760/3777] 10.222.0.23 () {56 vars in 886 bytes} [Thu Oct 13 08:48:41 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 13 08:48:41.597282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:41.598808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002159 Oct 13 08:48:41.599578 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2018/3778] 10.222.0.23 () {54 vars in 1035 bytes} [Thu Oct 13 08:48:41 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 13 08:48:41.607709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:41.609093 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c263881-6b44-49c2-9972-9abb48022efa tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001831 Oct 13 08:48:41.609872 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1761/3779] 10.222.0.23 () {54 vars in 1041 bytes} [Thu Oct 13 08:48:41 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:41.618927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:41.620866 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d7f48c6-cbce-419f-ba86-a8ef8f206a54 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002334 Oct 13 08:48:41.621718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2019/3780] 10.222.0.23 () {56 vars in 886 bytes} [Thu Oct 13 08:48:41 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 13 08:48:42.021734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:42.022460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:42.026369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:42.052154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.054163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.058277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.059779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.062845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.067423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.361398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:42.362115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:42.396526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.401868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.402790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.404756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.409076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.409638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.618496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:42.632503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:42.634281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:42.638015 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f83ae39e-9270-481a-81af-57e76fc36e57 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.282268 Oct 13 08:48:42.639462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2020/3781] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:42 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:42.645165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:42.646465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:42.657878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.658877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.659619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.660665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:42.661273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:42.662151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:42.906066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:42.923767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c981973-2103-43cf-9b82-e900a82e7fec tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1502 microversion: 2.1 time: 0.906028 Oct 13 08:48:42.938926 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1762/3782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:42 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1502 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:43.148433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:43.158646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e1ef028-4fdc-4dae-b497-856b34c01501 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 0.517886 Oct 13 08:48:43.170216 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2021/3783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:42 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:43.669596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:43.671065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:43.689275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:43.690005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:43.690730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:43.691717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:43.694946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:43.695803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:43.989987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:44.008269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:44.027412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:44.029056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-964df7cd-c3bc-420b-9ae3-b2bfe6df0cc0 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.363788 Oct 13 08:48:44.029637 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1763/3784] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:43 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:44.196499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:44.197217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:44.214331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:44.214889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:44.215337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:44.216138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:44.216636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:44.217082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:44.790640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:44.807535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e13827a-05df-4c6b-8aca-d095342ee5a7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 0.615055 Oct 13 08:48:44.808138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2022/3785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:44 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:45.064372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:45.066990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:45.076034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:45.076741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:45.078308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:45.086455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:45.087258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:45.088082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:45.245743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:45.266076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:45.272864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:45.274517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b092b25-7bd7-436c-9c37-94035fd594f5 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.217458 Oct 13 08:48:45.278354 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1764/3786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:45 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:45.835989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:45.837214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:45.850691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:45.852989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:45.854280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:45.861766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:45.862478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:45.863111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:46.123535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:46.134625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d12e53b3-5d02-45a6-b4f5-e0d267ea86c4"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:46.135988 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64ce962a-6fc8-46e3-b27d-81230416881c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 0.304800 Oct 13 08:48:46.136623 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2023/3787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:45 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:46.157680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:46.187866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:46.189090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:46.189700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:46.190731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:46.191195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:46.192971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:46.314119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:46.314770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:46.324319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:46.329931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:46.331728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:46.334085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:46.335548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:46.337942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:46.338240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:46.524766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:46.540616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:46.551467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:46.554098 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da8fab9e-6508-424d-a001-09afd931ad25 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1871 microversion: 2.32 time: 0.244691 Oct 13 08:48:46.593183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2024/3788] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:46 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1871 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:48:46.699678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9e0fd3c-be21-4f0f-a769-084e1ef763ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569827 Oct 13 08:48:46.720083 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1765/3789] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:48:46 2022] POST /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:46.978440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96702275-6276-4e96-9127-1a9f8b4e9bfc", "name": "network-vif-plugged", "status": "completed", "tag": "d5f8c795-9c7f-407b-919e-3cec523fdf2d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:47.004062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:47.005087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:47.006061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:47.040069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] Creating event network-vif-plugged:d5f8c795-9c7f-407b-919e-3cec523fdf2d for instance 96702275-6276-4e96-9127-1a9f8b4e9bfc on n-h1-858384-11 Oct 13 08:48:47.060992 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-07dfe25d-5070-405c-8f1c-5b8d5d0635e3 req-cad4ec13-7f78-43a6-8fe3-2280b6cf7955 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090992 Oct 13 08:48:47.062837 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1766/3790] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:47.161546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:47.162498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:47.178317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:47.183712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:47.185418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:47.186244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:47.187329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:47.189018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:47.338712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-610518426", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:47.505771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] validate_networks() for [('6866a7b5-989b-4c1c-8992-9f18fd3186c9', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:48:48.004847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:48.017608 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7133a94f-96cf-4494-ae7d-4d0c3fa7e9ea tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1308 microversion: 2.1 time: 0.862129 Oct 13 08:48:48.018219 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1767/3791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:47 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:48.031338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:48.031338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:48.044689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:48.045226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:48.045801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:48.047733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:48.048412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:48.049718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:48.125603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:48.126920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:48.127962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:48.128588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lazy-loading 'fault' on Instance uuid 38e316a8-6072-4463-b589-7454946d3bb6 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:48:48.184252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:48.201970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:48.205263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ceecb84f254b28aa4fd7506cc03a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd352975224f8da5c993efbe65fd45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:48.208595 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9b9120e2-9882-4eef-aafe-9391356035c6 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 200 len: 1876 microversion: 2.32 time: 0.188392 Oct 13 08:48:48.210965 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1768/3792] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:48 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 1876 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:48:48.433433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:48:48.433954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:48:48.434339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:48:48.434802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:48:48.435225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:48:48.451155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:48.453293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:48.453756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:48.460151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:48.460655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:48.461262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:48.506985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Getting quotas for project 60f6f633952f4caaa69b1ad0b8f9efbd. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:48:48.521796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Getting quotas for user b5d245aada2a45a7b68a1b719cc8d97b and project 60f6f633952f4caaa69b1ad0b8f9efbd. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:48:48.552178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:48:48.554089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:48:48.613770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:48.652690 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17da77b6-fd60-41df-977b-7096be61e9b3 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933262 Oct 13 08:48:48.659875 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2025/3793] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:48:48.665721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4fef0cbb-425d-4986-9919-0db19c05da20 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:48.666572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4fef0cbb-425d-4986-9919-0db19c05da20 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:48.750237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4fef0cbb-425d-4986-9919-0db19c05da20 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:48.766289 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4fef0cbb-425d-4986-9919-0db19c05da20 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1223 microversion: 2.1 time: 0.104951 Oct 13 08:48:48.767244 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1769/3794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:48 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:49.044655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:49.045934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:49.060168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.064746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.065184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.066211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.066810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.079763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.140537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:49.239282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:49.240509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:49.264853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.265655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.266272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.267728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.268369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.269036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.298127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] HTTP exception thrown: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Request method failure captured: Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 HTTP/1.1 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR89OjfBqWiPG2ifSouzrM3dA_ssHyCsXVroWBmepSKFLrFzdgqIBMF7z44K0milk0QDv0ZJAC7bG-Gb2bE5UwVCggP5OY4eCrxcc1jhrWLPnnGfxFXOT9lA3EcHQ2cjDQjeyr2D2_gYdXZm6UJ84TWmqTKmGpgvKpMovY1pTa4vumPo Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.32 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f4ceecb84f254b28aa4fd7506cc03a7d Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '38e316a8-6072-4463-b589-7454946d3bb6'} Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:49.308811 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:49.313621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:48:49.323936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Returning 404 to user: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:49.325201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1a99dfc-a22f-4823-b8de-d316b30a1861 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 404 len: 111 microversion: 2.32 time: 0.090943 Oct 13 08:48:49.326494 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1770/3795] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:49 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:48:49.340654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c861c532-aac5-43ea-b6b2-02da26ce83d4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '.version_select at 0x7f5375fb2b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:49.389852 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c861c532-aac5-43ea-b6b2-02da26ce83d4 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75893339" status: 204 len: 0 microversion: 2.32 time: 0.052535 Oct 13 08:48:49.397290 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1771/3796] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75893339 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:48:49.449886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:49.465414 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-81b279bd-7ef9-42b9-9ee7-124c9c1e360a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1489 microversion: 2.1 time: 0.424433 Oct 13 08:48:49.466530 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2026/3797] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:49 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1489 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:49.493208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1820179864"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:49.496486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:49.525079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.533744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.535112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.537150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.539301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.539957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.685861 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e565e619-d83d-4853-b7e0-a790b66cf17b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "PUT /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1075 microversion: 2.1 time: 0.198009 Oct 13 08:48:49.698468 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1772/3798] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:48:49 2022] PUT /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1075 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:49.708102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:49.708656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:49.715714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.716220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.716687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.730322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.730900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.735529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.791256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:49.792168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:49.804601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.805453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.808909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.810897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:49.815889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:49.816371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:49.974100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:49.992415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a042e62-370e-4f66-921c-b5325afe59d1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1227 microversion: 2.1 time: 0.203707 Oct 13 08:48:50.006433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1773/3799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:49 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1227 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:50.040444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:50.052447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-938cb65e-7e50-4363-997f-b9a6484db6c8 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1501 microversion: 2.1 time: 0.348724 Oct 13 08:48:50.054040 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2027/3800] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:49 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:50.091319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:50.092539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:50.107885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:50.108497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:50.110757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:50.114031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:50.119927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:50.122003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.033857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:51.035134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:51.053564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:51.054066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:51.056706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.057498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:51.057973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:51.058434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.214798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:51.217860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:51.226773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-030603a4-4a90-4e6a-b75f-1d10d374d097 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1281 microversion: 2.1 time: 0.208775 Oct 13 08:48:51.228370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e825cd25-78fd-4478-96e2-a378e33ed451 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1501 microversion: 2.1 time: 1.147064 Oct 13 08:48:51.229410 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1774/3801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:50 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1501 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:51.231380 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2028/3802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:51 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:51.253804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:51.260691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:51.261439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:51.262118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.330563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Going to try to stop instance {{(pid=127031) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:48:51.439894 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2412087-87b3-42ab-aa0e-d16c9d9da1b4 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "POST /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc/action" status: 202 len: 0 microversion: 2.1 time: 0.189031 Oct 13 08:48:51.441830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1775/3803] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:48:51 2022] POST /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:48:51.450852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:51.451833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:51.468557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:51.469634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:51.470275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.471364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:51.472020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:51.479245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:51.963102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:51.978743 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6afc5ca3-21af-4587-8773-209bd4233595 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.531403 Oct 13 08:48:51.980430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2029/3804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:51 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:52.256402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:52.257855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:52.274189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:52.275347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:52.276844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:52.280621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:52.281290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:52.282527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:52.696406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:52.707590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5bef11d-5d79-414f-b58d-5be5b9b7b346 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.456839 Oct 13 08:48:52.708187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1776/3805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:52 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:53.004941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:53.005762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:53.023558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:53.026496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:53.027555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:53.028567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:53.030061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:53.034016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:53.400527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:53.412506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ae31278-457a-4b80-b8fe-69061b3cfb50 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.413372 Oct 13 08:48:53.431479 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2030/3806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:52 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:53.735942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:53.736537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:53.760496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:53.761411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:53.764207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:53.768903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:53.769890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:53.772958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:54.263815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:54.279327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d815c448-00fc-4a3a-b563-43299fc68557 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.548106 Oct 13 08:48:54.280317 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1777/3807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:53 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:54.396897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec3a341-5b34-480e-b9c3-f44fd61c0170", "tag": "769df21d-1318-4425-9a98-4ed997fc1d66"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:48:54.424835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:54.425709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:54.426822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:54.445538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:54.446427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:54.453639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:54.460514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:54.464223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:54.466650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:54.467400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:54.468768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:54.481890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] Creating event network-changed:769df21d-1318-4425-9a98-4ed997fc1d66 for instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 on n-h2-858384-11 Oct 13 08:48:54.499200 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-55caaca7-746f-4b54-a22e-91ffb3044672 req-71e1186f-9a43-40b0-99b8-c244ae6825ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106475 Oct 13 08:48:54.501719 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2031/3808] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:48:55.244210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:55.254477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-802ebe4c-30b7-498c-aeb2-155b9b90b9f9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.817074 Oct 13 08:48:55.256031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1778/3809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:54 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:48:55.304898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:55.305917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:55.313491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:55.313989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:55.314533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:55.315436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:55.316057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:55.316664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:55.454014 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 08:48:55.454726 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 08:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 (ip 10.222.0.23) !!! Oct 13 08:48:55.884758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:55.902489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-397389d2-f7c9-4743-aef5-9513e689f5d0 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.602099 Oct 13 08:48:55.924493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2032/3810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:55 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:56.290939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:56.293008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:56.305168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:56.305720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:56.306257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:56.307060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:56.307792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:56.308412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:56.724457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:56.739968 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84532d57-c68c-436d-bb40-fc7c5b4ccb32 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.452402 Oct 13 08:48:56.757367 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1779/3811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:56 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:56.928391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:56.929100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:56.951952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:56.952492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:56.952832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:56.953554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:56.954080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:56.954539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:57.520428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:57.531808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1951fab6-51cf-494e-8a8a-d55c2bc8d1d7 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.607117 Oct 13 08:48:57.533509 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2033/3812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:56 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:57.768081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:57.769353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:57.778535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:57.780550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:57.781273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:57.782925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:57.784358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:57.785559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.036911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:58.037567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:58.062612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.063368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.063828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.067023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.067414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.067869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.119999 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] HTTP exception thrown: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Request method failure captured: Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 HTTP/1.1 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR89OjfBqWiPG2ifSouzrM3dA_ssHyCsXVroWBmepSKFLrFzdgqIBMF7z44K0milk0QDv0ZJAC7bG-Gb2bE5UwVCggP5OY4eCrxcc1jhrWLPnnGfxFXOT9lA3EcHQ2cjDQjeyr2D2_gYdXZm6UJ84TWmqTKmGpgvKpMovY1pTa4vumPo Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.32 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f4ceecb84f254b28aa4fd7506cc03a7d Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '38e316a8-6072-4463-b589-7454946d3bb6'} Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:58.123934 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Returning 404 to user: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:58.129607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6bf2928d-12c6-48aa-aad1-e00ef391d3d7 tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 404 len: 111 microversion: 2.32 time: 0.093395 Oct 13 08:48:58.140155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2034/3813] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:48:58 2022] DELETE /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:48:58.156911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:58.158476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] [instance: 38e316a8-6072-4463-b589-7454946d3bb6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:58.177327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.178207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.179100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.181571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.183660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.184273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.231038 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] HTTP exception thrown: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Request method failure captured: Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 HTTP/1.1 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR89OjfBqWiPG2ifSouzrM3dA_ssHyCsXVroWBmepSKFLrFzdgqIBMF7z44K0milk0QDv0ZJAC7bG-Gb2bE5UwVCggP5OY4eCrxcc1jhrWLPnnGfxFXOT9lA3EcHQ2cjDQjeyr2D2_gYdXZm6UJ84TWmqTKmGpgvKpMovY1pTa4vumPo Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.32 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cdbd352975224f8da5c993efbe65fd45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: cdbd352975224f8da5c993efbe65fd45 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1313434738 Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f4ceecb84f254b28aa4fd7506cc03a7d Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TaggedBootDevicesTest-1313434738-project Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '38e316a8-6072-4463-b589-7454946d3bb6'} Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.232902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. Oct 13 08:48:58.238300 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:48:58.239684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] Returning 404 to user: Instance 38e316a8-6072-4463-b589-7454946d3bb6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:48:58.240726 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cafb31cf-3cf7-4d0b-a45c-2c79ae6a3c7b tempest-TaggedBootDevicesTest-1313434738 tempest-TaggedBootDevicesTest-1313434738-project] 10.222.0.23 "GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6" status: 404 len: 111 microversion: 2.32 time: 0.097578 Oct 13 08:48:58.244676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2035/3814] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:48:58 2022] GET /compute/v2.1/servers/38e316a8-6072-4463-b589-7454946d3bb6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:48:58.570434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:58.570434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:58.572503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:58.572503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:58.585853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.586355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.586838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.587922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:58.588389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:48:58.588822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:48:58.755601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:48:58.932575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:48:58.952369 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3984df24-a9ec-4d3d-be23-c68cb65390d9 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 1.191742 Oct 13 08:48:58.955823 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1780/3815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:57 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:48:59.978320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:48:59.979755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:48:59.998627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:48:59.999770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:00.003206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:00.004508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:00.011337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:00.012208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:00.243916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:00.253831 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e75b33d9-5075-4223-a627-e3bea7c19e21 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 1.700769 Oct 13 08:49:00.266145 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2036/3816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:58 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:00.599566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:00.609037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3e958c16-e7c7-4dad-91de-7a61b70fec27 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.634687 Oct 13 08:49:00.612926 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1781/3817] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:48:59 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:01.284409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:01.286026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:01.309433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:01.310388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:01.311717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:01.314288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:01.315765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:01.317454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:01.639038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:01.639663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:01.659290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:01.659875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:01.660240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:01.660961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:01.661422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:01.661854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:01.755174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:02.121242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:02.137897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ac255e7-e8a3-4ffa-ba04-0299d28fcd1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.502745 Oct 13 08:49:02.143152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1782/3818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:01 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:02.170715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:02.172213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:02.179481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:02.186811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:02.187586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:02.188803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:02.191663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:02.192427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:02.193149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:02.195078 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5dcc8097-04a9-4596-923b-1658af9d1c23 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.915063 Oct 13 08:49:02.196015 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2037/3819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:01 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:02.307269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:49:02.611564 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b8be36d-929f-42e2-8ebf-471ff38caef8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 204 len: 0 microversion: 2.1 time: 0.450735 Oct 13 08:49:02.612158 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1783/3820] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:02 2022] DELETE /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:49:02.620348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:02.621569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:02.632182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:02.637868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:02.638330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:02.639110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:02.639576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:02.640008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:02.998605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:03.013425 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8f92feba-b4aa-4587-a9d6-3ec05f0ce6ff tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1554 microversion: 2.1 time: 0.396912 Oct 13 08:49:03.014028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2038/3821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:02 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1554 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:03.166624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:03.167502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:03.178619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:03.180624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:03.181713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:03.186676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:03.187396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:03.188376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:03.223513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:03.224133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:03.238365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:03.239348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:03.244904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:03.245993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:03.247011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:03.249162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:03.942517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:03.953266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d48bfc27-a0af-4ed4-bad1-1648eb2f9250 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.733527 Oct 13 08:49:03.954050 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2039/3822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:03 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:03.978804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:03.989351 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc5ee322-8adf-4bd6-bd0e-712b60f09f1f tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.827728 Oct 13 08:49:04.015396 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1784/3823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:03 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:04.063285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:04.063918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:04.103618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:04.105751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:04.110950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:04.114669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:04.118094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:04.118801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:04.979077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:04.980411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:04.995855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:04.998771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:04.999559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:05.001671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:05.006066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:05.007045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:05.200026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:05.279470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-541b1dd8-425a-4c16-b377-b5c87ee73cc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1554 microversion: 2.1 time: 1.244031 Oct 13 08:49:05.310245 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2040/3824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:04 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1554 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:05.322137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:05.325077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:05.352990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:05.353807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:05.354484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:05.355455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:05.356109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:05.356732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:05.723798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:05.749857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bad5ce24-39f0-4712-a2db-ea46e261e497 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.434180 Oct 13 08:49:05.767543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2041/3825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:05 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:05.787231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec3a341-5b34-480e-b9c3-f44fd61c0170", "name": "network-vif-plugged", "status": "completed", "tag": "769df21d-1318-4425-9a98-4ed997fc1d66"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:05.802572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:05.803257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:05.804070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:05.842122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] Creating event network-vif-plugged:769df21d-1318-4425-9a98-4ed997fc1d66 for instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 on n-h2-858384-11 Oct 13 08:49:05.863524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-756e8c66-214c-4a8e-b55d-20fde16b3f2c req-db1858f0-c9bb-4af3-bc5d-5bfd73824cda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092242 Oct 13 08:49:05.866290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2042/3826] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:06.215612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:06.231209 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c73ca2f6-941e-4743-9ae3-f20ddebdd7ea tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 1.255989 Oct 13 08:49:06.248243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1785/3827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:04 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:06.307090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:06.307661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:06.328047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:06.329090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:06.329532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:06.330253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:06.330772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:06.331202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:07.216131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-161fcb40-81a2-4e33-bee6-019f1ce59785 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5376e47790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1159037440", "description": "tempest-description-2082048719"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:07.359695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:07.370292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c873d98-8676-4f7c-866e-9674ef7b99b7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1554 microversion: 2.1 time: 1.067029 Oct 13 08:49:07.384189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1786/3828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:06 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1554 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:07.389299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:07.400540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:07.419234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:07.427190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:07.427993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:07.428990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:07.429796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:07.430504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:07.492916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-161fcb40-81a2-4e33-bee6-019f1ce59785 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.288206 Oct 13 08:49:07.493536 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2043/3829] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:07.507921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:07.509039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:07.522170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:07.522708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:07.525166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:07.525904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:07.529733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:07.532987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:07.886954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:07.900699 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-34e65302-4e00-48aa-9193-ee4b8dcaf7db tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1323 microversion: 2.1 time: 0.406091 Oct 13 08:49:07.904784 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2044/3830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:07 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:07.915107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8d7f9c3-b098-44ee-af0f-b6e7b8a1b38d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5377036550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960919957", "description": "tempest-description-569638314"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:08.286580 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8d7f9c3-b098-44ee-af0f-b6e7b8a1b38d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.378761 Oct 13 08:49:08.287952 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2045/3831] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:08.303727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9c0797-7694-42d0-8b3e-c09727df6bc4", "name": "network-vif-deleted", "tag": "c926a71a-814d-4071-830b-43ff1994b860"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:08.347025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:08.349175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:08.351755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:08.396949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] Creating event network-vif-deleted:c926a71a-814d-4071-830b-43ff1994b860 for instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 on n-h1-858384-11 Oct 13 08:49:08.421399 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1e02754b-9181-4186-a202-fbb91fc8aae6 req-4f9e6828-36e6-4537-b8a5-8db4411800f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131446 Oct 13 08:49:08.422971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2046/3832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:08.431012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:08.431774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:08.452734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:08.464279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:08.465017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:08.467732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:08.468540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:08.471954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:08.672856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:08.686151 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed130818-06b5-4fa2-9883-c94984e6bab1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.261754 Oct 13 08:49:08.689640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2047/3833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:08 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:08.716255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1475613491", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "22c30855-76bf-48c2-8764-3909c5e8c7d8"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:08.869696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] validate_networks() for [('22c30855-76bf-48c2-8764-3909c5e8c7d8', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:49:09.138455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:09.153177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73bf1a5e-e234-4cc3-b854-49ca6abb07f6 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 1.767586 Oct 13 08:49:09.153796 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1787/3834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:07 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:09.172903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:09.173805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:09.211286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:09.211886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:09.212343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:09.222585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:09.224492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:09.224952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.021652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:49:10.022513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:49:10.023327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:49:10.031169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:49:10.031953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:49:10.070440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.071217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.075173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.076952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.077643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.078468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.150742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Getting quotas for project c9d32647fff54e19bd61d2dcc70a3881. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:49:10.165163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Getting quotas for user c879a7eda44d4b97bd2b3747f0cd02dd and project c9d32647fff54e19bd61d2dcc70a3881. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:49:10.216232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:49:10.225141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:49:10.428054 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d839b339-b45b-4fbe-b9e1-211a9c64987d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737291 Oct 13 08:49:10.437415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2048/3835] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:49:10.445870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:10.455896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:10.477498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.489511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.490558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.493946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.494651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.504599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.517331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:10.596551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:10.605293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe2030f7-76c3-4231-9d55-48c6275070a2 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1519 microversion: 2.1 time: 1.440942 Oct 13 08:49:10.631662 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1788/3836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:09 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1519 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:10.653894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:10.665668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:10.689314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.699414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.703039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.704687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:10.705429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:10.706102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:10.755852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:10.768064 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5c87614c-5753-44e7-aec6-dcc22de0bb00 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.328642 Oct 13 08:49:10.788548 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2049/3837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:10 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:10.801200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa32f093-43cc-4599-9c0d-50993c8e09a5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:10.801896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa32f093-43cc-4599-9c0d-50993c8e09a5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:11.061381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa32f093-43cc-4599-9c0d-50993c8e09a5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:11.076384 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa32f093-43cc-4599-9c0d-50993c8e09a5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1216 microversion: 2.1 time: 0.282793 Oct 13 08:49:11.084702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2050/3838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:10 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:11.154770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:11.171960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-12934551-8bb1-43b9-b2f1-7f49295664fd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.531229 Oct 13 08:49:11.179714 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1789/3839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:10 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:11.255864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74dece23-5a7b-4e2f-9508-329471d66ffb tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1752809520", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74dece23-5a7b-4e2f-9508-329471d66ffb tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 243 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1752809520", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1752809520', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6866a7b5-989b-4c1c-8992-9f18fd3186c9'}]}}} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:11.262776 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74dece23-5a7b-4e2f-9508-329471d66ffb tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74dece23-5a7b-4e2f-9508-329471d66ffb tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.014739 Oct 13 08:49:11.267928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2051/3840] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:11 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:49:11.278251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:11.280913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 57fba951-5043-4327-86ce-c924f869b056] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:11.304379 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] HTTP exception thrown: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/57fba951-5043-4327-86ce-c924f869b056/metadata HTTP/1.1 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '57fba951-5043-4327-86ce-c924f869b056'} Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.316503 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 404 to user: Instance 57fba951-5043-4327-86ce-c924f869b056 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f75ff43c-bb90-40ee-b457-becec1a825b1 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/57fba951-5043-4327-86ce-c924f869b056/metadata" status: 404 len: 111 microversion: 2.1 time: 0.045724 Oct 13 08:49:11.321534 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1790/3841] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:49:11 2022] GET /compute/v2.1/servers/57fba951-5043-4327-86ce-c924f869b056/metadata => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:11.446267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a6e766b-ac26-4a32-8b79-e4703a1a973f tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-745017704", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a6e766b-ac26-4a32-8b79-e4703a1a973f tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 498 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-745017704", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-745017704', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6866a7b5-989b-4c1c-8992-9f18fd3186c9'}]}}} Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:49:11.457626 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.461418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a6e766b-ac26-4a32-8b79-e4703a1a973f tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:11.477116 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a6e766b-ac26-4a32-8b79-e4703a1a973f tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020885 Oct 13 08:49:11.477116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1791/3842] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:11 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:49:11.613768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0598fef6-db38-41c5-a499-fed0585f20d9 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-587110149", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0598fef6-db38-41c5-a499-fed0585f20d9 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 499 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-587110149", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-587110149', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6866a7b5-989b-4c1c-8992-9f18fd3186c9'}]}}} Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:49:11.618758 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:11.622229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0598fef6-db38-41c5-a499-fed0585f20d9 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:11.637733 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0598fef6-db38-41c5-a499-fed0585f20d9 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.024702 Oct 13 08:49:11.638454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1792/3843] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:11 2022] POST /compute/v2.1/servers => generated 689 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:49:11.796686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:11.799274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:11.820013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:11.821300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:11.822355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:11.823677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:11.824460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:11.825482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:11.867448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16dce355-2661-4652-a31f-16e6dd690862 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Action: 'create', calling method: .version_select at 0x7f537aaa40d0>, body: {"pool": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:12.078356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:12.095694 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-838024c3-800e-40c0-8e6b-db0f9f6aa6cb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.305778 Oct 13 08:49:12.098676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1793/3844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:11 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:12.120570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a98fe4e-e69b-4728-ac12-990b4cba096d tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1847384792", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a98fe4e-e69b-4728-ac12-990b4cba096d tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 754 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1847384792", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1847384792', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6866a7b5-989b-4c1c-8992-9f18fd3186c9'}]}}} Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:49:12.150022 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:49:12.153214 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:49:12.156024 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.156024 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.156024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a98fe4e-e69b-4728-ac12-990b4cba096d tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:12.159541 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a98fe4e-e69b-4728-ac12-990b4cba096d tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.057386 Oct 13 08:49:12.168139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1794/3845] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:12 2022] POST /compute/v2.1/servers => generated 1197 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 13 08:49:12.193852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:12.195056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:12.241575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:12.253849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:12.254366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:12.254835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:12.255553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:12.256005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:12.271252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:12.483442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:12.495602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f41b0234-d96d-45fd-bc56-8a733c325097 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1220 microversion: 2.1 time: 0.327560 Oct 13 08:49:12.496461 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1795/3846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:12 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1220 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:12.504665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:12.505800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:12.512750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:12.513478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:12.515420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:12.517674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:12.518676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:12.519984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:12.873457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:12.901738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2fdc0b5-05bd-4583-812b-f3c008ce3107 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.403872 Oct 13 08:49:12.904688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1796/3847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:12 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:12.916239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aae11722-1bae-452e-b30d-f3c09565f048 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-522347742", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aae11722-1bae-452e-b30d-f3c09565f048 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 1265 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-522347742", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6866a7b5-989b-4c1c-8992-9f18fd3186c9"}]}} Oct 13 08:49:12.946541 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-522347742', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6866a7b5-989b-4c1c-8992-9f18fd3186c9'}]}}} Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.949497 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:49:12.950902 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:49:12.953313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 13 08:49:12.953313 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:12.959086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aae11722-1bae-452e-b30d-f3c09565f048 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:12.963073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aae11722-1bae-452e-b30d-f3c09565f048 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.055593 Oct 13 08:49:12.966335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1797/3848] 10.222.0.23 () {60 vars in 1148 bytes} [Thu Oct 13 08:49:12 2022] POST /compute/v2.1/servers => generated 2221 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 13 08:49:12.989379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:12.990360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 28784029-b855-4ebd-9a6d-d690e38239cd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:13.010185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] HTTP exception thrown: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/28784029-b855-4ebd-9a6d-d690e38239cd/metadata/test2 HTTP/1.1 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '28784029-b855-4ebd-9a6d-d690e38239cd', 'id': 'test2'} Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:13.013495 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:13.018262 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:13.018262 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:13.018262 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. Oct 13 08:49:13.018262 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:13.018262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 404 to user: Instance 28784029-b855-4ebd-9a6d-d690e38239cd could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:13.036630 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c87a1614-cf81-4f74-92b2-405b7b70afbd tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/28784029-b855-4ebd-9a6d-d690e38239cd/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.045792 Oct 13 08:49:13.038712 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1798/3849] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Oct 13 08:49:12 2022] GET /compute/v2.1/servers/28784029-b855-4ebd-9a6d-d690e38239cd/metadata/test2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:13.056214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:13.059909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:13.070083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.074022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.075336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:13.078363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.079105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.079799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:13.151937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:49:13.381448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e65b6f5-62d5-4880-967d-c0efe8033340 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 204 len: 0 microversion: 2.1 time: 0.329932 Oct 13 08:49:13.389501 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1799/3850] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:13 2022] DELETE /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:49:13.405108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:13.408101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:13.417757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.425330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.426211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:13.427256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.430081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.430848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:13.745597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:13.762794 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad6f29b8-e250-413d-b8a6-2cc866d528ae tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.370762 Oct 13 08:49:13.767146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1800/3851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:13 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:13.781940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:13.791102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:13.806978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.807397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.807842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:13.817596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:13.818608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:13.819235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:14.339873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:14.342899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:14.363231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d299317d-d06d-4bb2-b357-8053e627deda tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1525 microversion: 2.1 time: 0.590021 Oct 13 08:49:14.365292 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1801/3852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:13 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1525 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:14.384226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:14.385392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:14.412455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:14.413927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:14.414515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:14.415308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:14.415789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:14.416324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:14.649557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:14.679991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b7268be-6281-4a06-91ee-c15ebcdcf6c6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1274 microversion: 2.1 time: 0.308603 Oct 13 08:49:14.685940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1802/3853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:14 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:14.700622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:14.701261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:14.726121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:14.726700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:14.730679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:14.731499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:14.735525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:14.736692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:15.399807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:15.425017 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-063022dd-1f21-41aa-84fd-4317a562301e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1511 microversion: 2.1 time: 0.736619 Oct 13 08:49:15.425742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1803/3854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:14 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:15.443782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:15.444777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:15.464321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:15.469821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:15.470603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:15.471574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:15.472261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:15.472945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:15.967272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16dce355-2661-4652-a31f-16e6dd690862 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.600825 Oct 13 08:49:15.974647 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2052/3855] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:49:11 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:15.984168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:15.984724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:16.016263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:16.026864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:16.027870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:16.029175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:16.030044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:16.030671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:16.139040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:16.150451 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc3107dc-546e-4dda-8840-fb6338e7406d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.723176 Oct 13 08:49:16.156746 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1804/3856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:15 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:16.167341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:16.168330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:16.185061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:16.185892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:16.189632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:16.190749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:16.191429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:16.192061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:16.570690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:16.584056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55e7ed4a-8377-47c6-87b8-3148ad4a583f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.421955 Oct 13 08:49:16.585857 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1805/3857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:16 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:16.611634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9eb57005-870a-45f2-a5f2-75b32b00c651 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Action: 'create', calling method: .version_select at 0x7f5376d8daf0>, body: {"pool": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:17.197537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d245aada2a45a7b68a1b719cc8d97b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f6f633952f4caaa69b1ad0b8f9efbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:17.217406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4865f1ff-eedb-4442-9d8b-10ff4b8fd51b tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 200 len: 1525 microversion: 2.1 time: 1.237952 Oct 13 08:49:17.235694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2053/3858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:15 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 1525 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:17.243287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:17.244617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:17.253581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:17.254537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:17.255619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:17.256851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:17.257484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:17.258082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:17.789997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:17.809496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25e3b0bb-0920-44cd-8568-03dd2b3274da tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1488 microversion: 2.1 time: 0.572289 Oct 13 08:49:17.817704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2054/3859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:17 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1488 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:17.835593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:17.837760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:17.860215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:17.861748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:17.862953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:17.864395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:17.865355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:17.868255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.034592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:18.057049 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3540414e-0ce4-4f31-a08b-e7c04c728046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.234485 Oct 13 08:49:18.057049 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2055/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:17 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:18.072426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:18.074548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:18.087100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.088890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.092234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.094161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.096645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.098862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.423540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:18.447729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2229d00-c148-4fc2-808e-34cf6f1c2099 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.390873 Oct 13 08:49:18.470295 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2056/3861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:18 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:18.486046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec3a341-5b34-480e-b9c3-f44fd61c0170", "name": "network-vif-deleted", "tag": "769df21d-1318-4425-9a98-4ed997fc1d66"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:18.504399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.505031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.506431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.545000 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] Creating event network-vif-deleted:769df21d-1318-4425-9a98-4ed997fc1d66 for instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 on n-h2-858384-11 Oct 13 08:49:18.553437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-32c3f8a6-bf24-4fa9-ad75-bf6f2dabc60e req-5f2ce2b1-327e-412a-82b3-318d10750a53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081624 Oct 13 08:49:18.564318 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2057/3862] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:18.570926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1984867863"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:18.577730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:18.597013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.597672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.598314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.599261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.599824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.600454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.779371 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e7a1472-63bf-4577-ac13-b80b24b8d16b tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "PUT /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1061 microversion: 2.1 time: 0.212751 Oct 13 08:49:18.781864 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2058/3863] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:49:18 2022] PUT /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1061 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:18.802492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:18.804351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] [instance: 8ec3a341-5b34-480e-b9c3-f44fd61c0170] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:18.815776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.816556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.818706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.819727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.820470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.821443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.853960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] HTTP exception thrown: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Request method failure captured: Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 HTTP/1.1 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Du0vZDEnBtEoOCQGlduqJD6ywWIXVCA-PL5zGl9vw3ajCQC0tvgKBikYiHX8fYKbzh8VZj1t9uNiuV2R6h4mFXPgbctYb6hh12_mWAyneSp9qaNiKNg6uWY5y8vC3VC3fY8ogCBDl72c_vXCKyWHkV4t0xW62MKStQLEVNtD88tCc Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60f6f633952f4caaa69b1ad0b8f9efbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 60f6f633952f4caaa69b1ad0b8f9efbd Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1992013529 Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b5d245aada2a45a7b68a1b719cc8d97b Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1992013529-project Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8ec3a341-5b34-480e-b9c3-f44fd61c0170'} Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:18.856175 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. Oct 13 08:49:18.861372 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:18.868945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] Returning 404 to user: Instance 8ec3a341-5b34-480e-b9c3-f44fd61c0170 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:18.870288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b67dbe7d-433a-4c16-80de-97b1b8590472 tempest-ServerMetadataNegativeTestJSON-1992013529 tempest-ServerMetadataNegativeTestJSON-1992013529-project] 10.222.0.23 "GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170" status: 404 len: 111 microversion: 2.1 time: 0.085988 Oct 13 08:49:18.872112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2059/3864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:18 2022] GET /compute/v2.1/servers/8ec3a341-5b34-480e-b9c3-f44fd61c0170 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:18.878857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:18.879742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:18.887341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.890080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.891896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:18.894699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:18.896299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:18.897230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:19.487703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:19.500757 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3595aa0-7571-4369-ba77-54a0d949b4ce tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1488 microversion: 2.1 time: 0.625866 Oct 13 08:49:19.513886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2060/3865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:18 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1488 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:19.526679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:19.527963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:19.531770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=76 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:19.550884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:19.552149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:19.553250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:19.554325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:19.555268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:19.556208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:19.707397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:19.716747 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f863dee-01b2-473a-8d9c-3c216103ae93 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 200 len: 1346 microversion: 2.1 time: 0.202313 Oct 13 08:49:19.720201 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2061/3866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:19 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 1346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:19.750620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:19.751466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:19.773381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:19.774984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:19.777190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:19.778868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:19.781153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:19.781955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:20.121604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:20.338889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:20.357126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25592061-590c-4555-a720-3d6fc677d678 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.613565 Oct 13 08:49:20.357986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2062/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:19 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:20.396981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:20.399332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:20.425308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:20.426092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:20.426884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:20.427846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:20.433817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:20.435296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:20.860644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:20.875711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d65df2b-d564-469f-b6f0-049024a22dac tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1488 microversion: 2.1 time: 0.513113 Oct 13 08:49:20.876310 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2063/3868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:20 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1488 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:20.886295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b403d-5404-4ec8-a28a-1482fe85b046", "tag": "61dd1e46-ef58-48f7-8e1f-cbd92c7c7835"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:20.916579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:20.917462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:20.919261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:20.944169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] Creating event network-changed:61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 for instance 272b403d-5404-4ec8-a28a-1482fe85b046 on n-h1-858384-11 Oct 13 08:49:20.951433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5b8d3bfe-8c1e-40ed-840c-519f2f043d8c req-f674b67a-a111-4b64-b5d0-6cbc1134303d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073010 Oct 13 08:49:20.952974 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2064/3869] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:20.960273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:20.962173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:20.974924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:20.976089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:20.977128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:20.978522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:20.979370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:20.980304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.002272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 HTTP/1.1 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6c9c0797-7694-42d0-8b3e-c09727df6bc4'} Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:21.005458 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.010277 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.012681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:21.014003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4954b814-c32c-49c0-b704-4fdfe09665d4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 404 len: 111 microversion: 2.1 time: 0.058910 Oct 13 08:49:21.015765 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2065/3870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:20 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:21.046671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:21.047929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:21.062121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.067695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.068235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.069038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.069558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.069998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.083208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:21.164943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:49:21.313528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9e4c653-2c2d-4449-91e0-51d33137423e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 204 len: 0 microversion: 2.1 time: 0.295011 Oct 13 08:49:21.314992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2066/3871] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:21 2022] DELETE /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:49:21.330392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:21.335958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:21.348199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.351127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.353178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.353890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.355816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.356685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.393589 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4/os-volume_attachments HTTP/1.1 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': '6c9c0797-7694-42d0-8b3e-c09727df6bc4'} Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:21.397673 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:49:21.403042 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:21.408152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:21.409932 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-817e4459-741f-4d6f-b533-586c3009cfd2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091784 Oct 13 08:49:21.411095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2067/3872] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:49:21 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:21.418350 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9eb57005-870a-45f2-a5f2-75b32b00c651 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.811808 Oct 13 08:49:21.419197 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1806/3873] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:49:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:21.423595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:21.424217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:21.434953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:21.435862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:21.446899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.447755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.448532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.449474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.450092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.450691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.452289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.453337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.453731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.454468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:21.465744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:21.466291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:21.766842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:21.775174 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dcba71a1-7457-4107-bf55-a77fe5f228c0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.355060 Oct 13 08:49:21.777527 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1807/3874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:21 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:21.783468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32cca9bf-7b59-48a9-894d-3afb1640854c tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Action: 'create', calling method: .version_select at 0x7f5375cd3040>, body: {"pool": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:21.945836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:21.954725 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f62a12c-e15b-47e7-a332-f8decd092959 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1494 microversion: 2.1 time: 0.542234 Oct 13 08:49:21.964046 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2068/3875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:21 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:21.985095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1129545111", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:22.096917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:49:23.172711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:49:23.173357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:49:23.173581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:49:23.174223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:49:23.174842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:49:23.195340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:23.196079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:23.196826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:23.197846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:23.198500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:23.200061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:23.249172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:49:23.259081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:49:23.283459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:49:23.286156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:49:23.372731 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bafb26ae-f3ae-4c0b-9e56-6c2d404b1886 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407328 Oct 13 08:49:23.373397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2069/3876] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:49:23.384379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:23.384993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:23.429095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:23.429668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:23.430119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:23.431978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:23.434273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:23.435006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:23.472747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:24.171454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:24.219584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83beea5b-5c60-4720-a35d-889c5805c147 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.832074 Oct 13 08:49:24.223413 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2070/3877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:23 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:24.246923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:24.249444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:24.269273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:24.274984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:24.275557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:24.276334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:24.277012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:24.279576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:24.738701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:24.796846 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42df877d-f1e6-4fbb-ba16-1c0c8cdd1f5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 200 len: 1494 microversion: 2.1 time: 0.569619 Oct 13 08:49:24.797578 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2071/3878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:24 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 1494 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:24.831970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:24.840748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:24.860603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:24.861461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:24.862076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:24.863629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:24.865994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:24.867884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.228187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:25.243962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-24eab0e6-11b4-4cce-a75c-3964ce2c57c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1267 microversion: 2.1 time: 0.421189 Oct 13 08:49:25.244963 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2072/3879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:24 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1267 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:25.250250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96702275-6276-4e96-9127-1a9f8b4e9bfc", "name": "network-vif-deleted", "tag": "d5f8c795-9c7f-407b-919e-3cec523fdf2d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:25.304219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:25.304734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:25.305180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.367562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] Creating event network-vif-deleted:d5f8c795-9c7f-407b-919e-3cec523fdf2d for instance 96702275-6276-4e96-9127-1a9f8b4e9bfc on n-h1-858384-11 Oct 13 08:49:25.403727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a0febace-527e-4457-a193-7270c153d86b req-09ac231c-bdf0-44b4-8fab-6621cca24dd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155858 Oct 13 08:49:25.408909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2073/3880] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:25.430841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:25.431964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:25.481449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:25.481964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:25.482445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.488786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:25.493910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:25.497673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.533385 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32cca9bf-7b59-48a9-894d-3afb1640854c tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.754383 Oct 13 08:49:25.534381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1808/3881] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:49:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:25.540085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:25.540916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:25.587582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:25.590052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:25.594635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.598292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:25.600846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:25.604077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:25.727238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:49:26.035880 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3f93c14-3e4b-480c-ab7e-b4faa0b144cf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 204 len: 0 microversion: 2.1 time: 0.499949 Oct 13 08:49:26.037248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1809/3882] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:25 2022] DELETE /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:49:26.044215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6121649d-a3f7-420e-92c8-94f73d6c4f8e tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Action: 'create', calling method: .version_select at 0x7f5375f44550>, body: {"pool": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:26.505836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:26.518624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1862c806-a70c-4180-bcaf-b9fd6d538077 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 1.108288 Oct 13 08:49:26.519564 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2074/3883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:25 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:26.531932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:26.532856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:26.544102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.545971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.548152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.549182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.551033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.551727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.592252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc HTTP/1.1 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '96702275-6276-4e96-9127-1a9f8b4e9bfc'} Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.594999 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.599539 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.607264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:26.609448 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcf6bdaa-9d6e-4fe0-8560-63c2a51425fc tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 404 len: 111 microversion: 2.1 time: 0.087494 Oct 13 08:49:26.612673 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2075/3884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:26 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:26.622880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:26.630070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:26.645065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.645570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.646011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.646766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.647302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.647731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.787930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:26.797644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6340bf53-d4c9-4eda-a5a6-72ee73e1cb72 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1273 microversion: 2.1 time: 0.183635 Oct 13 08:49:26.800866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2076/3885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:26 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:26.812246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:26.813070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:26.825336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.832328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.833055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.833975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.834999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.835631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.864838 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc HTTP/1.1 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '96702275-6276-4e96-9127-1a9f8b4e9bfc'} Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:26.866868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.872122 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.873703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:26.875916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1534132-440d-4998-b06a-647ac7d99c5c tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 404 len: 111 microversion: 2.1 time: 0.072049 Oct 13 08:49:26.878819 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2077/3886] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:26 2022] DELETE /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:26.894106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:26.894952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 96702275-6276-4e96-9127-1a9f8b4e9bfc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:26.910785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.911607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.912214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.913183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.913809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.914435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.929391 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc HTTP/1.1 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '96702275-6276-4e96-9127-1a9f8b4e9bfc'} Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.931860 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 96702275-6276-4e96-9127-1a9f8b4e9bfc could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-850bdb99-bbc8-4a71-849d-6be548001383 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc" status: 404 len: 111 microversion: 2.1 time: 0.043453 Oct 13 08:49:26.938421 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2078/3887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:26 2022] GET /compute/v2.1/servers/96702275-6276-4e96-9127-1a9f8b4e9bfc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:26.943407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:26.944024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:26.950303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.951051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.951593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.952403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:26.953041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:26.953570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:26.994008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d HTTP/1.1 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '00257390-2211-4b20-a485-fea5720afa6d'} Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:26.996840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d4164ae-093a-4a5e-9ccc-9f6633841bb7 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 404 len: 111 microversion: 2.1 time: 0.059134 Oct 13 08:49:27.001965 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2079/3888] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:26 2022] DELETE /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.008495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.009150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 00257390-2211-4b20-a485-fea5720afa6d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.026164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.026685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.027124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.027842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.028290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.029865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.058275 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d HTTP/1.1 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '00257390-2211-4b20-a485-fea5720afa6d'} Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.067172 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 00257390-2211-4b20-a485-fea5720afa6d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-498b822d-9875-42b9-ad52-921d2f5e5e16 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d" status: 404 len: 111 microversion: 2.1 time: 0.063913 Oct 13 08:49:27.074584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2080/3889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:27 2022] GET /compute/v2.1/servers/00257390-2211-4b20-a485-fea5720afa6d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.081447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.090200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.098091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.098883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.099560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.100488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.101148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.101794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.118284 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 HTTP/1.1 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8c4420b5-da0a-4d63-9022-f352c79fe4f2'} Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.120249 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.127615 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.130437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.131415 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fde22eb1-a769-4359-aa33-4a1e459b8334 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 404 len: 111 microversion: 2.1 time: 0.055001 Oct 13 08:49:27.135627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2081/3890] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:27 2022] DELETE /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.143120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.144239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 8c4420b5-da0a-4d63-9022-f352c79fe4f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.152165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.153014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.153824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.155030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.156433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.157405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.196893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 HTTP/1.1 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8c4420b5-da0a-4d63-9022-f352c79fe4f2'} Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.202604 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. Oct 13 08:49:27.208095 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.209646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 8c4420b5-da0a-4d63-9022-f352c79fe4f2 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.226685 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e86b1c1e-3b01-4f6a-9acc-74e06b59d3dd tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2" status: 404 len: 111 microversion: 2.1 time: 0.088612 Oct 13 08:49:27.229341 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2082/3891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:27 2022] GET /compute/v2.1/servers/8c4420b5-da0a-4d63-9022-f352c79fe4f2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.255514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.258199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.290767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.297501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.299066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.302037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.306231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.308929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.346228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 HTTP/1.1 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b2534080-aa36-404f-9a80-6efe22745775'} Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.349254 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.356328 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.359594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.361494 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c07420da-9d4e-4493-b5bc-c27432aa4f5e tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 404 len: 111 microversion: 2.1 time: 0.127085 Oct 13 08:49:27.362863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2083/3892] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:27 2022] DELETE /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.375881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.376896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: b2534080-aa36-404f-9a80-6efe22745775] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.388247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.389394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.391615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.392688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.393867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.395332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.426691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 HTTP/1.1 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b2534080-aa36-404f-9a80-6efe22745775'} Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.432525 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. Oct 13 08:49:27.437286 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.439473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance b2534080-aa36-404f-9a80-6efe22745775 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.440636 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c917563-b3ad-47e8-a08f-a1e21a884417 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775" status: 404 len: 111 microversion: 2.1 time: 0.073895 Oct 13 08:49:27.442937 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2084/3893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:27 2022] GET /compute/v2.1/servers/b2534080-aa36-404f-9a80-6efe22745775 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:49:27.457687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.460722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.470506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.471301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.471951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.472904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.473573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.474216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.521343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 HTTP/1.1 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '77c8f7df-186c-412a-995e-b33ef2e2e7c7'} Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:27.522986 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:27.528019 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:27.551749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:27.552922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c35c180b-dce9-40c0-b75d-ab4c58fd9335 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 404 len: 111 microversion: 2.1 time: 0.105672 Oct 13 08:49:27.553930 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2085/3894] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:27 2022] DELETE /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:27.559604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:27.560474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:27.573657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.576053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.576512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:27.577239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:27.585257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:27.585998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.016926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:28.030181 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-645c8584-3113-4903-918f-ac1896336f22 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.474944 Oct 13 08:49:28.031185 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2086/3895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:27 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:28.050669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.051364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 77c8f7df-186c-412a-995e-b33ef2e2e7c7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.060885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.062776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.064114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.065421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.068388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.070022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.085888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 HTTP/1.1 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '77c8f7df-186c-412a-995e-b33ef2e2e7c7'} Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.087874 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 77c8f7df-186c-412a-995e-b33ef2e2e7c7 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f8441a4-265a-461f-a7ed-08a200aacbeb tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7" status: 404 len: 111 microversion: 2.1 time: 0.059183 Oct 13 08:49:28.094090 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2087/3896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:28 2022] GET /compute/v2.1/servers/77c8f7df-186c-412a-995e-b33ef2e2e7c7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:28.099609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b403d-5404-4ec8-a28a-1482fe85b046", "name": "network-vif-plugged", "status": "completed", "tag": "61dd1e46-ef58-48f7-8e1f-cbd92c7c7835"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:28.109951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.110388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.110883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.137896 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] Creating event network-vif-plugged:61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 for instance 272b403d-5404-4ec8-a28a-1482fe85b046 on n-h1-858384-11 Oct 13 08:49:28.148962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3936503e-60c6-4bca-b91b-ec24caf1e549 req-6eb457a9-9614-44cc-b860-20096c38b952 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052818 Oct 13 08:49:28.149590 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2088/3897] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:28.154984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.155633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.192763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.195144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.196040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.197097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.197804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.198502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.341528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:28.361175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6b129c7-7de5-4685-b185-28bbe8aa1f95 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1273 microversion: 2.1 time: 0.209413 Oct 13 08:49:28.363377 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2089/3898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:28 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:28.384078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.387689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.403166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.405475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.406938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.409495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.410155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.412223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.455648 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 HTTP/1.1 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '118c9803-57d5-4674-a598-94ab63ad0b23'} Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:28.459778 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.464749 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.467128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:28.469040 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75d4ea5e-2459-4b61-b284-fa7926641484 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 404 len: 111 microversion: 2.1 time: 0.101591 Oct 13 08:49:28.470179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2090/3899] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:28 2022] DELETE /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:28.487133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.489870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 118c9803-57d5-4674-a598-94ab63ad0b23] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.509720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.512071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.512722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.513647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.517933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.518831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.553730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 HTTP/1.1 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '118c9803-57d5-4674-a598-94ab63ad0b23'} Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.555797 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 118c9803-57d5-4674-a598-94ab63ad0b23 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0c97244-1350-4ded-8139-d821dc942375 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23" status: 404 len: 111 microversion: 2.1 time: 0.081953 Oct 13 08:49:28.571242 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2091/3900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:28 2022] GET /compute/v2.1/servers/118c9803-57d5-4674-a598-94ab63ad0b23 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:28.573024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.573024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.594154 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 HTTP/1.1 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '22e6af67-729b-4f06-8dc5-f1602a27b138'} Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.611149 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:28.616398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-180d0053-4c8b-4a45-81d3-f37ec7f5d7b0 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138" status: 404 len: 111 microversion: 2.1 time: 0.047142 Oct 13 08:49:28.618819 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2092/3901] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:28 2022] DELETE /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:28.641283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.641961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: 22e6af67-729b-4f06-8dc5-f1602a27b138] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.673507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 HTTP/1.1 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '22e6af67-729b-4f06-8dc5-f1602a27b138'} Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:28.679447 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance 22e6af67-729b-4f06-8dc5-f1602a27b138 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-935e42c5-a313-4f7c-9d58-f14fb7c17017 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138" status: 404 len: 111 microversion: 2.1 time: 0.060899 Oct 13 08:49:28.684543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2093/3902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:28 2022] GET /compute/v2.1/servers/22e6af67-729b-4f06-8dc5-f1602a27b138 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:28.696427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:28.696930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:28.719622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.724437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.724915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.725624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:28.726092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:28.743929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:28.856039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:49:29.061179 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35495f0c-8308-4c8e-8d92-822f4bbfe807 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 204 len: 0 microversion: 2.1 time: 0.368680 Oct 13 08:49:29.063292 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2094/3903] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:49:28 2022] DELETE /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:49:29.079469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:29.080415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:29.095008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.096570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.098364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.100155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.100947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.102259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.457340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:29.466844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36ddf572-2f15-423a-8b49-094709ea5429 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1316 microversion: 2.1 time: 0.402135 Oct 13 08:49:29.470050 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2095/3904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:29 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:29.486802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:29.488059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:29.502930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.503799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.506187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.507501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.509212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.509651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.810699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:29.831307 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-122b847b-e106-4fe9-8e52-b9fdb0623221 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1480 microversion: 2.1 time: 0.358585 Oct 13 08:49:29.831948 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2096/3905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:29 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1480 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:29.850977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:29.851813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:29.863786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.865697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.866858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.868938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:29.872129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:29.872848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:29.928677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:30.264207 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6121649d-a3f7-420e-92c8-94f73d6c4f8e tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.220997 Oct 13 08:49:30.266935 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1810/3906] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:49:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:30.279612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66cbe5cf-36c2-435d-aec6-e3e095a65144 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5375cd3b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:30.528761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:30.545944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4ac93cec-fd71-4e61-8bfd-c7fef98f290e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1315 microversion: 2.1 time: 0.710604 Oct 13 08:49:30.547782 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2097/3907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:29 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:30.569510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:30.574805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:30.588046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:30.594524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:30.595020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:30.597844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:30.599231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:30.605815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:30.610234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:30.960478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:30.970879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-044f90c3-cfd8-4c66-a6e8-a91ff0865abd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1504 microversion: 2.1 time: 0.420526 Oct 13 08:49:30.974668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2098/3908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:30 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:30.984156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:30.985524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:31.006617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:31.007423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:31.007984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:31.008827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:31.015221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:31.016244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:31.057723 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66cbe5cf-36c2-435d-aec6-e3e095a65144 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/0c9ebafb-695f-4509-ad26-47af6569ae3d" status: 200 len: 142 microversion: 2.1 time: 0.782816 Oct 13 08:49:31.058727 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1811/3909] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 08:49:30 2022] GET /compute/v2.1/os-floating-ips/0c9ebafb-695f-4509-ad26-47af6569ae3d => generated 142 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:49:31.065919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1159037440"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:31.066859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:31.082599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:31.083445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:31.084268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:31.085447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:31.086109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:31.086841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:31.548880 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Adding security group 066931cf-0e3f-412e-be94-41257b3fed25 to port 61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 Oct 13 08:49:31.856109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4133b88d56d448f08fa91ca83abff2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc055633d3144829dd046c34e58aaaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:31.872060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2550fd1a-21d0-49d3-8516-1893c6d8ec5a tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 200 len: 1480 microversion: 2.1 time: 0.894883 Oct 13 08:49:31.874088 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2099/3910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:30 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 1480 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:31.895171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-66658a3f-63aa-4066-9783-795b988d562d tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5376521b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:33.089235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc54dabb-6df8-48ff-bd12-fcb7c24ba388 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/action" status: 202 len: 0 microversion: 2.1 time: 2.028894 Oct 13 08:49:33.090176 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1812/3911] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:49:31 2022] POST /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/action => generated 0 bytes in 2031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:33.095700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:33.096328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:33.111215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.115739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.116335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.117205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.117786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.118345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.223297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:33.267568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:33.528888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:33.547264 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4aeb9942-3c07-4615-b36d-0413cca0c527 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1315 microversion: 2.1 time: 0.454219 Oct 13 08:49:33.550623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1813/3912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:33 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:33.556376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcaad3ad-ed17-4741-9e03-5e7ced47ecdc", "name": "network-vif-deleted", "tag": "7239aa63-4869-413c-9a36-a17a519f08b0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:33.572081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.572884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.578659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.594582 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] Creating event network-vif-deleted:7239aa63-4869-413c-9a36-a17a519f08b0 for instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc on n-h2-858384-11 Oct 13 08:49:33.602631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-63a30413-5b9e-4bb6-ad67-89e69454ced3 req-175e5e8a-9669-4c72-b669-4900fad3436f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050756 Oct 13 08:49:33.604821 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1814/3913] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:33.622652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:33.623425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] [instance: dcaad3ad-ed17-4741-9e03-5e7ced47ecdc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:33.638771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.641583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.642293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.644339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.645435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.646701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.675525 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] HTTP exception thrown: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Request method failure captured: Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc HTTP/1.1 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR8_0-BQod9x3YpsQt0HO8VXkRupTZlLOJv9ro981wwy8ALo04nPh1kencmkZhcL9UYR-z1RGCNUl21xU9MI_NafEA8ndX7NK6RnUQuggFLbffaFXsObmEwI2NvpZu3TvklIFU2O_UOxtM0XpUv11F1rIzonEYKIiGDvP-BRv79oGZDI Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bcc055633d3144829dd046c34e58aaaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestJSON-1818112569 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: bcc055633d3144829dd046c34e58aaaf Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestJSON-1818112569 Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 4133b88d56d448f08fa91ca83abff2ad Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestJSON-1818112569-project Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'dcaad3ad-ed17-4741-9e03-5e7ced47ecdc'} Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:33.677829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. Oct 13 08:49:33.684226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:33.685856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] Returning 404 to user: Instance dcaad3ad-ed17-4741-9e03-5e7ced47ecdc could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:33.693008 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da13832f-5ec0-42a3-9cd0-0a6af3f13522 tempest-ServersTestJSON-1818112569 tempest-ServersTestJSON-1818112569-project] 10.222.0.23 "GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc" status: 404 len: 111 microversion: 2.1 time: 0.082881 Oct 13 08:49:33.693626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1815/3914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:33 2022] GET /compute/v2.1/servers/dcaad3ad-ed17-4741-9e03-5e7ced47ecdc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:33.722357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960919957"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:33.724158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:33.740605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.741180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.743320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.744184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:33.744553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:33.744990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:33.914808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-66658a3f-63aa-4066-9783-795b988d562d tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/0c9ebafb-695f-4509-ad26-47af6569ae3d" status: 202 len: 0 microversion: 2.1 time: 2.027779 Oct 13 08:49:33.917689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2100/3915] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:49:31 2022] DELETE /compute/v2.1/os-floating-ips/0c9ebafb-695f-4509-ad26-47af6569ae3d => generated 0 bytes in 2043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:33.928757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e954593-93e9-4473-8796-a44627da39a1 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5377036790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:34.123576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Adding security group 2f98b4ae-a7ec-468f-bd0d-f1a591753c26 to port 61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 Oct 13 08:49:34.376865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e954593-93e9-4473-8796-a44627da39a1 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.453775 Oct 13 08:49:34.378009 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2101/3916] 10.222.0.23 () {58 vars in 1164 bytes} [Thu Oct 13 08:49:33 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:49:34.397861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35ba23b3-8c85-4455-9d81-6559aa8121e8 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5375c491f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:34.830303 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35ba23b3-8c85-4455-9d81-6559aa8121e8 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.441703 Oct 13 08:49:34.831686 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2102/3917] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:49:34 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:34.838398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:34.840667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:34.860345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:34.861008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:34.862981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:34.863736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:34.878041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:34.885036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:35.266326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:35.284856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d659fa2b-ba56-4d49-ad7f-b2ea30260b5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1315 microversion: 2.1 time: 0.449924 Oct 13 08:49:35.286783 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2103/3918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:34 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:35.298138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff643bc3-a59a-4207-b311-7b4f071b6108 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5375da9430>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:35.758075 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ef9f4fc-723f-42d4-bd8f-814bb3f206fd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/action" status: 202 len: 0 microversion: 2.1 time: 2.051130 Oct 13 08:49:35.759014 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1816/3919] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:49:33 2022] POST /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/action => generated 0 bytes in 2065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:35.766191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b403d-5404-4ec8-a28a-1482fe85b046", "tag": "61dd1e46-ef58-48f7-8e1f-cbd92c7c7835"}, {"name": "network-changed", "server_uuid": "809c9162-3e9f-40c4-a05b-d81c7248acc5", "tag": "2add5d2f-522d-41f4-81c8-ebf63c1b46c3"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:35.801719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:35.802203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:35.802665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:35.841649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Creating event network-changed:61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 for instance 272b403d-5404-4ec8-a28a-1482fe85b046 on n-h1-858384-11 Oct 13 08:49:35.842189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_external_events [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] Unable to find a host for instance 809c9162-3e9f-40c4-a05b-d81c7248acc5. Dropping event network-changed {{(pid=127031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 08:49:35.851150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-24da7a88-e08a-4ff4-bb54-1cac6ee83b6d req-047017b7-f111-48b6-8cde-1fe7e6e3351d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 343 microversion: 2.1 time: 0.090490 Oct 13 08:49:35.851768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1817/3920] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 343 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 08:49:35.863446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:35.866709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:35.883692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:35.884375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:35.885009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:35.885956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:35.886603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:35.887323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:36.493130 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-627a742c-da9f-4981-a999-1b4fd60ed707 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.639684 Oct 13 08:49:36.505082 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1818/3921] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Oct 13 08:49:35 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046/os-security-groups => generated 1157 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:36.510865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:36.512932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:36.527082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:36.530025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:36.530955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:36.532073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:36.533108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:36.534556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:37.139294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:37.154995 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73499b5c-6223-4b15-883c-49af587d8388 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1259 microversion: 2.1 time: 0.646528 Oct 13 08:49:37.155925 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1819/3922] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:36 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1259 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:37.172498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b63fa0d-be93-4700-b3d7-06f67196af95 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5375ed2c10>, body: {"security_group": {"name": " tempest-securitygroup -20008443 ", "description": "tempest-description-876295205"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:37.711228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff643bc3-a59a-4207-b311-7b4f071b6108 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/13ad9b56-7115-4b6b-a03a-41fe4fa1bb23" status: 202 len: 0 microversion: 2.1 time: 2.421823 Oct 13 08:49:37.711979 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2104/3923] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:49:35 2022] DELETE /compute/v2.1/os-floating-ips/13ad9b56-7115-4b6b-a03a-41fe4fa1bb23 => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:37.728213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-98eaee7a-c05b-4171-b509-22177b98ccc9 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f5376deb280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:38.130650 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b63fa0d-be93-4700-b3d7-06f67196af95 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.973018 Oct 13 08:49:38.132380 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1820/3924] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:37 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:38.150943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b403d-5404-4ec8-a28a-1482fe85b046", "tag": "61dd1e46-ef58-48f7-8e1f-cbd92c7c7835"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:38.173741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:38.176354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:38.177212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:38.196255 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] Creating event network-changed:61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 for instance 272b403d-5404-4ec8-a28a-1482fe85b046 on n-h1-858384-11 Oct 13 08:49:38.207858 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3058552b-6d85-49cb-9c58-aaf087c7e4a8 req-900fee38-fdc0-4de4-b76e-7e4126bfea1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067743 Oct 13 08:49:38.209069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1821/3925] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:38.217245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84758aaa-6ccb-4675-a2fb-c3d01cc3de1f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375ed2c10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:38.931022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84758aaa-6ccb-4675-a2fb-c3d01cc3de1f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac" status: 200 len: 221 microversion: 2.1 time: 0.719090 Oct 13 08:49:38.932328 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1822/3926] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:49:38 2022] GET /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac => generated 221 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:38.945171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:38.946175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:38.960953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:38.961719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:38.962357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:38.963281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:38.963907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:38.964502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:39.149404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:39.163028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38b0a3cb-1b42-4aeb-9ade-a9470a44de21 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 200 len: 1217 microversion: 2.1 time: 0.229318 Oct 13 08:49:39.163987 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1823/3927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:38 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:39.179908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f8150e9-af1a-44ab-a53d-c509765530f6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375fb2d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:40.009804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-98eaee7a-c05b-4171-b509-22177b98ccc9 tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/b15ff824-7ceb-480c-80d9-33f0a545a181" status: 202 len: 0 microversion: 2.1 time: 2.293365 Oct 13 08:49:40.010836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2105/3928] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:49:37 2022] DELETE /compute/v2.1/os-floating-ips/b15ff824-7ceb-480c-80d9-33f0a545a181 => generated 0 bytes in 2295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:40.019312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4dccb593-4d42-4c65-adfb-8d519367ca1c tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] Calling method '.version_select at 0x7f53768749d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:40.498652 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f8150e9-af1a-44ab-a53d-c509765530f6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac" status: 202 len: 0 microversion: 2.1 time: 1.333192 Oct 13 08:49:40.499880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1824/3929] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:49:39 2022] DELETE /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:40.517990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:40.519546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:40.539306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:40.540020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:40.540839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:40.541737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:40.542361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:40.542973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:40.563670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 HTTP/1.1 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '809c9162-3e9f-40c4-a05b-d81c7248acc5'} Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:40.565918 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:49:40.571571 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.573870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:40.575296 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9cf0e39-40e7-4f96-8b9e-fd1532172ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 404 len: 111 microversion: 2.1 time: 0.073984 Oct 13 08:49:40.576079 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1825/3930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:40 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:40.581390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375f040d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:40.648343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:49:40.649985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:49:40.650766 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.650766 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac HTTP/1.1 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'a6b0df3d-10c7-46b8-aa89-510fd128c6ac'} Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:49:40.656892 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] Oct 13 08:49:40.661428 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:40.666165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:49:40.666165 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-d8c197b8-d026-4c2c-b55e-fa30de6caf32'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:40.667337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba596aae-c6fd-4f96-a93f-f8e677f9aee8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac" status: 404 len: 194 microversion: 2.1 time: 0.089971 Oct 13 08:49:40.668240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1826/3931] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:49:40 2022] GET /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:40.682242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809c9162-3e9f-40c4-a05b-d81c7248acc5", "name": "network-vif-deleted", "tag": "2add5d2f-522d-41f4-81c8-ebf63c1b46c3"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:40.708159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:40.710951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:40.711755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:40.739131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_external_events [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] Unable to find a host for instance 809c9162-3e9f-40c4-a05b-d81c7248acc5. Dropping event network-vif-deleted {{(pid=127031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 08:49:40.740327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b1af2664-34c9-4fb3-b3dd-cd6ce377889b req-c1df9526-1b24-4c22-91c2-78ccaf3ae4f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.070903 Oct 13 08:49:40.743235 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1827/3932] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 08:49:40.755410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16ebbdcd-86cc-4e95-b507-18cb86040360 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5375fb2820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1697589025", "description": "tempest-description-1655974528"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:41.248935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16ebbdcd-86cc-4e95-b507-18cb86040360 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.504282 Oct 13 08:49:41.250675 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1828/3933] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:41.256641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1005181996", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:41.380743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:49:42.971828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:49:42.972626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:49:42.973177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:49:42.974143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:49:42.974907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:49:42.977180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:42.991339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:42.991999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:42.992554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:42.993436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:42.994165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:42.995106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:43.021468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:49:43.028435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:49:43.045141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:49:43.048727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:49:43.132151 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86370310-a49d-41f8-a74b-1be7ebfebeb7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880047 Oct 13 08:49:43.132974 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1829/3934] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:49:43.140047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d029f5af-dec7-4ba3-aa43-ec936c3286c8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5375eb2550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-481155441", "description": "tempest-description-1340654037"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:43.563898 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d029f5af-dec7-4ba3-aa43-ec936c3286c8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.429297 Oct 13 08:49:43.566797 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1830/3935] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:43 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:43.579717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39049015-ba32-4422-bf4f-ee4fa8750bf2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:43.606500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-39049015-ba32-4422-bf4f-ee4fa8750bf2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:43.782023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-39049015-ba32-4422-bf4f-ee4fa8750bf2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:43.794101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39049015-ba32-4422-bf4f-ee4fa8750bf2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1215 microversion: 2.1 time: 0.224761 Oct 13 08:49:43.796668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1831/3936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:43 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:43.823769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54c6a06e-a0fc-4b37-b853-992a5173f5e2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5375eb2430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1641968781", "description": "tempest-description-86184254"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:44.299617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4dccb593-4d42-4c65-adfb-8d519367ca1c tempest-FloatingIPDetailsTestJSON-72094459 tempest-FloatingIPDetailsTestJSON-72094459-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e91729d3-ade9-4989-a118-b7aae447c7b3" status: 202 len: 0 microversion: 2.1 time: 4.284811 Oct 13 08:49:44.303872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2106/3937] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:49:40 2022] DELETE /compute/v2.1/os-floating-ips/e91729d3-ade9-4989-a118-b7aae447c7b3 => generated 0 bytes in 4286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:49:44.820252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:44.821141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:44.834275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:44.835259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:44.837738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:44.840258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:44.840774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:44.841224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:44.958720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54c6a06e-a0fc-4b37-b853-992a5173f5e2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.160529 Oct 13 08:49:44.960238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1832/3938] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:43 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:44.975961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55a97cbe-2aa8-467c-872e-bdcc6adf2bb5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e63c10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:45.318124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:45.339410 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1ecc951-686d-4f8f-8ef1-ed6ea1624f61 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1275 microversion: 2.1 time: 0.524788 Oct 13 08:49:45.345435 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2107/3939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:44 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1275 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:46.361111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55a97cbe-2aa8-467c-872e-bdcc6adf2bb5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.391487 Oct 13 08:49:46.366839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:46.367854 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1833/3940] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:49:44 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:46.375792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:46.386470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd3697ea-a441-4358-91e0-a9a8676022b7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e9ef70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:46.400162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:46.405912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:46.408272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:46.409914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:46.412154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:46.413202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:46.725046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:46.739211 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfd69945-123a-41fc-83f6-37cf047fe875 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1273 microversion: 2.1 time: 0.375743 Oct 13 08:49:46.750437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2108/3941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:46 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:47.098331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd3697ea-a441-4358-91e0-a9a8676022b7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736" status: 202 len: 0 microversion: 2.1 time: 0.719688 Oct 13 08:49:47.099494 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1834/3942] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:49:46 2022] DELETE /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:49:47.110195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f537abb6160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:47.220048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:49:47.224872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:49:47.225673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.225673 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736 HTTP/1.1 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4dca847a-a5d9-4f62-a878-1c1dcfb91736'} Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:49:47.228464 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] Oct 13 08:49:47.234067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:47.243070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:49:47.243070 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-5e532390-c3f2-4ac9-8afe-ad9473069b6f'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:47.244643 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f54ea38a-13bc-4741-84f4-1da845ee05a4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736" status: 404 len: 194 microversion: 2.1 time: 0.141373 Oct 13 08:49:47.245570 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2109/3943] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:49:47 2022] GET /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736 => generated 194 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:47.256255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf12a5af-1f21-41b8-9790-e7d20fc380ae tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f537a9bfca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:47.769083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:47.769903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:47.783010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:47.786046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:47.789241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:47.791786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:47.793147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:47.794549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:47.900047 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf12a5af-1f21-41b8-9790-e7d20fc380ae tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71" status: 202 len: 0 microversion: 2.1 time: 0.649246 Oct 13 08:49:47.904307 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1835/3944] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:49:47 2022] DELETE /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:47.911316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e10310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:47.994284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:49:47.995636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group dec9a32a-02be-45be-8228-89ccdd830d71 not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71 HTTP/1.1 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'dec9a32a-02be-45be-8228-89ccdd830d71'} Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:49:47.999763 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-2328a0e6-b566-4a4e-9e31-91d56e83c8ed'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad28ec4b-fcb3-4be9-89d1-15709294e2dd tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71" status: 404 len: 194 microversion: 2.1 time: 0.094413 Oct 13 08:49:48.004306 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1836/3945] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:49:47 2022] GET /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:49:48.010335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ce053a1-51f5-4e5a-b02c-5b62236a2963 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e9e820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:48.770045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:48.788377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9d23b38-1e10-4630-a846-c01ee1f2f34e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 1.027585 Oct 13 08:49:48.789762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2110/3946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:47 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:49.114863 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ce053a1-51f5-4e5a-b02c-5b62236a2963 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f" status: 202 len: 0 microversion: 2.1 time: 1.108905 Oct 13 08:49:49.115559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1837/3947] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:49:48 2022] DELETE /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:49:49.123711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375c25940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:49.235049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:49:49.236175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group fe6ab414-2d5f-4330-b8ef-041da4bb247f not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:49:49.237312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.237312 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f HTTP/1.1 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fe6ab414-2d5f-4330-b8ef-041da4bb247f'} Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:49:49.240192 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] Oct 13 08:49:49.245164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:49:49.253225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:49:49.253225 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-1366bdea-fcf4-402e-9dbe-a082dd3a5618'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:49:49.253225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9515dc40-93ca-4a5c-bbed-4b74d78e992e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f" status: 404 len: 194 microversion: 2.1 time: 0.132748 Oct 13 08:49:49.253225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2111/3948] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:49:49 2022] GET /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:49:49.264052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85f1ff67-742b-427d-8f7a-7945a392625e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e9eb80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:49.814761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:49.818125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:49.826134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:49.826989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:49.827628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:49.828558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:49.829812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:49.830488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:50.289567 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85f1ff67-742b-427d-8f7a-7945a392625e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.031415 Oct 13 08:49:50.292272 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1838/3949] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 08:49:49 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:50.298721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51308e09-70a1-4bab-aaf2-4fa88befb877", "tag": "43dd1ca4-5b4a-4b20-8629-f464bbff933a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:50.326240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:50.330146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:50.331061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:50.344721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:50.370546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] Creating event network-changed:43dd1ca4-5b4a-4b20-8629-f464bbff933a for instance 51308e09-70a1-4bab-aaf2-4fa88befb877 on n-h2-858384-11 Oct 13 08:49:50.381721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cbf3d0f3-e23f-4347-a0c3-bbddd75ee9ca req-7d899112-55b1-4b05-84d0-e27caaacc010 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087837 Oct 13 08:49:50.385841 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1839/3950] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:50.399284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a100791-e103-4694-a7c6-1d81b096e4a9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5375eaae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2007065786", "description": "tempest-description-33371138"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:50.465960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:50.482706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aee419b1-37c9-42ea-8bf3-94d86de75225 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 0.672598 Oct 13 08:49:50.508776 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2112/3951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:49 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:51.257062 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a100791-e103-4694-a7c6-1d81b096e4a9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.869536 Oct 13 08:49:51.258019 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1840/3952] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:51.274594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8ce20c8-6525-4841-b940-38b948cb41ea tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f5376ff3430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-60323527", "description": "tempest-description-1887211373"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:51.518024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:51.518814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:51.531916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:51.532417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:51.532849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:51.542862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:51.542862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:51.543323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:52.163311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:52.175731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1f2d201-185f-4891-b44f-2b536a77a069 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 0.662625 Oct 13 08:49:52.197618 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1841/3953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:51 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:52.806063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8ce20c8-6525-4841-b940-38b948cb41ea tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.538568 Oct 13 08:49:52.806769 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2113/3954] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:49:51 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:49:52.951040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1069294345", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "22c30855-76bf-48c2-8764-3909c5e8c7d8"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:53.007928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:53.067037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] validate_networks() for [('22c30855-76bf-48c2-8764-3909c5e8c7d8', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:49:53.221555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:53.224909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:53.288523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:53.289162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:53.289652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:53.292601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:53.293473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:53.294128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:53.792745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:49:54.507053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:54.519651 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46f8f00d-95e3-45d5-99df-bf2c1155221b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 1.313779 Oct 13 08:49:54.521300 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2114/3955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:53 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:55.545249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:55.545990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:55.565434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:55.565935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:55.566378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:55.567123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:55.567575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:55.568001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:56.109941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:49:56.110448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:49:56.113577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:49:56.113577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:49:56.113577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:49:56.144190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:56.150645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:56.151275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:56.152224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:56.152777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:56.153277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:56.210112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Getting quotas for project c9d32647fff54e19bd61d2dcc70a3881. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:49:56.218712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Getting quotas for user c879a7eda44d4b97bd2b3747f0cd02dd and project c9d32647fff54e19bd61d2dcc70a3881. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:49:56.233751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:49:56.236842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:49:56.319489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d66b6a2-cbf6-4872-8d68-9acb2b33aed0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.372493 Oct 13 08:49:56.320793 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1842/3956] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:49:56.333593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27916e7c-bf0b-45b7-9cce-71abaa2c8fa7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:56.336004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27916e7c-bf0b-45b7-9cce-71abaa2c8fa7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:56.575068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:56.584257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27916e7c-bf0b-45b7-9cce-71abaa2c8fa7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:56.621589 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7fbf36ab-08cc-42ef-af11-165f306fe595 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 1.079968 Oct 13 08:49:56.623309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27916e7c-bf0b-45b7-9cce-71abaa2c8fa7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1216 microversion: 2.1 time: 0.295048 Oct 13 08:49:56.625843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1843/3957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:56 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:56.627575 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2115/3958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:55 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:57.651270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:57.653572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:57.655435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1972624122", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:49:57.681952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:57.689361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:57.689746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:57.696590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:57.697084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:57.697540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:57.810620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] validate_networks() for [('4bae9443-cd73-40ab-8560-9507aea16f5d', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:49:57.996652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:58.011239 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1a692db5-1ccd-4e93-ba37-57b81b818a49 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1268 microversion: 2.1 time: 0.364842 Oct 13 08:49:58.018211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2116/3959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:57 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1268 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:58.023385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:58.035767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:58.059316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:58.059823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:58.061490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:58.062240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:58.062729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:58.067803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:58.812456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:58.824986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c9279dd-ba54-4e7a-b611-0e57e1603b36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 0.805130 Oct 13 08:49:58.827744 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2117/3960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:58 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:49:59.052002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:59.053125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:59.064720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.065424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.066029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.067148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.067769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.068363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.264632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:49:59.294276 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5d835d8-a9d7-48db-a86f-5b5a76b876d4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1274 microversion: 2.1 time: 0.250736 Oct 13 08:49:59.296791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2118/3961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:59 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:49:59.722180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:49:59.723542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:49:59.724490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:49:59.725358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:49:59.725950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:49:59.738437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.739718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.740333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.741532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.742177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.742796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.777039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:49:59.783286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for user 6f577a999e944e4ba79bd4771b2ddac2 and project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:49:59.810347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:49:59.812902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:49:59.874221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:59.874940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:59.882566 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4cc43a42-8fe9-4c3a-a98a-f5cc38ff5e47 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.706772 Oct 13 08:49:59.891109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1844/3962] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:49:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:49:59.898889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.901393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.901877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.902660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:49:59.910128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:49:59.910260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:49:59.916060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcd59ea8-e6ca-48f2-b3ae-79f6a7f1ca81 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:49:59.916706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dcd59ea8-e6ca-48f2-b3ae-79f6a7f1ca81 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:49:59.979081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=77 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:00.802539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:00.815099 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0af57368-656c-4a71-b6f3-e19dbe9531a0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 0.947521 Oct 13 08:50:00.856108 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2119/3963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:59 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:00.898052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dcd59ea8-e6ca-48f2-b3ae-79f6a7f1ca81 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:00.913574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dcd59ea8-e6ca-48f2-b3ae-79f6a7f1ca81 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1222 microversion: 2.1 time: 1.014459 Oct 13 08:50:00.915160 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1845/3964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:49:59 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1222 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:00.926882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:00.929787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:00.947655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:00.948557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:00.949294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:00.950690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:00.952747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:00.954471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:01.222114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:01.236477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d2f634e-79a0-4807-bc24-17fcf44e3d02 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1274 microversion: 2.1 time: 0.317223 Oct 13 08:50:01.238028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1846/3965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:00 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:01.301916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51308e09-70a1-4bab-aaf2-4fa88befb877", "name": "network-vif-plugged", "status": "completed", "tag": "43dd1ca4-5b4a-4b20-8629-f464bbff933a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:01.316915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=26 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:01.324306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:01.325211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:01.326214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:01.352367 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] Creating event network-vif-plugged:43dd1ca4-5b4a-4b20-8629-f464bbff933a for instance 51308e09-70a1-4bab-aaf2-4fa88befb877 on n-h2-858384-11 Oct 13 08:50:01.366732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b394ace1-b497-4981-a364-7a3d81e29ed1 req-6fac6767-34fe-4745-98fe-f8d287bdebab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508794 Oct 13 08:50:01.367354 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2120/3966] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:01.374353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-342484479", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:01.472252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] validate_networks() for [('4bae9443-cd73-40ab-8560-9507aea16f5d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:50:01.504575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d61b3e5-c686-4f08-8a68-f0499d2c4929 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f53767b13a0>, body: {"keypair": {"name": "tempest-keypair-612091704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaKxL65OWuK9mXYttrk2MgGNPumExHskZhClkAxpBaMFIhLPsV/YosK8ZVqC6Wgi9vuGbMC7O141ljFndbumMrEQCKb6MtBA/1L9XiB0KSYDOOvX5eyNMCMOJ7dil+oow=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:01.549385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5d61b3e5-c686-4f08-8a68-f0499d2c4929 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:01.564403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5d61b3e5-c686-4f08-8a68-f0499d2c4929 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:01.644423 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d61b3e5-c686-4f08-8a68-f0499d2c4929 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.404609 Oct 13 08:50:01.651368 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1847/3967] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:01.657586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ecaa05b0-772c-4275-aae2-e0ffdbbba8ae tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f537aaa2dc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:01.693585 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ecaa05b0-772c-4275-aae2-e0ffdbbba8ae tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-612091704" status: 200 len: 497 microversion: 2.1 time: 0.038771 Oct 13 08:50:01.695227 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1848/3968] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 08:50:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-612091704 => generated 497 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:01.711111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4e36726-2f67-43d3-9dba-5e1e71f572b8 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375d1e160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:01.752628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4e36726-2f67-43d3-9dba-5e1e71f572b8 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612091704" status: 202 len: 0 microversion: 2.1 time: 0.049487 Oct 13 08:50:01.753809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1849/3969] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612091704 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:01.785492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d1bbe97-6c53-4e72-9815-ab05b13dbaf9 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f5375e5a940>, body: {"keypair": {"name": "tempest-keypair-1728166328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnQ+TVILL/kSlrekBZaHY2lChcutFs1q2JpSdBh4Ql0DvCNFel+P+vYmXEvg1zBNJA8sg05cqU6VURkkG8sB8UVSBRUVf+X2VQLn3+Dglfk6iM2dkWMmarzZgONRxtQjA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:01.870112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1d1bbe97-6c53-4e72-9815-ab05b13dbaf9 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:01.890368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1d1bbe97-6c53-4e72-9815-ab05b13dbaf9 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:01.964038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d1bbe97-6c53-4e72-9815-ab05b13dbaf9 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201750 Oct 13 08:50:01.964737 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1850/3970] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:01.993186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:01.993582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:02.010167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:02.010694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:02.011134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:02.011846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:02.012298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:02.029712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:02.763814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:02.773252 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d7b32f12-169c-40dd-8cda-60ffd4544fa4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 0.807187 Oct 13 08:50:02.777115 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1851/3971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:01 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:02.794556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3699c11b-895e-4032-a24a-0c7ebbb635b4 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375f9f1f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:02.830648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3699c11b-895e-4032-a24a-0c7ebbb635b4 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728166328" status: 202 len: 0 microversion: 2.1 time: 0.052012 Oct 13 08:50:02.831239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1852/3972] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728166328 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:02.844849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:02.851060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:02.854083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=11,nova_api:DELETE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:02.869680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:02.870616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:02.871283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:02.872225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:02.872944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:02.874637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:03.319952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:03.320868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:03.321372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:03.321940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:03.324503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:03.344637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:03.348948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:03.349690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:03.350762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:03.351428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:03.352054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:03.397401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:03.403573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for user 6f577a999e944e4ba79bd4771b2ddac2 and project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:03.438419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:50:03.441349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:50:03.491536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:03.503543 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f4fc260-cfa4-4962-9705-68c1a9d263f2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.670991 Oct 13 08:50:03.506260 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1853/3973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:02 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:03.515269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94662135-ba8f-492f-9b2f-f7869759688f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f5375d1e160>, body: {"keypair": {"name": "tempest-keypair-11881764", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:03.533754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94f8bd5b-1235-47b3-b4cc-c2e69b313730 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.163078 Oct 13 08:50:03.535225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2121/3974] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:50:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:50:03.564483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2558f9af-9f40-4a1e-b80c-bc035e6bfb05 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:03.571920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2558f9af-9f40-4a1e-b80c-bc035e6bfb05 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:03.627286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-94662135-ba8f-492f-9b2f-f7869759688f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:03.638688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-94662135-ba8f-492f-9b2f-f7869759688f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:03.699089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94662135-ba8f-492f-9b2f-f7869759688f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.191443 Oct 13 08:50:03.700672 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1854/3975] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:03 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:03.711071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8adfeaff-2ed1-417a-9bca-7d60a8f2320f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375ee7b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:03.763646 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8adfeaff-2ed1-417a-9bca-7d60a8f2320f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-11881764" status: 202 len: 0 microversion: 2.1 time: 0.056717 Oct 13 08:50:03.765125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1855/3976] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 08:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-11881764 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:03.784140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d70e97d-e1fc-4032-867a-8de49a4be131 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f5375f00f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-151774492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU23Dg6MWlw27m88phbm2UFK7UCbKR2/m8pC+1kbtDgJbVsyepLBPp/aJLv9bpMytOksBS7N1R/Glz+o41p9fXux5CNcYw/lVTYvBtOO1gLrzofQbYd4lsvS8doN7yFlA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:03.816019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d70e97d-e1fc-4032-867a-8de49a4be131 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:03.827299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d70e97d-e1fc-4032-867a-8de49a4be131 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:03.867802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d70e97d-e1fc-4032-867a-8de49a4be131 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094833 Oct 13 08:50:03.880805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1856/3977] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:03.898976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:03.900039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:03.913702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:03.914841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:03.919252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:03.921414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:03.922944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:03.923401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:03.941390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2558f9af-9f40-4a1e-b80c-bc035e6bfb05 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:03.949488 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2558f9af-9f40-4a1e-b80c-bc035e6bfb05 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1221 microversion: 2.1 time: 0.405833 Oct 13 08:50:03.952254 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2122/3978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:03 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1221 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:03.958798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79044279-7803-4d35-809d-01ea682ae76f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f5375c193a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-567737457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ5E1JDfBNOU5FpzMnvZ/q/kS1J6ShlFVWjXp2H03cg25MMFUByqrXI7CkTyoR7XwIbZto6QOWVMQg+XAvjVybGI6FGaI1hVKGyauEzTldQsCHyOhSjBgRqJSnJyFjwnA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:04.021643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-79044279-7803-4d35-809d-01ea682ae76f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:04.054798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-79044279-7803-4d35-809d-01ea682ae76f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:04.146496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79044279-7803-4d35-809d-01ea682ae76f tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.191379 Oct 13 08:50:04.149279 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2123/3979] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:04.162517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f50cb9af-14a9-4896-b999-0cd55598ab56 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Action: 'create', calling method: .version_select at 0x7f5375da0040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-844312690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPTctfdQK/hwIRpJWOxMNm1TSKvdF+DX0S4oEgjih/3ROxK/NkJLbOxs/X4rBrxo1cg9HhpY/2qeW0Ef7taT9bfEPVTif6mx4dIaTwEGoODJU+uaQOSx2OiHbvHSpSn6w=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:04.227953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f50cb9af-14a9-4896-b999-0cd55598ab56 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:04.241014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f50cb9af-14a9-4896-b999-0cd55598ab56 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Getting quotas for user 10e387614f774e2d85de687b45df50e8 and project d4505f1bf21446bbaf7b6a2716fbeda7. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:04.349043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f50cb9af-14a9-4896-b999-0cd55598ab56 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.192054 Oct 13 08:50:04.360940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2124/3980] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:04.370674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d3ac7bb-27f3-4d5d-870f-b226b09fe249 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375bbb9d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:04.381154 n-d-858384-11 devstack@n-api.service[127030]: WARNING oslo_db.sqlalchemy.utils [None req-8d3ac7bb-27f3-4d5d-870f-b226b09fe249 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 13 08:50:04.396389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d3ac7bb-27f3-4d5d-870f-b226b09fe249 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.034182 Oct 13 08:50:04.397299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2125/3981] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:50:04 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:04.409019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-661d9a8e-4552-42f9-92b2-c8efab5bac39 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375c6d280>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:04.450446 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-661d9a8e-4552-42f9-92b2-c8efab5bac39 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-844312690" status: 202 len: 0 microversion: 2.1 time: 0.046351 Oct 13 08:50:04.451806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2126/3982] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-844312690 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:50:04.469087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f80b1e8f-bc25-49fd-94e2-b8b4dc572ca7 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375c38dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:04.517736 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f80b1e8f-bc25-49fd-94e2-b8b4dc572ca7 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-567737457" status: 202 len: 0 microversion: 2.1 time: 0.060316 Oct 13 08:50:04.519290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2127/3983] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-567737457 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:04.540851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0381c50-29f8-4d59-8482-bedd71cd7920 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] Calling method '.version_select at 0x7f5375c494c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:04.606209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0381c50-29f8-4d59-8482-bedd71cd7920 tempest-KeyPairsV2TestJSON-987809558 tempest-KeyPairsV2TestJSON-987809558-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-151774492" status: 202 len: 0 microversion: 2.1 time: 0.080847 Oct 13 08:50:04.608194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2128/3984] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-151774492 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:04.617215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:04.630887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:04.649922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:04.650715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:04.651341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:04.652262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:04.652898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:04.653521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:05.477419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:05.491021 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db17dd3b-20db-4a82-8069-5aa39183a77d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1315 microversion: 2.1 time: 1.608738 Oct 13 08:50:05.491937 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1857/3985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:03 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1315 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:05.496762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:05.505179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:05.515002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:05.515772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:05.520358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:05.521347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:05.522044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:05.522724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:05.572524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:05.586582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77e3cbe2-1ce9-46e7-bffd-75f0b17407b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.977060 Oct 13 08:50:05.591572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2129/3986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:04 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:05.873874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:05.887129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c19a5818-de7d-4b81-8866-086867f310e1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1281 microversion: 2.1 time: 0.393844 Oct 13 08:50:05.887797 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1858/3987] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:05 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:06.517131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:06.519750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:06.534507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:06.539453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:06.539918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:06.542191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:06.542682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:06.543116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:06.624063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:06.626554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:06.641266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:06.646077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:06.647118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:06.649475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:06.650579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:06.652517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.088088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:07.096456 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82b7efa2-c1b0-4cd5-a7c9-5565bacb7227 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1502 microversion: 2.1 time: 0.583097 Oct 13 08:50:07.102871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2130/3988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:06 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1502 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:07.341822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b77467f-18ba-48eb-b6f1-9e756e117b76", "tag": "8a67e02e-c3f7-4028-af3d-1aa1956358f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:07.364063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.368352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.369266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.396648 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] Creating event network-changed:8a67e02e-c3f7-4028-af3d-1aa1956358f6 for instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 on n-h1-858384-11 Oct 13 08:50:07.418733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d6258ddc-6ed2-4953-8ce4-ecde22768bc4 req-8439febd-9cdd-4115-846b-6e3dab864d2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314426 Oct 13 08:50:07.419384 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2131/3989] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:07.433105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:07.434675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:07.447894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.454237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.454913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.455855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.463122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.463821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.655093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:07.676814 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df56f763-56a4-4404-99bd-6a660b227f93 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1279 microversion: 2.1 time: 0.249992 Oct 13 08:50:07.706858 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2132/3990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:07 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:07.721253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:07.723148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:07.748186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.748736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.754535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.755325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.755815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.756253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.917123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b743791-5812-42f9-a57e-f50bef8b0235 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877/action" status: 202 len: 0 microversion: 2.1 time: 0.208696 Oct 13 08:50:07.924979 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2133/3991] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:07 2022] POST /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:07.931595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:07.932296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:07.951990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.954024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.955292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:07.964078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:07.966047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:07.967377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:08.281822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:08.302233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d1e233d-67e1-4feb-aa0b-b18f20d3934b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1507 microversion: 2.1 time: 0.375196 Oct 13 08:50:08.308379 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2134/3992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:07 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:08.351646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:08.379684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ed76b4a-7a28-4363-82a2-98e0050aacbe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 1.766476 Oct 13 08:50:08.387849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1859/3993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:06 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:08.700171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:08.700781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:08.712006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:08.712584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:08.714150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:08.715247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:08.715714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:08.719466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:08.922664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:08.959170 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99f3d816-7d25-4cd0-b4a6-32ff800f6fd8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1279 microversion: 2.1 time: 0.254692 Oct 13 08:50:08.966337 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2135/3994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:08 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:09.337974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:09.343839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:09.360253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:09.361529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:09.367167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:09.368445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:09.369137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:09.369911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:09.414525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:09.416139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:09.429335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:09.434673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:09.438505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:09.441288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:09.444339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:09.446707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:09.762227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:10.085292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:10.096234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3b8e55c-7b8f-4124-b5fe-b36d1d20cd46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.689209 Oct 13 08:50:10.097569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2136/3995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:09 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:10.116497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:10.117514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:10.126628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:10.128739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:10.129391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:10.130797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:10.132222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:10.133303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:10.546023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:10.563297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51ab1151-5135-4b34-bc97-95a9e58a9de6 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.464160 Oct 13 08:50:10.566092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2137/3996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:10 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:10.698528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:10.710744 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-058acc42-fade-493a-a528-189a26837e83 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1487 microversion: 2.1 time: 1.377124 Oct 13 08:50:10.711705 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1860/3997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:09 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1487 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:10.739556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:10.740479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:10.758597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:10.760394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:10.761128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:10.765180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:10.767661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:10.768294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:10.813992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:50:11.025043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7a5e333-9454-4f22-ac57-60aa45e0efde tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 204 len: 0 microversion: 2.1 time: 0.291395 Oct 13 08:50:11.036062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2138/3998] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:50:10 2022] DELETE /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:50:11.049813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:11.055094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:11.069525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.071298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.072385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.077228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.079335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.080906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.184468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9a3e22-2c0b-4b97-a186-c84e6846ae1d", "tag": "5f48e4a5-66b7-4172-a211-59c545552e90"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:11.196895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.197798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.198352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.225920 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] Creating event network-changed:5f48e4a5-66b7-4172-a211-59c545552e90 for instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d on n-h1-858384-11 Oct 13 08:50:11.233356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-60d40c20-c06a-485d-a795-28c58e88db5c req-68815fbe-5e07-4d57-9424-90af0376af13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344780 Oct 13 08:50:11.235737 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1861/3999] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:11.241954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:11.242775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:11.249608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.250216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.250772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.251535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.252103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.252595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.312800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:11.321567 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6eb44398-a2be-4655-8039-5a9a1e813c17 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1493 microversion: 2.1 time: 0.280928 Oct 13 08:50:11.322163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2139/4000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:11 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1493 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:11.593754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:11.595289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:11.617476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.618910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.621821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.622899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.625262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.626268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.823157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:11.834954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93388939-7e70-4560-8c0c-c1d83f6b3547 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.249710 Oct 13 08:50:11.835627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2140/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:11 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:11.841467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b77467f-18ba-48eb-b6f1-9e756e117b76", "name": "network-vif-plugged", "status": "completed", "tag": "8a67e02e-c3f7-4028-af3d-1aa1956358f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:11.859315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:11.861504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:11.863446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:11.891533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] Creating event network-vif-plugged:8a67e02e-c3f7-4028-af3d-1aa1956358f6 for instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 on n-h1-858384-11 Oct 13 08:50:11.900601 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-758ab6b8-db95-4172-a0d5-8514772f2b27 req-89cb16f1-9e9c-4340-9ba9-1f153d527c33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061367 Oct 13 08:50:11.902643 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2141/4002] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:11.960842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:11.972682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-303d95ef-fd58-4680-8b74-fd0e4b62977a tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.735466 Oct 13 08:50:11.986429 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1862/4003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:11 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:12.346788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:12.347500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:12.357292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:12.359525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:12.360298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:12.363361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:12.364044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:12.364889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:12.533590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:12.543406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1bafe7b6-a5c1-4b28-8613-136fa79e5782 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1493 microversion: 2.1 time: 0.201752 Oct 13 08:50:12.549372 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2142/4004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:12 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1493 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:12.860768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:12.861926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:12.870342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:12.870998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:12.871570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:12.872395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:12.872944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:12.874116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:12.997168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:12.998712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:13.008073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:13.008609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:13.009013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:13.009727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:13.010187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:13.010653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:13.019399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:13.251276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:13.264237 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d9c60ca-e1d3-4307-a3b8-9b65a6d16907 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.270360 Oct 13 08:50:13.266671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2143/4005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:12 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:13.570992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:13.572224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:13.574379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:13.588164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:13.593244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:13.593953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:13.596018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:13.628313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:13.634988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:13.635491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:13.660450 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ce59ec23-dd41-44ac-a8ae-9e91258fe488 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.803362 Oct 13 08:50:13.664321 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1863/4006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:12 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:14.033451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:14.075092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05c504d7-fdda-48cd-b80d-03fb82e32975 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 200 len: 1493 microversion: 2.1 time: 0.510537 Oct 13 08:50:14.077092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2144/4007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:13 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 1493 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:14.288345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=32 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:14.309573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:14.311825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:14.339450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:14.339973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:14.341216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:14.343370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:14.344261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:14.345753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:14.663280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=16 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:14.897532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c018dfe5-d8be-485a-82a0-897371be64b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: .version_select at 0x7f537ac12ee0>, body: {"keypair": {"name": "tempest-keypair-1106326991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILFQtxHB821Dm4OSVWWhHX5otRoP9bPUzubvnCEprAQbw/bVwC0lLhw57ELz3RLPrO06puUis/tbIcX9XHuuH+X0TolgAPhnv7s7ZcMWD9h/nRc6CFIOYIzdHX34ultnA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:14.914886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:14.924082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c018dfe5-d8be-485a-82a0-897371be64b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for project b33b27b3068d4e799a52eb001d6c1800. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:14.947122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c018dfe5-d8be-485a-82a0-897371be64b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for user 0f5d980244c14d37b8d352b0038a0ee3 and project b33b27b3068d4e799a52eb001d6c1800. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:14.994815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c018dfe5-d8be-485a-82a0-897371be64b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.342520 Oct 13 08:50:14.996216 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2145/4008] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:15.105523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2146233548", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "d49e29fb-d62c-46f3-834a-cda4bc95d8ec"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:15.223587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] validate_networks() for [('d49e29fb-d62c-46f3-834a-cda4bc95d8ec', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:50:15.996967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:16.019101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-830fd927-5abc-4ed7-9a0f-bc503c24b289 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 1.733149 Oct 13 08:50:16.019742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1864/4009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:14 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:16.039225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:16.043306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:16.071968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:16.079531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:16.080331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:16.081111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:16.081586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:16.082023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:16.882496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:16.900899 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b873a10-5aec-4544-911b-b63ff9be78e3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.869727 Oct 13 08:50:16.901533 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1865/4010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:16 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:16.909400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:16.910242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:16.924795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:16.925588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:16.926498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:16.929270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:16.930699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:16.933465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:16.983743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 HTTP/1.1 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '51308e09-70a1-4bab-aaf2-4fa88befb877'} Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:16.988863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:16.995449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-278145ae-aa01-40a9-bec6-bb010fe6f7c6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 404 len: 111 microversion: 2.1 time: 0.090004 Oct 13 08:50:17.002479 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1866/4011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:16 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:17.009866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26bcffe-464d-44d5-be6a-f52f46be2500", "tag": "9fc3c969-9c67-4efd-b2bd-44b5179a906d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:17.021217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:17.021733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:17.022174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:17.064626 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] Creating event network-changed:9fc3c969-9c67-4efd-b2bd-44b5179a906d for instance e26bcffe-464d-44d5-be6a-f52f46be2500 on n-h1-858384-11 Oct 13 08:50:17.072406 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-02d2700a-845f-4e93-9fd3-bc2eda6b1307 req-9bb74c02-0e3f-42fc-a19e-8caae866928e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066167 Oct 13 08:50:17.074704 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1867/4012] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:17.079989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:17.080737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:17.109932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:17.110345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:17.111658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:17.112400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:17.112863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:17.113295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:17.442176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:17.451041 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84911345-3158-422c-8719-a5991bd98c0d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.375087 Oct 13 08:50:17.454768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1868/4013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:17 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:17.460931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-595262603", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:17.563587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:50:18.083562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:18.084172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:18.084436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:18.085173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:18.085682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:18.109349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.109849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.114447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.115329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.115802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.116235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.161660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:18.176020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for user 31ba8f040ba341488b82d5240d3ff474 and project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:18.207877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:50:18.220186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:50:18.324827 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ca16d8f-63c5-4adb-bb58-d8b643d441b2 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.327103 Oct 13 08:50:18.332722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2146/4014] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:50:18.338149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:18.339057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:18.357152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.358363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.359009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.360058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.361229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.361946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.884602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:18.885178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:18.885478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:18.886062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:18.886672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:18.902037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.902895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.903499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.905040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:18.914577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:18.915310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:18.961793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:18.984352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:19.032209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:50:19.036568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:50:19.113963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:19.126987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebc9ed3d-b944-4756-a71e-b846bda72a56 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.792801 Oct 13 08:50:19.127853 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2147/4015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:18 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:19.135253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-769a004e-9ad4-434b-b546-530e2322eaa6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:19.139941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-769a004e-9ad4-434b-b546-530e2322eaa6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:19.168776 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-503a6422-1622-4fb1-a3f1-a416c8507ab6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711913 Oct 13 08:50:19.176626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1869/4016] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:50:19.188107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:19.192456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:19.211975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:19.214676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:19.215363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:19.216473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:19.219113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:19.219841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:19.367099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-769a004e-9ad4-434b-b546-530e2322eaa6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:19.381383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-769a004e-9ad4-434b-b546-530e2322eaa6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1218 microversion: 2.1 time: 0.252136 Oct 13 08:50:19.386225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2148/4017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:19 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1218 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:19.397220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51308e09-70a1-4bab-aaf2-4fa88befb877", "name": "network-vif-deleted", "tag": "43dd1ca4-5b4a-4b20-8629-f464bbff933a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:19.425619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:19.426596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:19.427416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:19.464838 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] Creating event network-vif-deleted:43dd1ca4-5b4a-4b20-8629-f464bbff933a for instance 51308e09-70a1-4bab-aaf2-4fa88befb877 on n-h2-858384-11 Oct 13 08:50:19.475617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9497cb25-38ad-4cc6-801f-c5474d49b346 req-8efc2133-eb5d-454e-8eb0-6f64d7fdf7ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086039 Oct 13 08:50:19.478084 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2149/4018] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:19.494802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdf90de0-13a6-409e-afb8-b4240a6db2c0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:19.499166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdf90de0-13a6-409e-afb8-b4240a6db2c0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:19.582033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:19.599772 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-545287c4-7f24-4a8e-9cc9-8b23960f5b46 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.420402 Oct 13 08:50:19.600388 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1870/4019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:19 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:19.696153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cdf90de0-13a6-409e-afb8-b4240a6db2c0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:19.705093 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdf90de0-13a6-409e-afb8-b4240a6db2c0 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1214 microversion: 2.1 time: 0.224780 Oct 13 08:50:19.710746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2150/4020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:19 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:20.139100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-448763914", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "806f7ab8-11c1-4c81-94b2-9485da4c48dc"}], "security_groups": [{"name": "tempest-securitygroup--709254598"}], "key_name": "tempest-keypair-1106326991", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:20.153505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:20.154826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:20.170974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:20.174826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:20.175598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:20.179002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:20.180414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:20.181628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:20.378071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] validate_networks() for [('806f7ab8-11c1-4c81-94b2-9485da4c48dc', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:50:20.936010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:20.946839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ab5dcab-def4-4abb-b9c5-1f6790633331 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.795836 Oct 13 08:50:20.958629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2151/4021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:20 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:20.963715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:20.963715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:20.977640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:20.978131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:20.978799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:20.981027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:20.982319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:20.983782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.083521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:21.092385 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfa759f2-15f2-42fe-8a47-805c1464e5e5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1276 microversion: 2.1 time: 0.143363 Oct 13 08:50:21.106850 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2152/4022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:20 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:21.112569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:21.113519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:21.131215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.131980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.143202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.144289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.144950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.145560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.418838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:21.438184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c193a994-ebfd-4fd3-9a06-2d1887e8728b tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.329284 Oct 13 08:50:21.439311 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2153/4023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:21 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:21.454136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:21.458963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:21.469507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.470381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.471103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.472072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.472803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.473478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.628216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:21.637359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd55d49d-e370-413a-a2a1-3505d057b496 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1284 microversion: 2.1 time: 0.196812 Oct 13 08:50:21.647356 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2154/4024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:21 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:21.652432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9a3e22-2c0b-4b97-a186-c84e6846ae1d", "name": "network-vif-plugged", "status": "completed", "tag": "5f48e4a5-66b7-4172-a211-59c545552e90"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:21.678769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.679249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.679883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.700263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] Creating event network-vif-plugged:5f48e4a5-66b7-4172-a211-59c545552e90 for instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d on n-h1-858384-11 Oct 13 08:50:21.709641 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3d98af22-cc73-4f98-95f0-7014e5507994 req-9bb9c7ac-9612-4685-b29b-5f21bb1812dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059511 Oct 13 08:50:21.711002 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2155/4025] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:21.899712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:21.899712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:21.899712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:21.899712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:21.900474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:21.916362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.917042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.917368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.918134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.918631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:21.919073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:21.930773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:21.973249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:21.973964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:21.987710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for project b33b27b3068d4e799a52eb001d6c1800. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:21.991099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:21.991630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.000622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for user 0f5d980244c14d37b8d352b0038a0ee3 and project b33b27b3068d4e799a52eb001d6c1800. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:22.001376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.002283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.002903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.003443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.019279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:50:22.022152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:50:22.090613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5ec415b-c6df-47ed-bea7-e93931af1fa4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.955635 Oct 13 08:50:22.093264 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1871/4026] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:50:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:50:22.108338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64c7ea20-a06e-4308-9205-b1bd3061a18d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:22.110313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64c7ea20-a06e-4308-9205-b1bd3061a18d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:22.409973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64c7ea20-a06e-4308-9205-b1bd3061a18d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:22.422318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64c7ea20-a06e-4308-9205-b1bd3061a18d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1237 microversion: 2.1 time: 0.322211 Oct 13 08:50:22.425130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1872/4027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:22 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1237 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:22.444286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:22.444918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:22.471061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:22.475968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.476489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.480707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.481520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.482005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.486847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.508407 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9739ce4c-1dd9-44b2-af1c-573cc2ca3a17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.529027 Oct 13 08:50:22.512184 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2156/4028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:21 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:22.537582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:22.540577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:22.566859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.568027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.568756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.569802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.570549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.571504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.875850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:22.901180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ebc1a3b-d4bf-48db-9225-a230ea6e9af8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1276 microversion: 2.1 time: 0.472239 Oct 13 08:50:22.902513 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1873/4029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:22 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1276 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:22.907525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:22.908376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:22.914995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.916217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.916833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:22.917712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:22.918337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:22.918944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.138312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:23.151245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e76166f3-e100-4cf6-b649-cab718ae6723 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1272 microversion: 2.1 time: 0.247396 Oct 13 08:50:23.151845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1874/4030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:22 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:23.451337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:23.452699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:23.490313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:23.495606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.495958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.499012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.504922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.507797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.508824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.512788 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7193f548-5cee-480b-bb70-b3cdbccf1de2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1316 microversion: 2.1 time: 0.985846 Oct 13 08:50:23.519231 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2157/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:22 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1316 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:23.547286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:23.552405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:23.584562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.588479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.592544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.593702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.599792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.600511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.675213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:23.696628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e479924d-a264-4c87-bf1a-356d57356936 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1233 microversion: 2.1 time: 0.248915 Oct 13 08:50:23.698521 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1875/4032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:23 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1233 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:23.931452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:23.932299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:23.935713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:23.947655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.951249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.953908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:23.957133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:23.958290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:23.959531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.213337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:24.232281 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-430f2ee8-a6f9-4a08-830a-4a01de066086 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1276 microversion: 2.1 time: 0.306522 Oct 13 08:50:24.250676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1876/4033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:23 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1276 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:24.265015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:24.265878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:24.314430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.318996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.321310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.324485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.325247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.326358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.376667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:24.390165 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36654d86-9c42-4576-8157-71c056aeeab1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.851448 Oct 13 08:50:24.399449 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2158/4034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:23 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:24.545279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:24.546091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:24.581124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.581787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.582347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.583816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.584989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.586460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.874884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:24.902383 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0525e249-53e7-4d7a-97ac-e002c7864649 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1272 microversion: 2.1 time: 0.650426 Oct 13 08:50:24.907959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1877/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:24 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1272 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:24.925672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:24.930780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:24.954837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.957574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.958635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:24.962945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:24.963824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:24.964434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:25.158539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:25.173065 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4c491f6-793b-42df-9653-20a1dabed4b2 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1504 microversion: 2.1 time: 0.631623 Oct 13 08:50:25.173675 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2159/4036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:24 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:25.200284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2007065786"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:25.201717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:25.209565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:25.210618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:25.211256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:25.212239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:25.212891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:25.213512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:25.243740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:25.265309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b3b8502-3e51-4ba3-b639-d1a9751acea3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1295 microversion: 2.1 time: 0.349932 Oct 13 08:50:25.266361 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1878/4037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:24 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1295 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:25.277254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:25.278319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:25.291146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:25.291962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:25.292656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:25.293585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:25.294224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:25.296025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:25.577388 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.network.security_group_api [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Adding security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 to port 5f48e4a5-66b7-4172-a211-59c545552e90 Oct 13 08:50:26.211100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:26.221822 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00d15392-c799-488d-93db-e9e466aba032 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.954082 Oct 13 08:50:26.225882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1879/4038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:25 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:26.235927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:26.238953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:26.260948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:26.261471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:26.261926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:26.262702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:26.263173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:26.264174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:26.275954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47f8e5de-ee97-47b6-a3b4-f847b8837b01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action" status: 202 len: 0 microversion: 2.1 time: 1.081400 Oct 13 08:50:26.276580 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2160/4039] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:25 2022] POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:26.536472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9895859f-9ed2-431f-82f9-1f7ffbd6424f tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Action: 'create', calling method: .version_select at 0x7f5375c388b0>, body: {"keypair": {"name": "tempest-keypair-767150305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgR6IMbWQxtowke4G146PPssh8Mn+7mupGJpfHWD0wTo+uoyOJcPNnoKFh98Op1eiEMnpgHMbQPsyn1czUkqmSMmcLs2nCKpkaxjEOZNrXq+krKi35Ay/WxRYKLODDJiQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:26.578915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9895859f-9ed2-431f-82f9-1f7ffbd6424f tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Getting quotas for project ae743f9829d841fc9afc965ed17a32f9. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:26.590166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-9895859f-9ed2-431f-82f9-1f7ffbd6424f tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Getting quotas for user 35baa51647ac4228a92bc6a2ddff6dbe and project ae743f9829d841fc9afc965ed17a32f9. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:26.664571 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9895859f-9ed2-431f-82f9-1f7ffbd6424f tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382416 Oct 13 08:50:26.665288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2161/4040] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:50:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:26.680916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:26.689799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:26.699803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:26.700424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:26.701553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:26.702367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:26.703148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:26.703805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:26.809949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:26.820886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-337d777e-30d1-477a-badf-5f4b8ce571f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.593285 Oct 13 08:50:26.837240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1880/4041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:26 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:26.847847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375f040d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:27.199048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:27.212163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-443b078d-d032-4086-9c62-a76d00e26127 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.537055 Oct 13 08:50:27.214629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2162/4042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:26 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:27.228703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:27.233569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:27.254599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:27.255319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:27.257118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:27.258234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:27.260302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:27.261462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:27.417378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:27.426255 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3239bcb-38f4-49ae-b391-3a857fd62969 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1295 microversion: 2.1 time: 0.210209 Oct 13 08:50:27.431976 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2163/4043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:27 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:27.441537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9a3e22-2c0b-4b97-a186-c84e6846ae1d", "tag": "5f48e4a5-66b7-4172-a211-59c545552e90"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:27.462617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:27.464750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:27.465486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:27.498871 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] Creating event network-changed:5f48e4a5-66b7-4172-a211-59c545552e90 for instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d on n-h1-858384-11 Oct 13 08:50:27.514463 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4010a39d-7c07-4fcb-9b0a-35e21772e011 req-3e475489-3391-475a-b749-f983cf696c9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079662 Oct 13 08:50:27.515585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2164/4044] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:27.533762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:27.537867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:27.549592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:27.550076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:27.550542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:27.551283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:27.551697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:27.552117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:27.975466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:28.003580 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1224f0d-8cfe-4dd0-a5fc-c3ea78a6a76e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.485934 Oct 13 08:50:28.005160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2165/4045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:27 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:28.011962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26bcffe-464d-44d5-be6a-f52f46be2500", "name": "network-vif-plugged", "status": "completed", "tag": "9fc3c969-9c67-4efd-b2bd-44b5179a906d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:28.042082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.049247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.049891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.076866 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] Creating event network-vif-plugged:9fc3c969-9c67-4efd-b2bd-44b5179a906d for instance e26bcffe-464d-44d5-be6a-f52f46be2500 on n-h1-858384-11 Oct 13 08:50:28.090717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-92011753-e255-456a-ab61-aee99cb88065 req-1981f574-17f7-4d0c-8fc2-783bc6247064 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083340 Oct 13 08:50:28.091740 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2166/4046] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:28.096924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:28.097636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:28.113991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.122631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.123686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.125010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.125754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.126320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.135568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:28.195426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:28.415647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use.", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:28.416864 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.416864 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60 HTTP/1.1 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: exception: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6b7ad823-2fbe-4622-90cf-65ca33adeb60'} Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:28.419277 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] Oct 13 08:50:28.427926 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:28.434978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 400 to user: Security Group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 in use. Oct 13 08:50:28.434978 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-4d388e7a-cdf6-4cbb-85c9-026bf55f4197'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:28.434978 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fb92bc1e-49c4-4dc0-aa42-357a26737078 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60" status: 400 len: 185 microversion: 2.1 time: 1.591339 Oct 13 08:50:28.434978 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1881/4047] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:26 2022] DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60 => generated 185 bytes in 1593 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:50:28.445561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:28.450134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:28.468555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.470086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.470572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.471521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.472198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.472870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.664421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:28.684646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdd00130-8580-4d01-8ae8-ed6da1c77703 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 0.589510 Oct 13 08:50:28.686095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2167/4048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:28 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:28.694501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:28.706655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:28.714749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.715667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.716878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.717901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.718630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.719507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.842684 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2eec3496-fd4d-487e-9925-d744ede366a8 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action" status: 202 len: 0 microversion: 2.1 time: 0.153131 Oct 13 08:50:28.845872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2168/4049] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:28 2022] POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:28.854512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:28.855690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:28.872902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.874124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.875176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:28.877445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:28.878622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:28.879468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.043955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:29.060692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6fcd0424-158c-4390-b05a-27858b2343c0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1295 microversion: 2.1 time: 0.211435 Oct 13 08:50:29.067417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2169/4050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:28 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:29.077751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:29.080023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:29.091200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.091940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.092545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.093440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.094190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.094830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.467772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:29.480679 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4ab8fa6-a314-4132-8de6-14155c59022c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1575 microversion: 2.1 time: 0.410943 Oct 13 08:50:29.487340 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2170/4051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:29 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1575 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:29.492456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:29.497508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:29.504593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.505074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.510840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.514744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.515288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.515735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.787432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:29.797797 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d8888a53-def6-44b3-80e1-4021ab05b5a1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 1.360979 Oct 13 08:50:29.799791 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1882/4052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:28 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:29.819793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:29.830233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:29.837302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.838262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.839479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.840991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:29.841771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:29.842443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:29.843077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:29.852672 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b4d4a1a-3cc1-458a-a824-b9e687c56496 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.361439 Oct 13 08:50:29.853446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2171/4053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:29 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:30.087530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:30.089410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:30.102784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.103815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.104582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:30.105523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.106232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.106868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:30.429086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:30.438288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9b97c03-6665-4906-94ca-9fb120d60468 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.355573 Oct 13 08:50:30.442743 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2172/4054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:30 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:30.506212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:30.507955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:30.524285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.529131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.529131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:30.529131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.529534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.533944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:30.945488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:30.962521 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ea73c81-3228-4cf3-8d7b-e051301d4768 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1321 microversion: 2.1 time: 1.159073 Oct 13 08:50:30.964815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1883/4055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:29 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1321 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:30.972635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:30.973607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:30.980743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.981924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.983781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:30.986101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:30.986915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:30.988132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.158768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:31.176150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d11cd82f-2b3a-43ac-b713-2380876dd9d7 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1575 microversion: 2.1 time: 0.674045 Oct 13 08:50:31.182735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2173/4056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:30 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1575 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:31.198940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eff84ef-56d4-4fe5-a671-76415e9c2e90", "tag": "365dbb93-1db2-4792-8eef-649c089bdb0d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:31.217816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:31.218348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:31.218806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.237350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] Creating event network-changed:365dbb93-1db2-4792-8eef-649c089bdb0d for instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 on n-h2-858384-11 Oct 13 08:50:31.247298 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-72eb2c48-8931-46f4-bf5f-2a399a0061e1 req-69340b05-f74e-447b-a530-579ce298980f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062310 Oct 13 08:50:31.249896 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2174/4057] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:31.260310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:31.261714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:31.276574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:31.277705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:31.278547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.279592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:31.280311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:31.280950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.659929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:31.678902 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1b431e8-8098-490e-a384-a14e5c0d32be tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.417150 Oct 13 08:50:31.679863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2175/4058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:31 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:31.689027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:31.689928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:31.696384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:31.703389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:31.705644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:31.710326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.711304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:31.711940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:31.721129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99d81010-d9b0-4fcb-bd1a-82ee04977624 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.754740 Oct 13 08:50:31.723200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:31.725579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1884/4059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:30 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:31.993463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:31.995800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:32.005479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:32.008440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.009454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.010639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.011839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.012808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.014218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.420436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:32.429756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:32.438060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0932110e-1e0a-4c84-8f58-1f149dee63b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.756804 Oct 13 08:50:32.458178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2176/4060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:31 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:32.464036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:32.464968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:32.472709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:32.476343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.477313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.478261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.479548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.480524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.481112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.852697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:32.862119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7316a978-91a5-4625-89df-a74b635c34e9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1575 microversion: 2.1 time: 0.402412 Oct 13 08:50:32.862749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2177/4061] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:32 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1575 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:32.871509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:32.877068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:32.884346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.885488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.886147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.887160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:32.887622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:32.888053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:32.977071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:32.986948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f09d4cb6-f1a3-4dae-be65-9f6c246b9dcf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1515 microversion: 2.1 time: 1.000460 Oct 13 08:50:33.007334 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1885/4062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:31 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1515 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:33.016100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:33.016724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:33.023088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.023589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.024029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.024745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.025363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.025970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.153017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:33.163574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c96c8cc3-e51c-494c-8557-8c1b573443a6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.295653 Oct 13 08:50:33.179603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2178/4063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:32 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:33.187211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:33.191330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:33.198204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.199554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.200067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.201104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.201791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.202227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.233311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'flavor' on Instance uuid e26bcffe-464d-44d5-be6a-f52f46be2500 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:50:33.391741 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb815764-31d9-41cf-af2a-5700254db83b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action" status: 200 len: 32 microversion: 2.1 time: 0.210423 Oct 13 08:50:33.392699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2179/4064] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:33 2022] POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:50:33.410528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef48e06e-362e-47bd-8f27-3c4e8f05f988", "tag": "9368ec10-cf05-46d3-9fbb-d2929c9d5d57"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:33.440411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.441613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.442283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.460732 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] Creating event network-changed:9368ec10-cf05-46d3-9fbb-d2929c9d5d57 for instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 on n-h2-858384-11 Oct 13 08:50:33.476131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-87c04d6b-b290-4be3-a6c7-a7820c682ed6 req-2d8a406f-5128-459b-8ba9-b22866f8bd3c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080694 Oct 13 08:50:33.476769 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2180/4065] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:33.484117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:33.485193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:33.493684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.494439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.495192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.496527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.497371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.502372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.659305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:33.667244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a397178e-6634-4388-820b-9cf60c868502 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.189025 Oct 13 08:50:33.667820 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2181/4066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:33 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:33.672901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:33.673722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:33.680276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.681109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.681742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.682505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:33.683177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:33.683604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:33.699271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:33.830202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:33.838919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a61fe69a-f953-4df0-94f3-641a4113f660 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.170089 Oct 13 08:50:33.842919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2182/4067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:33 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:33.848067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8cb6d5b5-2cdd-408a-a72e-3cadea7e5eca"}], "security_groups": [{"name": "tempest-securitygroup--1384373774"}], "key_name": "tempest-keypair-767150305", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:33.945314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:33.970056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7599ae6-4268-4b69-9d38-aff8ad7062a4 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.958231 Oct 13 08:50:33.983688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1886/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:33 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:33.993004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:33.994041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:33.996887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] validate_networks() for [('8cb6d5b5-2cdd-408a-a72e-3cadea7e5eca', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:50:34.001870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.002670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.003317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.004548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.005247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.005914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.506812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:34.507397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:34.507732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:34.508163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:34.508583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:34.518082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.519177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.519904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.520861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.521812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.522506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.553138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Getting quotas for project ae743f9829d841fc9afc965ed17a32f9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:50:34.565757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Getting quotas for user 35baa51647ac4228a92bc6a2ddff6dbe and project ae743f9829d841fc9afc965ed17a32f9. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:50:34.580885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:50:34.583880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:50:34.623485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:34.651366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a172e7e2-9b33-4515-ba5b-9ae71785bf82 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.807327 Oct 13 08:50:34.659967 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2183/4069] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:50:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:50:34.666129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:34.667192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:34.674063 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b054e422-2c6b-468d-806f-357ed956f5fe tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1575 microversion: 2.1 time: 0.689180 Oct 13 08:50:34.675260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.676029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.676657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.677616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.678446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.679056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.717571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1887/4070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:33 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1575 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:34.740813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d040fb6a-88e8-44aa-842c-5dfe83ec32cb tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:34.741446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d040fb6a-88e8-44aa-842c-5dfe83ec32cb tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:34.840043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d040fb6a-88e8-44aa-842c-5dfe83ec32cb tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:34.859679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d040fb6a-88e8-44aa-842c-5dfe83ec32cb tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1225 microversion: 2.1 time: 0.132030 Oct 13 08:50:34.861621 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1888/4071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:34 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:34.880274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:34.882633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:34.893326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:34.901434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.901878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.902484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.903653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.904519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.904942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4ebfd6a-d5ab-4d95-9d8a-00e092e6b8ae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.242167 Oct 13 08:50:34.905604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.907032 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2184/4072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:34 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:34.920899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:34.921911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:34.933711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.935267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.935779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:34.937013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:34.937790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:34.938618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.167188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:35.188071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1162c586-0b95-408b-aa47-def6f1fd43f9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.279513 Oct 13 08:50:35.189047 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2185/4073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:34 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:35.199800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:35.200831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:35.210148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.210670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.211147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.211858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.212320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.212756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.384175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:35.393694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-663f2a67-b0e2-4d41-bdad-9e574708121e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.202682 Oct 13 08:50:35.394295 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2186/4074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:35 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:35.643972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:35.652824 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51fefcfc-ea5c-45e1-b991-1a77fdb28a9d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.789971 Oct 13 08:50:35.653411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1889/4075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:34 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:35.704472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:35.705146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.761620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a0cad5-37ea-4141-a2a1-b0edefe9af7c", "tag": "ebaa941e-ae3b-4ff6-a00c-9e62819673f8"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:35.778833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.786817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.787582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.804705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] Creating event network-changed:ebaa941e-ae3b-4ff6-a00c-9e62819673f8 for instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c on n-h2-858384-11 Oct 13 08:50:35.822052 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c482ddcb-5f06-4ffa-b4e7-5d3caf024599 req-45c41a6f-3728-4ed5-97fa-8edfab593679 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064348 Oct 13 08:50:35.825390 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1890/4076] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:35.897219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:35.897940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:35.915175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.916200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.916662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:35.917524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:35.917842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:35.918273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.034486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:36.048910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68c429ea-3c01-488e-aa8a-e943055117d1 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1573 microversion: 2.1 time: 0.349449 Oct 13 08:50:36.075328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2187/4077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:35 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1573 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:36.082346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:36.086197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:36.087222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:36.095815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.096527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.097205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.098126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.098829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.099489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.103898 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ee9925a6-db69-4b7b-895f-8a7166a92f63 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1229 microversion: 2.1 time: 0.219466 Oct 13 08:50:36.106723 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1891/4078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:35 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1229 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:36.123382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-60323527"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:36.124012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:36.138228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.138820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.139274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.140001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.140463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.140900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.151018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:36.421109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:36.434183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a492fb5-cec5-42d6-9f29-463138d592b8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.357718 Oct 13 08:50:36.443721 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2188/4079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:36 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:36.458478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:36.459175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:36.481461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.482610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.484454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.486577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.486700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.487128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.651429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:36.659855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc07f044-82d3-4dc4-af10-4e79b59b51bc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.212623 Oct 13 08:50:36.660451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2189/4080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:36 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:36.665421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:36.666025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:36.673043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.673528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.673962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.674677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.675430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.675939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.785311 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Adding security group 887908b5-c5f9-474b-9fbe-7a748002dad2 to port 5f48e4a5-66b7-4172-a211-59c545552e90 Oct 13 08:50:36.839867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:36.850475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e106daa-0fd9-4478-8024-9779a65b4549 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.188468 Oct 13 08:50:36.869358 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2190/4081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:36 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:36.876224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:36.877090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:36.886832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.887594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.888317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:36.889243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:36.889699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:36.890327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.144269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:37.154178 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6badec00-e55d-4709-acaa-007672bc8c25 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.283306 Oct 13 08:50:37.155299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2191/4082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:36 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:37.160443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:37.161259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:37.170430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.171680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.172495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.173551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.174208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.174666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.266486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:37.278383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-63583e44-4d1e-4b7e-b894-1a57287e5061 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1295 microversion: 2.1 time: 0.121842 Oct 13 08:50:37.279341 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2192/4083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:37 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1295 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:37.457227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:37.458177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:37.464985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.465775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.466974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.467868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.468501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.469212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.550823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e58fd86-d6d2-4bd0-86b7-d268035bbf92 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action" status: 202 len: 0 microversion: 2.1 time: 1.441525 Oct 13 08:50:37.552484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1892/4084] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:36 2022] POST /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d/action => generated 0 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:37.560708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e5ed30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:37.721107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:37.735475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90e75e96-c334-4504-b9bd-30ed938e9d16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.282046 Oct 13 08:50:37.737128 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2193/4085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:37 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:37.750274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:37.753338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:37.768519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.769992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.770648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.772501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.773323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.774672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.807275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use.", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:37.808191 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.808191 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2 HTTP/1.1 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: exception: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '887908b5-c5f9-474b-9fbe-7a748002dad2'} Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:37.810425 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 400 to user: Security Group 887908b5-c5f9-474b-9fbe-7a748002dad2 in use. Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-5f3046bc-7461-4354-aa5c-c119db50a91c'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7a1bfc70-58bc-4bdc-99bb-7e77b3a1e055 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2" status: 400 len: 185 microversion: 2.1 time: 0.257161 Oct 13 08:50:37.816315 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1893/4086] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:37 2022] DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2 => generated 185 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:50:37.824245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:37.829138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:37.843824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.851626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.852586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.853661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:37.854326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:37.855133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:37.896112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:50:38.018720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d7e47a2-62e1-4c3f-a344-e2573d74f29d tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 204 len: 0 microversion: 2.1 time: 0.197328 Oct 13 08:50:38.021165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1894/4087] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:50:37 2022] DELETE /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:50:38.030024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9a3e22-2c0b-4b97-a186-c84e6846ae1d", "tag": "5f48e4a5-66b7-4172-a211-59c545552e90"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:38.042552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.044062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.045305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.065160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] Creating event network-changed:5f48e4a5-66b7-4172-a211-59c545552e90 for instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d on n-h1-858384-11 Oct 13 08:50:38.067335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:38.077320 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e6511ad6-c920-4a81-af0c-8496ee4683ed req-66076bde-fe6e-496d-8207-92d067f89dbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051888 Oct 13 08:50:38.081330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1895/4088] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:38.081480 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f4ecee6f-6126-4a00-8ab8-dac4e65e4cc6 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.341850 Oct 13 08:50:38.082113 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2194/4089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:37 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:38.087370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:38.087989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:38.094779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.095581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.096259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.097152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.097785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.098269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:38.099036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.099252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:38.111543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.112592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.113289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.114212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.115215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.116398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.281001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:38.299095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd423602-f228-465b-92f9-6fbeffe42860 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1646 microversion: 2.1 time: 0.215638 Oct 13 08:50:38.299970 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2195/4090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:38 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1646 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:38.321271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:38.322180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:38.328997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.329699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.330555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.331628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.332122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.332748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.482998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:38.492257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6eca6f3e-8966-499f-a06f-a0e5d1dda8a1 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.175775 Oct 13 08:50:38.492969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2196/4091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:38 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:38.498125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:38.499303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:38.504931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:38.505991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.507002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.507747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.508674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.509143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.509623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.512758 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43a1a922-b2cc-4412-893e-885af7c0661f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.430017 Oct 13 08:50:38.513920 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1896/4092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:38 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:38.583250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:38.592015 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62a5cefd-0a08-4320-8a54-391512f4c332 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1295 microversion: 2.1 time: 0.098030 Oct 13 08:50:38.592915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2197/4093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:38 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:38.763317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:38.764640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:38.771817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.772311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.772755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:38.773471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:38.773948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:38.774764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.110798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:39.112394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:39.128296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.129940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.130424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.134050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.134747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.135358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.346676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:39.355980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2da5161-6743-4026-bb7c-c32d1db8e573 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.253356 Oct 13 08:50:39.357181 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2198/4094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:39 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:39.362044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:39.362803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:39.369326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.370011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.370557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.372084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.373721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.374394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.645834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:39.648935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:39.658542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-228ac813-4d68-4a75-858f-befbbfb42c72 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1646 microversion: 2.1 time: 0.299656 Oct 13 08:50:39.676806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2199/4095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:39 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1646 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:39.685129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:39.685928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:39.689886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:39.695506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.695997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.696434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.697138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.697589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.698010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.704187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4be6d864-5293-4629-9b5f-e970809958da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.941143 Oct 13 08:50:39.704955 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1897/4096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:38 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:39.720152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:39.722769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:39.736716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.737373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.737999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.738749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.739217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.739684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.914118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:39.932277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-809d8c40-7b01-407e-a3e3-b89794b1ef9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.253921 Oct 13 08:50:39.933729 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2200/4097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:39 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:39.942095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:39.943300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:39.954174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.954690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.955118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:39.955832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:39.956333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:39.957418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.176443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:40.185742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9974e6f8-19d6-43ff-8801-43f5d9e07cef tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.250664 Oct 13 08:50:40.199272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2201/4098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:39 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:40.208382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eff84ef-56d4-4fe5-a671-76415e9c2e90", "name": "network-vif-plugged", "status": "completed", "tag": "365dbb93-1db2-4792-8eef-649c089bdb0d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:40.220119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.220746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.221494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.236858 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] Creating event network-vif-plugged:365dbb93-1db2-4792-8eef-649c089bdb0d for instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 on n-h2-858384-11 Oct 13 08:50:40.244050 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0211eec3-90fe-4628-8f92-f55dc9ee5147 req-93056617-ac65-40c3-bad9-2e2b28bd5898 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042941 Oct 13 08:50:40.251551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2202/4099] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:40.382511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:40.384020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:40.392731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.393272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.393921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.395376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.395942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.396384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.622359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:40.631212 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d32e98dd-1ab1-49ae-8eee-6637da62db91 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.253186 Oct 13 08:50:40.631984 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2203/4100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:40 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:40.684885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:40.686497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:40.692606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.693256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.693802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.694737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.695317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.695847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.952727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:40.961108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d8c8b53-e62a-4878-a5d3-b8bcf5234d41 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1646 microversion: 2.1 time: 0.280634 Oct 13 08:50:40.971698 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2204/4101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:40 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1646 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:40.971698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:40.971698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:40.976256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.976976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.978080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:40.979497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:40.980158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:40.981317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.088640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:41.097353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4847b167-cec7-4742-9c54-9cafeb055656 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 1.391039 Oct 13 08:50:41.098026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1898/4102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:39 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:41.104184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:41.105166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:41.111772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.112772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.113415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.114311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.115091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.115691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.633754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:41.642332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b470ccda-33d0-4447-b0c6-2fcf5dcf2221 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.679298 Oct 13 08:50:41.658744 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2205/4103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:40 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:41.664371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:41.664982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:41.673667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.674389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.675010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.675888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.676508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.677665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.705818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:41.728254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-713eeb23-49a3-44d7-a057-c331b27471b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.628246 Oct 13 08:50:41.744694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1899/4104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:41 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:41.755228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83aac8b-837f-4c7f-9cc9-702579b2b650", "tag": "e0ebee5a-7155-4db1-8c83-e248dec36358"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:41.769151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.769890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.770826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.798449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] Creating event network-changed:e0ebee5a-7155-4db1-8c83-e248dec36358 for instance b83aac8b-837f-4c7f-9cc9-702579b2b650 on n-h2-858384-11 Oct 13 08:50:41.805399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9dd5b560-f153-44d2-9495-4468f7f9ce77 req-82652fdb-d644-4a0e-9ed2-56f5cff36c16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058888 Oct 13 08:50:41.806565 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1900/4105] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:41.814240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:41.815603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:41.830792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.833015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.834096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:41.835274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:41.836469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:41.837000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.020108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:42.036456 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee58d528-4422-452c-86b6-68ba02fce451 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.375459 Oct 13 08:50:42.057107 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2206/4106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:41 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:42.067565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:42.069396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:42.078428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.079131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.079777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.081687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.082326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.083648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.200916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:42.202968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:42.213161 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0590a77-3473-4758-92d5-62ef4aacf9b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 200 len: 1468 microversion: 2.1 time: 0.152286 Oct 13 08:50:42.221934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2207/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:42 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 1468 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:42.222432 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d937cce7-6bcc-49b0-b32e-850038fdf838 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.404532 Oct 13 08:50:42.234984 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1901/4108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:41 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:42.239113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:42.246677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:42.270277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.270826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.271267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.271979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.272432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.272856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.396618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9a3e22-2c0b-4b97-a186-c84e6846ae1d", "name": "network-vif-deleted", "tag": "5f48e4a5-66b7-4172-a211-59c545552e90"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:42.420549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.421029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.421470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.438087 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] Creating event network-vif-deleted:5f48e4a5-66b7-4172-a211-59c545552e90 for instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d on n-h1-858384-11 Oct 13 08:50:42.451628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4e4a7caa-4871-44ae-9b7e-21c3be0d6f77 req-cec240ae-2c89-46fc-8d1f-99026b607ac8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058794 Oct 13 08:50:42.456650 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1902/4109] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:42.666334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:42.667031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:42.667536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:42.674680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.675410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.676048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.676952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.677421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.678306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.678599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3c43d9c-c4a1-44c2-96e6-32d78124f861 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.454947 Oct 13 08:50:42.679484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2208/4110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:42 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:42.758461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:42.759945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:42.767638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.768331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.768954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.769866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:42.770542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:42.771170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:42.858825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:42.868384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21534478-578d-4131-990d-954315b6e80a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.206674 Oct 13 08:50:42.868900 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1903/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:42 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:43.002988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:43.017543 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77be8fb2-f62f-4364-ba30-250cf867153f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.267116 Oct 13 08:50:43.018173 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2209/4112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:42 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:43.065434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.066051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:43.085098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.087183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.087839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.090698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.093540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.095846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.259084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.259748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:43.285631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.286141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.286640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.290776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.291524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:43.292296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.302866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.309820 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3d94cbe-2c9a-472e-99fd-874589785d24 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.248357 Oct 13 08:50:43.311690 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1904/4113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:43 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:43.317282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.317986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:43.325828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.326640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.327388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.328348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.329116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.329906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.351606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d HTTP/1.1 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3d9a3e22-2c0b-4b97-a186-c84e6846ae1d'} Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:43.353785 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:43.360703 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:43.362427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:43.363571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7211d279-1616-4f09-93e4-b35bc4d19db9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 404 len: 111 microversion: 2.1 time: 0.050698 Oct 13 08:50:43.365226 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1905/4114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:43 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:43.373979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6862653-c366-47fe-8359-56f7a60b7eb6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375eb2940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.526452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:43.542682 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-179b1b80-d564-4f39-ac78-cdcfed4bd93b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.298175 Oct 13 08:50:43.544910 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2210/4115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:43 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:43.703180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.704046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:43.715602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.717005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.717522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.718307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.722111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.725358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.812250 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6862653-c366-47fe-8359-56f7a60b7eb6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60" status: 202 len: 0 microversion: 2.1 time: 0.442950 Oct 13 08:50:43.813378 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1906/4116] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:43 2022] DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:43.823106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b83c17b-29e9-4090-a2e7-b886b278c084 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375cd38b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.964013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:43.972336 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1ac2616-716f-4da5-8854-2e251435a770 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.272981 Oct 13 08:50:43.973347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2211/4117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:43 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:43.978496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:43.979492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:43.986264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.986930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.987588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:43.988638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:43.989322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:43.990052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.152042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:44.165694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1412ff9-398a-4790-933e-d12542d0860c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1318 microversion: 2.1 time: 0.191001 Oct 13 08:50:44.166935 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2212/4118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:43 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:44.172402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef48e06e-362e-47bd-8f27-3c4e8f05f988", "name": "network-vif-plugged", "status": "completed", "tag": "9368ec10-cf05-46d3-9fbb-d2929c9d5d57"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:44.183524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.184310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.185467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.198136 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] Creating event network-vif-plugged:9368ec10-cf05-46d3-9fbb-d2929c9d5d57 for instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 on n-h2-858384-11 Oct 13 08:50:44.205569 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0c097584-23c9-4242-8595-ace8dc8f0784 req-dc2da6b1-5783-43b4-b504-47ed6d90eb97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Oct 13 08:50:44.206289 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2213/4119] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:44.212313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:44.213026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:44.220144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.220914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.221667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.222383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.222860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.223488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.380268 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b83c17b-29e9-4090-a2e7-b886b278c084 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2" status: 202 len: 0 microversion: 2.1 time: 0.562958 Oct 13 08:50:44.381416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1907/4120] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:43 2022] DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:44.386496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:44.387343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:44.402314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:44.410037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.410563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.410998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.411889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.412772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.413456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.414952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8984057-dfb8-42fd-953c-390c9899a9a2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.207367 Oct 13 08:50:44.415580 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2214/4121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:44 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:44.439057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dd36cf0-3b7f-4813-98ba-002fe9497eb0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'create', calling method: .version_select at 0x7f53758484c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1438014426", "description": "tempest-description-1535041756"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:44.538786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:44.576387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=24 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:44.670689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5dd36cf0-3b7f-4813-98ba-002fe9497eb0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.239061 Oct 13 08:50:44.678025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2215/4122] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:50:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:44.687856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:44.688480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:44.698388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.699052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.699502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.700713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:44.701219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:44.701651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:44.834667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:44.852463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdfc6f6f-cdb5-4cdc-8aad-4b9e07b3b645 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.468561 Oct 13 08:50:44.853341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1908/4123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:44 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:44.857866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:44.871184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7d2fd816-3ede-4402-8acf-ec8a14985db4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Action: 'update', calling method: .version_select at 0x7f5375eb2940>, body: {"security_group": {"name": "tempest-sg-hth-253826779", "description": "tempest-description-hth-83841631"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:45.000266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:45.011756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d47eeed-fa2c-4014-8dbf-308caff2f9b3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.331623 Oct 13 08:50:45.013396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2216/4124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:44 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:45.019724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:45.020530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:45.033848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.034772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.035411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.036460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.037115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.037755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.324280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:45.336585 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4ed90fc8-013b-43b6-906e-72da4f74f90e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.321669 Oct 13 08:50:45.337627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2217/4125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:45 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:45.348821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:45.349870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:45.358390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.361067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.362162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.365951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.367108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.371803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.590760 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7d2fd816-3ede-4402-8acf-ec8a14985db4 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c" status: 200 len: 215 microversion: 2.1 time: 0.735070 Oct 13 08:50:45.591473 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1909/4126] 10.222.0.23 () {60 vars in 1290 bytes} [Thu Oct 13 08:50:44 2022] PUT /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c => generated 215 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:45.596439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:45.597054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:45.605462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.606097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.607288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.608106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.608574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.614895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.851246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:45.854993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:45.882241 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07c1c539-e07b-49c8-a420-f6dccc55e29c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1508 microversion: 2.1 time: 0.543121 Oct 13 08:50:45.883250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2218/4127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:45 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:45.893988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8589c1d-5268-4916-8c91-0c97265545d6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375d5e8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:45.908498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:45.931622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-770f3725-9f1d-4fbc-8f0e-77279272e20d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.339049 Oct 13 08:50:45.935547 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1910/4128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:45 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:45.941237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:45.942096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:45.951224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.952080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.952668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:45.953666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:45.954275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:45.954909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.035833 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8589c1d-5268-4916-8c91-0c97265545d6 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c" status: 200 len: 215 microversion: 2.1 time: 0.151296 Oct 13 08:50:46.038070 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2219/4129] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 08:50:45 2022] GET /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c => generated 215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:46.048937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.049681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.056956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.057500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.058056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.059040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.059569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.060230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.249167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:46.265047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-175b0307-594d-48a8-8f6e-0e55829cd6a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1508 microversion: 2.1 time: 0.225549 Oct 13 08:50:46.268723 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2220/4130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:46 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:46.292536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.296602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:46.300792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.305540 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4213e012-ce26-4d1c-9251-e71e8d6ff3ee tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.368703 Oct 13 08:50:46.309706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:46.311740 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1911/4131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:45 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:46.320498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.320988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.321420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.330434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08cce39e-c43d-4ea6-96d1-530af9f10e66 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f537a9bfca0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.334669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.339386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.339835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.505445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:46.515574 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef7191f1-5b0d-4d6e-a22e-30b3080fb88d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.245407 Oct 13 08:50:46.516238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2221/4132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:46 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:46.530981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:46.535128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.548728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.549548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.550301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.551249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.551700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.552226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.676913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:50:46.677347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:50:46.677828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:50:46.678239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:50:46.678681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:50:46.725269 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08cce39e-c43d-4ea6-96d1-530af9f10e66 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c" status: 202 len: 0 microversion: 2.1 time: 0.408776 Oct 13 08:50:46.725861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1912/4133] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:46 2022] DELETE /compute/v2.1/os-security-groups/3e69b764-1aa1-435f-9d9d-21cab834492c => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:46.732820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.733729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.740071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.740842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.741506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.742502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.743225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.743876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.798663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.810860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.811360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.811805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.812516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.812970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.813394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.868699 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c70450d6-8b37-47bb-b8a8-250e979d3f98 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "POST /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90/action" status: 202 len: 1110 microversion: 2.1 time: 0.344093 Oct 13 08:50:46.875526 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2222/4134] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:46 2022] POST /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90/action => generated 1110 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 13 08:50:46.880320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.880814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.898062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.898607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.899033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.899735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.900195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.900617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.925943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:46.928533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d HTTP/1.1 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '3d9a3e22-2c0b-4b97-a186-c84e6846ae1d'} Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:50:46.930242 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:46.937735 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-274cfe74-d621-466e-b903-18bdc4c95ffb tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 404 len: 111 microversion: 2.1 time: 0.055145 Oct 13 08:50:46.943900 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2223/4135] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:50:46 2022] DELETE /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:46.949261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.950087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.953616 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74f3ad4c-23db-455d-8b16-2b6fb2a84fe1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.226275 Oct 13 08:50:46.954514 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1913/4136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:46 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:46.960464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.961303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.961982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.962948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.963652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.964336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.975995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:46.976679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:46.992641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:46.993967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:46.994750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:46.999069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.001072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.002371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.039870 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d HTTP/1.1 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3d9a3e22-2c0b-4b97-a186-c84e6846ae1d'} Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.041465 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Instance 3d9a3e22-2c0b-4b97-a186-c84e6846ae1d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6e9344f-6364-4037-9ba8-509155f7387c tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d" status: 404 len: 111 microversion: 2.1 time: 0.087370 Oct 13 08:50:47.047727 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1914/4137] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:46 2022] GET /compute/v2.1/servers/3d9a3e22-2c0b-4b97-a186-c84e6846ae1d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:47.050064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.050925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:47.057530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.058031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.058523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.059217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.059775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.060211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.266970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:47.269246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:47.272741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:47.280043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6338f51-d6b5-45ed-ae9c-59968710527f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.233903 Oct 13 08:50:47.280832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1915/4138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:47 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:47.284380 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75b8d512-2e1f-405c-8324-1522c8e9568c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.338939 Oct 13 08:50:47.284993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2224/4139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:46 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:47.305754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375ee7b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.337748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.338507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:47.346474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.346984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.347421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.348143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.348847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.349524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.351783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.352873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group 887908b5-c5f9-474b-9fbe-7a748002dad2 not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.354179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.354179 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2 HTTP/1.1 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '887908b5-c5f9-474b-9fbe-7a748002dad2'} Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.358460 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group 887908b5-c5f9-474b-9fbe-7a748002dad2 does not exist Oct 13 08:50:47.363845 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-33b63620-e9ab-4f5c-a0dd-1ad5056e4189'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.371619 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51524284-96a4-4ebc-9e9a-b3d5e130bd01 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2" status: 404 len: 194 microversion: 2.1 time: 0.082568 Oct 13 08:50:47.371619 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1916/4140] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/887908b5-c5f9-474b-9fbe-7a748002dad2 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:47.381136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e5a820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.421303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.422043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.422692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.422692 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60 HTTP/1.1 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6b7ad823-2fbe-4622-90cf-65ca33adeb60'} Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.425504 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group 6b7ad823-2fbe-4622-90cf-65ca33adeb60 does not exist Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-7b190b0d-7345-45ad-a6df-c4d2ee507e41'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-159b0ff9-c19e-4128-9ed7-b98f9693ec7e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60" status: 404 len: 194 microversion: 2.1 time: 0.056484 Oct 13 08:50:47.435561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1917/4141] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/6b7ad823-2fbe-4622-90cf-65ca33adeb60 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:50:47.444462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375e5a670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.543859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG neutronclient.v2_0.client [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist", "detail": ""}} {{(pid=127031) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.545284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.security_group_api [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group fe6ab414-2d5f-4330-b8ef-041da4bb247f not found {{(pid=127031) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.546427 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.546427 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f HTTP/1.1 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: exception: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fe6ab414-2d5f-4330-b8ef-041da4bb247f'} Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.550730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group fe6ab414-2d5f-4330-b8ef-041da4bb247f does not exist Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: Neutron server returns request_ids: ['req-6648e694-4155-4795-a863-09e3211f677c'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4862c66d-c98f-43bf-8abd-7dec4ce53f48 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f" status: 404 len: 194 microversion: 2.1 time: 0.117706 Oct 13 08:50:47.555561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1918/4142] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/fe6ab414-2d5f-4330-b8ef-041da4bb247f => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:50:47.564655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.564655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:47.566565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:47.572790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.573249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.573696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.574487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.574951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.575979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.585163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ab31b63-ce9d-4237-894c-b6ed4e5bef5b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.251197 Oct 13 08:50:47.587288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2225/4143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:47 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:47.595548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375c599d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.669227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.670088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group dec9a32a-02be-45be-8228-89ccdd830d71 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.670771 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.670771 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71 HTTP/1.1 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'dec9a32a-02be-45be-8228-89ccdd830d71'} Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.672741 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group dec9a32a-02be-45be-8228-89ccdd830d71 does not exist Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-3f7ae873-2efa-4144-a0d1-624121ca0ca2'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.677949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5b0b5fd-d96e-4507-b4a3-f29e4295e100 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71" status: 404 len: 194 microversion: 2.1 time: 0.085953 Oct 13 08:50:47.682904 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2226/4144] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/dec9a32a-02be-45be-8228-89ccdd830d71 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:47.686601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f53758f7820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.775758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.776356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.776862 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.776862 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736 HTTP/1.1 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4dca847a-a5d9-4f62-a878-1c1dcfb91736'} Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.779541 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] Oct 13 08:50:47.784690 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.790324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group 4dca847a-a5d9-4f62-a878-1c1dcfb91736 does not exist Oct 13 08:50:47.790324 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-71a6352b-a97e-46ae-a681-97677e6808d9'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.790324 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e864df7-186a-4c75-a415-5f94b0114f70 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736" status: 404 len: 194 microversion: 2.1 time: 0.106886 Oct 13 08:50:47.791160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2227/4145] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/4dca847a-a5d9-4f62-a878-1c1dcfb91736 => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:50:47.799489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375848820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.824949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:47.838629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c25674b-106d-4f2b-9dc3-bb504a0df08f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.282973 Oct 13 08:50:47.840279 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1919/4146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:47 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:47.912176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG neutronclient.v2_0.client [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist", "detail": ""}} {{(pid=127030) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 13 08:50:47.912788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Neutron security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac not found {{(pid=127030) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 13 08:50:47.913303 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.913303 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac HTTP/1.1 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: exception: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a6b0df3d-10c7-46b8-aa89-510fd128c6ac'} Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 13 08:50:47.915935 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Security group a6b0df3d-10c7-46b8-aa89-510fd128c6ac does not exist Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: Neutron server returns request_ids: ['req-75f7e814-68f2-4afc-86f9-a50dce4bfa71'] {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:47.923262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd6ab798-dd3e-4d9f-bbe3-64beff602a1e tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac" status: 404 len: 194 microversion: 2.1 time: 0.122343 Oct 13 08:50:47.931667 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2228/4147] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/a6b0df3d-10c7-46b8-aa89-510fd128c6ac => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:47.932467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.932467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:47.950475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.951023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.951444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.952166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:47.952620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:47.953046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:47.980739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:47.980739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:47.994909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:50:47.999961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.000559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.001041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.002295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.003123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.004564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.142038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3300670a-3141-4ff2-9958-29d46f6122b0 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 204 len: 0 microversion: 2.1 time: 0.214050 Oct 13 08:50:48.143413 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1920/4148] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:50:47 2022] DELETE /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:50:48.159871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:48.160951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:48.174394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.177985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.178652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.180682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.183131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.183936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.490314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:48.499676 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21dbf2b2-0df8-4493-9a4a-e29df9fdb908 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1647 microversion: 2.1 time: 0.350499 Oct 13 08:50:48.500273 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1921/4149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:48 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1647 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:48.514499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:48.515122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:48.523798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.524302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.524739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.525971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.526454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.526892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.754292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:48.765882 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b01f5cb9-edc4-4330-a76a-ca78e84de585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.260768 Oct 13 08:50:48.766827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1922/4150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:48 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:48.775428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:48.776268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:48.793214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.793745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.794214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.795216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.795853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.796440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.804741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:48.818890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d1833b4-b316-4385-a327-b3d1dd4eab57 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1314 microversion: 2.1 time: 0.844273 Oct 13 08:50:48.820505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2229/4151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:47 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:48.825584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a0cad5-37ea-4141-a2a1-b0edefe9af7c", "name": "network-vif-plugged", "status": "completed", "tag": "ebaa941e-ae3b-4ff6-a00c-9e62819673f8"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:48.836752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.837428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.838062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.853419 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] Creating event network-vif-plugged:ebaa941e-ae3b-4ff6-a00c-9e62819673f8 for instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c on n-h2-858384-11 Oct 13 08:50:48.861872 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-271a81f0-7a58-4648-bfc8-ef1c7e1e2674 req-6cea6a3a-6149-4efe-b3ad-a93cabc8f458 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039527 Oct 13 08:50:48.862516 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2230/4152] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:48.877141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:48.878512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:48.894919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.895852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.896531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:48.897540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:48.898231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:48.899120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.164228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:49.182040 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-127e977e-e826-442f-bb3c-b109619d3370 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.316651 Oct 13 08:50:49.183493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2231/4153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:48 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:49.190832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:49.191681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:49.202734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.203591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.204395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.206124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.208010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.208742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.285056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:49.295102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16c10e04-e380-4df6-a6b1-f1ce04f524d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.526651 Oct 13 08:50:49.295707 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1923/4154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:48 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:49.416617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:49.425927 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d52f4ed-2ae9-48b6-bdb1-827007661d50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.240993 Oct 13 08:50:49.438893 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2232/4155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:49 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:49.524354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:49.529801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:49.559285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.560282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.560730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.561472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.561957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.562387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.792415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:49.793024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:49.799979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.800759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.801418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.802451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.803095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.803688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.900525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:49.908792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4ab6f8f-40b6-4b44-b32b-59d84502dad9 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1647 microversion: 2.1 time: 0.388413 Oct 13 08:50:49.909373 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1924/4156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:49 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1647 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:49.930086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:49.930963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:49.936949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.937689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.938320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:49.939048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:49.939503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:49.939924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.062073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:50.074859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f31c20a-cbb2-4695-8a51-acb0ca5aada0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.285591 Oct 13 08:50:50.094730 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2233/4157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:49 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:50.206196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:50.210518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:50.211605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:50.214254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16aed2b1-5e0e-47f4-8b68-6a3d598c5651 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1501 microversion: 2.1 time: 0.290284 Oct 13 08:50:50.214883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1925/4158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:49 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:50.234243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.238130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:50.238627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.238815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:50.239521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.241201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.242072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.242897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.253963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.254486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.254925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.255624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.256265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.256857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.297115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lazy-loading 'flavor' on Instance uuid ef48e06e-362e-47bd-8f27-3c4e8f05f988 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:50:50.519918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:50.532026 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90cfd882-3a58-4742-b914-0a8cc6d2cad6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.329642 Oct 13 08:50:50.532619 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2234/4159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:50 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:50.537349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:50.538208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:50.545082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.545813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.546250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.547062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.547514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.548120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.572724 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c8b7ad4-1059-49a0-af47-055b02c05361 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988/action" status: 202 len: 0 microversion: 2.1 time: 0.334971 Oct 13 08:50:50.574050 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1926/4160] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:50:50 2022] POST /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:50:50.588477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:50.589442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:50.602187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.603145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.603992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.605737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.607003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.607446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.881206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:50.892820 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3dbfd95b-f060-43ae-b358-c15f1b307bb7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1362 microversion: 2.1 time: 0.317234 Oct 13 08:50:50.893647 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1927/4161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:50 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:50.914850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:50.915707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:50.918066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:50.924053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.924789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.925426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.926319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:50.926968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:50.927596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:50.959404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:50.974457 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d2d249f-e29e-4461-beb2-49b98b5b449b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.440498 Oct 13 08:50:50.982315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2235/4162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:50 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:51.004785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b403d-5404-4ec8-a28a-1482fe85b046", "name": "network-vif-deleted", "tag": "61dd1e46-ef58-48f7-8e1f-cbd92c7c7835"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:51.068100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.068783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.068908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.101716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] Creating event network-vif-deleted:61dd1e46-ef58-48f7-8e1f-cbd92c7c7835 for instance 272b403d-5404-4ec8-a28a-1482fe85b046 on n-h1-858384-11 Oct 13 08:50:51.121834 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6690ff5f-c16a-4b3e-89b6-fb7389f9f9e1 req-eb875a04-9c86-4120-8d02-0d3952774ebb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136949 Oct 13 08:50:51.126459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2236/4163] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:51.142434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:51.146626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:51.155119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.156028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.156747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.157755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.158629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.159313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.217557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.218074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.218568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.219035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lazy-loading 'fault' on Instance uuid 272b403d-5404-4ec8-a28a-1482fe85b046 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:50:51.249689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:51.269898 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e325edc-c350-497f-b8f8-41e2a2b22aa7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.358933 Oct 13 08:50:51.275711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1928/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:50 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:51.283708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:51.284343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:51.290717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.291215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.291658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.292362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.293017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.293660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.395641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c879a7eda44d4b97bd2b3747f0cd02dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d32647fff54e19bd61d2dcc70a3881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:51.407572 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-650070f2-6a04-4b01-a1ac-f010292292e3 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 200 len: 1306 microversion: 2.1 time: 0.277069 Oct 13 08:50:51.408167 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2237/4165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:51 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:51.486222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:51.497163 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f692295f-cedb-4b63-85b7-b1a28a809a1b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.220267 Oct 13 08:50:51.497761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1929/4166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:51 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:51.559762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:51.560602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:51.567424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.568233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.568738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.569577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.570090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.570961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.753817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:51.765033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff4344e6-935d-4bfd-8c9e-02bbecfff1d2 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.209388 Oct 13 08:50:51.765697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2238/4167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:51 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:51.918346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:51.919553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:51.928119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.928721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.929382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:51.930432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:51.931261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:51.931941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.007989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.008813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:52.028580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.032269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.059231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.060787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.061280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.061716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.112234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:52.164110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:52.174099 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4483d4f2-8180-4675-8df5-06ebd1f2e8fa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1549 microversion: 2.1 time: 0.260744 Oct 13 08:50:52.186492 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1930/4168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:51 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:52.198812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.200034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:52.210311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.211149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.211568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.212755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.213363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.213896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.393168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4dde6082-bc40-4d11-880a-fe11ccb01321 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198506 Oct 13 08:50:52.393795 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1931/4169] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:52.398900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.401276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:52.414445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.414949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.427887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.429369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.430145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.431246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.455339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:50:52.524977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:52.536730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f22ec89a-6dbf-4dd6-a2b5-2303a67e7caa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.534182 Oct 13 08:50:52.537330 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2239/4170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:52.548407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83aac8b-837f-4c7f-9cc9-702579b2b650", "name": "network-vif-plugged", "status": "completed", "tag": "e0ebee5a-7155-4db1-8c83-e248dec36358"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:52.569816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.570729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.571530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.589728 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] Creating event network-vif-plugged:e0ebee5a-7155-4db1-8c83-e248dec36358 for instance b83aac8b-837f-4c7f-9cc9-702579b2b650 on n-h2-858384-11 Oct 13 08:50:52.597943 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-65a1df4a-e7a0-4c37-8401-a72dbdb5b325 req-e86d3bb4-887f-49fc-8e49-3f96e1fff103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057353 Oct 13 08:50:52.599204 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2240/4171] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:52.605652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.606896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] [instance: 272b403d-5404-4ec8-a28a-1482fe85b046] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:52.617758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.618273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.618742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.619454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.619939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.620392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.645703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] HTTP exception thrown: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Request method failure captured: Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 HTTP/1.1 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ECcXrnqBldWPJ8VDDEvXXEq_zcBpETNLcy-qD0tmSDw_EYfmbcXOesQfsBIPc7gy5tGn9GJrAfelVT8pmN8VNGxj5ImLTe6y_muudBMwgcma4wi68cpe4hfxBIvdI6VKxVjmuq_erhBGg8ZUMq5bDRoV6NiWJiM9T8Hx8cp1N0jtY Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d32647fff54e19bd61d2dcc70a3881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9d32647fff54e19bd61d2dcc70a3881 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-545494252 Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c879a7eda44d4b97bd2b3747f0cd02dd Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-SecurityGroupsTestJSON-545494252-project Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '272b403d-5404-4ec8-a28a-1482fe85b046'} Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:50:52.650123 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Returning 404 to user: Instance 272b403d-5404-4ec8-a28a-1482fe85b046 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-33244494-45b8-4276-beb0-53ac42ddba5f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046" status: 404 len: 111 microversion: 2.1 time: 0.051051 Oct 13 08:50:52.655829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2241/4172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/272b403d-5404-4ec8-a28a-1482fe85b046 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:50:52.660192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.660818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:52.667917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.668420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.668934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.669651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:52.670106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:52.670566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:52.801289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:52.809672 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a6c0b2f-4929-47b0-a7d6-93c3c810c046 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.414231 Oct 13 08:50:52.824382 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1932/4173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:52.832963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f9136ba-4de6-4251-b687-c4e3605a8a1f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375d030d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:52.974653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:52.983163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-623ed9dc-34ce-4e0f-977c-b1bb2380e3e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.327022 Oct 13 08:50:52.993570 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2242/4174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:53.005941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:53.008047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:53.019124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.020130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.020729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:53.021669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.022463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.023219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:53.264137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:53.281697 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-01c0ee2c-0d69-4dc0-8c71-2ac9bf209970 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.280735 Oct 13 08:50:53.283264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2243/4175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:52 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:53.564188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:53.564896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:53.572152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.572723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.573232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:53.574007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.574560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.575057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:53.654552 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f9136ba-4de6-4251-b687-c4e3605a8a1f tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2f98b4ae-a7ec-468f-bd0d-f1a591753c26" status: 202 len: 0 microversion: 2.1 time: 0.828369 Oct 13 08:50:53.655174 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1933/4176] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:52 2022] DELETE /compute/v2.1/os-security-groups/2f98b4ae-a7ec-468f-bd0d-f1a591753c26 => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:50:53.663309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fae8166-9f38-4794-8672-f411ae2ec4d5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] Calling method '.version_select at 0x7f5375d18af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:53.836448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:53.846559 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba29819e-e72d-4a99-9be4-fe8a1e7fb596 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.286941 Oct 13 08:50:53.847298 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2244/4177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:53 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:53.853124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:53.854005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:53.862089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.862993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.863726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:53.864438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:53.865742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:53.865742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.093228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:54.101935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a6f4e85-0693-41dd-a4cd-2b48dee2e88d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.253253 Oct 13 08:50:54.102576 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2245/4178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:53 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:54.107757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:54.108576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:54.114639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.115433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.116320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.117262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.117939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.118865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.244169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fae8166-9f38-4794-8672-f411ae2ec4d5 tempest-SecurityGroupsTestJSON-545494252 tempest-SecurityGroupsTestJSON-545494252-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/066931cf-0e3f-412e-be94-41257b3fed25" status: 202 len: 0 microversion: 2.1 time: 0.584698 Oct 13 08:50:54.245636 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1934/4179] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:50:53 2022] DELETE /compute/v2.1/os-security-groups/066931cf-0e3f-412e-be94-41257b3fed25 => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:50:54.310345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:54.311031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:54.329901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.336062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.340853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.344399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.344643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:54.349052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.349993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.353137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7996aafe-69e9-444c-8ca5-d6aec940e7ec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.249224 Oct 13 08:50:54.362328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2246/4180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:54 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:54.803240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:54.810793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a0cad5-37ea-4141-a2a1-b0edefe9af7c", "tag": "ebaa941e-ae3b-4ff6-a00c-9e62819673f8"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:54.815752 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4c2e290-e9df-4b24-8d2b-855835437c5e tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1351 microversion: 2.1 time: 0.509798 Oct 13 08:50:54.825861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.827964 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1935/4181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:54 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1351 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:54.843220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.843947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.856396 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] Creating event network-changed:ebaa941e-ae3b-4ff6-a00c-9e62819673f8 for instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c on n-h2-858384-11 Oct 13 08:50:54.871254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3306f530-58ad-4909-8428-cf39f4f5310d req-c8bbc06b-84d1-4517-b3cf-cd45cee5d648 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064545 Oct 13 08:50:54.872954 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2247/4182] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:54.874082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:54.874940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:54.888016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.890462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.891187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:54.892137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:54.892813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:54.896153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.125896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:55.126943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:55.138515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.139263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.151136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.151899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.152373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.152807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.414813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:55.424422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1edef253-a63a-4dba-94ef-e5075e395b41 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.302753 Oct 13 08:50:55.425599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2248/4183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:55 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:55.431229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:55.432059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:55.438225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.438986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.439608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.440500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.441128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.441728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.477299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:55.487086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b84767e0-4e02-4857-a5ee-67553cc1bb2c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.620015 Oct 13 08:50:55.492279 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1936/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:54 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:55.656038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:55.666347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20cfce38-3b86-4ab7-ba7e-6a0e94b8802d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.238877 Oct 13 08:50:55.679439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2249/4185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:55 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:55.852546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:55.853440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:55.860261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.861096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.861727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:55.863241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:55.864729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:55.865358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.396187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:56.412065 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-799d8b09-152d-4577-acb5-426e74c207c7 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1541 microversion: 2.1 time: 0.564406 Oct 13 08:50:56.412831 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1937/4186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:55 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1541 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:56.439065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:56.440193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:56.448543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.449603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.450947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.451880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.452499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.453828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.455631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:56.456550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:56.466558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.469789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.470507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.473787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.474550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.475246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.552014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0829cb53-c8e8-491d-aef5-3dde662ebfb6 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119275 Oct 13 08:50:56.552617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2250/4187] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:50:56 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:50:56.567636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:56.569211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:56.599815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.600621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.602007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.603145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.603874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.604840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.906051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:56.931267 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96ae2458-30d2-4cf4-834b-f393094b5e41 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.370061 Oct 13 08:50:56.948395 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2251/4188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:56 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:56.974349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:56.975440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:56.989028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.990018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.991040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:56.993866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:56.994993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:56.995761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:57.244502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:57.263593 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3efec959-00d9-4a86-a1ca-f2e62eec5fad tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.812227 Oct 13 08:50:57.276096 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1938/4189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:56 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:57.825530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:57.839063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a53ea126-6a6e-4abc-9586-1bcff2c96e30 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.878734 Oct 13 08:50:57.840277 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2252/4190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:56 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:57.973176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:57.973782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:57.980655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:57.981510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:57.982114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:57.983013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:57.983630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:57.984220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:58.304929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:58.307213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:58.319744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:58.320235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:58.320673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:58.321380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:58.321829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:58.322252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:58.427627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:58.441848 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-570b37be-704e-4a6f-a472-3ab890200151 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.472743 Oct 13 08:50:58.446927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1939/4191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:57 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:58.466933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83aac8b-837f-4c7f-9cc9-702579b2b650", "tag": "e0ebee5a-7155-4db1-8c83-e248dec36358"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:50:58.490030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:58.492682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:58.495326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:58.514013 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] Creating event network-changed:e0ebee5a-7155-4db1-8c83-e248dec36358 for instance b83aac8b-837f-4c7f-9cc9-702579b2b650 on n-h2-858384-11 Oct 13 08:50:58.524045 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5613e352-8364-48c0-9546-fad1b28ab7ea req-a2c23405-6697-416c-ad23-a00b937860a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068053 Oct 13 08:50:58.525216 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1940/4192] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:50:58.584371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:58.600598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8c2c1ea-5a5d-494f-904b-4998fd9f2cb8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.308962 Oct 13 08:50:58.616086 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2253/4193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:58 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:58.864574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:58.865534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:58.872678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:58.873617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:58.874160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:58.875123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:58.875758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:58.876370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:59.469436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:59.470220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:59.478271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:59.478876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:59.479387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:59.480186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:59.480723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:59.481278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:59.665178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:59.675445 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1decf821-0ff6-4252-9fe1-909fd23e9fc3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.209958 Oct 13 08:50:59.676050 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2254/4194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:59 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:50:59.694864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:50:59.695482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:50:59.703533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:59.705033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:59.705622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:59.707552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:50:59.708488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:50:59.709099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:50:59.796706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:59.808083 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6c6189a-e5a3-4b02-ad34-5aa2151cfdbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.947598 Oct 13 08:50:59.816880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1941/4195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:58 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:50:59.911763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:50:59.921467 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff9b6d67-e8cb-4614-b27d-85c1a038c1b3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.244363 Oct 13 08:50:59.922428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2255/4196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:50:59 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:00.701156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:00.702105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:00.720268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:00.722731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:00.723422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:00.725524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:00.728681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:00.729378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:00.835903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:00.837203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:00.846686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:00.847413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:00.847850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:00.848990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:00.850248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:00.854077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:01.104385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:01.116691 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27b4d243-3f0d-4322-92ca-569efa05d781 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.420842 Oct 13 08:51:01.119070 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1942/4197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:00 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:01.125246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:01.126274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:01.146775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:01.147594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:01.148211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:01.151851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:01.152506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:01.153824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:01.283368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:01.295286 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c4661bc-1322-4363-8ed0-ed60bf595fcd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.465765 Oct 13 08:51:01.313835 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2256/4198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:00 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:01.413560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:01.422418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2edfdac-3338-4dc6-a546-2fe838e8b89d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.301998 Oct 13 08:51:01.423392 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1943/4199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:01 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:02.149208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:02.149944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:02.163551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.173563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.175393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.176541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.177569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.178192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.321793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:02.322738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:02.334880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.336406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.337821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.341389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.342002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.343154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.683696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:02.693493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a025a28-e3cc-498e-a3a8-abab97992360 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1521 microversion: 2.1 time: 0.375450 Oct 13 08:51:02.709510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1944/4200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:02 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:02.709510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:02.709510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:02.713546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.714043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.714513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.715237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:02.715855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:02.716212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:02.921545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:02.930282 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b72562d3-cbd6-4c24-abf2-d35b90750c96 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.234362 Oct 13 08:51:02.931117 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1945/4201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:02 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:03.129196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:03.137897 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5187c162-9c71-4211-bd72-6bb23f6c2d9f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.992080 Oct 13 08:51:03.138588 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2257/4202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:02 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:03.717738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:03.718993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:03.726314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.727083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.727743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:03.728657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.729200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.729845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:03.891749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:03.900442 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-322a613c-6754-4abc-afba-61750513ade4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1501 microversion: 2.1 time: 0.186788 Oct 13 08:51:03.915066 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1946/4203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:03 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:03.924457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:03.925070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:03.937573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.938437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.938892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:03.939958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.940650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.941264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:03.944467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:03.954847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:03.955888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:03.975182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.975773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.976505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:03.977954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:03.978585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:03.979142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.196624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:04.208058 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45039c72-b5d6-439a-944f-939efe7cc60a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.256357 Oct 13 08:51:04.229218 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1947/4204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:03 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:04.235093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:04.236189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:04.271961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.272470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.272906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.274167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.274942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.275768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.415378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:04.430479 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac95c20e-9758-42ec-8b6c-fea312c588d0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1516 microversion: 2.1 time: 0.507470 Oct 13 08:51:04.444719 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2258/4205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:03 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1516 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:04.461941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:04.469217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b3faabb1-3432-432e-aedb-2a054007f400] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:04.477063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/b3faabb1-3432-432e-aedb-2a054007f400/action HTTP/1.1 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 14 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: {"rescue": {}} Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b3faabb1-3432-432e-aedb-2a054007f400', 'body': {'rescue': {}}} Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:51:04.489156 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. Oct 13 08:51:04.493199 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:51:04.494978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 404 to user: Instance b3faabb1-3432-432e-aedb-2a054007f400 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:51:04.496287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b54bfe00-1d5c-45eb-add6-3c20934ece65 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/b3faabb1-3432-432e-aedb-2a054007f400/action" status: 404 len: 111 microversion: 2.1 time: 0.042309 Oct 13 08:51:04.502308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2259/4206] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:04 2022] POST /compute/v2.1/servers/b3faabb1-3432-432e-aedb-2a054007f400/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:51:04.509490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:04.510207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:04.529564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.530314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.531018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.532264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.532862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.533439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.568399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:04.581843 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3bba5250-9c85-419c-8f6e-a94c90897a96 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.351599 Oct 13 08:51:04.582460 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1948/4207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:04 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:04.663931 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07a14153-5c92-4ed5-be33-78c7a7b91738 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action" status: 202 len: 0 microversion: 2.1 time: 0.159161 Oct 13 08:51:04.664827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2260/4208] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:04 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:51:04.677942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:04.685640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:04.702147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.703728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.704405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:04.718233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:04.718827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:04.719614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:05.237620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:05.240030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:05.249036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:05.251752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:05.252475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:05.253612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:05.254816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:05.255458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:05.256132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:05.265986 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fbdbdb8-96f2-47de-ac46-29988fd84de3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1521 microversion: 2.1 time: 0.592415 Oct 13 08:51:05.273320 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1949/4209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:04 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:05.605033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:05.605846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:05.613118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:05.613802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:05.614240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:05.614967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:05.615566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:05.615996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:05.639059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:05.652790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d38cb73-92a6-4364-9d30-526219810352 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.420348 Oct 13 08:51:05.654608 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2261/4210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:05 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:05.776274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:05.784352 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22b091ea-b67f-480c-84b9-72e335c03dfa tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.183172 Oct 13 08:51:05.784944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1950/4211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:05 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:06.293884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:06.295063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:06.308856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.309425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.312779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:06.314641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.315406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.316244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:06.683132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:06.688447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:06.700367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.700881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.701305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:06.702011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.702490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.711331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:06.765394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:06.777078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:06.788906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a277ef6-bdf5-4a3a-a8ce-8823708820e0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1501 microversion: 2.1 time: 0.499635 Oct 13 08:51:06.789843 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2262/4212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:06 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1501 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:06.809712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:06.809712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:06.832294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.832787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.835582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:06.836329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:06.836805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:06.837234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.049157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:07.060730 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95da18db-49c5-43bd-8148-ad9023f48b25 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.385036 Oct 13 08:51:07.061998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1951/4213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:06 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:07.084164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:07.087822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:07.095701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.096326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.096900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.097731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.098330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.098894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.126114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'flavor' on Instance uuid 8b77467f-18ba-48eb-b6f1-9e756e117b76 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:51:07.141037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Cannot 'rescue' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state paused Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action HTTP/1.1 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 14 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: {"rescue": {}} Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'rescue' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state paused Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8b77467f-18ba-48eb-b6f1-9e756e117b76', 'body': {'rescue': {}}} Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 in vm_state paused. Cannot rescue while the instance is in this state. Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state paused Oct 13 08:51:07.142960 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state paused Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:07.147681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 409 to user: Cannot 'rescue' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state paused {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:51:07.148737 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f5ac617-f2c5-4d0e-99dd-704a03dcd8a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action" status: 409 len: 144 microversion: 2.1 time: 0.072619 Oct 13 08:51:07.149690 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1952/4214] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:07 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action => generated 144 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:51:07.157869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:07.158592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:07.165097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.165715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.166481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.167261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.167848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.168908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.258310 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d72924d6-4b88-4216-9481-e8f25c010b4b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action" status: 202 len: 0 microversion: 2.1 time: 0.103692 Oct 13 08:51:07.262792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1953/4215] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:07 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:51:07.273820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:07.275015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:07.287368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.288326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.289078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.290300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:07.291160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:07.292453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:07.486661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:07.497832 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed3813cd-a7ff-4d02-8b8d-007578f63700 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.693772 Oct 13 08:51:07.501730 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2263/4216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:06 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:07.695786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:07.712101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6d94703d-9782-4a29-83c0-916d383a4b67 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1508 microversion: 2.1 time: 0.447623 Oct 13 08:51:07.712796 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1954/4217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:07 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1508 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:08.087819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:08.088648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:08.106842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.107561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.111532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:08.112496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.116319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.120867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:08.427342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:08.438529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b198e576-6076-43b4-b078-6cf384a3b6e8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.355722 Oct 13 08:51:08.439129 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2264/4218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:08 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:08.527052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:08.527743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:08.541761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.545457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.546781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:08.547706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.548742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.550525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:08.742193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:08.742847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:08.758783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.763212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.764200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:08.765448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:08.770861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:08.771879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:09.108108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:09.123138 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83f54e4c-43d0-4676-ae4a-9b8d09f4bffa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1516 microversion: 2.1 time: 0.386230 Oct 13 08:51:09.124384 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2265/4219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:08 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1516 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:09.323892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:09.336806 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43e5df94-c687-455d-a5f8-e6e5ac44619c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.815656 Oct 13 08:51:09.338202 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1955/4220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:08 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:09.466575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:09.467294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:09.490287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:09.490868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:09.492104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:09.493338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:09.495757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:09.497223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:09.763357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:09.773189 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cfbc497-1b9f-4247-9b7e-a14d1046c0e5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.315671 Oct 13 08:51:09.776407 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2266/4221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:09 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:10.364140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:10.364680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:10.379547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:10.381274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:10.388094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:10.389871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:10.391208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:10.391941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:10.801745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:10.803322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:10.815806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:10.816751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:10.817367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:10.818219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:10.818835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:10.819543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:10.977165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:10.987866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-940e8c9f-fc48-45fb-9571-7902eb7ebed4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.630267 Oct 13 08:51:10.989057 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1956/4222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:10 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:11.110718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:11.122349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76b16f7e-3019-4d63-8721-4ff2e2c8df5c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.329963 Oct 13 08:51:11.124989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2267/4223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:10 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:11.786590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:11.789577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:11.798821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:11.799631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:11.800256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:11.801216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:11.801765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:11.802426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:11.829419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'flavor' on Instance uuid 8b77467f-18ba-48eb-b6f1-9e756e117b76 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:51:11.943515 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4184dc9-9776-408a-a34b-663a756c4ecd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action" status: 200 len: 32 microversion: 2.1 time: 0.160933 Oct 13 08:51:11.944550 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1957/4224] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:11 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:51:11.955022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:11.955799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:11.972194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:11.973035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:11.973659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:11.974646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:11.975289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:11.975901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:12.016183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:12.016906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:12.032801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:12.034955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:12.037607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:12.038720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:12.040261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:12.041012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:12.149261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:12.161141 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-198b2695-167e-4294-aea6-a6362233d6cc tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.210201 Oct 13 08:51:12.163602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2268/4225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:11 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:12.170078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:12.170961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:12.182037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:12.183372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:12.184100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:12.185022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:12.185675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:12.186296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:12.431091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:12.440863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d9459ba-9f5c-40de-937d-120b5528ff02 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.275918 Oct 13 08:51:12.441985 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2269/4226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:12 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:12.720871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:12.729279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-867c4704-1e56-4c0a-8860-7d22cddee71e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.720879 Oct 13 08:51:12.732061 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1958/4227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:12 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:13.192196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:13.193862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:13.202837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.203522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.204136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.204998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.205601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.206332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.469074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:13.471500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:13.481077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.481805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.482391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.483315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.483916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.485411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.521741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:13.555981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2e1a3be-d401-4a68-a78c-3296a2bce4f8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.367920 Oct 13 08:51:13.558202 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2270/4228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:13 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:13.759677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:13.760294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:13.772598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:13.777709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.778473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.779092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.792429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:13.796307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:13.797428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:13.825445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:13.836299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7f203fe-bc5c-4800-8a97-dd55d79d44b1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.372608 Oct 13 08:51:13.838978 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1959/4229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:13 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:14.156144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:14.168951 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc631821-c846-422f-84ca-25b66d99df39 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.411831 Oct 13 08:51:14.189063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2271/4230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:13 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:14.590307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:14.591749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:14.609671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:14.610390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:14.613318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:14.614086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:14.614589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:14.615189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:14.867378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:14.867852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:14.874707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:14.875204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:14.875645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:14.876365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:14.883136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:14.889025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:15.099625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:15.108987 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62542311-22ac-4255-a08c-85801413faae tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.527720 Oct 13 08:51:15.123300 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1960/4231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:14 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:15.194725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:15.195377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:15.208563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:15.210870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:15.211501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:15.212557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:15.213894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:15.221447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:15.333443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:15.349199 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-589bc8b6-8032-4616-83c4-2b2348677603 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.485984 Oct 13 08:51:15.367665 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2272/4232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:14 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:15.490171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:15.511520 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0acf861-da95-4db1-b9dd-f7490e49e42a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.321704 Oct 13 08:51:15.512911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1961/4233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:15 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:15.685149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1079982753", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "cee1a7d2-16e9-4c25-a251-9d6ddd27e7fd"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:15.798190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] validate_networks() for [('cee1a7d2-16e9-4c25-a251-9d6ddd27e7fd', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:51:16.133991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:16.135394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:16.158373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.159276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.159925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.160847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.161543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.162172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.453107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:51:16.453539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:51:16.453998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:51:16.454436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:51:16.454839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:51:16.465532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.466010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.466859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.467330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:16.467842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.467842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.468362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.488162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f64e8c8d-791e-4f15-ba57-faa5060682c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.352412 Oct 13 08:51:16.488442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Getting quotas for project ef0342adce0b4653b811f79e4f396628. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:51:16.502436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1962/4234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:16 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:16.510712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:16.510712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:16.513107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Getting quotas for user 25b83427acdb4cc0befba00d3c19447e and project ef0342adce0b4653b811f79e4f396628. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:51:16.519306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.520175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.521020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.522290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.522988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.523625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.528619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:51:16.531006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:51:16.605828 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53436338-c849-4ecb-b0ff-9fa3e8855117 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201179 Oct 13 08:51:16.608799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2273/4235] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:51:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:51:16.614235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:16.615251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:16.626597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.627299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.627932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.628787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:16.629397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:16.629994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:16.823781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:16.838185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-855e0ede-9b03-481a-ab2a-00c980483638 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.344200 Oct 13 08:51:16.838817 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1963/4236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:16 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:16.858837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:16.860948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a1eef3f-9785-44b0-87f1-3f74bdf779eb tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:16.861831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a1eef3f-9785-44b0-87f1-3f74bdf779eb tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:16.870729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83fad834-1344-41b9-9e39-21dc6e5c8c2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.260550 Oct 13 08:51:16.872000 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2274/4237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:16 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:16.988850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a1eef3f-9785-44b0-87f1-3f74bdf779eb tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:16.995780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a1eef3f-9785-44b0-87f1-3f74bdf779eb tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1217 microversion: 2.1 time: 0.144232 Oct 13 08:51:17.006774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1964/4238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:16 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:17.517837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:17.518483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:17.533633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.534619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.535508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:17.536532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.537704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.538398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:17.557094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:17.724394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:17.735159 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-884628b9-a1c7-4252-b89d-597edc27d9b0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.221315 Oct 13 08:51:17.736429 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2275/4239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:17 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:17.868613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:17.869402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:17.877760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.878325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.878818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:17.879719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.880810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.883659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:17.895258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:17.896205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:17.906013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.906755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.907391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:17.908685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:17.909373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:17.924532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:18.135820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:18.147103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdc2b3fd-48b2-4fab-a3ad-3b5d41c83c4d tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.254001 Oct 13 08:51:18.147935 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2276/4240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:17 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:18.159581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:18.160396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:18.172493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:18.177550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:18.181598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:18.182659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:18.183445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:18.184107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:18.297375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:18.309811 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e26238a2-84fb-42c7-af4f-c155c7983583 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1277 microversion: 2.1 time: 0.159028 Oct 13 08:51:18.312151 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2277/4241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:18 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:18.761381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:18.762119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:18.769104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:18.769869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:18.770561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:18.771500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:18.772188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:18.772845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:18.927635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:18.955903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7300bd7-d92c-4582-9b79-b0c6f65115c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 1.091633 Oct 13 08:51:18.956845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1965/4242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:17 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:18.998667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:19.009541 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1cb96fa-fc84-4588-9403-869fc8ebd452 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.250479 Oct 13 08:51:19.010395 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2278/4243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:18 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:19.173882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:19.174525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:19.182394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:19.182995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:19.183437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:19.184220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:19.184677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:19.185105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:19.210441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:19.337706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:19.338430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:19.350157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:19.352885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:19.353533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:19.356873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:19.358651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:19.359239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:19.475576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:19.493154 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f1c43d9-1cd5-4079-874a-8d5f5ef69b0a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1275 microversion: 2.1 time: 0.152346 Oct 13 08:51:19.493154 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2279/4244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:19 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:19.563223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:19.581809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-693302e4-444d-415e-ad85-ad2153b5a796 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.408537 Oct 13 08:51:19.582504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1966/4245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:19 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:19.986667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:19.987303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:19.999370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:19.999877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.000327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.001057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.001513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.001945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.044628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:20.045898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:20.057748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.058232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.061870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.062686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.063172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.063617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.347640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:20.357930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1eed63e6-df30-4c9a-9a0c-9ea40440daf6 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.378690 Oct 13 08:51:20.362867 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2280/4246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:19 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:20.516686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:20.517332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:20.524606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.525106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.526798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.527640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.528515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.528678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.545122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:20.559068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ae801cd-b0ab-42a4-8502-5e1feb1eb619 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.516399 Oct 13 08:51:20.560468 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1967/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:20 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:20.618335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:20.619456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:20.651058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.651833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.652852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.653772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:20.654382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:20.654969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:20.946717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:20.958878 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5c463a9-ed4d-4c23-86da-ff1a287071fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.443536 Oct 13 08:51:20.959871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2281/4248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:20 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:21.034525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:21.043506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ab9f735-89f9-4877-bf55-bf85f1656c16 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1515 microversion: 2.1 time: 0.434005 Oct 13 08:51:21.044020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1968/4249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:20 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1515 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:21.390846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:21.390846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:21.399147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.400721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.401821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.403379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.403990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.404566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.534457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e00da7-d9e9-4c28-b60c-a7e66902a4d5", "tag": "80342a4a-0a1f-4670-8ed1-a4347ce1beb5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:21.540817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=80 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:21.557179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.558051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.559229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.571361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] Creating event network-changed:80342a4a-0a1f-4670-8ed1-a4347ce1beb5 for instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 on n-h1-858384-11 Oct 13 08:51:21.578160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2e752871-310f-450f-aa3b-3d59d8583b9b req-3b323436-28b7-45c7-8811-d3ba9220dbc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046768 Oct 13 08:51:21.579487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1969/4250] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:21.588243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:21.589257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:21.599807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.600381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.600891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.601939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.602654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.603191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.813356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:21.826289 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2a0938c-3682-4d98-8356-ec1ed0ca4f77 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.440484 Oct 13 08:51:21.828131 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2282/4251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:21 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:21.833509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:21.844418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-479df6c7-fdb7-4b80-904d-da48fdfc5dfd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.261453 Oct 13 08:51:21.860811 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1970/4252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:21 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:21.981813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:21.982724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:21.989999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.990871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.991391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:21.992375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:21.993054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:21.993585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.072619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:22.073278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:22.080597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.081272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.081725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.082640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.083538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.084132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.228821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:22.237433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bb0bcbe7-02f1-4c00-99d5-c2dc67a549c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.171648 Oct 13 08:51:22.238024 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1971/4253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:22 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:22.700737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:22.708534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a9ff6ec-0539-4c2d-959d-f69f6ab8153a tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.731198 Oct 13 08:51:22.721267 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2283/4254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:21 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:22.854529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:22.855787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:22.867596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.868160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.869711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.870113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:22.870540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.871084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.872014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:22.872909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.878994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.881293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.881987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:22.882933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:22.883610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:22.884508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:23.172185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:23.181308 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c71c1765-b123-45e2-83f3-4e65b4fb5780 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.315948 Oct 13 08:51:23.182121 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2284/4255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:22 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:23.261916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:23.262694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:23.276235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:23.277048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:23.278196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:23.279347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:23.279839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:23.281615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:23.459713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:23.471516 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1109cde8-aeeb-4ca1-9af0-1615ca68d7fd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1507 microversion: 2.1 time: 0.620765 Oct 13 08:51:23.482503 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1972/4256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:22 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:23.524800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:23.534470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17c73113-e8f8-4370-8b2d-1f3b75f7bb8a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.277177 Oct 13 08:51:23.535493 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2285/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:23 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:23.735972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:23.736830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:23.746979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:23.747573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:23.748087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:23.748871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:23.749402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:23.751446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.039102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:24.058029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-764fcfe0-da70-4ec2-8b2c-6b1e041eab9d tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.328216 Oct 13 08:51:24.059723 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1973/4258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:23 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:24.209735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:24.218376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:24.230739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.232430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.234254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.235233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.235964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.238069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.497935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:24.499070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:24.505735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.506589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.507247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.508461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.509403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.510532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.658514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:24.667228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bce8302-8db5-41d6-9eb5-176150c954a9 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.465428 Oct 13 08:51:24.682973 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2286/4259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:24 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:24.691562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:24.692980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:24.700312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.701002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.701595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.702507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:24.703109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:24.703684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:24.783162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:24.794365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-994f11bf-a719-4436-bf3f-95aacca3e363 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1528 microversion: 2.1 time: 0.300972 Oct 13 08:51:24.796786 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1974/4260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:24 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1528 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:24.951726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:24.966068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c06c03e7-6144-4c61-a387-a0d78ce9b6da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.281665 Oct 13 08:51:24.967324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2287/4261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:24 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:25.086287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:25.088627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:25.097354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.099613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.101038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.102016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.102731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.103381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.340339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:25.353150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9efe7709-1c9d-43c2-9661-7875b600a505 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.272592 Oct 13 08:51:25.354308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1975/4262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:25 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:25.695018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:25.695662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:25.709317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.709839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.713084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.713955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.714473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.720864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.821994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:25.822656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:25.841501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.842010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.842482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.850900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:25.851732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:25.852365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:25.978610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:25.990625 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e0882b1-b3da-4b19-b045-8be2aaebad3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.297968 Oct 13 08:51:25.992977 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2288/4263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:25 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:26.003232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:26.004414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:26.020174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:26.020773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:26.021290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:26.022074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:26.023036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:26.023978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:26.128493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:26.140958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18b02ec8-7f3f-47a5-beeb-127c16ac2699 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1528 microversion: 2.1 time: 0.323642 Oct 13 08:51:26.159489 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1976/4264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:25 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:26.359319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:26.368771 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e608575c-8fbc-47f0-a1b6-e7e90872d1e9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.373462 Oct 13 08:51:26.370290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2289/4265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:25 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:26.393815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:26.396254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:26.407001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:26.407701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:26.408293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:26.410246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:26.410929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:26.411515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:26.691615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:26.701075 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bdfbf41c-2afa-4edc-aa2f-b01877a4b6f5 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.316818 Oct 13 08:51:26.701681 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1977/4266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:26 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:26.914960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef48e06e-362e-47bd-8f27-3c4e8f05f988", "name": "network-vif-plugged", "status": "completed", "tag": "9368ec10-cf05-46d3-9fbb-d2929c9d5d57"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:26.933822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:26.935421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:26.940511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:26.942324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:26.943115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:26.975804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] Creating event network-vif-plugged:9368ec10-cf05-46d3-9fbb-d2929c9d5d57 for instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 on n-h2-858384-11 Oct 13 08:51:26.985993 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4e796368-0e10-456e-9d50-e96ca1097af4 req-13cc90fb-b749-4742-8ef4-6306e20497d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078479 Oct 13 08:51:26.987153 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2290/4267] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:27.017291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:27.018464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:27.022262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:27.026925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.028176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.028811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.029744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.030383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.033505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.172483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:27.174611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:27.189516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.190048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.190537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.191273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.191750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.192163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.369656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:27.379384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fedc1a33-5970-4faa-8978-7a644129d36b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.366170 Oct 13 08:51:27.396006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1978/4268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:27 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:27.409845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:27.410943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:27.418854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.419585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.420250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.421182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.421848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.423050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.564990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:27.591187 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0facd9b6-2bc7-42b5-8314-c4dd67b59140 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1528 microversion: 2.1 time: 0.424866 Oct 13 08:51:27.592910 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2291/4269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:27 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:27.728769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:27.729384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:27.741961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.746011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.748968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.749981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:27.750681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:27.751318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:27.800149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:27.817032 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b35aa51-d362-4b33-b2b6-b2c4c51b705a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.419441 Oct 13 08:51:27.817752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1979/4270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:27 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:28.004792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:28.008538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:28.015946 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-171abb1d-42c0-4342-8ca4-8977856be5a3 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.291779 Oct 13 08:51:28.017544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2292/4271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:27 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:28.412128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:28.413311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:28.421180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.421956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.422657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.423576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.424260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.424918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.622073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:28.623902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:28.638475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.639825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.640493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.641727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.642760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.643383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.671903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:28.695903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1010c9f-951c-4794-bc01-07b07dcbb0fe tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.287398 Oct 13 08:51:28.712201 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1980/4272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:28 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:28.840840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:28.841456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:28.849385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.850087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.850746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.851613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:28.852229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:28.852811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:28.953498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:28.961989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a18b07b4-6ce3-4f6c-bf37-cc9d39669fcd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1528 microversion: 2.1 time: 0.346796 Oct 13 08:51:28.975880 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2293/4273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:28 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1528 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:29.016573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e00da7-d9e9-4c28-b60c-a7e66902a4d5", "name": "network-vif-plugged", "status": "completed", "tag": "80342a4a-0a1f-4670-8ed1-a4347ce1beb5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:29.040727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:29.041319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:29.041874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:29.064969 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] Creating event network-vif-plugged:80342a4a-0a1f-4670-8ed1-a4347ce1beb5 for instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 on n-h1-858384-11 Oct 13 08:51:29.069858 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1b51e1e0-ed82-4239-a546-3345f6bbe6e4 req-c1e7db9a-fb0f-4cc2-8064-231278270f76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057501 Oct 13 08:51:29.071011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2294/4274] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:29.076373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:29.077187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:29.093000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:29.094005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:29.094636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:29.095348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:29.095802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:29.096220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:29.239389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:29.255998 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-567605bf-2968-4ac8-9dfc-45ea0fb6cbed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.419504 Oct 13 08:51:29.270431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1981/4275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:28 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:29.332560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:29.343421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-356a3c90-ae70-495c-86f1-bf822fd1a3fa tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.271019 Oct 13 08:51:29.344317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2295/4276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:29 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:29.723679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:29.724334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:29.740215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:29.740709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:29.741159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:29.741894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:29.742356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:29.747042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:29.902912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:29.924348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6e60dec0-a2d9-4441-8834-188d980efa3e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.203742 Oct 13 08:51:29.925792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1982/4277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:29 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:29.991064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:29.991926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:29.999892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.000926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.001826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.003019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.004104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.005079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.233043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:30.242081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-78c53368-1982-479b-9104-da7e80d57f24 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1528 microversion: 2.1 time: 0.255725 Oct 13 08:51:30.242704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2296/4278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:29 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1528 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:30.282729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:30.283560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:30.298294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.299149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.299770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.300680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.303495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.304153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.331196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:30.368475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:30.369086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:30.376564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.377114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.377789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.378950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.379803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.380397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.550928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:30.564512 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57c9f519-f19e-47a3-a12e-a45a1e648278 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.287139 Oct 13 08:51:30.565128 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1983/4279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:30 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:30.672533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:30.697354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a291bd1-0f5c-45d9-a503-bf8870024079 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1317 microversion: 2.1 time: 0.332859 Oct 13 08:51:30.707923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2297/4280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:30 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:30.956160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:30.959395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:30.977591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.978089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.978566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:30.979275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:30.983211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:30.983849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.096278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eff84ef-56d4-4fe5-a671-76415e9c2e90", "name": "network-vif-plugged", "status": "completed", "tag": "365dbb93-1db2-4792-8eef-649c089bdb0d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:31.109530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.110307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.110956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.125047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] Creating event network-vif-plugged:365dbb93-1db2-4792-8eef-649c089bdb0d for instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 on n-h2-858384-11 Oct 13 08:51:31.130991 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-21059cf0-5c6c-4632-b5f1-8512fa0e0968 req-511d39c1-b450-4c6d-8bd0-fd31f902e803 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038577 Oct 13 08:51:31.132021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2298/4281] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:31.270530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:31.272268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:31.286838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.288062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.288665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.290756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.291674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.293985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.318692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:31.331275 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d275f820-c046-4b00-8672-e54338933814 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.386844 Oct 13 08:51:31.339835 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1984/4282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:30 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:31.591377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:31.593383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:31.631396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.632104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.634431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.635626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.637946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.638605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.659011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:31.668663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3e37967-cfd4-4c3a-829b-b9705fb1a70c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.403207 Oct 13 08:51:31.672367 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2299/4283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:31 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:31.735822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:31.736717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:31.743455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.744170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.744805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.746843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:31.747458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:31.748063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:31.894879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:31.904954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-885d814e-7fb3-4e59-a118-94835c6c205f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.319920 Oct 13 08:51:31.926809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1985/4284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:31 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:32.040723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:32.063108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cf07061-66cc-4225-8190-96a6b07fe0c1 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1505 microversion: 2.1 time: 0.331604 Oct 13 08:51:32.068101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2300/4285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:31 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:32.093806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:32.094528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.104179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.104867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.106619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.108339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.109991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.110720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.150353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:32.152491 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94295525-3a5b-476d-87ce-6ba036a1038b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/os-instance-actions/req-53436338-c849-4ecb-b0ff-9fa3e8855117" status: 200 len: 313 microversion: 2.1 time: 0.065689 Oct 13 08:51:32.153504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1986/4286] 10.222.0.23 () {58 vars in 1419 bytes} [Thu Oct 13 08:51:32 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/os-instance-actions/req-53436338-c849-4ecb-b0ff-9fa3e8855117 => generated 313 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:32.167439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:32.170466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.178337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.179154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.179824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.180843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.181509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.182356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.349777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d9eb271-9510-455f-94e5-0f28dfbf588e tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "POST /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/action" status: 202 len: 0 microversion: 2.1 time: 0.185850 Oct 13 08:51:32.362064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:32.364412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.369285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2301/4287] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:32 2022] POST /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:51:32.372626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.373539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.374984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.380036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.381877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.382851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.413156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:32.419720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.444561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.445057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.447300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.450479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.451850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.454195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.748449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:32.765389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4b4cc0c-64a7-483b-a9bd-eee33c2cb869 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1507 microversion: 2.1 time: 0.388571 Oct 13 08:51:32.789529 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2302/4288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:32 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:32.795360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:32.801500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.818680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.822627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.824819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.825930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:32.827072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.827706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.828627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.839675 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa30800d-9013-4ec0-81b7-e319c537b536 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.486123 Oct 13 08:51:32.855798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1987/4289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:32 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:32.935484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:32.936135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:32.946515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.947013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.947450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:32.948157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:32.948608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:32.949142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:33.214206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:33.225723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a0bb610-c7e5-4581-b19e-bba40039cd03 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.434648 Oct 13 08:51:33.242444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2303/4290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:32 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:33.456654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:33.472108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c254caa-3360-4919-8864-d9dc24625ed3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1521 microversion: 2.1 time: 0.541159 Oct 13 08:51:33.472702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1988/4291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:32 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:33.794917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:33.796186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:33.802828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:33.804265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:33.804910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:33.805839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:33.806939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:33.807559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:33.872073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:33.872730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:33.882323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:33.882838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:33.883274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:33.883971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:33.884421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:33.884844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.086118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:34.098693 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e17c42a-051a-45ce-a69e-197fb51b01ed tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1507 microversion: 2.1 time: 0.307312 Oct 13 08:51:34.114597 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2304/4292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:33 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:34.224302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:34.234973 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-767cc0c8-941e-463a-b479-09d3478d7fec tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.375751 Oct 13 08:51:34.239490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1989/4293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:33 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:34.256206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:34.257275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:34.267118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.273316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.274015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.275016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.275628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.276279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.490137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:34.501073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db067235-1ab8-4459-9193-f5cd54000911 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.248889 Oct 13 08:51:34.505434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:34.507562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:34.511063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2305/4294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:34 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:34.536373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.537172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.540793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.541838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.542846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.544423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.806795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:34.816412 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89232053-2d6f-44ab-871a-c63001897ee5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1506 microversion: 2.1 time: 0.318142 Oct 13 08:51:34.821603 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1990/4295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:34 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:34.846197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:34.847494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:34.878044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.878582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.879196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:34.880091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:34.880722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:34.881366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.123073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.124009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.134270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.137232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.138156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.141009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.142833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.143512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.172635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:35.187012 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-488368bc-3202-4485-a995-3202186c16ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 200 len: 1506 microversion: 2.1 time: 0.346011 Oct 13 08:51:35.203606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2306/4296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:34 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:35.211326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.212055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.221256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.222272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.223040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.224432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.224926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.225388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.269392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:51:35.422840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c5d02b0-1e20-41be-9f57-a950fd5ec168 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 204 len: 0 microversion: 2.1 time: 0.206567 Oct 13 08:51:35.423993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2307/4297] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:51:35 2022] DELETE /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:51:35.455702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:35.475054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.478246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.485330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d4c8578e-d377-44b5-a564-c84bf2d5600c tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1505 microversion: 2.1 time: 0.366042 Oct 13 08:51:35.487785 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1991/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:35 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:35.498765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.499627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.500348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.501551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.503323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.510929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '.version_select at 0x7f5375d1e0d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.512782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.514289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.547629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.549941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.550694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.552967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.561976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.564303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.591826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:35.625449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5434eb6-a249-4d38-a80f-86332da09648 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.119322 Oct 13 08:51:35.626730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1992/4299] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Oct 13 08:51:35 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:35.650802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.652123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.663551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.664322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.664811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.666296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.666794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.667228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.866036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:35.876623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c0d6716-48bb-4a36-aa4b-ab2b91e95558 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.246834 Oct 13 08:51:35.877901 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1993/4300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:35 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:35.883218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:35.883973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:35.891609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.892575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.893244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.894179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:35.894853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:35.896056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:35.903091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:35.914540 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c0892c05-5886-486e-931b-b3a76677ed51 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.476826 Oct 13 08:51:35.915179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2308/4301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:35 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:35.927591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:51:35.931107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-479188273", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "d49e29fb-d62c-46f3-834a-cda4bc95d8ec"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:36.006181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] validate_networks() for [('d49e29fb-d62c-46f3-834a-cda4bc95d8ec', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:51:36.061977 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62bc279a-029f-45c7-a909-6db4d6e1d75b tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 204 len: 0 microversion: 2.1 time: 0.182376 Oct 13 08:51:36.062764 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1994/4302] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:51:35 2022] DELETE /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:51:36.079696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:36.080696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:36.088891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:36.090232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:36.090823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:36.091589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:36.092165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:36.092599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:36.598334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:36.611475 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05990277-a09f-4d53-8f9b-470c8b587123 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1511 microversion: 2.1 time: 0.537542 Oct 13 08:51:36.626432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1995/4303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:36 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1511 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:36.908618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:36.909577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:36.922273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:36.940393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:51:36.941954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:36.943211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:51:36.943858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:36.945243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:51:36.945811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:51:36.947555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:36.952824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:51:36.956787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:36.957510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:51:37.003365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for user 31ba8f040ba341488b82d5240d3ff474 and project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:51:37.012040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:51:37.014736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:51:37.168552 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19870b30-9096-482a-a86f-e0b08427121a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251198 Oct 13 08:51:37.169534 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2309/4304] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:51:37.174687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:37.176036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:37.188233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.189213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.190028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.191123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.191789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.192481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.324564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:37.339574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9eb1d09d-e772-4cb8-b0d5-e445e135bb5f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.438019 Oct 13 08:51:37.340619 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1996/4305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:36 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:37.359163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9a62afc-b1ec-46d5-a58b-7dede86d7758 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:37.360320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9a62afc-b1ec-46d5-a58b-7dede86d7758 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:37.469930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:37.480903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ddaccc86-9c48-42d4-ad8d-7fe29ec2b613 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.309468 Oct 13 08:51:37.485854 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2310/4306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:37 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:37.570312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9a62afc-b1ec-46d5-a58b-7dede86d7758 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:37.577821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9a62afc-b1ec-46d5-a58b-7dede86d7758 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1217 microversion: 2.1 time: 0.235952 Oct 13 08:51:37.580346 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1997/4307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:37 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:37.635974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:37.637364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:37.669229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.671256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.672461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:37.677502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:37.678119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:37.683318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:38.107202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:38.121362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-be1e320f-3183-4d99-91e1-47ff7bddbcd7 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1511 microversion: 2.1 time: 0.487482 Oct 13 08:51:38.122060 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2311/4308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:37 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1511 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:38.365751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:38.366734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:38.388016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:38.394703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:38.398681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:38.405339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:38.410980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:38.411578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:38.505318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:38.506088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:38.519305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:38.520165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:38.520927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:38.525624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:38.526370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:38.527449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.007764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:39.020751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d666bcf5-77d9-478a-b9c8-3b78ee9d1f53 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.518523 Oct 13 08:51:39.021992 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2312/4309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:38 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:39.054009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eff84ef-56d4-4fe5-a671-76415e9c2e90", "name": "network-vif-deleted", "tag": "365dbb93-1db2-4792-8eef-649c089bdb0d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:39.076217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:39.077352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:39.077973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.095603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] Creating event network-vif-deleted:365dbb93-1db2-4792-8eef-649c089bdb0d for instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 on n-h2-858384-11 Oct 13 08:51:39.101208 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4a2d8100-4575-45bc-83fc-3e75c09e2373 req-326eed48-e9ab-4bc8-aaa7-1dd906b907b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066802 Oct 13 08:51:39.102384 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2313/4310] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:39.108395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:39.109830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:39.122980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:39.123815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:39.124553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.125490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:39.126283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:39.127012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.161370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:39.177473 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ebb2642-cf33-4146-8856-4b945729aa8e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.815040 Oct 13 08:51:39.181290 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1998/4311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:38 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:39.192016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:39.194835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:39.236345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:39.239214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:39.239836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.240764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:39.242590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:39.243858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:39.311122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:39.322216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:39.335029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09d6b4d6-f8b6-47d4-99e5-ef5b16bd6e67 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1269 microversion: 2.1 time: 0.230945 Oct 13 08:51:39.341906 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2314/4312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:39 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:39.643314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:39.656987 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cca34743-1d8a-4ca3-bba8-a36568580597 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1469 microversion: 2.1 time: 0.473514 Oct 13 08:51:39.662308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 1999/4313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:39 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:40.052826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:40.053476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:40.080931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.081437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.081883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.084279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.085109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.088811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.206753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:40.208455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:40.218213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.221744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.222494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.223491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.224222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.224903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.756790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:40.772263 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aeecf385-7cbe-4ac4-9fa0-02640458fd76 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.569592 Oct 13 08:51:40.773474 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2000/4314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:40 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:40.780662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:40.781994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:40.796801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.801402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.802023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.803215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.804597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.808150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.838305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:40.857262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94d8b0d0-e5ee-4c6b-8e4b-cea44f957092 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.809691 Oct 13 08:51:40.858837 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2315/4315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:40 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:40.871302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:40.874484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:40.902805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.903518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.908257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:40.909195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:40.909811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:40.911644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.013190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.014203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.016060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.016838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lazy-loading 'fault' on Instance uuid d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:51:41.027085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:41.040169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-413b492d-9575-4c78-9cca-c0add39d63e7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1275 microversion: 2.1 time: 0.265437 Oct 13 08:51:41.041746 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2001/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:40 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:41.113051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b83427acdb4cc0befba00d3c19447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0342adce0b4653b811f79e4f396628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:41.129554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-865f84db-9c99-408c-882e-f4d67f12a2d9 tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 200 len: 1307 microversion: 2.1 time: 0.268046 Oct 13 08:51:41.130855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2316/4317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:40 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:41.460014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e00da7-d9e9-4c28-b60c-a7e66902a4d5", "name": "network-vif-deleted", "tag": "80342a4a-0a1f-4670-8ed1-a4347ce1beb5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:41.485092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.486331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.488883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.512697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] Creating event network-vif-deleted:80342a4a-0a1f-4670-8ed1-a4347ce1beb5 for instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 on n-h1-858384-11 Oct 13 08:51:41.524464 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-724f616a-d669-48e3-8d2d-8ce69634447b req-9132f033-6644-4468-8dac-735c6e594760 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068954 Oct 13 08:51:41.541675 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2002/4318] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:41.800034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:41.801031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:41.810046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.813228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.814151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.815024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.815991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.817025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.885783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:41.886483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:41.902104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.908088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.908649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:41.909404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:41.909872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:41.910309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.210095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:42.223417 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-765bfc21-c140-4373-843b-56ec4d9e0e7d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.427103 Oct 13 08:51:42.224382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2317/4319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:41 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:42.231657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:42.232263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:42.262594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.264491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.266382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.267956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.269065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.269748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.497445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:42.509538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae367f24-1fd6-413b-8fc6-d7d7a661d3df tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1502 microversion: 2.1 time: 0.628257 Oct 13 08:51:42.510439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2003/4320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:41 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:42.535867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:42.536833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] [instance: d4e00da7-d9e9-4c28-b60c-a7e66902a4d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:42.544519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.545185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.545776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.546680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.547285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.547877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.583095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] HTTP exception thrown: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Request method failure captured: Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 HTTP/1.1 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9GD8aqj4jGUNEXw_Er0GopK2tAeCA7ZtZzu0j5MFauRN_xOszxyUOEaKmfJVG68wfwOiLT0SgRrl2h73r5ljWkS0Z_DBYcZ96wz_sh3E8hcXJ3Jeyda5OhibiOkkaAHLUCAF79cmmJ8wdg-6fTkN9k8UmUOVq5tyOJJBLcvHLJCuic Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ef0342adce0b4653b811f79e4f396628 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-InstanceActionsTestJSON-690419675 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0342adce0b4653b811f79e4f396628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef0342adce0b4653b811f79e4f396628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0342adce0b4653b811f79e4f396628"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef0342adce0b4653b811f79e4f396628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-InstanceActionsTestJSON-690419675 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ef0342adce0b4653b811f79e4f396628 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-InstanceActionsTestJSON-690419675 Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-InstanceActionsTestJSON-690419675-project Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 25b83427acdb4cc0befba00d3c19447e Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-InstanceActionsTestJSON-690419675-project Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'd4e00da7-d9e9-4c28-b60c-a7e66902a4d5'} Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:42.585483 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. Oct 13 08:51:42.589012 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.593814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] Returning 404 to user: Instance d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:51:42.593814 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b59eea2-608c-46c5-ad9d-f258b24e12ee tempest-InstanceActionsTestJSON-690419675 tempest-InstanceActionsTestJSON-690419675-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5" status: 404 len: 111 microversion: 2.1 time: 0.069139 Oct 13 08:51:42.593814 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2004/4321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:42 2022] GET /compute/v2.1/servers/d4e00da7-d9e9-4c28-b60c-a7e66902a4d5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:51:42.608375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77eab653-2bd6-431c-82af-6aa9d273d5ec"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:42.621864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:42.632247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.632743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.633725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.634458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.634918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.635346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.674886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Cannot 'attach_volume' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state rescued Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/os-volume_attachments HTTP/1.1 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 74 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: {"volumeAttachment": {"volumeId": "77eab653-2bd6-431c-82af-6aa9d273d5ec"}} Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'attach_volume' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state rescued Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '8b77467f-18ba-48eb-b6f1-9e756e117b76', 'body': {'volumeAttachment': {'volumeId': '77eab653-2bd6-431c-82af-6aa9d273d5ec'}}} Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 13 08:51:42.676521 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state rescued Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state rescued Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 409 to user: Cannot 'attach_volume' instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 while it is in vm_state rescued {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab6c581f-ef64-41fb-a94a-4ca23bee33e7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079169 Oct 13 08:51:42.679956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2005/4322] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:51:42 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:51:42.694546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:42.695078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:42.702033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.703173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.703945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.704903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.706311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.707437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.892225 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5eeca685-7f47-49d8-9980-9ab31d3e4d88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action" status: 202 len: 0 microversion: 2.1 time: 0.201460 Oct 13 08:51:42.893191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2006/4323] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:51:42 2022] POST /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:51:42.901371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:42.902653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:42.926698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.927977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.928601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.929545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:42.930114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:42.930595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:42.953395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:42.965727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f82db1f-a5bd-4f5a-b901-d6785453569e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.738360 Oct 13 08:51:42.970466 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2318/4324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:42 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:43.252487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:43.253083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:43.267644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:43.270221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:43.271302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:43.273555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:43.276034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:43.277175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:43.496034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:43.504069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bacea31b-b28a-448c-9354-5009dbe637d3 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1510 microversion: 2.1 time: 0.606784 Oct 13 08:51:43.508616 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2007/4325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:42 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:43.837041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:43.847912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1dc4fd68-2bc4-4240-adb2-878806f042dc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.597671 Oct 13 08:51:43.849584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2319/4326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:43 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:43.993448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:43.994060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:44.006581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.007316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.007948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:44.013951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.014954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.015598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:44.533384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:44.534004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:44.541733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.548486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.549483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:44.563489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.564231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.564832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:44.720239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:44.733913 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fb8b4bb4-9d91-4ac5-818e-cc014e52f274 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.744443 Oct 13 08:51:44.750486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2008/4327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:43 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:44.882284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:44.883477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:44.895218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.895960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.897405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:44.898705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:44.899435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:44.900374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:45.255309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:45.271455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5dd53ae7-e797-4faf-b5c8-4153638adfd0 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1510 microversion: 2.1 time: 0.741911 Oct 13 08:51:45.274210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2320/4328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:44 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1510 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:45.335584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:45.344405 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d652e89-e88d-40ec-8b3b-c06e8bb22bfd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.474285 Oct 13 08:51:45.350190 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2009/4329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:44 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:45.532545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2531613-8d13-4853-b69f-cd95a3445f2e", "tag": "8eb73bd2-2f68-4327-90ea-535813ee0a18"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:45.557741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:45.561099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:45.565017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:45.606349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] Creating event network-changed:8eb73bd2-2f68-4327-90ea-535813ee0a18 for instance f2531613-8d13-4853-b69f-cd95a3445f2e on n-h2-858384-11 Oct 13 08:51:45.618022 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-896a0c06-4e06-4a93-b0ba-031deb9f3e22 req-fc5de980-e36d-4de1-b288-b598feb52171 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092872 Oct 13 08:51:45.619775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2321/4330] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:51:45.763369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:45.763906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:45.784042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:45.785007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:45.785777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:45.786705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:45.788533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:45.792786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:46.224164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:46.232907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08ac70de-cfea-4e6d-a357-ed5afec1a9b6 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.474117 Oct 13 08:51:46.249876 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2010/4331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:45 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:46.297063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:46.297743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:46.312039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:46.312539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:46.312985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:46.313698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:46.314335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:46.314955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:46.374730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:46.375905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:46.388060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:46.388560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:46.389003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:46.389715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:46.390174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:46.399024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:46.839413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:46.847950 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4a5b4b6-7cb3-4ed9-8714-623449844182 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.477016 Oct 13 08:51:46.852318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2011/4332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:46 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:46.982329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:47.006661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:47.037867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:47.052047 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68c05a2c-11be-4359-96a8-1db0f5d2b22c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1510 microversion: 2.1 time: 0.759864 Oct 13 08:51:47.052832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2322/4333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:46 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1510 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:47.257973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:47.258912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:47.268238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:47.268998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:47.269631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:47.270550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:47.271260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:47.273102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:47.575683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:47.579583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:47.588669 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c73125b-bd3a-412b-a59b-9109e70724f8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.334929 Oct 13 08:51:47.606099 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2012/4334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:47 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:47.882247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:47.883047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:47.900151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:47.900658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:47.901087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:47.907957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:47.908996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:47.910943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:48.080306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:48.082400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:48.096374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:48.101705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:48.104019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:48.106039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:48.109143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:48.109857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:48.423598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:48.435501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15fe0cc3-e91e-45db-be40-e7efaa7f5a3e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.559951 Oct 13 08:51:48.436312 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2323/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:47 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:48.482104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:48.503222 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-812e6048-6fb3-455f-b74b-944224061b66 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1516 microversion: 2.1 time: 0.425868 Oct 13 08:51:48.504345 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2013/4336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:48 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:48.615495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:48.616479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:48.625802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:48.628297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:48.628979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:48.631784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:48.632482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:48.633137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:49.466901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:49.467983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:49.479792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:49.480297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:49.480762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:49.481522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:49.481978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:49.482467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:49.777005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:49.795272 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd67eda9-0a24-4648-b3b4-09d4c39d7a13 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 1.180334 Oct 13 08:51:49.816914 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2324/4337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:48 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:49.935739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:49.945288 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50090846-642a-40d9-81b3-d4b50e9d7411 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.483360 Oct 13 08:51:49.951664 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2014/4338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:49 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:50.821686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:50.822778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:50.835888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:50.836381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:50.837008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:50.837877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:50.843178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:50.845585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:50.975527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:50.976721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:50.982182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:50.986439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:50.986962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:50.987408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:50.988147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:50.988602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:50.989028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:51.150291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:51.160110 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f1e026f-24a7-41b8-ba43-8ec14b6f25cc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1523 microversion: 2.1 time: 0.188261 Oct 13 08:51:51.161331 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2015/4339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:50 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:51.184330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:51.203970 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cf5c29e5-3ce1-44bc-b17a-39b2b630708a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.386618 Oct 13 08:51:51.204948 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2325/4340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:50 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:51.293539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21d585f9-d837-41c8-9570-c3770186f28a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: .version_select at 0x7f53756b5670>, body: {"keypair": {"name": "tempest-keypair-236405028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjkz82vqMlgPeXGq6gLh4UamW6RmnIBuXmLMgbhUMHOXoxp0H4nYl9fp9f8CtrKr2Zy4SOhaAABhrP9tjHsgjPIjYgfSztu+mWTvyc5oI0N+T6XUQdO0MUbtqNNpMuozQ=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:51.311935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-21d585f9-d837-41c8-9570-c3770186f28a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:51:51.321550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-21d585f9-d837-41c8-9570-c3770186f28a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for user 6f577a999e944e4ba79bd4771b2ddac2 and project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:51:51.350929 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21d585f9-d837-41c8-9570-c3770186f28a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062498 Oct 13 08:51:51.351601 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2016/4341] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:51:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:52.187773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:52.189127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:52.199028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:52.200028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:52.200703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:52.201743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:52.202474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:52.203120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:52.220892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:52.236115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:52.236727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:52.248649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:52.249247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:52.249903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:52.250636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:52.251100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:52.251516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:52.688036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:52.703355 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61051034-282d-4d0c-b124-0d3aefdf1da2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1505 microversion: 2.1 time: 0.519355 Oct 13 08:51:52.704053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2326/4342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:52 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:53.091601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:53.095909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:51:53.104946 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81632c7a-504d-44cd-9080-809221f2ea56 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.873416 Oct 13 08:51:53.106059 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2017/4343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:52 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:53.729990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:53.731638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:53.744733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:53.745592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:53.746993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:53.747954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:53.750837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:53.752567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:53.787685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2531613-8d13-4853-b69f-cd95a3445f2e", "name": "network-vif-plugged", "status": "completed", "tag": "8eb73bd2-2f68-4327-90ea-535813ee0a18"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:53.802672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:53.806686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:53.807816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:53.832869 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] Creating event network-vif-plugged:8eb73bd2-2f68-4327-90ea-535813ee0a18 for instance f2531613-8d13-4853-b69f-cd95a3445f2e on n-h2-858384-11 Oct 13 08:51:53.839958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-21188ae3-488e-4fed-bf24-929a99757625 req-00087027-3ab5-41c5-9c9c-6d0a202313d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059179 Oct 13 08:51:53.841335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2018/4344] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:54.114532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:54.129807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7285b50-d79f-411e-827b-997fce144c58 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1505 microversion: 2.1 time: 0.403873 Oct 13 08:51:54.130681 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2327/4345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:53 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:54.142738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:54.143100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:54.168259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:54.168821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:54.169282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:54.170045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:54.170529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:54.170962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:54.451566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:54.461024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5bc4b124-3dc3-47dc-9811-1432da9fe68b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.334970 Oct 13 08:51:54.462312 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2019/4346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:54 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:54.773349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1962584658", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bae9443-cd73-40ab-8560-9507aea16f5d"}], "security_groups": [{"name": "tempest-securitygroup--1645897292"}], "key_name": "tempest-keypair-236405028", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:54.976698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] validate_networks() for [('4bae9443-cd73-40ab-8560-9507aea16f5d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:51:55.156397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:55.157603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:55.185064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:55.187252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:55.188339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:55.192454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:55.193346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:55.194635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:55.513801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:55.527122 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e045bdff-8117-4784-b4e5-b2df5ef3c033 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1505 microversion: 2.1 time: 0.375482 Oct 13 08:51:55.545436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2020/4347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:55 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:55.551430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:55.552393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:55.559513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:55.560225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:55.560808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:55.561666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:55.562266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:55.562875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:55.810294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:55.826005 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6312e419-35d9-4054-9e79-fee8b013dbfd tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.279068 Oct 13 08:51:55.828677 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2021/4348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:55 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:55.911596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef48e06e-362e-47bd-8f27-3c4e8f05f988", "name": "network-vif-unplugged", "status": "completed", "tag": "9368ec10-cf05-46d3-9fbb-d2929c9d5d57"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:55.926762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:55.927602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:55.928670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:55.949089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] Creating event network-vif-unplugged:9368ec10-cf05-46d3-9fbb-d2929c9d5d57 for instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 on n-h2-858384-11 Oct 13 08:51:55.954842 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-94d8abfc-a2d8-414c-9bc4-4bff1142fde8 req-e4d1b22e-8897-4f02-8ffa-4911104fceec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048529 Oct 13 08:51:55.956173 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2022/4349] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:51:56.088940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:51:56.089433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:51:56.090681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:51:56.091169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:51:56.091689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:51:56.101271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.102217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.103019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.104812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.105591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.106250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.126909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:51:56.132771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Getting quotas for user 6f577a999e944e4ba79bd4771b2ddac2 and project caa87d8db3d2480cbde8aeb42f51ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:51:56.146252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:51:56.149107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:51:56.203533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18ef35df-c6de-4fca-a98b-c2ea912fe16d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.434420 Oct 13 08:51:56.204810 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2328/4350] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:51:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:51:56.222600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3993e4a8-2ad8-4a48-99f8-c98a13b41c88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:56.223350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3993e4a8-2ad8-4a48-99f8-c98a13b41c88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:56.551307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:56.551941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:56.569402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.570209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.570838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.571838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.572557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.573963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.697506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3993e4a8-2ad8-4a48-99f8-c98a13b41c88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:56.706887 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3993e4a8-2ad8-4a48-99f8-c98a13b41c88 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1245 microversion: 2.1 time: 0.493876 Oct 13 08:51:56.712687 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2023/4351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:56 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1245 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:56.762261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:56.781691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-261f70e3-2a66-465a-ab7b-8921d424def1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 200 len: 1508 microversion: 2.1 time: 0.223905 Oct 13 08:51:56.783193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2329/4352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:56 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:56.813844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:56.814351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:56.827239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.827754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.828182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.828889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.829344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.829772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.850790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:56.851752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:56.868405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.870161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.870929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.874541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:56.875446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:56.876168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:56.888804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:51:56.897465 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Working on deleting snapshot bbdc6871-34ec-4da5-b305-4d0055623a53 from shelved instance... Oct 13 08:51:57.232035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:57.244470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9bd7874b-3b86-4451-b7ff-df2f8cb240f3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1317 microversion: 2.1 time: 0.397830 Oct 13 08:51:57.246699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2330/4353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:56 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:57.736463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:57.737221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:57.744146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:57.744639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:57.745158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:57.757350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:57.757849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:57.758291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:57.946773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:57.996951 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1d54b94-959c-41cb-a592-714496f817e8 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1297 microversion: 2.1 time: 0.264235 Oct 13 08:51:58.001372 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2331/4354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:57 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1297 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:58.079531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Doing local delete in cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127031) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 13 08:51:58.081152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:58.081822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:58.082695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:58.083421 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 13 08:51:58.089319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] deallocate_for_instance() {{(pid=127031) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 13 08:51:58.277203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:58.278920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:58.294500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:58.298506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:58.299673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:58.302888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:58.304730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:58.305204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:58.712226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:58.721412 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3762cc4b-6378-4bf5-9a67-17c6e3b2f1a9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1507 microversion: 2.1 time: 0.450587 Oct 13 08:51:58.731551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2332/4355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:58 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:58.745693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:58.746318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:58.756160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:58.756569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:58.757003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:58.757730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:58.758141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:58.758587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.059721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:59.075800 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b72bd482-c4d1-4cf8-a941-51977f288b50 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1507 microversion: 2.1 time: 0.335157 Oct 13 08:51:59.076399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2333/4356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:58 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:59.083603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:59.084467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:59.092606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.093735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.094451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.095389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.096185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.096836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.262149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:59.276723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6ee44a1-18bd-4cfb-934d-2a3694ac1358 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1303 microversion: 2.1 time: 0.196068 Oct 13 08:51:59.277467 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2334/4357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:59 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:59.284441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:51:59.304934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:59.337725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.339616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.340529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.341489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.342165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.342913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.428727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e019a5d-b590-4f7f-b51c-a5254e8b17ca tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "PUT /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1079 microversion: 2.1 time: 0.148806 Oct 13 08:51:59.429672 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2335/4358] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:51:59 2022] PUT /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1079 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:51:59.457363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:59.458359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:59.466740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.467469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.468072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.469465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.470373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.471058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.886065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:51:59.895588 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07c39136-17fb-40f7-a07f-a2c94e4caeed tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1505 microversion: 2.1 time: 0.444024 Oct 13 08:51:59.896505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2336/4359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:59 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:51:59.937932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:51:59.938829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:51:59.945847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.946623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.947823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:51:59.949280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:51:59.949942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:51:59.950573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:00.535152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Updating instance_info_cache with network_info: [] {{(pid=127031) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:52:01.057600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:01.072232 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9aa84fcd-e6e5-468f-b56a-619503ee287f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1505 microversion: 2.1 time: 1.151897 Oct 13 08:52:01.073682 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2337/4360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:51:59 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1505 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:01.091031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:01.091550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:01.105376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.114538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.119676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.121191 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22af390a-fd12-450c-9a2f-e61f984f942e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 204 len: 0 microversion: 2.1 time: 4.312786 Oct 13 08:52:01.123497 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2024/4361] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:51:56 2022] DELETE /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 0 bytes in 4316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:52:01.124438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.127341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.127799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.132245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef48e06e-362e-47bd-8f27-3c4e8f05f988", "name": "network-vif-deleted", "tag": "9368ec10-cf05-46d3-9fbb-d2929c9d5d57"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:01.164015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.165402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.165836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.194015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_external_events [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] Unable to find a host for instance ef48e06e-362e-47bd-8f27-3c4e8f05f988. Dropping event network-vif-deleted {{(pid=127031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 08:52:01.197682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6431ca53-11d1-4019-9ffa-d426116cda87 req-f4e80fbc-3966-4635-9a94-94220610ddcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.072147 Oct 13 08:52:01.200109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2025/4362] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 08:52:01.214738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:01.220799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:01.229753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.230428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.230937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.231648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.232158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.232574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.319528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:52:01.320916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:52:01.321623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:52:01.322278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:52:01.322814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:52:01.399236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:01.408035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.408972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.409912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.411066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.413997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.414298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.448166 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5550649a-48b0-4e55-b5bf-88662e7a5183 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "POST /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e/action" status: 202 len: 1111 microversion: 2.1 time: 0.244804 Oct 13 08:52:01.448988 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2026/4363] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:52:01 2022] POST /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e/action => generated 1111 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 13 08:52:01.453881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:01.454853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:01.461608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.462353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.463243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.464788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.465977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.467040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.489448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 HTTP/1.1 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ef48e06e-362e-47bd-8f27-3c4e8f05f988'} Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:01.491621 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:52:01.496558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:01.497053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:01.498052 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcb131ee-7dde-4468-943d-2ea0537bdd4f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 404 len: 111 microversion: 2.1 time: 0.047766 Oct 13 08:52:01.499178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2027/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:01 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:01.509574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:01.510479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:01.530657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.534750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.535475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.537652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:01.538852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:01.541993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:01.653617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:01.673945 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b75f1988-dd03-429c-b4d9-5cf7053fb79e tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.599137 Oct 13 08:52:01.675373 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2338/4365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:01 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:01.683511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1270506457", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:01.759699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:52:01.871092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:01.879787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-097d4535-c0d4-4f49-87fe-55700aeab9e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.378781 Oct 13 08:52:01.880768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2028/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:01 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:02.700902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:02.703095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:02.713055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:02.713927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:02.714958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:02.716448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:02.716891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:02.717318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:02.947409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:02.951884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:02.966001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a184b752-b8b4-453f-ace2-a16883660b20 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.271958 Oct 13 08:52:02.968649 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2029/4367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:02 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:02.975922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:02.976927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:02.985920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:02.986430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:02.986888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:02.987784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:02.988405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:02.989140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:03.137163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:03.145532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6e7778f-df50-49e9-8524-12e37f66640e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.175672 Oct 13 08:52:03.146109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2030/4368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:02 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:03.215363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:03.224861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:03.225339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:03.225774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:03.238328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] Creating event network-changed:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:52:03.243558 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-82d05c94-5d3c-4019-b46e-eeae3fabb973 req-3a19148a-0d21-40ac-b506-9f8e5ac89dfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Oct 13 08:52:03.244165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2031/4369] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:03.573786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:52:03.574814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:52:03.575544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:52:03.576107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:52:03.576681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:52:03.585769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:03.586250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:03.586767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:03.587486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:03.587946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:03.588360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:03.621183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:03.627226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:03.641544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:52:03.644095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:03.657280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:03.699918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f09cea75-e804-46ad-ad11-00fa8050dddc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.022769 Oct 13 08:52:03.706759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2339/4370] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:52:03.712451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6486ac9c-066f-46d3-b697-4673c07b3d70 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:03.713855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6486ac9c-066f-46d3-b697-4673c07b3d70 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:03.833928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6486ac9c-066f-46d3-b697-4673c07b3d70 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:03.842360 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6486ac9c-066f-46d3-b697-4673c07b3d70 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1215 microversion: 2.1 time: 0.134277 Oct 13 08:52:03.843611 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2032/4371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:03 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:03.991071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:03.992082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:03.999412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.000773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.001386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:04.002272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.002976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.003586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:04.169754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:04.170661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:04.178603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.182700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.190879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:04.191867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.192672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.193329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:04.539570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:04.549509 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56ef86fd-49f5-4048-8b48-e2481d3e1a20 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.384271 Oct 13 08:52:04.550792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2033/4372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:04 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:04.673620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:04.681984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b9296a0-e447-4d1d-956d-65f9df8bd99a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.694940 Oct 13 08:52:04.686029 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2340/4373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:03 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:04.871676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:04.872060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:04.883054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.883553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.883995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:04.891890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:04.892852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:04.896244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:05.011985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:05.022489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcb7bd1b-89d8-4df0-b9b3-8884089d16c1 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1267 microversion: 2.1 time: 0.155872 Oct 13 08:52:05.023428 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2034/4374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:04 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:05.573810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:05.576046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:05.599154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:05.602807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:05.603535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:05.607451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:05.610123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:05.613709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:05.711249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:05.711768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:05.720147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:05.722849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:05.724896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:05.725722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:05.727114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:05.727751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:06.018474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:06.029775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7926c5eb-0677-4020-a63e-a78659a18750 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.322568 Oct 13 08:52:06.045913 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2035/4375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:05 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:06.057518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:06.058199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:06.065133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:06.065637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:06.066071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:06.067004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:06.067981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:06.068274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:06.171083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:06.180837 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d32b0b8-41b1-4a84-87cc-fa980d662f56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1273 microversion: 2.1 time: 0.133977 Oct 13 08:52:06.181882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2036/4376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:06 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1273 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:06.362021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:06.377855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97a77456-88aa-430d-8251-0d640d7127bf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.808374 Oct 13 08:52:06.379848 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2341/4377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:05 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:07.059082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:07.060869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:07.072617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.073901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.074572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.075427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.081137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.082761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.144999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "name": "network-vif-plugged", "status": "completed", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:07.171194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.171711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.172336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.185137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] Creating event network-vif-plugged:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:52:07.193057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8b4630ae-56c9-4169-b9fd-77988317d27b req-e15a6b48-fc1f-428f-8aa3-4b0980ca0a59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051763 Oct 13 08:52:07.194486 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2342/4378] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:07.206110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:07.206861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:07.231089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.231631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.234167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.235115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.235676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.236025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.629574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:07.644524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2673cced-b0aa-451d-aae4-9c4eac060204 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.595137 Oct 13 08:52:07.651466 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2037/4379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:07 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:07.666234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:07.667172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:07.676274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.678076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.678992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.680373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:07.681209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:07.682777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:07.888073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:07.899266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89ffe261-8e3f-4922-82d6-19fb9e1bf919 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.696996 Oct 13 08:52:07.902461 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2343/4380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:07 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:08.114825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:08.123424 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e50fdf7-fe58-4d14-96f8-ac7a4223c1dc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.470516 Oct 13 08:52:08.126298 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2038/4381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:07 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:08.236817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5bc8bc-af3a-41fb-80be-1217bfd52901", "tag": "9109b163-5aec-4a1f-8839-d6d2822314c2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:08.259366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:08.261661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:08.262878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:08.291971 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] Creating event network-changed:9109b163-5aec-4a1f-8839-d6d2822314c2 for instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 on n-h1-858384-11 Oct 13 08:52:08.305125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b20137dd-c5e0-4b2f-97bc-6d2701aebb26 req-4b546de9-26f8-4abf-a096-82fd8549ccda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072977 Oct 13 08:52:08.311054 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2344/4382] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:08.553323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-586047480", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a6770643-1f19-4a7c-8c17-fd344ecffdd2"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:08.659352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] validate_networks() for [('a6770643-1f19-4a7c-8c17-fd344ecffdd2', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:52:08.674250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:08.674981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:08.698854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:08.699714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:08.702581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:08.709480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:08.711305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:08.712089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:08.730776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:09.138866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:09.148185 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f76e8979-fec4-4fe9-acb3-dc6ce99e703c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1371 microversion: 2.1 time: 0.478400 Oct 13 08:52:09.153183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2345/4383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:08 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:09.162892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:09.163606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:09.195668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:09.196489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:09.199474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:09.203770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:09.208681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:09.209159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:10.011309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:10.045940 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2f3148f-fed6-42e9-b811-7e05d7b48195 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.891572 Oct 13 08:52:10.051373 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2346/4384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:09 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:10.061925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:10.067214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:10.074322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:10.075101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:10.075696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:10.076715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:10.077344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:10.077929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:10.560141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:10.568672 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6cd6c3ad-05a6-4775-99d7-804b4861a657 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.516047 Oct 13 08:52:10.569613 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2347/4385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:10 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:10.578649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:10.579279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:10.600324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:10.600834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:10.601283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:10.602009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:10.602495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:10.602936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:10.976952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:10.987096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b08ccea-9421-4a49-bce6-0428a6806f27 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1566 microversion: 2.1 time: 0.416423 Oct 13 08:52:10.987694 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2348/4386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:10 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1566 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:10.997909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:10.998378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:11.016448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:52:11.017646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:52:11.019021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:52:11.020281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:52:11.020906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:52:11.026677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.027412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.028039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.028915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.029532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.030118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.059260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.060408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.061006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.061899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.062545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.063163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.099468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Getting quotas for project 48670dcdb52f490f99c71fcd1fd56b9d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:11.099955 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31ddb99c-9c3a-4dfa-a3b3-5df66e5f6177 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/ips" status: 200 len: 147 microversion: 2.1 time: 0.108645 Oct 13 08:52:11.100965 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2349/4387] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:52:10 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/ips => generated 147 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:11.105566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Getting quotas for user 7e56c20456e84aa088b9735ed4032ee2 and project 48670dcdb52f490f99c71fcd1fd56b9d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:11.122359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Going to run 3 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:52:11.124753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:11.134943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:11.135689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:11.163968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.168492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.169765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.174294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=57f368c5-c513-4e99-8308-a18ebb78afa5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:11.181698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.187316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.192384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.227846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=dc4ec3c1-411f-434f-9031-b01d6a1c9733,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:11.367960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76bc6e30-d320-4547-94a8-805e20eeb2ea tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.028309 Oct 13 08:52:11.370145 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2039/4388] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:52:11.375884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:11.376718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:11.383773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.384660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.385418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.386512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.387312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.387948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.446839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d52bdb8-7be5-49d4-ad04-050ee2cdd9dd tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344709 Oct 13 08:52:11.448101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2350/4389] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:52:11 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:11.453406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:11.465549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:11.466400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:11.524078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.524635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.525088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.525952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.526434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.534213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.594279 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d560564-0f6c-4073-b6c5-9d4d35808771 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.144644 Oct 13 08:52:11.594931 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2351/4390] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:52:11 2022] GET /compute/v2.1/servers => generated 1015 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:11.607651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:11.608340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:11.617740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.618595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.619402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.620901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:11.621372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:11.621810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:11.678460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:11.696029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d432985-97dc-4757-81b7-336b6a9bfc33 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.318279 Oct 13 08:52:11.696696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2040/4391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:11 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:11.717069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb510b84-6002-4981-a69d-69779936d0e2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:11.717983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb510b84-6002-4981-a69d-69779936d0e2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:11.730689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:11.834641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb510b84-6002-4981-a69d-69779936d0e2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:11.843140 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb510b84-6002-4981-a69d-69779936d0e2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1222 microversion: 2.1 time: 0.134038 Oct 13 08:52:11.863421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2041/4392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:11 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:12.186007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:12.207464 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d3e5662-abe7-494c-a40e-6a16922eebc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.611461 Oct 13 08:52:12.214450 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2352/4393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:11 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:12.724081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:12.724771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:12.740842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:12.741353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:12.747482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:12.748252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:12.748724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:12.751415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:12.871914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aafb4c02-9b2e-46ab-9665-6faf6ce3bc1e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:12.873224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aafb4c02-9b2e-46ab-9665-6faf6ce3bc1e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:13.635344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:13.822160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:13.830889 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1324169-ccb7-4708-a9d1-0abcb61bfd94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 1.110723 Oct 13 08:52:13.838278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2042/4394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:12 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:13.847339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:13.847961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:13.860577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:13.864574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:13.867402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:13.868401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:13.869041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:13.870953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:13.932610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aafb4c02-9b2e-46ab-9665-6faf6ce3bc1e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:13.955681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aafb4c02-9b2e-46ab-9665-6faf6ce3bc1e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1222 microversion: 2.1 time: 1.081206 Oct 13 08:52:13.957954 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2353/4395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:12 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1222 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:14.152794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:14.165685 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b2b6090a-0f75-4573-a944-418589fa586f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.326225 Oct 13 08:52:14.184104 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2043/4396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:13 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:14.417045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:14.464661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.465323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.465771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.495559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:14.496056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:14.516093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.516609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.517048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.517751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.518200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.518645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.543830 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] Creating event network-changed:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:52:14.564972 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f8974a00-f88d-4657-9f8f-95cf68ccb850 req-021c6cd6-ceef-402b-bccb-38d60647ef8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152957 Oct 13 08:52:14.571441 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2354/4397] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:14.644468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:14.862332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:14.864551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:14.878084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.880629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.884517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.885815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.888346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.890217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.897390 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67ac2686-f260-4f92-bf96-4f65a0802f59 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 204 len: 0 microversion: 2.1 time: 0.406585 Oct 13 08:52:14.898139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2044/4398] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:14 2022] DELETE /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:52:14.910083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:14.914574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:14.934455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.935116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.935840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:14.937469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:14.938206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:14.938878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.394303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:15.408722 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a49e3e02-44b1-47a5-8e97-02e651dcfb42 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.552912 Oct 13 08:52:15.409316 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2355/4399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:14 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:15.424244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:15.424915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:15.436396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.436899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.437335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.439641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.442015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.445263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.558360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:15.570051 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58a897fe-4b4d-49cf-8e0c-d16564aea8ef tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1274 microversion: 2.1 time: 0.158831 Oct 13 08:52:15.571109 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2356/4400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:15 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:15.578790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:15.579847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:15.588483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.589496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.590288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.592383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.593250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.593917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.683790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:15.694154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b503417-b3d8-4654-b3f9-125061084641 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1666 microversion: 2.1 time: 0.790461 Oct 13 08:52:15.695426 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2045/4401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:14 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1666 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:15.711036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f55c660b-89d0-4d69-9c0e-a28f7f79b189"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:15.713885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:15.720878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.721593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.722210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.723144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:15.723766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:15.724779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:15.824134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:15.833510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c7082e15-017c-4f94-9ed5-9e7b44d588c8 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.260984 Oct 13 08:52:15.839026 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2357/4402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:15 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:16.435289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:16.436321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:16.454562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:16.457852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:16.458222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:16.460148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:16.462677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:16.464969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:16.688866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:16.742579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b4a11c55-cd95-4c0e-b218-defcec74cf7c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044358 Oct 13 08:52:16.745257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2046/4403] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:52:15 2022] POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments => generated 194 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:16.768365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:16.771594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:16.802882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:16.805692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:16.806465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:16.809327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:16.809963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:16.811687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:17.105084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:17.125352 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14baca4d-b22e-4bee-90e5-73664f9f6a7a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1274 microversion: 2.1 time: 0.370614 Oct 13 08:52:17.132677 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2047/4404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:16 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1274 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:17.144083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:17.144711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:17.155829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:17.165903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88c8caf2-114a-4fe0-be9f-9946a7d11ce3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.737676 Oct 13 08:52:17.167194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:17.167699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:17.168143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:17.168907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:17.169272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2358/4405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:16 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:17.169374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:17.169816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:17.183465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:17.187888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:17.200228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:17.203616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:17.205511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:17.206464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:17.210310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:17.211241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:17.965249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:17.977073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b0c6c38-8f7f-41bf-bf79-0c57903a143c tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1666 microversion: 2.1 time: 0.843182 Oct 13 08:52:17.979485 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2048/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:17 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1666 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:17.988890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5bc8bc-af3a-41fb-80be-1217bfd52901", "name": "network-vif-plugged", "status": "completed", "tag": "9109b163-5aec-4a1f-8839-d6d2822314c2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:18.007589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:18.009144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:18.009901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:18.023971 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] Creating event network-vif-plugged:9109b163-5aec-4a1f-8839-d6d2822314c2 for instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 on n-h1-858384-11 Oct 13 08:52:18.031230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ff32e028-a863-428f-bf2b-2089e32bb11c req-6ca17353-1ae6-4695-a66d-f85557c12457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050212 Oct 13 08:52:18.032111 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2049/4407] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:18.157397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:18.158576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:18.169676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:18.170181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:18.170672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:18.175169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:18.175876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:18.176479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:18.501419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:18.516953 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38f22f50-1022-4dd4-8515-c6b1970acfbc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1280 microversion: 2.1 time: 0.364364 Oct 13 08:52:18.530443 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2050/4408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:18 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1280 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:18.530443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:18.530443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:18.542303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:18.543000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:18.544065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:18.545009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:18.546134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:18.546777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:18.559711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:18.571102 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2acd6bd9-472f-493c-a5e4-9478d526d85e tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 1.398152 Oct 13 08:52:18.571654 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2359/4409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:17 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:19.008949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:19.010725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:19.027359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.028125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.028902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.029808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.030279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.030895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.245657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:19.260874 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b92037ab-1170-4041-bb19-a0fb98ca49a4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1666 microversion: 2.1 time: 0.256732 Oct 13 08:52:19.262599 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2360/4410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:19 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1666 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:19.393575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:19.408814 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-137384c1-834e-4c25-935f-400d65e3c35f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.889403 Oct 13 08:52:19.409457 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2051/4411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:18 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:19.545158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:19.546054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:19.565565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.571094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.571568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.572436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.572911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.573344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.603773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:19.605461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:19.618925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.621607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.622475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.624916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:19.627500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:19.629744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:19.771543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:19.781321 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0be7011a-2717-4e2e-b3c0-d61a99f7df51 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1280 microversion: 2.1 time: 0.241530 Oct 13 08:52:19.785620 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2361/4412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:19 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:20.060526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:20.075519 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05612112-c8fd-4e2c-8136-0ba6675fdc6f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.477065 Oct 13 08:52:20.090430 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2052/4413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:19 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:20.288968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:20.290177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:20.316514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.352380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.353465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.361549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.362599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.365157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.442759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:20.443376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:20.465656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.468245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.469269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.471521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.472159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.473742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.653660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:20.667077 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05a72452-f327-482e-9ebe-38ee0d4c43d4 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1598 microversion: 2.1 time: 0.381620 Oct 13 08:52:20.671003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2362/4414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:20 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1598 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:20.676234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83aac8b-837f-4c7f-9cc9-702579b2b650", "name": "network-vif-deleted", "tag": "e0ebee5a-7155-4db1-8c83-e248dec36358"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:20.703357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.714150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.717694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.745689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] Creating event network-vif-deleted:e0ebee5a-7155-4db1-8c83-e248dec36358 for instance b83aac8b-837f-4c7f-9cc9-702579b2b650 on n-h2-858384-11 Oct 13 08:52:20.774715 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ad20af78-7702-41ba-b617-f70fb8336d90 req-c6e04aff-f296-4fcc-a718-57fec47ad7db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102086 Oct 13 08:52:20.776482 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2363/4415] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:20.810462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:20.811384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:20.820846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.821626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.823412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.824493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:20.826077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:20.826883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:20.834780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:20.846127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b9ee1ae-ee9d-41fc-abb7-4b89f5310162 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1315 microversion: 2.1 time: 0.417685 Oct 13 08:52:20.852405 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2053/4416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:20 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:21.102732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:21.103349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:21.113085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:21.116604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:21.118030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:21.118517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:21.124930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:21.125505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:21.126376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:21.558802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:21.826270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:21.843067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:21.844398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-81200832-cad1-4f67-9ed0-5329fe586d58 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 1.037779 Oct 13 08:52:21.846617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2364/4417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:20 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:21.878087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:21.878741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:21.886899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:21.887648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:21.888239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:21.889158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:21.889781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:21.890365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:21.909458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:21.930258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:21.931120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:21.932426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:21.933380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lazy-loading 'fault' on Instance uuid b83aac8b-837f-4c7f-9cc9-702579b2b650 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:52:22.094938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35baa51647ac4228a92bc6a2ddff6dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae743f9829d841fc9afc965ed17a32f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:22.106285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe4addf3-622b-47fe-9991-864b0025a09b tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 200 len: 1315 microversion: 2.1 time: 0.238776 Oct 13 08:52:22.107716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2365/4418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:21 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:22.112961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:22.113808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:22.138138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:22.140775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:22.143291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:22.144053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:22.144539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:22.148245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:22.235787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:22.259100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19358721-c1f9-4acf-ba1e-32b1c3c5d88f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 1.157409 Oct 13 08:52:22.261542 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2054/4419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:21 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:22.843098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f368c5-c513-4e99-8308-a18ebb78afa5", "tag": "7ec1b93a-5b20-4148-8122-0ecfa47340a9"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:22.878256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:22.880877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:22.882246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:22.912729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:22.913188 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] Creating event network-changed:7ec1b93a-5b20-4148-8122-0ecfa47340a9 for instance 57f368c5-c513-4e99-8308-a18ebb78afa5 on n-h2-858384-11 Oct 13 08:52:22.922226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f05bf1cb-2416-4447-b541-f45f2633975e tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1502 microversion: 2.1 time: 0.813141 Oct 13 08:52:22.923155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-002e0124-1448-4ba1-965f-3ed31447b872 req-94980aaa-ae0c-4e11-bc4c-1cd5ea421404 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080976 Oct 13 08:52:22.927008 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2055/4420] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:22.927444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2366/4421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:22 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1502 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:22.949776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:22.950361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:22.951070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:22.958122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:22.958879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:22.959563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:22.987981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:52:22.988810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:22.989353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.005457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.009459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.013268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.016047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.054879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43f9a22c-14d4-48a0-b95d-e0280d4791e3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901/action" status: 202 len: 0 microversion: 2.1 time: 0.105659 Oct 13 08:52:23.055868 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2367/4422] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:52:22 2022] POST /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:52:23.070085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:23.071145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:23.089832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.091508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.092820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.095365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.097087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.097830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.485862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:23.498089 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ad0fadf-cde9-45b5-a693-e9e2ad7d0879 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.436790 Oct 13 08:52:23.505056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2368/4423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:23 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:23.515813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:23.517053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] [instance: b83aac8b-837f-4c7f-9cc9-702579b2b650] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:23.535922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.540474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.540968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.550059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.550578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.551022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.596480 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] HTTP exception thrown: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Request method failure captured: Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 HTTP/1.1 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FRFqo9RV11Q_76ildLGycqbz9F9laah9O5Og29wJgK-mQ1SpLtX4f1i0xN4_QYNQcBZev6MBl2we5uArnPe-ChTfrR6ZP7m9EkYtzDfpdoUL7wsNA5xl9ONBo1Vao2coGhRj7zsfSydI0xRSGBLkB0I_YvAlG3I4AeTCgqHm1clOc Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ae743f9829d841fc9afc965ed17a32f9 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersTestFqdnHostnames-1997242563 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae743f9829d841fc9afc965ed17a32f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ae743f9829d841fc9afc965ed17a32f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae743f9829d841fc9afc965ed17a32f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ae743f9829d841fc9afc965ed17a32f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersTestFqdnHostnames-1997242563 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ae743f9829d841fc9afc965ed17a32f9 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1997242563 Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersTestFqdnHostnames-1997242563-project Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 35baa51647ac4228a92bc6a2ddff6dbe Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersTestFqdnHostnames-1997242563-project Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b83aac8b-837f-4c7f-9cc9-702579b2b650'} Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:23.598164 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Returning 404 to user: Instance b83aac8b-837f-4c7f-9cc9-702579b2b650 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:23.601751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af2d982c-4857-4fc2-9780-b64afd834597 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650" status: 404 len: 111 microversion: 2.1 time: 0.099493 Oct 13 08:52:23.604118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2369/4424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:23 2022] GET /compute/v2.1/servers/b83aac8b-837f-4c7f-9cc9-702579b2b650 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:23.608839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:23.609465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:23.615535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.616019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.616453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.617160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:23.617612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:23.618038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:23.713700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:23.736856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5a3dd9e8-424a-4cb6-ac40-8a3170d0d43a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.807877 Oct 13 08:52:23.741887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2056/4425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:22 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:23.748110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4e7ad5e-1caa-4bd2-a746-28ca70951a72 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] Calling method '.version_select at 0x7f537559c550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:23.798235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4e7ad5e-1caa-4bd2-a746-28ca70951a72 tempest-ServersTestFqdnHostnames-1997242563 tempest-ServersTestFqdnHostnames-1997242563-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767150305" status: 202 len: 0 microversion: 2.1 time: 0.054189 Oct 13 08:52:23.799051 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2057/4426] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767150305 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:52:23.942165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:24.204143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:24.215397 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9cba4cd-c011-4914-ae83-cbec80db8ef7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.610043 Oct 13 08:52:24.216666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2370/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:23 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:24.410966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e54c98-7b67-42e4-9b41-3a0f28ce4faa", "tag": "5ab52edd-7df4-40d8-b720-df416e989637"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:24.421652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:24.422123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:24.422783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:24.436267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] Creating event network-changed:5ab52edd-7df4-40d8-b720-df416e989637 for instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa on n-h2-858384-11 Oct 13 08:52:24.441387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a7491684-a639-4c24-b4bc-74bce51d7e89 req-12d7f299-3157-4fe8-8726-1badf74500aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035041 Oct 13 08:52:24.442284 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2058/4428] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:24.524902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:24.530180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:24.536529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:24.537236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:24.537846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:24.538739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:24.539447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:24.539871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:24.765086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:24.766267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:24.778586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:24.781865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:24.782958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:24.784253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:24.785649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:24.786363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:24.886090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:24.901525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6912fcc6-b06d-46bb-8c7c-ce064c28d521 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.378592 Oct 13 08:52:24.903629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2371/4429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:24 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:24.980117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4ec3c1-411f-434f-9031-b01d6a1c9733", "tag": "09465e2c-0656-4676-a640-876b4b2f419b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:25.004061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:25.004555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:25.004992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:25.052980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] Creating event network-changed:09465e2c-0656-4676-a640-876b4b2f419b for instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 on n-h1-858384-11 Oct 13 08:52:25.062077 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2800ccdb-f9f6-459f-984d-281ec5b3f49b req-579709fa-c531-4561-9a87-606bc3300d86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086632 Oct 13 08:52:25.064419 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2372/4430] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:25.069489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:25.078560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb3eb97e-9211-404f-8707-959772cabb48 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.320704 Oct 13 08:52:25.079567 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2059/4431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:24 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:25.247225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:25.248035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:25.260318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:25.260825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:25.261228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:25.261931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:25.262385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:25.262827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:25.891609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:25.899365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-742b7334-ad7f-4467-800a-c073cd225a7c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.661128 Oct 13 08:52:25.900025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2373/4432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:25 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:25.925017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:25.925625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:25.932921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:25.933397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:25.933852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:25.934582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:25.935042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:25.935456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:26.113894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:26.114902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:26.122390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:26.122911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:26.123354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:26.124555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:26.125470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:26.126060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:26.458863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:26.470534 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59915b79-8860-4b58-8cc6-3d032ac231bb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.549234 Oct 13 08:52:26.471174 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2060/4433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:25 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:26.723478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:26.736413 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9ccf1ce-0df9-4344-ad8b-eeed17bb62be tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.626551 Oct 13 08:52:26.739759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2374/4434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:26 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:26.923081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:26.924065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:26.935043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:26.936338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:26.938498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:26.939326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:26.943082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:26.943671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.270336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:27.280089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0fe1b05-a7e0-4c8f-9c1b-c72c2a19e535 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.360905 Oct 13 08:52:27.280502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:27.281029 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2061/4435] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:26 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:27.295139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.298652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.299191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.343705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:52:27.409370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20cafb01-bb80-40f9-b359-b8367b50dfa3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action" status: 202 len: 0 microversion: 2.1 time: 0.131298 Oct 13 08:52:27.414278 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2375/4436] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:52:27 2022] POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:52:27.419209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:27.419831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:27.426105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.426635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.427076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.427803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.430918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.431763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.496835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:27.497917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:27.505693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.506557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.507203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.508175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.509050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.510228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.627256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:27.637856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35d8b016-7a12-4c42-85f6-68a4249b0b4a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.222457 Oct 13 08:52:27.638479 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2062/4437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:27 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:27.766427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:27.768987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:27.782698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.784747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.785397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.786495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:27.787429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:27.788039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:27.811763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:27.819533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e036c7c1-69eb-4375-b9b0-f9d56ae00bd5 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.327061 Oct 13 08:52:27.835795 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2376/4438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:27 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:27.971566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:27.980694 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d007011-9357-4633-8121-c9ec92c16c13 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.224042 Oct 13 08:52:27.981471 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2063/4439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:27 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:28.304287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:28.305071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:28.313092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.313878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:28.314606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:28.315671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.316363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:28.317128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:28.671818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:28.672639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:28.679003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.679504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:28.679941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:28.680647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.684150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:28.687078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:28.950286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:28.961518 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9e68cfb-f12b-43ba-bab8-94f50633a8a3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.300076 Oct 13 08:52:28.982442 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2064/4440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:28 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:28.982442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:28.982442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:28.983533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.984308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:28.986283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:28.995808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:28.996678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:28.999591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:29.000063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:29.007721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a3e201d-b958-4a8a-a378-8a38b5b3d5ef tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1516 microversion: 2.1 time: 0.707442 Oct 13 08:52:29.009996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2377/4441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:28 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1516 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:29.029192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:29.031032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:29.044250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:29.045064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:29.046139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:29.047243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:29.048231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:29.050998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:29.252369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:29.262653 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b31b2021-bdd6-43a7-aca3-8eac1bf3fcaf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.292180 Oct 13 08:52:29.264012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2065/4442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:28 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:29.269419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4ec3c1-411f-434f-9031-b01d6a1c9733", "name": "network-vif-plugged", "status": "completed", "tag": "09465e2c-0656-4676-a640-876b4b2f419b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:29.299978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:29.301250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:29.301864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:29.317363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] Creating event network-vif-plugged:09465e2c-0656-4676-a640-876b4b2f419b for instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 on n-h1-858384-11 Oct 13 08:52:29.326212 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-831fcca2-1da4-428b-8bba-7d6b6ea250f3 req-80e2aba8-2d8b-46b0-b3d1-2809f180833e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060456 Oct 13 08:52:29.328862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2066/4443] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:29.519919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:29.528701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cf66fe3-3688-45c9-8c3d-8532738339de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.517182 Oct 13 08:52:29.529629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2378/4444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:29 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:29.998864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:30.000400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:30.048483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:30.049474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:30.059937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.061988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.066236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.067840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.068708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.070867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.071489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.071612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.072832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.073588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.075086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.075765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.161182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:30.472728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:30.485059 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad72ed04-afe8-4044-bd2c-d151901e8cc5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.448233 Oct 13 08:52:30.486921 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2379/4445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:30 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:30.514717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:30.515358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:30.537565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.538234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.543927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.545152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.553332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.553879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.827120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:30.846209 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d1ba741-e817-4ea0-a195-19a2ce341ce1 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.848323 Oct 13 08:52:30.858664 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2067/4446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:29 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:30.880531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:30.887262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:30.899825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.904748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.905402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.907065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:30.908422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:30.911716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:30.946113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:30.959807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76e29c15-c6b4-4cb9-ab30-de8723d80a92 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.471825 Oct 13 08:52:30.961331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2380/4447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:30 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:31.344103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f368c5-c513-4e99-8308-a18ebb78afa5", "name": "network-vif-plugged", "status": "completed", "tag": "7ec1b93a-5b20-4148-8122-0ecfa47340a9"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:31.356252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:31.356727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:31.357340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:31.361796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:31.373680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] Creating event network-vif-plugged:7ec1b93a-5b20-4148-8122-0ecfa47340a9 for instance 57f368c5-c513-4e99-8308-a18ebb78afa5 on n-h2-858384-11 Oct 13 08:52:31.381315 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4398ed57-ae00-488c-a059-83f468b313c1 req-0d4ccd81-c2c7-4427-b83f-01836841a68f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040826 Oct 13 08:52:31.386080 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2381/4448] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:31.519008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:31.519541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:31.529041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:31.529786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:31.530379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:31.531368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:31.531974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:31.532548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:31.643910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:31.657923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-557e9e1b-ef57-411a-ab77-45f2aefa27b5 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.787541 Oct 13 08:52:31.659116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2068/4449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:30 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:31.878674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:31.880735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:31.898997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:31.900029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:31.901236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:31.903438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:31.905005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:31.906266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:32.170138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:32.188887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53f4f165-54a4-424b-a4f4-ea542ab52903 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.676450 Oct 13 08:52:32.191136 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2382/4450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:31 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:32.201853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:32.203335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:32.211075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:32.211561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:32.212021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:32.214161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:32.214668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:32.215280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:32.360179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:32.368177 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b79b205-1064-4dee-bcd4-227115fc36dd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.175707 Oct 13 08:52:32.370467 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2383/4451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:32 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:32.459979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:32.470361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-af5745ec-ad51-4569-a68c-9444160a7041 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.597172 Oct 13 08:52:32.470971 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2069/4452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:31 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:32.682965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:32.683926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:32.690372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:32.691173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:32.691830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:32.692787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:32.693712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:32.695099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:32.999292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:33.008643 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3b727ec-ec73-4d21-adec-4dd89f5d34b0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.330223 Oct 13 08:52:33.014436 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2384/4453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:32 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:33.218752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:33.219450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:33.240341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.240845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.241296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.242020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.242513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.242944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.393188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:33.393804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:33.403820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.404321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.404767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.405899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.406463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.407014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.589981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:33.600879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50c26095-03fc-458a-9120-9528e60896ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.211431 Oct 13 08:52:33.617743 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2385/4454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:33 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:33.622939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2531613-8d13-4853-b69f-cd95a3445f2e", "name": "network-vif-unplugged", "status": "completed", "tag": "8eb73bd2-2f68-4327-90ea-535813ee0a18"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:33.629435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:33.635724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.636448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.637027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.651306 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] Creating event network-vif-unplugged:8eb73bd2-2f68-4327-90ea-535813ee0a18 for instance f2531613-8d13-4853-b69f-cd95a3445f2e on n-h2-858384-11 Oct 13 08:52:33.656405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-70f30e5b-8095-4dc8-a039-38423a6ac3a1 req-1bf3e0aa-ae4c-46c8-9862-ac480df505b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037222 Oct 13 08:52:33.658171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2386/4455] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:33.665497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:33.666523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:33.673421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.674147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.674825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.676110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:33.677040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:33.677655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:33.710097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:33.738269 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3e8b600-6ba2-471d-9843-32ae626ee7da tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.524107 Oct 13 08:52:33.754692 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2070/4456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:33 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:34.002651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:34.020596 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2accde38-9210-485d-adbf-b2f093825a2d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.358058 Oct 13 08:52:34.022264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2387/4457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:33 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:34.041682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:34.042941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:34.051045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.051696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.052092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.052853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.053520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.053956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.297767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:34.307866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8bb746e1-9d42-4db8-86a2-9add0f669edc tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.270802 Oct 13 08:52:34.308623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2071/4458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:34 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:34.627488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:34.628305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:34.639186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.639680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.640119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.640828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.641290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.641714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.763698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:34.764311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:34.775750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.781180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.781766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.782552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:34.784873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:34.786606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:34.867713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:34.895260 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c1aaa5f-cdd6-4f89-9cb2-29b9988e5276 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.273867 Oct 13 08:52:34.899103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2388/4459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:34 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:35.048669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:35.049335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:35.056808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.057374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.057835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.058654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.060349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.060701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.198618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:35.209579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e410b9a-e754-4907-8740-fb71fc71e1a0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.448003 Oct 13 08:52:35.209579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2072/4460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:34 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:35.263585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:35.273447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-866847f0-69f9-4faa-837a-01709d5cd3ad tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.229522 Oct 13 08:52:35.274767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2389/4461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:35 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:35.332748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:35.333985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:35.342919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.343695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.345545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.351829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.352479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.352936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.679407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e54c98-7b67-42e4-9b41-3a0f28ce4faa", "name": "network-vif-plugged", "status": "completed", "tag": "5ab52edd-7df4-40d8-b720-df416e989637"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:35.715128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.727538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.727630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.748073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] Creating event network-vif-plugged:5ab52edd-7df4-40d8-b720-df416e989637 for instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa on n-h2-858384-11 Oct 13 08:52:35.759071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c0899a76-518a-4fd2-ac36-ffc9f0ec63ed req-ec43f9e2-88d8-4d38-9ebb-e9d67cab7df7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084538 Oct 13 08:52:35.761624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2390/4462] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:35.843795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:35.854274 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-291aae95-6b82-4d31-871d-9d4e530a867d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.525948 Oct 13 08:52:35.855245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2073/4463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:35 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:35.924792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:35.925827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:35.933894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.934660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.935324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:35.936253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:35.936906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:35.937586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.198182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:36.216151 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4d08368-fe1f-408c-9d95-27ebd1f1da50 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.295645 Oct 13 08:52:36.232199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2391/4464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:35 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:36.248585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:36.249495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:36.256479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.257635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.258924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.260300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.261236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.261661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.300536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:36.301646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:36.314342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.314874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.315318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.316050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.316600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.316918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.492503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:36.505167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-118dda6e-18d0-4bbc-b118-a999693e6ed9 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.272073 Oct 13 08:52:36.505767 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2074/4465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:36 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:36.880456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:36.882161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:36.892151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.893327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.894221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.895453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:36.896253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:36.897085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:36.919311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:36.934253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73cae852-e75b-48d0-a660-d02d9578717e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.639965 Oct 13 08:52:36.938438 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2392/4466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:36 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:37.200364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:37.212588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-efb86324-a76f-430d-afb1-4abb8ee7f11f tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1322 microversion: 2.1 time: 0.336892 Oct 13 08:52:37.221464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2075/4467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:36 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:37.250424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:37.251266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:37.263899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.264767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.265620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:37.266889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.267606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.268181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:37.530103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:37.531733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:37.539694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.540613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.541451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:37.542565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.543238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.544079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:37.554628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:37.571837 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00744f56-370b-4a67-adde-52c6a007d3fe tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.325108 Oct 13 08:52:37.575323 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2393/4468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:37 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:37.829174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:37.837937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-560b4e35-2070-41e3-9759-d1545d7722b0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.311951 Oct 13 08:52:37.841988 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2076/4469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:37 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:37.959379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:37.961407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:37.974942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.975922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.976475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:37.980246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:37.982389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:37.983277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.166329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2531613-8d13-4853-b69f-cd95a3445f2e", "name": "network-vif-plugged", "status": "completed", "tag": "8eb73bd2-2f68-4327-90ea-535813ee0a18"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:38.182973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.187464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.188009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.218968 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] Creating event network-vif-plugged:8eb73bd2-2f68-4327-90ea-535813ee0a18 for instance f2531613-8d13-4853-b69f-cd95a3445f2e on n-h2-858384-11 Oct 13 08:52:38.229548 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ba4ba9de-b764-45f9-8457-21ce6cd40419 req-fcbb9b19-4020-487f-822e-fc432c351f90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066882 Oct 13 08:52:38.230819 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2077/4470] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:38.237137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:38.241634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:38.254249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.254991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.255528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.256693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.257248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.257788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.292630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:38.308421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54991e37-dd84-46ba-8f93-58fdca54d9d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.351000 Oct 13 08:52:38.309301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2394/4471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:37 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:38.519723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:38.534860 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f76db574-8176-4fd2-8cc2-0cf6c381d49d tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1514 microversion: 2.1 time: 0.296398 Oct 13 08:52:38.536631 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2078/4472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:38 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:38.562276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:38.563141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:38.569677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.570191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.570652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.571357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.571848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.572272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.601778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:38.602387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:38.617047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.617527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.617965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.629126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.633838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.635739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.850567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:38.861246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb97df40-821a-4635-9f19-25276e3ecec8 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 200 len: 1515 microversion: 2.1 time: 0.303494 Oct 13 08:52:38.862557 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2395/4473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:38 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:38.901769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:38.902734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:38.918052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.918914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.919543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.921004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:38.921658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:38.922276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:38.963616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:38.985388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1965f0cc-f4ab-4805-8597-7532d3720566 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.388864 Oct 13 08:52:38.994276 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2079/4474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:38 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:39.013325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:39.014246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:39.021324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.025429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.026864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.027989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.029629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.034599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.239093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:39.254132 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1de133c4-ead7-4f7b-9c14-c7910d78325b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.362862 Oct 13 08:52:39.255303 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2396/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:38 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:39.334789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:39.338102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:39.339111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:39.349464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.350433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.351937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.353392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.353651 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dbf751a-099f-459c-8a14-7f0902710706 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 200 len: 1514 microversion: 2.1 time: 0.357280 Oct 13 08:52:39.354255 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2080/4476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:38 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:39.359702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.361126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.395212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:39.402613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:39.409070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.417130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.417589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.418339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.418825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.421996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.457081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:39.607643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e0a36ef-62c3-49f2-92c7-750c0f6ad1ba tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 204 len: 0 microversion: 2.1 time: 0.234106 Oct 13 08:52:39.608565 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2081/4477] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:39 2022] DELETE /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:52:39.617570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:39.618291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:39.636207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.636712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.637224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.638133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:39.639812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:39.640459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:39.959615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:39.974089 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-578cfed2-379d-4a93-92c1-6d9db5c90b31 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.643183 Oct 13 08:52:39.986814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2397/4478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:39 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:40.019605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:40.021014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:40.049067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:40.049990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:40.050746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:40.051658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:40.058777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:40.060028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:40.267294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:40.270584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:40.285448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f4561df-014a-4d90-8fd3-6975d04871c9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 200 len: 1520 microversion: 2.1 time: 0.672489 Oct 13 08:52:40.301601 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2082/4479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:39 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 1520 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:40.315783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:40.317694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:40.355648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:40.393438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:40.395987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:40.396709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:40.397874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:40.399688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:40.402361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:40.604534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:40.620069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-594c1dd2-92b5-41a9-aeeb-fcd9f308154a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.603687 Oct 13 08:52:40.632386 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2398/4480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:40 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:40.707326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:40.720024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db5b6d81-f392-4e8b-9ba8-e66f573aa507 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1522 microversion: 2.1 time: 0.416701 Oct 13 08:52:40.737066 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2083/4481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:40 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:41.002838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:41.004981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:41.021514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.024835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.026988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.029534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.030321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.030934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.318316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:41.319810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:41.334210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.336580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.338428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.341016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.343127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.343900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.641761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:41.651103 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f839fc9-def6-48ad-9306-98b13ea45f86 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 200 len: 1520 microversion: 2.1 time: 0.336726 Oct 13 08:52:41.651711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2084/4482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:41 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:41.666745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:41.667579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:41.680259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.688045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.688788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.689680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.690308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.690885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.755021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:41.760638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:41.777680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-116dfbe6-623b-4c11-ad6c-6e12b21bd2b8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.779407 Oct 13 08:52:41.778878 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2399/4483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:40 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:41.797585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:41.798530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:41.813699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.815092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.817350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:41.818105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:41.818683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:41.819026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.139053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:42.139257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:42.183836 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8bffd82a-a6c5-4356-8482-ebf6877c7ab7 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1507 microversion: 2.1 time: 0.398447 Oct 13 08:52:42.196610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc58c308-2c59-46d3-a6b5-8233e51cd9cd tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.530359 Oct 13 08:52:42.197578 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2085/4484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:41 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:42.198179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2400/4485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:41 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:42.212886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:42.213813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:42.224160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.224742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.225299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.226368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.226912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.227464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.679486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:42.680283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:42.695346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.696276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.697237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.698614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.699328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.700663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.883308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:42.899084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca7a8a2b-d7a8-4b6d-b482-b78f9584ccbc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 200 len: 1507 microversion: 2.1 time: 0.690850 Oct 13 08:52:42.899249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:42.900701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2401/4486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:42 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 1507 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:42.905617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f368c5-c513-4e99-8308-a18ebb78afa5", "name": "network-vif-deleted", "tag": "7ec1b93a-5b20-4148-8122-0ecfa47340a9"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:42.926142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d5d68e3-5687-4b5f-87bc-5f2a868334c3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 200 len: 1478 microversion: 2.1 time: 0.250842 Oct 13 08:52:42.926956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2086/4487] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:42 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:42.930539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.933937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.935248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.950678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:42.955656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:42.977957 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] Creating event network-vif-deleted:7ec1b93a-5b20-4148-8122-0ecfa47340a9 for instance 57f368c5-c513-4e99-8308-a18ebb78afa5 on n-h2-858384-11 Oct 13 08:52:42.978731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.980598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.982960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:42.988079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:42.991114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:42.993286 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-525923a1-c7c9-409b-9731-5df71027c604 req-7390461c-1a1d-41fd-89f9-876d3c730566 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091039 Oct 13 08:52:42.994149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.004286 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2402/4488] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:43.021774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:43.022766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:43.063284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.066703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.067392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.071147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.074361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.074952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.128885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:43.242450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfb92096-5da5-4618-8d87-0a5c28ab5dec tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 204 len: 0 microversion: 2.1 time: 0.236406 Oct 13 08:52:43.249821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2403/4489] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:43 2022] DELETE /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:52:43.260973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:43.261696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:43.274509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.275066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.275508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.276229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.276686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.277119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.579984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:43.591886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d650e5d7-dbe6-42f0-b1f9-21c8a2f9856b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.655487 Oct 13 08:52:43.594474 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2087/4490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:42 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:43.605153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1587730048", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "d49e29fb-d62c-46f3-834a-cda4bc95d8ec"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:43.644163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:43.659844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f2c2b01-cd5f-40ce-9363-9d4ae9559320 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.410168 Oct 13 08:52:43.678522 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2404/4491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:43 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:43.716545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] validate_networks() for [('d49e29fb-d62c-46f3-834a-cda4bc95d8ec', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:52:43.949888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:43.950712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:43.966988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.967502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.967952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:43.968681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:43.969143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:43.969578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.050782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:44.054294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:44.055199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.056706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lazy-loading 'fault' on Instance uuid 57f368c5-c513-4e99-8308-a18ebb78afa5 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:52:44.133916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:44.145761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b909428-7d19-4e60-8a57-38d0799ec05b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 200 len: 1312 microversion: 2.1 time: 0.200211 Oct 13 08:52:44.153010 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2405/4492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:43 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:44.638216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2148fb92-f2be-4bdc-bf7a-995c1a3628c8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Action: 'create', calling method: .version_select at 0x7f53756541f0>, body: {"keypair": {"name": "tempest-keypair-1018598068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuDcxJU3wZRdi8iFTCDnujWiIdRojacY3FiNCNPonqTXv9eFJ8FvsuYuaIpIExFplNgEiA6/JgtYkmBu16gOjKSbxvInmX2TRKj265eyMmyMqccVaHoJHNgfsc0gUjQZA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:44.655981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2148fb92-f2be-4bdc-bf7a-995c1a3628c8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:44.665482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2148fb92-f2be-4bdc-bf7a-995c1a3628c8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for user 3681c8dbae004d1eb8f381f28a41b55b and project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:44.707995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2148fb92-f2be-4bdc-bf7a-995c1a3628c8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.247319 Oct 13 08:52:44.709488 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2406/4493] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:52:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:44.727095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:44.734535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:44.756686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:44.757243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:44.757705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.763679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:44.764174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:44.766209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.803554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:52:44.804131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:52:44.804454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:52:44.805316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:52:44.806120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:52:44.827612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:44.828409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:44.829783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.832388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:44.834564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:44.836559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:44.885019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:44.894924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Getting quotas for user 31ba8f040ba341488b82d5240d3ff474 and project d78189ef54c54346b68b51fb1ef9befb. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:44.934659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:52:44.937684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:45.060744 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82b71e78-ef46-4508-a30a-62504779d64c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463968 Oct 13 08:52:45.069618 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2088/4494] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:52:45.076536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.077919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:45.092251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.093112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.093981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.095581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.097579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.098184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.178928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.198591 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd380d76-d2b6-418a-b430-735d7fd20a8e tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1724 microversion: 2.1 time: 0.487992 Oct 13 08:52:45.212622 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2407/4495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:44 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:45.237132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a851623e-e1aa-4bfb-b718-0883ea1202f1 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.237819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a851623e-e1aa-4bfb-b718-0883ea1202f1 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:45.419716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a851623e-e1aa-4bfb-b718-0883ea1202f1 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.435497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a851623e-e1aa-4bfb-b718-0883ea1202f1 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1218 microversion: 2.1 time: 0.216711 Oct 13 08:52:45.438221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2408/4496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:45.445268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.446296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:45.456384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.457328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.458362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.459430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.459926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.461694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.463243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.473860 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ade7bb6e-2713-4b82-a6af-fc6493045ae8 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.402198 Oct 13 08:52:45.475342 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2089/4497] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:45.490230 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] HTTP exception thrown: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 HTTP/1.1 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '57f368c5-c513-4e99-8308-a18ebb78afa5'} Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.493177 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:45.497285 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.501306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 404 to user: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:45.516277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37675e4b-85e0-44a7-a9f9-da80c278bc4b tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 404 len: 111 microversion: 2.1 time: 0.072062 Oct 13 08:52:45.518133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2409/4498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:45.527430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.532552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.533449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:45.538966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.539446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.539879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.540655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.541209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.541639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.720181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95e9cdc6-b053-4c78-ad38-fe444f7046d4 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.196048 Oct 13 08:52:45.721017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2090/4499] 10.222.0.23 () {58 vars in 1230 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:52:45.733843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c36fadd6-89b5-47e1-ae7f-3b6c501bfe64 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c36fadd6-89b5-47e1-ae7f-3b6c501bfe64 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 13 08:52:45.740035 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 13 08:52:45.744514 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:45.751870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c36fadd6-89b5-47e1-ae7f-3b6c501bfe64 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:45.753153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c36fadd6-89b5-47e1-ae7f-3b6c501bfe64 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023458 Oct 13 08:52:45.753797 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2410/4500] 10.222.0.23 () {58 vars in 1182 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:52:45.763387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.774611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.775823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:45.785177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.785836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.786478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.787364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.788171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.788888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.823964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:52:45.875335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8946276a-bc51-4e70-98e9-f40b18033d94 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.116254 Oct 13 08:52:45.889544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:45.905121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2091/4501] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers => generated 681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:45.915819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:45.916819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.servers [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Removing options 'limit' from query {{(pid=127030) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 13 08:52:45.919714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:45.936864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.937625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.938861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:45.941791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:45.942712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:45.945312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.007912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:52:46.062180 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26ed3517-16b1-479f-9f1e-6a77fc40ebe3 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.174159 Oct 13 08:52:46.063190 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2411/4502] 10.222.0.23 () {58 vars in 1144 bytes} [Thu Oct 13 08:52:45 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:46.077421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae860c35-748e-4ea7-9328-58acd2ba6dec tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae860c35-748e-4ea7-9328-58acd2ba6dec tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: action_args: {} Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '-1' Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 13 08:52:46.086334 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 13 08:52:46.092587 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.094720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae860c35-748e-4ea7-9328-58acd2ba6dec tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:46.097139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae860c35-748e-4ea7-9328-58acd2ba6dec tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024350 Oct 13 08:52:46.097914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2092/4503] 10.222.0.23 () {58 vars in 1142 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:52:46.107506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb4f324b-493d-437d-978e-2952478ccc12 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb4f324b-493d-437d-978e-2952478ccc12 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: action_args: {} Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'testing' Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 13 08:52:46.111809 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb4f324b-493d-437d-978e-2952478ccc12 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:46.116426 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb4f324b-493d-437d-978e-2952478ccc12 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009799 Oct 13 08:52:46.124789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2160bb91-56e7-48e0-ae53-4b51d409c2a6 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.131594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2412/4504] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:52:46.138707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2160bb91-56e7-48e0-ae53-4b51d409c2a6 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.139602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2160bb91-56e7-48e0-ae53-4b51d409c2a6 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:46.157244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.servers [None req-2160bb91-56e7-48e0-ae53-4b51d409c2a6 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Flavor 'non_existing_flavor' could not be found {{(pid=127031) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 13 08:52:46.158355 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2160bb91-56e7-48e0-ae53-4b51d409c2a6 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039328 Oct 13 08:52:46.159144 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2093/4505] 10.222.0.23 () {58 vars in 1178 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:52:46.172336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.177540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.178888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:46.189545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.190782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.191947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.193056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.194883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.195766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.231602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.232652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:46.239972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.240758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.241737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.244413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.245124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.245774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.359515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-553fcd4e-41b4-44fb-922c-c142a43ea22e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.190978 Oct 13 08:52:46.368514 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2413/4506] 10.222.0.23 () {58 vars in 1174 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:52:46.373710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.379371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.380102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:46.386517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.387772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.389251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.390092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.390740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.391262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.491813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f773b75a-5f84-4af1-a62a-4c8dbcdbc3d9 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.122146 Oct 13 08:52:46.492471 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2414/4507] 10.222.0.23 () {58 vars in 1184 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:52:46.505082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.506005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:46.513333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.514088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.514709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.516702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.518639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.519288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.656845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.671714 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1f53a1b-1b39-486b-b814-66c3fa4d7094 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1701 microversion: 2.1 time: 0.449359 Oct 13 08:52:46.691415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2094/4508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1701 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:46.704820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.705444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:46.724306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.745364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.747831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.749131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.751624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb715f81-9966-43f9-9d7a-602ee4bec294 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1270 microversion: 2.1 time: 0.247370 Oct 13 08:52:46.753132 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2415/4509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:46.757665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.758369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.764956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.768786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:46.787341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.788135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:46.811824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.813929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.814487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.815364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.817232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.818047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:46.880243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:52:46.952731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:46.966660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:46.967152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:46.967603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.336431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86a3b6d2-b47e-4cdb-b281-7c388b8ac7a7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.579022 Oct 13 08:52:47.337660 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2416/4510] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:47.342767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:47.350687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.351457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.352025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.381718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Going to try to start instance {{(pid=127030) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 08:52:47.451547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e356db2-95f9-4ae3-92a5-61e7dde1ea58 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action" status: 202 len: 0 microversion: 2.1 time: 0.111567 Oct 13 08:52:47.453570 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2417/4511] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:52:47 2022] POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:52:47.462445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2531613-8d13-4853-b69f-cd95a3445f2e", "name": "network-vif-deleted", "tag": "8eb73bd2-2f68-4327-90ea-535813ee0a18"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:47.480072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.480914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.481614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.499689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] Creating event network-vif-deleted:8eb73bd2-2f68-4327-90ea-535813ee0a18 for instance f2531613-8d13-4853-b69f-cd95a3445f2e on n-h2-858384-11 Oct 13 08:52:47.505681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2d85329f-d2e4-4017-8284-f9e72ab191bf req-d64d89cf-55a8-4926-ab2b-0fd5fc34bef1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049506 Oct 13 08:52:47.507052 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2418/4512] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:47.514763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca041904-dfd3-49c3-8c8e-5e4a359d2e31 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:47.520762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ca041904-dfd3-49c3-8c8e-5e4a359d2e31 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:47.522369 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca041904-dfd3-49c3-8c8e-5e4a359d2e31 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013916 Oct 13 08:52:47.523691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2419/4513] 10.222.0.23 () {58 vars in 1178 bytes} [Thu Oct 13 08:52:47 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:52:47.530230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:47.531839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:47.539181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.540063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.541549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.542576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.543411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.544092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.614706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:47.631220 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b8ee1f3-570e-42da-b33e-08716ab1d5f3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.938035 Oct 13 08:52:47.632397 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2095/4514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:46 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:47.646362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:47.662714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:47.666500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Searching by: {'deleted': False, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:52:47.686552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.687153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.687866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.691015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.691579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.692101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.805635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:52:47.874189 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5da2b47c-f723-4f8d-b51d-9c61fd58fd0a tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.238597 Oct 13 08:52:47.875469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2096/4515] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:52:47 2022] GET /compute/v2.1/servers => generated 681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:47.901254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:47.901577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:47.902468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:47.904249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:47.909886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.910770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.911626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.912594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.913230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.914535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.921944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99f2d9d2-ff2d-4c14-a93e-95ea4968cda0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1710 microversion: 2.1 time: 0.395115 Oct 13 08:52:47.938436 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2420/4516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:47 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1710 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:47.949232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:47.950067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:47.973148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.974060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.975168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:47.976945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:47.978222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:47.978755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.002707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] HTTP exception thrown: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 HTTP/1.1 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '57f368c5-c513-4e99-8308-a18ebb78afa5'} Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:48.004510 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 404 to user: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-326b31ea-0a8c-47bc-87a1-3045e351f861 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 404 len: 111 microversion: 2.1 time: 0.080659 Oct 13 08:52:48.008423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2421/4517] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:47 2022] DELETE /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:48.031703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:48.031703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:48.047123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.047784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.048702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.049258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.049771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.050233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.063011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:48.077155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1c257d5-f2b9-4dd0-98e3-700a7cc680c0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1276 microversion: 2.1 time: 0.200361 Oct 13 08:52:48.078062 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2097/4518] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:47 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:48.100566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:48.219125 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90ba6d59-c6df-42a8-8b39-3ee11a1c96a2 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 204 len: 0 microversion: 2.1 time: 0.206882 Oct 13 08:52:48.219399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2422/4519] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:48 2022] DELETE /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:52:48.239964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:48.242752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:48.271844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.272730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.276840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.282098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.283943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.287147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.410358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:48.482992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16778e46-05e7-4f5a-b281-86c165925c93"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:48.486747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:48.495951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.496880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.497703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.499229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.499940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.500872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.582805 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7024ebe9-b0d9-46f0-b18a-4014e14edec7 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 204 len: 0 microversion: 2.1 time: 0.358042 Oct 13 08:52:48.588420 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2098/4520] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:48 2022] DELETE /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:52:48.595094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:48.595798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 57f368c5-c513-4e99-8308-a18ebb78afa5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:48.606828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.608611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.609095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.618273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.618999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.622485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.638684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] HTTP exception thrown: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 HTTP/1.1 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '57f368c5-c513-4e99-8308-a18ebb78afa5'} Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.640744 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 404 to user: Instance 57f368c5-c513-4e99-8308-a18ebb78afa5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a9e38a53-0216-4e3d-8390-9267ea7be4cd tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5" status: 404 len: 111 microversion: 2.1 time: 0.052833 Oct 13 08:52:48.645090 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2099/4521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:48 2022] GET /compute/v2.1/servers/57f368c5-c513-4e99-8308-a18ebb78afa5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:48.656282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:48.657089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:48.664592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.665094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.665626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:48.667089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:48.667545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:48.667971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.026941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:49.035243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73f6c5f2-a228-4111-a602-e8d115a85e80 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 200 len: 1521 microversion: 2.1 time: 0.385967 Oct 13 08:52:49.036125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2100/4522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:48 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:49.042978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:49.043925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:49.051297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.052161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.052819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.053818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.054550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.055923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.097725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:49.367756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:49.378935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09f597e3-ab96-46cf-bc96-2f09705c9446 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.341326 Oct 13 08:52:49.381976 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2101/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:49 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:49.387679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:49.388568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:49.394953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.395659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.396414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.397295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.398073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.398702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.851533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0dbcbdd0-b85a-401e-8192-bada83e37863 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.376563 Oct 13 08:52:49.854068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2423/4524] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:52:48 2022] POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 194 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:49.889672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:49.897242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:49.937245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.942180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.947989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:49.951585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:49.954649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:49.955851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:50.275122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:50.285775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f1ffd4a-d312-4cfb-8e62-16c722c4655b tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.430070 Oct 13 08:52:50.286706 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2424/4525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:49 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:50.291903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:50.292510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:50.295434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:50.311442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:50.311957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:50.312410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:50.313141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:50.313699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:50.314007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:50.364041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:50.374386 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b347897-bfc7-43ad-91eb-194c7ecb74f0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1710 microversion: 2.1 time: 0.990605 Oct 13 08:52:50.375503 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2102/4526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:49 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1710 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:50.401306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:50.402225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:50.409212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:50.409984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:50.411669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:50.413040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:50.417811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:50.419099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:50.657683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:50.670969 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f3855b9-2222-403f-9488-a3dd330afd7e tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 200 len: 1521 microversion: 2.1 time: 0.381349 Oct 13 08:52:50.672209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2425/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:50 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:50.995652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f52a59-f2e1-4318-b9ce-13ffd223c972", "tag": "ee271360-30b7-417f-ae85-e3340a8a56f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:51.009702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:51.010732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:51.011645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:51.068820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] Creating event network-changed:ee271360-30b7-417f-ae85-e3340a8a56f6 for instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 on n-h2-858384-11 Oct 13 08:52:51.074139 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8d88fb19-524e-44d6-a5b2-c0058dfe944a req-ec84fcef-d078-4ef5-8602-c67d3be8a4a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084113 Oct 13 08:52:51.079115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2426/4528] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:51.095368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1795735581", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c7ed1f90-0ec7-448d-a3de-8a6447f39fb6"}], "security_groups": [{"name": "tempest-securitygroup--1951368445"}], "key_name": "tempest-keypair-1018598068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:51.381423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] validate_networks() for [('c7ed1f90-0ec7-448d-a3de-8a6447f39fb6', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:52:51.602299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:51.629208 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-31605288-af8f-4d20-b7f5-7df3594812d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 1.231886 Oct 13 08:52:51.652243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2103/4529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:50 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:51.658203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:51.660835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:51.680224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:51.681558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:51.682214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:51.683206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:51.683847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:51.684461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.110945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:52.117173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for user 3681c8dbae004d1eb8f381f28a41b55b and project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: dict_keys(['metadata_items']) {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:52.131897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:52:52.132319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:52:52.132793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:52:52.133201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:52:52.133607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:52:52.142366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.143170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.143602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.144908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.145412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.145898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.166533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:52:52.172282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Getting quotas for user 3681c8dbae004d1eb8f381f28a41b55b and project 696ab20443ee4b6cb24865bfe4ab0db1. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:52:52.186516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:52:52.189072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:52:52.209379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:52.229831 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e47e9cec-9bc3-4bc0-8bb1-7313efa4613c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.572576 Oct 13 08:52:52.232459 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2104/4530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:51 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:52.239347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:52.240389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:52.248304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.250461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.251150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.252061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.253064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.253794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.267317 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-290643ca-2e1c-44fa-9549-d8909839d248 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.186886 Oct 13 08:52:52.268446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2427/4531] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:52:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:52:52.273637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:52.274929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:52.290969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.293378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.293990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.294971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.295819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.296390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.403145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:52.424615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf3b8cbd-3661-4910-bcf6-1953a49ffe72 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 200 len: 1479 microversion: 2.1 time: 0.154819 Oct 13 08:52:52.426363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2428/4532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:52 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 1479 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:52.436094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e71af6c-a25b-44df-9e1a-6ad55d84c1eb tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:52.437411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e71af6c-a25b-44df-9e1a-6ad55d84c1eb tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:52.501166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e71af6c-a25b-44df-9e1a-6ad55d84c1eb tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:52.522018 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e71af6c-a25b-44df-9e1a-6ad55d84c1eb tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1270 microversion: 2.1 time: 0.090286 Oct 13 08:52:52.523286 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2429/4533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:52 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:52.578011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e54c98-7b67-42e4-9b41-3a0f28ce4faa", "name": "network-vif-deleted", "tag": "5ab52edd-7df4-40d8-b720-df416e989637"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:52.603361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.604443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.607187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.625846 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] Creating event network-vif-deleted:5ab52edd-7df4-40d8-b720-df416e989637 for instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa on n-h2-858384-11 Oct 13 08:52:52.633863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8d2943f4-b866-4e0d-849d-e01c79eee0e3 req-e35e28e1-ea0c-4d8c-bfc9-821c9e03b641 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060961 Oct 13 08:52:52.635408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2430/4534] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:52.661340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:52.662337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:52.688635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.689221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.690121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.692501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:52.693034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:52.694812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:52.812350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:52.833149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66c9a680-2f53-4d37-97e8-069f068b76ab tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1710 microversion: 2.1 time: 0.599252 Oct 13 08:52:52.849179 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2105/4535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:52 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1710 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:53.128955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:53.137546 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ec21ddb-8c41-4f1a-98f1-2e32dc706213 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1512 microversion: 2.1 time: 0.485997 Oct 13 08:52:53.142472 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2431/4536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:52 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:53.256238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:53.257373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:53.267167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.267890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.276453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.277393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.277879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.278315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.463120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:53.463943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:53.471479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.472235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.472838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.473559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.474010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.474445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.508033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.508866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.509455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.510057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lazy-loading 'fault' on Instance uuid dc4ec3c1-411f-434f-9031-b01d6a1c9733 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:52:53.567653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:53.579779 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3e86814-f954-41fa-83b9-b2bc43c6f012 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.328362 Oct 13 08:52:53.581499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:53.586241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2106/4537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:53 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:53.602319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:53.602319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:53.610713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6143c623-fe1e-4c1f-a82b-8fff6ca57e66 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 200 len: 1312 microversion: 2.1 time: 0.153858 Oct 13 08:52:53.612134 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2432/4538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:53 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:53.638308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.638832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.639296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.639969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.640423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.640839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.774017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:53.787741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80427d39-bb6f-4d7c-a366-5a1bdde1bf18 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1274 microversion: 2.1 time: 0.194773 Oct 13 08:52:53.788189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2107/4539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:53 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:53.861799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:53.862711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:53.871394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.872191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.872898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:53.875131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:53.875796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:53.876443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.077032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:54.092094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-862ca981-b7d2-43c4-b1fe-21cc70e17656 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1710 microversion: 2.1 time: 0.234706 Oct 13 08:52:54.092690 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2433/4540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:53 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1710 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:54.171904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:54.172506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:54.185315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.199214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.199950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.200706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.201326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.201926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.610189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:54.611036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:54.622379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.625992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.627278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.629339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.631541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.632107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.851769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:54.861029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25a83690-dc17-415b-b399-e7d3cd819b33 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.255198 Oct 13 08:52:54.861636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2434/4541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:54 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:54.866792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:54.867586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: dc4ec3c1-411f-434f-9031-b01d6a1c9733] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:54.874644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.875150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.875598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.876330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.882982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.883448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.907312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] HTTP exception thrown: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 HTTP/1.1 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'dc4ec3c1-411f-434f-9031-b01d6a1c9733'} Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:54.909158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. Oct 13 08:52:54.914120 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:54.915582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 404 to user: Instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:54.916694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd4944dd-5c71-4838-8773-a776089b9b75 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733" status: 404 len: 111 microversion: 2.1 time: 0.054093 Oct 13 08:52:54.918002 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2435/4542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:54 2022] GET /compute/v2.1/servers/dc4ec3c1-411f-434f-9031-b01d6a1c9733 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:52:54.919587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:54.923267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4ec3c1-411f-434f-9031-b01d6a1c9733", "name": "network-vif-deleted", "tag": "09465e2c-0656-4676-a640-876b4b2f419b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:54.935090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.935840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.936463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.951219 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] Creating event network-vif-deleted:09465e2c-0656-4676-a640-876b4b2f419b for instance dc4ec3c1-411f-434f-9031-b01d6a1c9733 on n-h1-858384-11 Oct 13 08:52:54.952041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:54.957922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-726e7536-826b-4e91-ba1f-2e99ac21cc71 req-4f019903-ee6c-4de1-9a9b-67ee119c0a67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037881 Oct 13 08:52:54.959371 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2436/4543] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:54.966350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:54.967375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:54.976201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1693e1d3-ac9e-4149-aee0-d7979788f0be tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1489 microversion: 2.1 time: 0.809253 Oct 13 08:52:54.976316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.976585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.977626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:54.979241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:54.980271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:54.980680 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2108/4544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:54 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1489 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:54.981038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.006165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:55.006815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:55.016161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.019507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.020210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.021169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.023390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.026980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.104161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.109131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.113496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.114397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lazy-loading 'fault' on Instance uuid 24e54c98-7b67-42e4-9b41-3a0f28ce4faa {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:52:55.126760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:55.141034 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48205749-79d5-4230-80df-5dd1ee54a315 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1322 microversion: 2.1 time: 0.176866 Oct 13 08:52:55.148953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2437/4545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:54 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:55.154169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:55.155213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:55.176473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.177630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.178299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.179476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.180154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.180908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.286648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:52:55.325952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e56c20456e84aa088b9735ed4032ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48670dcdb52f490f99c71fcd1fd56b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:55.339462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:55.345183 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e6f7fec-38f2-4aac-890b-c1c238dfe6de tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 200 len: 1312 microversion: 2.1 time: 0.352390 Oct 13 08:52:55.345972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2109/4546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:54 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:55.359540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:55.363479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:55.380931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.384127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.384903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.389786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.390621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.391292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.475723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6ab619d-fc8f-499b-a422-f1b7ece8ea1b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 204 len: 0 microversion: 2.1 time: 0.324134 Oct 13 08:52:55.476818 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2438/4547] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:52:55 2022] DELETE /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:52:55.496032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:55.496925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:55.507362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.508073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.508588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.509482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.510012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.510603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.861786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:55.866607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:55.874919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e9aa775-5231-4a51-a6ec-8298c63b8f90 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1495 microversion: 2.1 time: 0.385198 Oct 13 08:52:55.877225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2439/4548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:55 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1495 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:55.882149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1b5c973-b5e6-4302-9ff0-7067dcb51f3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1714 microversion: 2.1 time: 0.531242 Oct 13 08:52:55.886700 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2110/4549] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:55 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1714 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:55.910746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:55.911671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:55.928219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.929711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.930957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:55.932227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:55.934015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:55.937722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.175568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:56.176181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:56.185970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.186491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.186939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.187655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.188113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.188543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.319280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:56.331777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-720aeb97-71be-4099-b068-6766eefda79c tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.445432 Oct 13 08:52:56.333432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2440/4550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:55 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:56.372584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:56.373542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] [instance: 24e54c98-7b67-42e4-9b41-3a0f28ce4faa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:56.388410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:56.389519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.393660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.393660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.393660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.394885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.397549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.404621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76daa627-2461-4d36-9da8-b773d84055ab tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1328 microversion: 2.1 time: 0.231409 Oct 13 08:52:56.405485 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2111/4551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:56 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:56.431422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] HTTP exception thrown: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Request method failure captured: Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa HTTP/1.1 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9G4yCYjm3aOAO826hgLhmUFp-XVRr5OJGp0dVwShyUxSZnlSrGcx6gXewGkMSJp399bZGRrNDOM3hYjpYPFRRYQcAdH0Fl8UeZqypnlklZCt6o0rCsBQTH0pfW5RDm-jz40X4TARj5LfyYJ_y_2YKOHgwKHGgltIo-Qx_G5cx2MU6M Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48670dcdb52f490f99c71fcd1fd56b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 48670dcdb52f490f99c71fcd1fd56b9d Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-648803855 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7e56c20456e84aa088b9735ed4032ee2 Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ListServersNegativeTestJSON-648803855-project Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '24e54c98-7b67-42e4-9b41-3a0f28ce4faa'} Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:56.441951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] Returning 404 to user: Instance 24e54c98-7b67-42e4-9b41-3a0f28ce4faa could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c1e7bea-c7c8-4cdc-8e14-a0c7a9881da0 tempest-ListServersNegativeTestJSON-648803855 tempest-ListServersNegativeTestJSON-648803855-project] 10.222.0.23 "GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa" status: 404 len: 111 microversion: 2.1 time: 0.078503 Oct 13 08:52:56.449484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2441/4552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:56 2022] GET /compute/v2.1/servers/24e54c98-7b67-42e4-9b41-3a0f28ce4faa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:52:56.907844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:56.908263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:56.926718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.936331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.937061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:56.937976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:56.938637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:56.939221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:57.357162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:57.357796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:57.369037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:57.369534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:57.374952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:57.375797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:57.378892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:57.380822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:57.592731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:57.610533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ef64ffd-6b2d-43e9-b722-e30996fc85ab tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1495 microversion: 2.1 time: 0.707308 Oct 13 08:52:57.611046 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2112/4553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:56 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1495 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:57.620330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:57.623038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:57.636288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:57.638798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:57.640341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:57.641994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:57.643037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:57.645420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:57.715692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:52:57.757758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:57.795861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b023475-4872-4db5-8a94-85607f08e002 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.440899 Oct 13 08:52:57.797257 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2442/4554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:57 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:52:58.116302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f52a59-f2e1-4318-b9ce-13ffd223c972", "name": "network-vif-plugged", "status": "completed", "tag": "ee271360-30b7-417f-ae85-e3340a8a56f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:58.133429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.133926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.134373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:58.165912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] Creating event network-vif-plugged:ee271360-30b7-417f-ae85-e3340a8a56f6 for instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 on n-h2-858384-11 Oct 13 08:52:58.179203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0cafd6a1-f2cf-47a3-85a4-e88111806b23 req-e3447705-c92a-402c-ab9d-b88b92d9be29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066452 Oct 13 08:52:58.183713 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2443/4555] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:52:58.220618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1a537c-036c-4605-b3eb-4000bf1e3a73", "tag": "4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:58.241672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.242234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.242773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:58.269259 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] Creating event network-changed:4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c for instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 on n-h2-858384-11 Oct 13 08:52:58.275973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0c1f1d47-59e6-4626-a9dc-35a78a009a48 req-54e715b5-bb60-4d76-94f9-b3078681b17e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059829 Oct 13 08:52:58.277200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2444/4556] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:52:58.532924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:58.547039 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4fdedcb5-92fc-4804-87bc-5639f550e71c tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.934068 Oct 13 08:52:58.568306 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2113/4557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:57 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:58.644910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:58.646281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:58.659264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.660499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.661177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:58.662108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.663147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.664438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:58.823977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:58.825293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:58.836304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.837618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.838253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:58.839357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:58.840043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:58.840994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:59.159992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:59.170257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65738c9c-b0d6-4750-a85b-055c32871254 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1495 microversion: 2.1 time: 0.533762 Oct 13 08:52:59.182827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2445/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:58 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1495 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:59.352764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:52:59.366091 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8e3a312-81db-45da-b2ad-a719b9e68dfb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1318 microversion: 2.1 time: 0.546431 Oct 13 08:52:59.366756 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2114/4559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:58 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:52:59.577431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:52:59.581343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:52:59.613245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5bc8bc-af3a-41fb-80be-1217bfd52901", "name": "network-vif-deleted", "tag": "9109b163-5aec-4a1f-8839-d6d2822314c2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:52:59.619306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:59.621521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:59.622143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:59.626853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:59.628522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:59.631304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:59.663643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:52:59.665825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:52:59.666299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:52:59.715128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] Creating event network-vif-deleted:9109b163-5aec-4a1f-8839-d6d2822314c2 for instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 on n-h1-858384-11 Oct 13 08:52:59.736990 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cfd3cb6f-61c0-4691-8739-bba47a71604f req-2c5e9d3f-f631-42fb-9bd9-1aec7479ad41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128589 Oct 13 08:52:59.749544 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2115/4560] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:00.199481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:00.201068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:00.208364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.209094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.210105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.212898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.213778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.216125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.301402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.303739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.304532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.305964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lazy-loading 'fault' on Instance uuid fa5bc8bc-af3a-41fb-80be-1217bfd52901 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:00.374793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:00.391008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de13d91d-8d68-47a6-8ca8-3cc0d7bbe347 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.816430 Oct 13 08:53:00.392215 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2446/4561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:52:59 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:00.402523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:00.403399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:00.420352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.421063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.421679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.422593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.423238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.423831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.480699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:00.496335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-788f3959-0a7c-407f-94e6-d5569f480b94 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 200 len: 1305 microversion: 2.1 time: 0.301661 Oct 13 08:53:00.528335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2116/4562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:00 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 1305 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:00.809327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:00.824798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b8e69df-8d2a-4882-80da-a944f7a68499 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1508 microversion: 2.1 time: 0.431300 Oct 13 08:53:00.828728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2447/4563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:00 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1508 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:00.853306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:00.859176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:00.874523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.879543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.881994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:00.883760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:00.886717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:00.888339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.277832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:01.285119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:01.291265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-248d9462-476b-4e5f-9faa-5ff542439075 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1508 microversion: 2.1 time: 0.441786 Oct 13 08:53:01.294165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2117/4564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:00 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:01.316918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:01.319493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:01.331180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.331596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.332031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.332742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.333200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.333659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.419423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:01.420046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:01.435896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.437379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.438037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.439074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.439844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.440637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.486469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-610dfbcb-8197-4fd5-a43e-b5c757a44a2f tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "PUT /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1080 microversion: 2.1 time: 0.173493 Oct 13 08:53:01.492762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2448/4565] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:53:01 2022] PUT /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1080 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:01.509741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:01.510715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:01.523402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.524843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.525434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.528179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.529304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.529897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.749306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:01.762503 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd0f3fee-09a6-43d3-bf33-65e5d74042f7 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.348997 Oct 13 08:53:01.763518 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2118/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:01 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:01.772540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:01.773191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:01.781443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.782261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.783062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.784049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.784720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:01.786068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:01.808097 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 HTTP/1.1 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fa5bc8bc-af3a-41fb-80be-1217bfd52901'} Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:01.810522 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:01.815233 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:01.817442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:01.819322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53df093d-2b4f-4ce4-b1c8-430cfd585ebb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 404 len: 111 microversion: 2.1 time: 0.054460 Oct 13 08:53:01.820240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2119/4567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:01 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:01.929549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:01.939679 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce9e0469-a545-489a-bff6-38cd2d6fa6d5 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1506 microversion: 2.1 time: 0.433844 Oct 13 08:53:01.956737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2449/4568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:01 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:01.979489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:01.980305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:01.993297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:01.998046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.003074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.004143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.004823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.005449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.035541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2058278118", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "a4fe6d17-35f8-4a8f-a330-1aa975a9e642"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:02.148678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] validate_networks() for [('a4fe6d17-35f8-4a8f-a330-1aa975a9e642', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:53:02.155896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:02.395332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:02.415325 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-467e3353-0c67-45a2-b81b-a30cb977bdaf tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1506 microversion: 2.1 time: 0.445992 Oct 13 08:53:02.416877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2120/4569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:01 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:02.446705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:02.453848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:02.462276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.463210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.463873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.464800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.465519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.466344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.511955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=20 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:02.569472 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3e765f4-392f-4023-a9e9-d0e6548d968a tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "PUT /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1082 microversion: 2.1 time: 0.130244 Oct 13 08:53:02.583411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2121/4570] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:53:02 2022] PUT /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1082 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:02.596387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:02.598220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:02.612595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:02.619175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.620805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.621287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.623082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.626687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.627217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.871606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:02.883151 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1998ecfd-00f1-475a-9095-8d1316c682fc tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1508 microversion: 2.1 time: 0.292924 Oct 13 08:53:02.884203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2122/4571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:02 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:02.892259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:02.892746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:02.900435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.901265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.901865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:02.902804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:02.903419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:02.904004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.207457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:53:03.208099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:53:03.208677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:53:03.209235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:53:03.209712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:53:03.229569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:03.231419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.232085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.232552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.233471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.233972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.236382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.246504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10b1884a-339c-4519-bbfa-9a0b97892e9e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.358248 Oct 13 08:53:03.247333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2123/4572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:02 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:03.255079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:03.255992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:03.268650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.269479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.271712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.273142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.274237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.274937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.288044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:53:03.296952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Getting quotas for user 8255be4ef5614f3599fe1523c8c28376 and project 47442db2ef2e490fa125a7675cef7e5c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:53:03.332273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:53:03.335566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:53:03.404248 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-59ea31ea-4a5e-4316-9b54-a0a6e78b1b56 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382874 Oct 13 08:53:03.405702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2450/4573] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:53:03.421326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f52ef7a6-155c-4e80-9858-8c7b4f4bac47 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:03.423744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f52ef7a6-155c-4e80-9858-8c7b4f4bac47 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:03.464692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:03.619725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f52ef7a6-155c-4e80-9858-8c7b4f4bac47 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:03.629322 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f52ef7a6-155c-4e80-9858-8c7b4f4bac47 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1215 microversion: 2.1 time: 0.216742 Oct 13 08:53:03.631672 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2451/4574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:03 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:03.728813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:03.740884 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c11da888-7568-4c42-a44d-8b2b1a3fa612 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1508 microversion: 2.1 time: 0.492182 Oct 13 08:53:03.741577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2124/4575] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:03 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:03.774764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:03.775834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:03.810861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.813929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.817580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.819641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:03.822243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:03.831342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:03.900677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:53:04.073750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7afa7a9-ef7e-4197-8908-65aeccd467e0 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 204 len: 0 microversion: 2.1 time: 0.306619 Oct 13 08:53:04.074483 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2452/4576] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:03 2022] DELETE /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:53:04.090292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:04.090921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:04.103186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.103700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.104219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.108297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.108846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.109299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.170226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:53:04.262226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Instance is already in deleting state, ignoring this request Oct 13 08:53:04.263343 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5119602-7269-4684-b3d2-3893f5a85feb tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 204 len: 0 microversion: 2.1 time: 0.182202 Oct 13 08:53:04.264690 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2125/4577] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:04 2022] DELETE /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:53:04.280909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:04.281672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:04.298898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.300102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.301822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.302731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.305880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:04.306292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.307007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:04.307201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.341577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.343186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.343892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.345135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.345814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.346482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.665805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:04.677915 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ae8f627-6f77-4aed-9c43-3b56b39a43bc tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.401365 Oct 13 08:53:04.678549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2453/4578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:04 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:04.683784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:04.684644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:04.707992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.713623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.714189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.716477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.717079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.719014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.891214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:04.903983 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44467cb3-311f-403e-84d3-9232ab5ca314 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1267 microversion: 2.1 time: 0.224365 Oct 13 08:53:04.916244 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2454/4579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:04 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:04.923711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:04.931884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:04.938955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.939458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.939908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.940634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:04.941258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:04.941709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:04.983978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:05.000192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'flavor' on Instance uuid b66eb356-e05e-45dc-a8ce-6aa7ea45163b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:05.233237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:05.247819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7e8f343-0cd3-4978-92b9-a7363820f735 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1514 microversion: 2.1 time: 0.970883 Oct 13 08:53:05.264059 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa00f332-bf72-4b78-8a1d-6b402e42deff tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/action" status: 200 len: 32 microversion: 2.1 time: 0.334711 Oct 13 08:53:05.264059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2455/4580] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:53:04 2022] POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:53:05.266225 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2126/4581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:04 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1514 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:05.281006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:05.283731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:05.304716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:05.306328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:05.312042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:05.313179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:05.313913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:05.314682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:05.705667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:05.706665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:05.720340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:05.721069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:05.721876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:05.723276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:05.724390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:05.725122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:05.978839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:05.989118 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fb2d76b-eebc-4364-ac31-041bdd0e9e8f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.728311 Oct 13 08:53:05.990034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2456/4582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:05 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:06.011436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:06.012300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:06.022084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.022852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.023544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.025092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.025803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.026509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.175989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:06.192069 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2bdc64e-8ce5-4dee-afd2-346f89453b52 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.491074 Oct 13 08:53:06.195001 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2127/4583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:05 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:06.220186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:06.237803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bc0c815-a75b-4be4-b6ed-4fb7c5f4cddf tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1273 microversion: 2.1 time: 0.226997 Oct 13 08:53:06.238360 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2457/4584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:06 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:06.279542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:06.280172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:06.291930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.292436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.292879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.303710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.304249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.304687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.389546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1a537c-036c-4605-b3eb-4000bf1e3a73", "name": "network-vif-plugged", "status": "completed", "tag": "4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:06.407669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.408156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.408601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.452198 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] Creating event network-vif-plugged:4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c for instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 on n-h2-858384-11 Oct 13 08:53:06.458429 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5363db30-2206-4420-8902-64b3136c2996 req-5852047c-b117-42ce-a594-f78ea021651f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074444 Oct 13 08:53:06.460392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2458/4585] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:06.759201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:06.770588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-689dc5d2-de2f-4e0b-a1ac-4da7eae50196 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1514 microversion: 2.1 time: 0.496107 Oct 13 08:53:06.773595 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2128/4586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:06 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1514 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:06.800569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f52a59-f2e1-4318-b9ce-13ffd223c972", "name": "network-vif-deleted", "tag": "ee271360-30b7-417f-ae85-e3340a8a56f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:06.819644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:06.823509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:06.824188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:06.859218 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] Creating event network-vif-deleted:ee271360-30b7-417f-ae85-e3340a8a56f6 for instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 on n-h2-858384-11 Oct 13 08:53:06.876481 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5559b618-c411-4b60-921e-d50f6abdf97d req-dc1b0f75-8297-4b49-8527-69f49bc326e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082075 Oct 13 08:53:06.882343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2459/4587] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:07.013919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:07.014576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:07.040803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.042013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.043221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.061358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.061868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.062316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.220917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:07.222246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:07.232927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.240382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.240878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.241771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.242244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.242713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.491341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:07.503169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00c03ef4-ff97-460a-9a1f-bf389d24f4a4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.493824 Oct 13 08:53:07.506452 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2129/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:07 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:07.519966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:07.521330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:07.533302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.533493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:07.534254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.546565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2662dd34-03b8-4544-8940-ec5068aaacc8 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1396 microversion: 2.1 time: 0.330215 Oct 13 08:53:07.546922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.548294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.549662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.549975 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2460/4589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:07 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1396 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:07.551480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.801610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:07.802485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:07.814608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.815344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.816205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.818240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.821777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.822397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.874318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:07.891494 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ea830b7-e181-4885-bb58-d437fa4c58db tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.381571 Oct 13 08:53:07.895105 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2130/4590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:07 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:07.896292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:07.898339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:07.899661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:07.902597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lazy-loading 'fault' on Instance uuid 92f52a59-f2e1-4318-b9ce-13ffd223c972 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:08.015917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ba8f040ba341488b82d5240d3ff474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd78189ef54c54346b68b51fb1ef9befb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:08.033147 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4745b024-e29f-45af-a777-95f856f46fae tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 200 len: 1308 microversion: 2.1 time: 0.235735 Oct 13 08:53:08.053023 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2461/4591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:07 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:08.530191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:08.531620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:08.542631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:08.549033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:08.550821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:08.552424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:08.553878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:08.558186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:08.577608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:08.578898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:08.617622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:08.621053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:08.621510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:08.623285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:08.627797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:08.630600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.052462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:09.061923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-abae0317-fe62-430a-a657-42fd5eb435d9 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1577 microversion: 2.1 time: 0.489074 Oct 13 08:53:09.062523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2462/4592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:08 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1577 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:09.075540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.076161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.091452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.092186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.092808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.093685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.094294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.094900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.275194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:09.286152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21f1636c-bfff-4159-861c-dfb4cb1c1144 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.222530 Oct 13 08:53:09.287558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2463/4593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:09 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:09.303120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:09.308496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab3dd87-28c6-4abe-b852-a02051b0200d", "tag": "0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:09.318749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.319484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.320097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.330665 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7652d32f-23f5-4087-8494-f5238783d884 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.802882 Oct 13 08:53:09.336629 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] Creating event network-changed:0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25 for instance 8ab3dd87-28c6-4abe-b852-a02051b0200d on n-h1-858384-11 Oct 13 08:53:09.344016 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-be104fb9-61a7-4d42-940d-f8775f9551a5 req-f99f300a-ea7c-4025-9708-14e1f7768ccb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054801 Oct 13 08:53:09.345002 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2131/4594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:08 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:09.345264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2464/4595] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:09.350770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.351530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.361360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.362243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.362907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.363799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.364555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.365364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.373236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.373856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 92f52a59-f2e1-4318-b9ce-13ffd223c972] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.392071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.392883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.393515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.394394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.395045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.395625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.434833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] HTTP exception thrown: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Request method failure captured: Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 HTTP/1.1 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9FGEOvFRAntZgyKFf7w7UIwQzz4hoOSxxPF8pHQrmC8cD2ld-bYIXsYC8vgqRaJn2YV-mwTGjmfm9zWbIqCLscslEc0nXdmL-4yhWyTZtquWSLdd4L-vSQaNmLnvzrHD94lCJS6FBygkBOG7NK94hUNwwVUR7mmaOI60p-4TMWZSf8 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 31ba8f040ba341488b82d5240d3ff474 Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '92f52a59-f2e1-4318-b9ce-13ffd223c972'} Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.436857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. Oct 13 08:53:09.441631 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.442965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Returning 404 to user: Instance 92f52a59-f2e1-4318-b9ce-13ffd223c972 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:09.443994 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fd0ca6c-f7ce-4b80-98a6-30ff392a2084 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972" status: 404 len: 111 microversion: 2.1 time: 0.088298 Oct 13 08:53:09.444823 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2132/4596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:09 2022] GET /compute/v2.1/servers/92f52a59-f2e1-4318-b9ce-13ffd223c972 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:09.454584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.455240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.465075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.465733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.466338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.467211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.467809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.468377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.472489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9008803-03a8-4b75-915f-c231a814adfa tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125850 Oct 13 08:53:09.473093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2465/4597] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:53:09 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:09.483990 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] HTTP exception thrown: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Request method failure captured: Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e HTTP/1.1 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9FGEOvFRAntZgyKFf7w7UIwQzz4hoOSxxPF8pHQrmC8cD2ld-bYIXsYC8vgqRaJn2YV-mwTGjmfm9zWbIqCLscslEc0nXdmL-4yhWyTZtquWSLdd4L-vSQaNmLnvzrHD94lCJS6FBygkBOG7NK94hUNwwVUR7mmaOI60p-4TMWZSf8 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 31ba8f040ba341488b82d5240d3ff474 Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f2531613-8d13-4853-b69f-cd95a3445f2e'} Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:09.485714 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.489938 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.491450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Returning 404 to user: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:09.492303 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e384bd85-21fa-42a0-9cf5-c602caf8cad4 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 404 len: 111 microversion: 2.1 time: 0.042008 Oct 13 08:53:09.496265 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2133/4598] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:09 2022] DELETE /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:09.501783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.502398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: f2531613-8d13-4853-b69f-cd95a3445f2e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.509844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.510687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.511466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.512538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.513164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.513745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.529225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] HTTP exception thrown: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Request method failure captured: Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e HTTP/1.1 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGEOvFRAntZgyKFf7w7UIwQzz4hoOSxxPF8pHQrmC8cD2ld-bYIXsYC8vgqRaJn2YV-mwTGjmfm9zWbIqCLscslEc0nXdmL-4yhWyTZtquWSLdd4L-vSQaNmLnvzrHD94lCJS6FBygkBOG7NK94hUNwwVUR7mmaOI60p-4TMWZSf8 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 31ba8f040ba341488b82d5240d3ff474 Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'f2531613-8d13-4853-b69f-cd95a3445f2e'} Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.531340 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. Oct 13 08:53:09.535800 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.537262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Returning 404 to user: Instance f2531613-8d13-4853-b69f-cd95a3445f2e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:09.540227 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86586f7b-c99d-4e29-b9c5-71d64df866ad tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e" status: 404 len: 111 microversion: 2.1 time: 0.041918 Oct 13 08:53:09.541318 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2466/4599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:09 2022] GET /compute/v2.1/servers/f2531613-8d13-4853-b69f-cd95a3445f2e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:09.550426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.551068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.557535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.558079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.558688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.559705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.560273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.560926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.576757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] HTTP exception thrown: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Request method failure captured: Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 HTTP/1.1 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9FGEOvFRAntZgyKFf7w7UIwQzz4hoOSxxPF8pHQrmC8cD2ld-bYIXsYC8vgqRaJn2YV-mwTGjmfm9zWbIqCLscslEc0nXdmL-4yhWyTZtquWSLdd4L-vSQaNmLnvzrHD94lCJS6FBygkBOG7NK94hUNwwVUR7mmaOI60p-4TMWZSf8 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 31ba8f040ba341488b82d5240d3ff474 Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6eff84ef-56d4-4fe5-a671-76415e9c2e90'} Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:09.578716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.582796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.585071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Returning 404 to user: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:09.586205 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d420d4f5-83c5-4c45-a5bb-6d238e0ecac3 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 404 len: 111 microversion: 2.1 time: 0.040050 Oct 13 08:53:09.594692 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2134/4600] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:09 2022] DELETE /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:09.599472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:09.600649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] [instance: 6eff84ef-56d4-4fe5-a671-76415e9c2e90] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:09.609922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.611614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.612376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.613369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:09.614793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:09.615539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:09.641700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] HTTP exception thrown: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Request method failure captured: Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 HTTP/1.1 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGEOvFRAntZgyKFf7w7UIwQzz4hoOSxxPF8pHQrmC8cD2ld-bYIXsYC8vgqRaJn2YV-mwTGjmfm9zWbIqCLscslEc0nXdmL-4yhWyTZtquWSLdd4L-vSQaNmLnvzrHD94lCJS6FBygkBOG7NK94hUNwwVUR7mmaOI60p-4TMWZSf8 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d78189ef54c54346b68b51fb1ef9befb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: d78189ef54c54346b68b51fb1ef9befb Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-922637679 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 31ba8f040ba341488b82d5240d3ff474 Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerDiskConfigTestJSON-922637679-project Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6eff84ef-56d4-4fe5-a671-76415e9c2e90'} Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:09.644634 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] Returning 404 to user: Instance 6eff84ef-56d4-4fe5-a671-76415e9c2e90 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-590df14a-24f2-4c71-b9fa-8d238c003851 tempest-ServerDiskConfigTestJSON-922637679 tempest-ServerDiskConfigTestJSON-922637679-project] 10.222.0.23 "GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90" status: 404 len: 111 microversion: 2.1 time: 0.051052 Oct 13 08:53:09.649687 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2467/4601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:09 2022] GET /compute/v2.1/servers/6eff84ef-56d4-4fe5-a671-76415e9c2e90 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:10.310152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:10.310790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:10.323065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:10.323809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:10.324824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:10.334199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:10.334865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:10.335525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:10.339049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:10.361296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:10.362112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:10.377786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:10.378684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:10.379421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:10.380409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:10.381099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:10.381760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:10.679949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:10.700756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ffd38f8e-6da4-4c68-8207-eea15748badf tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.343307 Oct 13 08:53:10.701721 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2468/4602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:10 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:11.143757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:11.157706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c85c5eb5-a64b-4aff-a95c-c94312b41143 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.851348 Oct 13 08:53:11.158488 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2135/4603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:10 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:11.724474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:11.725672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:11.743593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:11.744371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:11.745021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:11.750698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:11.752160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:11.752787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:12.188757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:12.189395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:12.205866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:12.206368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:12.206835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:12.207550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:12.208009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:12.208440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:12.780198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:12.813109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:12.817327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-076f3169-a3a9-4450-9213-58cc8930b687 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 1.092877 Oct 13 08:53:12.820417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2469/4604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:11 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:12.839593 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9cd2eaf1-c061-43a8-8527-b7400d95596d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.655166 Oct 13 08:53:12.841862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2136/4605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:12 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:13.016019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:13.017910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:13.035075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.038059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.039039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.041225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.042078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.042858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.048156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1a537c-036c-4605-b3eb-4000bf1e3a73", "tag": "4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:13.077199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.077755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.078193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.104941 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] Creating event network-changed:4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c for instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 on n-h2-858384-11 Oct 13 08:53:13.115088 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-242f45b4-d4cf-4d84-b771-aeb2bf4581d3 req-c07363c9-5137-4905-88cb-30b1230704dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072609 Oct 13 08:53:13.119694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2137/4606] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:13.255656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:13.490178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:13.534039 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcf33ef3-5926-47f5-9db0-6da3537dbb7e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1577 microversion: 2.1 time: 0.511950 Oct 13 08:53:13.537909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2470/4607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:13 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1577 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:13.848117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:13.849535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:13.871023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:13.872384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:13.875542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.876203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.881249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.882038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.882548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.883042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.885740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:13.891421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.894615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.895229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:13.896381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:13.900584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:13.901374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:14.418582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:14.432203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f80321d0-5a36-43c0-a83a-783cef5d576d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.565696 Oct 13 08:53:14.432810 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2471/4608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:13 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:14.681554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:14.699031 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba812827-4921-4e13-a701-26e0f1ec0093 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.859597 Oct 13 08:53:14.712827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2138/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:13 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:15.462166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:15.463758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:15.474802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:15.476306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:15.477578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:15.479112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:15.479712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:15.480349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:15.726667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:15.727361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:15.734808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:15.735544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:15.736477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:15.737368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:15.737988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:15.738608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:16.124001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:16.138251 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf7639c8-90b5-493e-84ff-11b39e543c84 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.414015 Oct 13 08:53:16.141257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2139/4610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:15 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:16.450273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:16.460555 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43a3629c-88c6-4e9a-ab3c-8686f167beeb tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 1.007196 Oct 13 08:53:16.466316 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2472/4611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:15 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:17.168653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:17.171722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:17.181267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:17.182365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:17.183126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:17.184088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:17.185467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:17.186141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:17.492087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:17.493451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:17.511602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:17.512274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:17.514573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:17.517008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:17.518869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:17.520343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:17.583052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:17.623424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:17.642781 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-03e6eb47-9a7f-4327-b4f4-96a45b84c66c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.476342 Oct 13 08:53:17.645008 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2140/4612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:17 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:17.981515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:17.995892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18a52e89-546c-406f-b610-f79a6d2ac133 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.504596 Oct 13 08:53:17.999067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2473/4613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:17 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:18.604174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab3dd87-28c6-4abe-b852-a02051b0200d", "name": "network-vif-plugged", "status": "completed", "tag": "0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:18.635172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:18.635788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:18.636892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:18.652794 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] Creating event network-vif-plugged:0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25 for instance 8ab3dd87-28c6-4abe-b852-a02051b0200d on n-h1-858384-11 Oct 13 08:53:18.659113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a228d003-b575-45c7-9f56-bd4774adf8de req-68860538-29eb-43b6-a5db-bba2eaa19449 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062414 Oct 13 08:53:18.660211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2141/4614] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:18.683497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:18.684568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:18.707315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:18.707938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:18.708427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:18.709165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:18.709679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:18.710122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:19.025847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:19.027094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:19.044958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:19.045831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:19.049343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:19.052192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:19.053092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:19.054671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:19.143786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:19.155918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-940455e0-3260-41ef-bb76-7b1846c2572c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.486825 Oct 13 08:53:19.169989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2474/4615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:18 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:19.973835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:19.988480 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-551aabbe-6f6c-4518-87b4-77b535b89c44 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.968324 Oct 13 08:53:20.003262 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2142/4616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:19 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:20.183255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:20.183889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:20.196483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:20.196981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:20.197426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:20.198150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:20.198635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:20.199068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:20.563378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:20.575375 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f0d948b-4f22-415a-8190-b65c4b7b6361 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.398156 Oct 13 08:53:20.593123 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2475/4617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:20 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:21.013211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:21.014487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:21.052960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:21.053472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:21.053910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:21.059250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:21.059956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:21.060555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:21.457408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1677026421", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8a2749c8-c2e6-47b0-9627-424ec3647781"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:21.508884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:21.517981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b12e98da-bc0c-45b5-b099-0593798cade3 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1315 microversion: 2.1 time: 0.508571 Oct 13 08:53:21.519868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2143/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:21 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:21.592874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] validate_networks() for [('8a2749c8-c2e6-47b0-9627-424ec3647781', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:53:21.603390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:21.604392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:21.612866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:21.613851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:21.614615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:21.615671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:21.616532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:21.617523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:21.882203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:21.897311 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3e5239f-85cb-49aa-b7b7-e71d4819798b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.298581 Oct 13 08:53:21.923463 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2144/4619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:21 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:22.237440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:53:22.238707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:53:22.239418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:53:22.239979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:53:22.240418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:53:22.252037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.252797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.253447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:22.254209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.254681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.255256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:22.276709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Getting quotas for project 70679717540d48b7b34a080c0a87d9cd. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:53:22.283667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Getting quotas for user c930a822bdf84b3e8d099c3ddec6784c and project 70679717540d48b7b34a080c0a87d9cd. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:53:22.298508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:53:22.301345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:53:22.364071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-72a96594-9011-4945-9450-0c003d3dc586 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.199668 Oct 13 08:53:22.365318 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2476/4620] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 13 08:53:22.376338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:22.376956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:22.499425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:22.509506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:22.513385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:22.516402 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83c7a777-6b44-49b9-98e9-b65d99bd2f71 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1262 microversion: 2.26 time: 0.143892 Oct 13 08:53:22.518927 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2145/4621] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:22 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1262 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:22.544645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:22.545944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:22.557338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.557835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.558270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:22.563875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.564558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.565240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:22.933622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:22.934776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:22.954497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.954990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.955429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:22.956137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:22.956587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:22.957011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.176923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:23.194599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa982474-a924-4fc7-90de-d704bb6d9e6d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1503 microversion: 2.1 time: 0.656073 Oct 13 08:53:23.216536 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2477/4622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:22 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1503 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:23.224832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:23.226043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:23.246882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.251120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.252979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.253942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.254639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.257351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.329393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lazy-loading 'flavor' on Instance uuid 8ab3dd87-28c6-4abe-b852-a02051b0200d {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:23.531762 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b5443184-87df-4f7e-b2b5-67e3d502174d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "POST /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d/action" status: 202 len: 0 microversion: 2.1 time: 0.312193 Oct 13 08:53:23.533133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2478/4623] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:53:23 2022] POST /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:53:23.574133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:23.574939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:23.587316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.587819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.588363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.589136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.589703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.590073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.852599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:23.877000 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b2e67205-2255-4fb0-bde6-edc466f0ebaa tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.947578 Oct 13 08:53:23.878312 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2146/4624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:22 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:23.883768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:23.884565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:23.893392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.894156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.894791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.895641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:23.896316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:23.896891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:23.973402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:23.982861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d89540f-5f1e-44ef-af0d-ad2dd4290ff2 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1511 microversion: 2.1 time: 0.445444 Oct 13 08:53:23.985020 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2479/4625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:23 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:24.048297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:24.063300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:24.064744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:24.066336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-428240d3-59c0-4caa-b142-331934a6cf2f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1314 microversion: 2.26 time: 0.186632 Oct 13 08:53:24.067114 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2147/4626] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:23 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:24.906906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:24.908475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:24.929225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:24.932141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:24.937403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:24.941596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:24.945970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:24.946778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.011038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:25.012377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:25.024544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.025041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.025486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.026193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.026666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.027088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.430794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:25.443107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36763053-887f-4730-9f4d-8577fb930585 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1736 microversion: 2.1 time: 0.542264 Oct 13 08:53:25.451708 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2480/4627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:24 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1736 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:25.458245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:25.459079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:25.469666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.472344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.473503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.474432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.475052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.475642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.557967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:25.569520 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21612143-2d60-4edd-bcbd-62e57fa05354 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1494 microversion: 2.1 time: 0.562194 Oct 13 08:53:25.570766 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2148/4628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:25 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1494 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:25.573262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:25.596598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:25.598332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:25.599344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:25.600026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:25.600453 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e83b4583-22d3-420d-82c9-6c62cced8a78 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1320 microversion: 2.26 time: 0.145787 Oct 13 08:53:25.602824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2481/4629] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:25 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:25.608748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.609962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.612418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.614571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.615297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.616432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.671947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:53:25.809768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae85915a-6bdb-4844-b4fb-c8442136389a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 204 len: 0 microversion: 2.1 time: 0.214634 Oct 13 08:53:25.815665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2149/4630] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:25 2022] DELETE /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:53:25.819574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:25.821053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:25.829403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.830380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.831120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:25.832195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:25.832935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:25.833628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:26.082362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:26.091742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07b0475b-76f1-4d9f-b93d-84aa64ed3d1a tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1500 microversion: 2.1 time: 0.276440 Oct 13 08:53:26.092345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2482/4631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:25 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1500 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:26.471663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:26.472295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:26.480368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:26.480857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:26.481293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:26.481990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:26.482466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:26.483154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:26.632560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:26.634560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:26.643488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:26.644747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:26.645364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:26.646924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:26.647557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:26.649954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:26.892445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:26.904900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:26.907174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:26.908351 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ae50f04-4c04-4fb3-b7a9-97d206e79cca tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.282906 Oct 13 08:53:26.910733 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2483/4632] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:26 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:26.991142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:27.012453 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c04f0940-3372-47d6-b1d2-dc475e68fd97 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1716 microversion: 2.1 time: 0.545286 Oct 13 08:53:27.025178 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2150/4633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:26 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1716 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:27.116337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:27.116967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:27.131377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.131867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.132507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.133600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.134727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.135320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.238043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:27.239083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:27.252222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.253119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.253785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.254771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.255445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.266745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.412668 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Cannot 'detach_volume' instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b while it is in vm_state rescued Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments/16778e46-05e7-4f5a-b281-86c165925c93 HTTP/1.1 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'detach_volume' instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b while it is in vm_state rescued Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'b66eb356-e05e-45dc-a8ce-6aa7ea45163b', 'id': '16778e46-05e7-4f5a-b281-86c165925c93'} Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b while it is in vm_state rescued Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:27.419031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b while it is in vm_state rescued Oct 13 08:53:27.423672 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:27.426519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 409 to user: Cannot 'detach_volume' instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b while it is in vm_state rescued {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:27.432550 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94e8d089-eb67-4f7e-9b45-77605ccced58 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments/16778e46-05e7-4f5a-b281-86c165925c93" status: 409 len: 152 microversion: 2.1 time: 0.198730 Oct 13 08:53:27.433714 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2151/4634] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:53:27 2022] DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments/16778e46-05e7-4f5a-b281-86c165925c93 => generated 152 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:53:27.442058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:27.442916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:27.451022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.451775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.452785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.453709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.454377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.455177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.480426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:27.578968 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-06a8d678-4ba1-4a8c-8013-c766baa9a643 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/action" status: 202 len: 0 microversion: 2.1 time: 0.140372 Oct 13 08:53:27.580392 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2152/4635] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:53:27 2022] POST /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:53:27.596870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:27.600563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:27.622771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.623920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.624804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.626081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.627054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.628014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.918357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:27.926815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-63ce1cf7-341e-4db7-b1bf-7485300fc05d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1500 microversion: 2.1 time: 0.816141 Oct 13 08:53:27.943199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2484/4636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:27 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1500 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:27.963747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:27.964738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:27.976353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.978776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.979388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:27.980593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:27.984395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:27.985067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:28.268878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:28.280929 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b929bb21-4d88-4161-9567-53d537b280b5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1724 microversion: 2.1 time: 0.695289 Oct 13 08:53:28.285147 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2153/4637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:27 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1724 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:28.677617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:28.694786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:28.696359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:28.697586 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-655cff25-662a-426f-9cf9-d2578830a095 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.753142 Oct 13 08:53:28.699709 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2485/4638] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:27 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:28.970963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:28.973463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:28.999016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.003783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.004529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.007087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.009935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.010661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.309377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:29.310559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:29.333619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.336759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.339753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.343486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.351138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.355384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.706894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:29.732195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-218e67c2-4699-4a85-9ccc-060c88556884 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1500 microversion: 2.1 time: 0.766435 Oct 13 08:53:29.735406 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2154/4639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:28 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1500 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:29.740381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab3dd87-28c6-4abe-b852-a02051b0200d", "name": "network-vif-deleted", "tag": "0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:29.765078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.765748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.766345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.782020 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] Creating event network-vif-deleted:0a0c9fb9-6ca6-4b93-8679-ee7e9a7c5f25 for instance 8ab3dd87-28c6-4abe-b852-a02051b0200d on n-h1-858384-11 Oct 13 08:53:29.789432 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9a9d9fa2-892a-41c4-9803-7165a8a07c57 req-d28c666c-decb-4c4d-b566-0dc28a309ba3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052487 Oct 13 08:53:29.790684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2155/4640] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:29.800302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:29.801243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:29.809699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.810566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.811196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.812271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:29.812916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:29.813536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:29.913429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:29.926975 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58246b4c-07ad-44cd-8d7f-665d81567582 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1724 microversion: 2.1 time: 0.622263 Oct 13 08:53:29.937872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2486/4641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:29 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:30.066880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:30.076433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:30.080003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:30.081806 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f5a917a-1cb9-48a7-b13a-d37a02452f69 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.288512 Oct 13 08:53:30.092377 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2156/4642] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:29 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:30.786526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:30.787540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:30.888258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:30.891325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:30.899915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:30.901859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:30.923068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:30.927117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:30.963036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:30.964215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:30.977094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:30.978043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:30.979210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:30.981157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:30.983883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:30.984628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:31.101078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:31.104409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:31.105043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:31.106601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lazy-loading 'fault' on Instance uuid 8ab3dd87-28c6-4abe-b852-a02051b0200d {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:31.212113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8255be4ef5614f3599fe1523c8c28376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47442db2ef2e490fa125a7675cef7e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:31.229320 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d9d5f75-9aeb-481e-b0a4-21abdb145b49 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 200 len: 1305 microversion: 2.1 time: 0.469634 Oct 13 08:53:31.229931 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2487/4643] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:30 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 1305 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:31.241586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:31.243323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:31.249192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:31.253219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:31.254098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:31.254722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:31.261180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:31.262317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:31.263608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:31.475158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:31.480830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:31.491005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:31.494197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:31.495899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a22b0953-5f9c-48c9-86c2-ccc7da5d7d3a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.264825 Oct 13 08:53:31.507305 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2488/4644] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:31 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:31.779407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:31.789698 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4bdb58d7-4e33-45e2-b0da-d4b21243d534 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1724 microversion: 2.1 time: 0.831651 Oct 13 08:53:31.795341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2157/4645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:30 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1724 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:31.821854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fef053-8bd4-4717-be36-c9004c234100", "tag": "17c86ec3-d195-4bbf-b289-ed0dedbf880f"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:31.850295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:31.850970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:31.852163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:31.871550 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] Creating event network-changed:17c86ec3-d195-4bbf-b289-ed0dedbf880f for instance 58fef053-8bd4-4717-be36-c9004c234100 on n-h2-858384-11 Oct 13 08:53:31.882394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c24ed663-d7c4-4583-990a-036548e5bc26 req-20da892b-04e6-461b-ab85-1c3941b9ad68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068301 Oct 13 08:53:31.886850 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2489/4646] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:32.255485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.256194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.263452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.263988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.264606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.265302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.265752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.266300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.282791 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d HTTP/1.1 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8ab3dd87-28c6-4abe-b852-a02051b0200d'} Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.284625 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.290734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-775272ae-06bd-40ff-a9f5-a8751068ff36 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 404 len: 111 microversion: 2.1 time: 0.034585 Oct 13 08:53:32.292684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2158/4647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.298307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.299462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.301568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:32.303217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:32.311149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.311660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.312157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.313171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.313665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.314363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.328773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d HTTP/1.1 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8ab3dd87-28c6-4abe-b852-a02051b0200d'} Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.331178 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.335097 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.337477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.338359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ba2c1d6-444c-4385-aa4f-ce705802393c tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 404 len: 111 microversion: 2.1 time: 0.044384 Oct 13 08:53:32.339115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2490/4648] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:32 2022] DELETE /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.347319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.348006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 8ab3dd87-28c6-4abe-b852-a02051b0200d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.354130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.354839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.355368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.356128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.356657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.357142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.371546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d HTTP/1.1 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8ab3dd87-28c6-4abe-b852-a02051b0200d'} Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.373168 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 8ab3dd87-28c6-4abe-b852-a02051b0200d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.377572 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83f753ab-2c20-420a-b30d-8c5bb54520d7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d" status: 404 len: 111 microversion: 2.1 time: 0.031195 Oct 13 08:53:32.378931 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2159/4649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/8ab3dd87-28c6-4abe-b852-a02051b0200d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.385473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.385983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.393060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.393709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.394244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.395073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.402948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.403373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.421534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 HTTP/1.1 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fa5bc8bc-af3a-41fb-80be-1217bfd52901'} Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.423312 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.428951 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e23f2e4-e065-4c36-9681-29edf882adc7 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 404 len: 111 microversion: 2.1 time: 0.046694 Oct 13 08:53:32.439114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.440673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: fa5bc8bc-af3a-41fb-80be-1217bfd52901] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.446759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2491/4650] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:32 2022] DELETE /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.449465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.450202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.451091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.452026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.452686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.454040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.475121 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 HTTP/1.1 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fa5bc8bc-af3a-41fb-80be-1217bfd52901'} Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.478925 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. Oct 13 08:53:32.483386 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.488144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance fa5bc8bc-af3a-41fb-80be-1217bfd52901 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.489344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d57c65a-1e32-48bd-baa2-e64b830e9e27 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901" status: 404 len: 111 microversion: 2.1 time: 0.054383 Oct 13 08:53:32.489977 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2160/4651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/fa5bc8bc-af3a-41fb-80be-1217bfd52901 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.498687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.499187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.506859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.508354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.508957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.510016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.510845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.511482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.530226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 HTTP/1.1 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ef48e06e-362e-47bd-8f27-3c4e8f05f988'} Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.532253 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.536798 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.537698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.537698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.539241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.540211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:32.540492 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cf575068-1fcc-4706-8b39-7c61fb53945d tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 404 len: 111 microversion: 2.1 time: 0.045635 Oct 13 08:53:32.541827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.543188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.545809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.547221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.549397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.551757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.553146 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2492/4652] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:32 2022] DELETE /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:53:32.562526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.567396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: ef48e06e-362e-47bd-8f27-3c4e8f05f988] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.585326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.586387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.587013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.587912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.588550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.589138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.618695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 HTTP/1.1 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ef48e06e-362e-47bd-8f27-3c4e8f05f988'} Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.620839 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. Oct 13 08:53:32.625371 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.627892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance ef48e06e-362e-47bd-8f27-3c4e8f05f988 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.628949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a156461e-c4ab-4483-962b-87482c66acca tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988" status: 404 len: 111 microversion: 2.1 time: 0.070681 Oct 13 08:53:32.630057 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2493/4653] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/ef48e06e-362e-47bd-8f27-3c4e8f05f988 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.642173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.653731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.662671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.663163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.663608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.664869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.665330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.665764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.683613 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 HTTP/1.1 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '51308e09-70a1-4bab-aaf2-4fa88befb877'} Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.685244 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.690713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dda5a386-dad5-4eb6-b3c7-54757582aabc tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 404 len: 111 microversion: 2.1 time: 0.055421 Oct 13 08:53:32.695702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2494/4654] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:32 2022] DELETE /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.701875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.701875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 51308e09-70a1-4bab-aaf2-4fa88befb877] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.713465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.713798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.714249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.715024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.715666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.716638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.748862 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 HTTP/1.1 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '51308e09-70a1-4bab-aaf2-4fa88befb877'} Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:32.755950 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. Oct 13 08:53:32.761076 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:32.762639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 51308e09-70a1-4bab-aaf2-4fa88befb877 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:32.763753 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a16cd15-b934-425c-bcaf-6cd8da02de22 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877" status: 404 len: 111 microversion: 2.1 time: 0.068626 Oct 13 08:53:32.771546 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2495/4655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/51308e09-70a1-4bab-aaf2-4fa88befb877 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:32.921044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:32.937736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:32.939951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:32.941153 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbe6aa63-4132-4c84-9f4e-d3cfc86e97c7 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.412689 Oct 13 08:53:32.954643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2161/4656] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:32 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:53:32.960033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:32.960544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:32.976128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:32.978173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.978802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.979260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:32.979980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:32.980439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:32.983470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.032240 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 HTTP/1.1 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '809c9162-3e9f-40c4-a05b-d81c7248acc5'} Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:33.038499 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.042924 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.045538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:33.046454 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9cfd428-2fd6-46bd-a80e-36333af5e92b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 404 len: 111 microversion: 2.1 time: 0.090735 Oct 13 08:53:33.050262 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2162/4657] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:32 2022] DELETE /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:33.056031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:33.056657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:33.064676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.065180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.065625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.066351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.066844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.067284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.072894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1611270381", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:33.171617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] validate_networks() for [('2ff7a555-66ce-473c-816b-f2dd4357c597', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:53:33.258506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:33.268399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-925eff8c-7298-4476-8048-814fa1769a31 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1730 microversion: 2.1 time: 0.216916 Oct 13 08:53:33.270259 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2163/4658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:33 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:33.275640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:33.276384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 809c9162-3e9f-40c4-a05b-d81c7248acc5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:33.284562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.285323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.286290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.287347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.287802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.288224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.304067 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 HTTP/1.1 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '809c9162-3e9f-40c4-a05b-d81c7248acc5'} Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:33.305691 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 809c9162-3e9f-40c4-a05b-d81c7248acc5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25e88b57-246d-4032-bd2b-2548e78afb8b tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5" status: 404 len: 111 microversion: 2.1 time: 0.035793 Oct 13 08:53:33.310257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2164/4659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:33 2022] GET /compute/v2.1/servers/809c9162-3e9f-40c4-a05b-d81c7248acc5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:33.316622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:33.316622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:33.323831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.324323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.324762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.325458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.325909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.326332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.429510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-290661db-f907-44c1-94b9-566213907ad5 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119883 Oct 13 08:53:33.430121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2165/4660] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:53:33 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:33.971348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:33.972161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:33.984441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.985197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.985818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:33.986777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:33.993259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:33.993988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:34.268325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:34.288037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:34.293068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:34.298715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-338dbe33-c23f-4614-a772-03323ec327c2 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.326832 Oct 13 08:53:34.300038 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2166/4661] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:33 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:34.446182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:53:34.447448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:53:34.448059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:53:34.448591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:53:34.450231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:53:34.482523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:34.483193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:34.483843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:34.487942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:34.487942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:34.487942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:34.518491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Getting quotas for project 91b82b44cc3d4b8e9268995b95c49434. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:53:34.531810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Getting quotas for user 7db00c490a4246a7901bcaff5d0e73cb and project 91b82b44cc3d4b8e9268995b95c49434. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:53:34.565648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:53:34.572727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:53:34.662359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c90953a0-097b-4edf-b2e3-62d4201c6990 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.884050 Oct 13 08:53:34.663410 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2496/4662] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:53:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:53:34.677369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67f815a0-1d6e-45a4-88fb-0636d4f8d85d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:34.679156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67f815a0-1d6e-45a4-88fb-0636d4f8d85d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:34.979762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67f815a0-1d6e-45a4-88fb-0636d4f8d85d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:34.998444 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67f815a0-1d6e-45a4-88fb-0636d4f8d85d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1214 microversion: 2.1 time: 0.326188 Oct 13 08:53:34.999054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2167/4663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:34 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:35.330393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:35.331235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:35.346913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:35.347496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:35.347945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:35.349726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:35.350191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:35.350650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:35.898628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:35.915292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:35.916945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:35.918613 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-467d5e10-0ed3-4d3a-ada2-66e9a03ffcd6 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.593089 Oct 13 08:53:35.919638 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2497/4664] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:35 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:36.027793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:36.029023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:36.055997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.056692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.057292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:36.058172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.058821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.062715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:36.187425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:36.208398 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afe62e9e-91e8-40cf-a886-73abe7920086 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1266 microversion: 2.1 time: 0.184831 Oct 13 08:53:36.228929 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2168/4665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:36 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:36.399214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:36.435303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.438106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.438594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:36.481378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] Creating event network-changed:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:53:36.493756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c66e5817-c153-4421-a9ba-b1ac638cf63c req-22b67b65-cd00-4f6c-b41e-b6c044defcf1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097200 Oct 13 08:53:36.501245 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2498/4666] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:36.701963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fef053-8bd4-4717-be36-c9004c234100", "name": "network-vif-plugged", "status": "completed", "tag": "17c86ec3-d195-4bbf-b289-ed0dedbf880f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:36.736644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.737220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.737703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:36.790338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] Creating event network-vif-plugged:17c86ec3-d195-4bbf-b289-ed0dedbf880f for instance 58fef053-8bd4-4717-be36-c9004c234100 on n-h2-858384-11 Oct 13 08:53:36.806327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4354bcc3-0d0b-42c8-9aa0-66f905092d19 req-9154da85-4545-464c-9870-d7f83a1fadf8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108068 Oct 13 08:53:36.808850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2169/4667] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:36.947831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:36.948552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:36.970106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.978974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.979884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:36.984965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:36.985461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:36.985906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:37.243965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:37.249600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:37.270861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:37.271660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:37.272274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:37.273253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:37.273884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:37.274536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:37.301663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:37.316397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:37.322397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:37.326562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7eaff5c-9bce-4fc5-957c-771ed2092c17 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 0.381717 Oct 13 08:53:37.327933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2499/4668] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:36 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:37.472875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:37.481893 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7261c02d-f49f-4549-837d-2ff3aad3aded tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1272 microversion: 2.1 time: 0.246829 Oct 13 08:53:37.482385 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2170/4669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:37 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:38.356023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:38.357316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:38.368016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.368939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.369615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.370698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.371400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.372118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.508383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:38.508992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:38.518992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.521336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.521873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.535365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.535974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.536427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.661205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:38.672111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6649a670-6838-42b4-8df1-8109c2f5cdaa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1272 microversion: 2.1 time: 0.167574 Oct 13 08:53:38.675417 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2171/4670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:38 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:38.687700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:38.709239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.710130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.712994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.732920 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] Creating event network-changed:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:53:38.747170 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-58ac77ed-bebd-4867-a40c-ca3214d553b6 req-dfb8e57a-cda7-4cb0-b0ac-2a30528d5fae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070245 Oct 13 08:53:38.747797 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2172/4671] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:38.949706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:38.950637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:38.966242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.967000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.967608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:38.968691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:38.976276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:38.979320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.012085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 HTTP/1.1 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6c9c0797-7694-42d0-8b3e-c09727df6bc4'} Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:39.016517 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.021215 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.035333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:39.046663 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac330596-0911-4cb4-8d51-9c7a9c73ea18 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 404 len: 111 microversion: 2.1 time: 0.093631 Oct 13 08:53:39.049715 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2173/4672] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:38 2022] DELETE /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:39.062839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:39.064113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 6c9c0797-7694-42d0-8b3e-c09727df6bc4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:39.078179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.079802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.081496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.082398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.084089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.086361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.120650 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 HTTP/1.1 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6c9c0797-7694-42d0-8b3e-c09727df6bc4'} Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.122467 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. Oct 13 08:53:39.127113 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.136679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 6c9c0797-7694-42d0-8b3e-c09727df6bc4 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:39.138778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf6a3731-03a0-49a9-8ac9-f186610bd0c9 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4" status: 404 len: 111 microversion: 2.1 time: 0.085706 Oct 13 08:53:39.140789 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2174/4673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:39 2022] GET /compute/v2.1/servers/6c9c0797-7694-42d0-8b3e-c09727df6bc4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:39.158265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:39.159449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:39.178871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.180228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.180832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.181862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.182544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.183133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.219786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d HTTP/1.1 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '517b0740-2577-400f-85ee-7699ad247c0d'} Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:39.222998 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.227717 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.234380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:39.236599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-207cf890-28f9-4dde-8c1e-6eadd6f6500f tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "DELETE /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 404 len: 111 microversion: 2.1 time: 0.091153 Oct 13 08:53:39.238022 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2175/4674] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:53:39 2022] DELETE /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:53:39.246387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:39.247318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] [instance: 517b0740-2577-400f-85ee-7699ad247c0d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:39.254173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.254925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.255524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.256425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.257136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.258821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.276777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] HTTP exception thrown: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Request method failure captured: Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d HTTP/1.1 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9C2KyLwB-13rGW6YQ4mZGPqV-Ga1RXF2AmuJch2QDphAYXQ6CFuoXvbArOSZr108VIk9LTRmlgMJKBnh09mWF4BCw51Ly3jMtjT5rZ2zFdWr_WyMw6NCoHJeU-mv4ddLrGmlO0DspV4zVsttT2W32x1NMRJvcwlULZ6W8szh-lg3PI Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47442db2ef2e490fa125a7675cef7e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 47442db2ef2e490fa125a7675cef7e5c Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1708978045 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8255be4ef5614f3599fe1523c8c28376 Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-1708978045-project Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '517b0740-2577-400f-85ee-7699ad247c0d'} Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:39.278877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. Oct 13 08:53:39.283863 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:53:39.285779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] Returning 404 to user: Instance 517b0740-2577-400f-85ee-7699ad247c0d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:39.288042 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-090a026c-6d42-4e60-a506-0a49068ce472 tempest-DeleteServersTestJSON-1708978045 tempest-DeleteServersTestJSON-1708978045-project] 10.222.0.23 "GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d" status: 404 len: 111 microversion: 2.1 time: 0.046149 Oct 13 08:53:39.289876 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2176/4675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:39 2022] GET /compute/v2.1/servers/517b0740-2577-400f-85ee-7699ad247c0d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:53:39.420725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:39.441006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:39.446997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:39.449405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7b60112-438c-467f-81bd-3880047bc320 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1362 microversion: 2.26 time: 1.097141 Oct 13 08:53:39.452720 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2500/4676] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:38 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1362 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:39.696043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:39.696745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:39.706476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.713414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.714117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.716889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:39.717469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:39.717996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:39.751540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:40.151201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:40.161009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81aa545d-7fed-4bff-9062-75253a1cf006 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.469576 Oct 13 08:53:40.165358 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2177/4677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:39 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:40.479871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:40.481251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:40.488594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.489391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.490086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.491038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.491770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.492415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.737929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:40.768284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:40.770123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:40.771562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b32b9fd-a979-47ef-8819-5f48b09d6382 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1545 microversion: 2.26 time: 0.296237 Oct 13 08:53:40.791274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2501/4678] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:40 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1545 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:40.800101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754ece50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:40.811569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.812226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.812821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.813436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:40.819457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.820647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.821232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.821946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.822584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.823152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.852727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.853711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.854370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.871208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.871950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.872603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:40.947014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:40.967425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ebc1f2ce-e6d2-47a3-b128-121524197ef8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-619287056" status: 201 len: 0 microversion: 2.26 time: 0.172142 Oct 13 08:53:40.968615 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2178/4679] 10.222.0.23 () {62 vars in 1377 bytes} [Thu Oct 13 08:53:40 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-619287056 => generated 0 bytes in 174 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 13 08:53:40.980613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4907f1f-6fcf-4811-abeb-69d78d7e0a8a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f5375c384c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:40.989318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4907f1f-6fcf-4811-abeb-69d78d7e0a8a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:40.990024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4907f1f-6fcf-4811-abeb-69d78d7e0a8a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:40.990500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4907f1f-6fcf-4811-abeb-69d78d7e0a8a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.011556 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4907f1f-6fcf-4811-abeb-69d78d7e0a8a tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-619287056" status: 204 len: 0 microversion: 2.26 time: 0.036378 Oct 13 08:53:41.016267 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2502/4680] 10.222.0.23 () {60 vars in 1358 bytes} [Thu Oct 13 08:53:40 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-619287056 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 08:53:41.022057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53755408b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.058214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.059300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.059752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.060234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:41.078524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.079002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.079436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.080137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.080583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.081003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.132556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.133151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.133665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.158349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:41.182761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3c3dbb5a-87bb-4bea-95e3-81b1220d0830 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 204 len: 0 microversion: 2.26 time: 0.165224 Oct 13 08:53:41.185163 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2179/4681] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Oct 13 08:53:41 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 08:53:41.194174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.196332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:41.200601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2550e397-ad8c-4086-a392-3d22d8c62f20 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537556e5e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.208710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.209225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.209676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.211469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.211965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.212404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.213545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2550e397-ad8c-4086-a392-3d22d8c62f20 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.214261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2550e397-ad8c-4086-a392-3d22d8c62f20 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.214943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2550e397-ad8c-4086-a392-3d22d8c62f20 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.229790 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2550e397-ad8c-4086-a392-3d22d8c62f20 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 12 microversion: 2.26 time: 0.038143 Oct 13 08:53:41.231245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2180/4682] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:53:41 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:41.242707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53755400d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.254006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.254813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.255570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.256253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:41.264764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.264764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.264764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.265454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.265907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.266331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.342100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.342897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.343498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.370345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.370861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.373349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.446687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:41.484038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0ece5ce-d05f-47b9-a858-27c78d6ef991 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2016678862" status: 201 len: 0 microversion: 2.26 time: 0.246423 Oct 13 08:53:41.500625 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2181/4683] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Oct 13 08:53:41 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2016678862 => generated 0 bytes in 263 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 13 08:53:41.517284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e60281a-d237-4574-bae3-8041cccd1e08", "tag": "d23dab75-bc19-4ddb-9369-45577916ba37"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:41.529526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.530001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.530462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.553365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] Creating event network-changed:d23dab75-bc19-4ddb-9369-45577916ba37 for instance 2e60281a-d237-4574-bae3-8041cccd1e08 on n-h1-858384-11 Oct 13 08:53:41.570294 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d1d8d0ce-f0d2-4b76-aa7d-94463493de34 req-c1735d67-e666-4b52-8364-661b41f9adde service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067271 Oct 13 08:53:41.571828 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2182/4684] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:41.582057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e4a0ff2-1270-4e00-9a50-9823dfeacf49 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754a0b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.597546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e4a0ff2-1270-4e00-9a50-9823dfeacf49 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.598188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e4a0ff2-1270-4e00-9a50-9823dfeacf49 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.598657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e4a0ff2-1270-4e00-9a50-9823dfeacf49 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.600705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:41.610764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd4b92e6-430c-48f0-aedd-d376722f8d8d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.427582 Oct 13 08:53:41.615600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e4a0ff2-1270-4e00-9a50-9823dfeacf49 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 36 microversion: 2.26 time: 0.040961 Oct 13 08:53:41.616110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2503/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:41 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:41.626648 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2183/4686] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:53:41 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 36 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:41.636260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f5375deeee0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.658762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.666107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.667171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.667658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:41.691663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.692241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.692615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.693350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.693814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.694310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.754226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.754755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.755201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.827708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:41.883144 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa8c23a4-720b-45ce-987c-8352d9c8badf tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2016678862" status: 204 len: 0 microversion: 2.26 time: 0.254256 Oct 13 08:53:41.890043 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2504/4687] 10.222.0.23 () {60 vars in 1364 bytes} [Thu Oct 13 08:53:41 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2016678862 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:53:41.897386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd46ce75-e677-4533-803e-ac81a37f3708 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754a0310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.910087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd46ce75-e677-4533-803e-ac81a37f3708 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.918016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd46ce75-e677-4533-803e-ac81a37f3708 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.919358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd46ce75-e677-4533-803e-ac81a37f3708 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.939236 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd46ce75-e677-4533-803e-ac81a37f3708 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 12 microversion: 2.26 time: 0.047583 Oct 13 08:53:41.944861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2184/4688] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:53:41 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:41.957107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f5375deeb80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:41.975482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.976010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.976492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:41.976983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:41.995009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:41.996054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:41.999738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.000494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.002850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.006534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.070136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.071022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.071600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.112819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:42.150078 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ef8509a-a126-4a4e-994a-c7342d81083e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 204 len: 0 microversion: 2.26 time: 0.195615 Oct 13 08:53:42.159759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2505/4689] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Oct 13 08:53:41 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:53:42.166846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537556e5e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.188070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.188581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.189027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.189828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:42.205124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.207443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.208050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.211914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.213265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.218200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.263913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.264414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.264862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.302972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.303719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.305823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.361413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:42.387839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4dd26054-f817-45a8-b22c-c1175fa7d494 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-304322628" status: 201 len: 0 microversion: 2.26 time: 0.227428 Oct 13 08:53:42.395416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2185/4690] 10.222.0.23 () {62 vars in 1377 bytes} [Thu Oct 13 08:53:42 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-304322628 => generated 0 bytes in 236 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 13 08:53:42.401763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53758485e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.426668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.427537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.428150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.428828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:42.436017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.436864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.438157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.439034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.439783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.440202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.469096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.469381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.469940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.481025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.481520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.481955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.514239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:42.540026 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5fb586e-e039-4052-9af2-6c0a39846a1e tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2027206792" status: 201 len: 0 microversion: 2.26 time: 0.144546 Oct 13 08:53:42.541151 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2506/4691] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Oct 13 08:53:42 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-2027206792 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 13 08:53:42.554396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754ae5e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.564116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.564776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.565531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.566951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:42.574493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.575176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.575922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.576771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.577719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.578499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.635390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.635879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.636314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.648665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.649276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:42.661505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.686810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.687325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.688561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.688733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.693556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.711394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:42.758452 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ade34ed-c9b5-4c5e-a965-e248d2a2a8e9 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 204 len: 0 microversion: 2.26 time: 0.207972 Oct 13 08:53:42.762733 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2186/4692] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Oct 13 08:53:42 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:53:42.784471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-664feba5-e557-474a-a816-d991521fbdd0 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537559c8b0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.820287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-664feba5-e557-474a-a816-d991521fbdd0 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.824867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-664feba5-e557-474a-a816-d991521fbdd0 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.826140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-664feba5-e557-474a-a816-d991521fbdd0 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.838687 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-664feba5-e557-474a-a816-d991521fbdd0 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 12 microversion: 2.26 time: 0.070796 Oct 13 08:53:42.849321 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2187/4693] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:53:42 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 12 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:42.854623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754ecee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.862251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.862860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.863443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.863706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:42.875432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.875927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.876375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.878106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.878106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.878388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.934899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.936066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.936677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.950714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:42.970477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0000ed3c-c895-44e9-8d67-602716d53116 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 204 len: 0 microversion: 2.26 time: 0.119907 Oct 13 08:53:42.976965 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2188/4694] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Oct 13 08:53:42 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:53:42.983697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f53754ec700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:42.994018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:42.994792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:42.995391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:42.996037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:43.006490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.008230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.008836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.009704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.010305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.010946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.049269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.049950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.050597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.059912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:43.061571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.062229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.063524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.115438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:43.153506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5822bd6-212c-44b5-9a5e-4cc956012509 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-531036651" status: 201 len: 0 microversion: 2.26 time: 0.173731 Oct 13 08:53:43.155544 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2189/4695] 10.222.0.23 () {62 vars in 1377 bytes} [Thu Oct 13 08:53:42 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-531036651 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 13 08:53:43.178084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537544bee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:43.197847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.198267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.198741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.199219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:43.216602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.217357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.218126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.219139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.219859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.220558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.314830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.315357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.315846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.344876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:43.361576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.362545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.363204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.377258 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0529b250-3480-4de7-b900-726efee8ff83 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.729011 Oct 13 08:53:43.379056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2507/4696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:42 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:43.448667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:43.474912 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b43d2f24-1177-4a80-ade3-da463ca9b7c4 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-1371803281" status: 201 len: 0 microversion: 2.26 time: 0.303980 Oct 13 08:53:43.495614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Action: 'update_all', calling method: .version_select at 0x7f5375880a60>, body: {"tags": ["tempest-tag-89882082", "tempest-tag-1974770324"]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:43.502010 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2190/4697] 10.222.0.23 () {62 vars in 1380 bytes} [Thu Oct 13 08:53:43 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags/tempest-tag-1371803281 => generated 0 bytes in 333 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 13 08:53:43.511237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.512108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.513115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.513447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:43.521960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.523763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.524354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.526732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.527568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.528365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.597701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:43.613279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.614879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.618114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.670250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:43.703446 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e819ee8-7807-491e-bd5a-e11a7711f517 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 60 microversion: 2.26 time: 0.220641 Oct 13 08:53:43.705615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2508/4698] 10.222.0.23 () {62 vars in 1312 bytes} [Thu Oct 13 08:53:43 2022] PUT /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 60 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:43.723732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e203fe49-b261-44a2-8644-6990ad06bd6b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537544b670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:43.745367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e203fe49-b261-44a2-8644-6990ad06bd6b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.745864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e203fe49-b261-44a2-8644-6990ad06bd6b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.746476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e203fe49-b261-44a2-8644-6990ad06bd6b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.799673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:43.800178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:43.801261 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e203fe49-b261-44a2-8644-6990ad06bd6b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 200 len: 60 microversion: 2.26 time: 0.088093 Oct 13 08:53:43.809272 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2191/4699] 10.222.0.23 () {60 vars in 1292 bytes} [Thu Oct 13 08:53:43 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 60 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:43.812020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.812744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.813363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.814263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.816438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '.version_select at 0x7f537544baf0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:43.817148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.817755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.849628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.850393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.851083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.856202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:43.870641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.871148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.871598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.872311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.872773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.879040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.924074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:43.924855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:43.926298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:43.955865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lazy-loading 'flavor' on Instance uuid 58fef053-8bd4-4717-be36-c9004c234100 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:43.998284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4bf0be0f-75a3-48ca-b93f-1f9e06908ada tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags" status: 204 len: 0 microversion: 2.26 time: 0.187635 Oct 13 08:53:43.999152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2192/4700] 10.222.0.23 () {60 vars in 1295 bytes} [Thu Oct 13 08:53:43 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:53:44.010526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:44.011261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:44.014665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lazy-loading 'services' on Instance uuid e3a0cad5-37ea-4141-a2a1-b0edefe9af7c {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:44.020879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.027290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.028038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.029021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.029690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.030328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.084955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:53:44.251555 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c98405ea-de01-4373-91a4-837bb45fed3d tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments/f55c660b-89d0-4d69-9c0e-a28f7f79b189" status: 202 len: 0 microversion: 2.1 time: 0.455630 Oct 13 08:53:44.287845 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2509/4701] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:53:43 2022] DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments/f55c660b-89d0-4d69-9c0e-a28f7f79b189 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:53:44.321496 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3db83fcd-0709-4189-992c-b087180cca1b tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 204 len: 0 microversion: 2.26 time: 0.316614 Oct 13 08:53:44.329391 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2193/4702] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:53:44 2022] DELETE /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 08:53:44.340690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:44.342157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:44.354638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.363041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.364353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.365376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.366069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.367453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.406449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:44.407209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:44.430212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.430212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.430651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.431749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:44.431872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:44.432220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:44.506852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:44.552331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:44.666372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:44.676959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:44.679280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:44.680584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20d5db05-5001-4ead-b635-6b5f4f670008 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1551 microversion: 2.26 time: 0.346958 Oct 13 08:53:44.681376 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2510/4703] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:44 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1551 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:53:44.760798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:44.790277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-547c4cbb-a9c4-478e-b055-a5eef07e645c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.388179 Oct 13 08:53:44.816972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2194/4704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:44 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:45.711910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:45.713156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:45.724276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:45.728015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:45.728710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:45.729668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:45.732976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:45.733799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:45.832507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:45.833934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:45.848311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:45.855175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:45.855992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:45.856702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:45.858282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:45.860104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:45.864555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:46.069328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:46.105778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:46.116181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:46.125891 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56ae80ae-6d52-48dd-a85f-290ff51def0c tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1551 microversion: 2.26 time: 0.414935 Oct 13 08:53:46.128602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2511/4705] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:45 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1551 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:46.465098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:46.475438 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd2fce0f-ac93-4eb1-87af-89b5895c290d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.646734 Oct 13 08:53:46.481053 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2195/4706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:45 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:47.159527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:47.161045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:47.175177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.180069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.182689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.184270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.184950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.186696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.202035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fef053-8bd4-4717-be36-c9004c234100", "name": "network-vif-deleted", "tag": "17c86ec3-d195-4bbf-b289-ed0dedbf880f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:47.234094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.237855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.242495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.276722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] Creating event network-vif-deleted:17c86ec3-d195-4bbf-b289-ed0dedbf880f for instance 58fef053-8bd4-4717-be36-c9004c234100 on n-h2-858384-11 Oct 13 08:53:47.297775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-fb26a821-b713-4a90-8419-b1b51f4c017f req-a5b0d54b-46be-4409-af3f-c1c447ed24e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098532 Oct 13 08:53:47.299238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2196/4707] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:53:47.320019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:47.332129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:47.333839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c930a822bdf84b3e8d099c3ddec6784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70679717540d48b7b34a080c0a87d9cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:47.344053 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ec3ce840-7dc5-41d3-ba36-6f369f4f0dc8 tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 200 len: 1509 microversion: 2.26 time: 0.189489 Oct 13 08:53:47.344912 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2512/4708] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:47 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:47.523566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:47.528032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:47.580960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.588461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.592824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.610858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.613287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.617049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.815969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e60281a-d237-4574-bae3-8041cccd1e08", "name": "network-vif-plugged", "status": "completed", "tag": "d23dab75-bc19-4ddb-9369-45577916ba37"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:47.842457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:47.842953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:47.843390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:47.870970 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] Creating event network-vif-plugged:d23dab75-bc19-4ddb-9369-45577916ba37 for instance 2e60281a-d237-4574-bae3-8041cccd1e08 on n-h1-858384-11 Oct 13 08:53:47.881116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e8b73a52-e112-456a-abd3-0587429d479b req-9a484e2c-e1ea-482b-81d6-edb173a9fbf2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068987 Oct 13 08:53:47.883367 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2513/4709] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:53:47.930845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:47.941078 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd9353d6-a980-4863-8d8d-b755fd894555 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.437352 Oct 13 08:53:47.962503 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2197/4710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:47 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:48.376377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:48.377023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] [instance: 58fef053-8bd4-4717-be36-c9004c234100] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:48.390708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:48.393718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:48.394362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:48.395285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:48.400864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:48.402889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:48.443973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] HTTP exception thrown: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Request method failure captured: Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 HTTP/1.1 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9IA1nkEt2LwlsDuRyH_Q836YiuricjJqn2vPXDPLeUmC-tAgWsJrbQMRg4XQBAT1AVp6NTYXnC2W0Ln0Gu7xNCHJn67NYN4vT8N95lEJIa9Sgy-kTWdttm16doA9EB-1BDe9OJDHsxMq8GLm2vooGWeYG09QyOE337BczVO-vxLo7k Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.26 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 70679717540d48b7b34a080c0a87d9cd Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerTagsTestJSON-129816779 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70679717540d48b7b34a080c0a87d9cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70679717540d48b7b34a080c0a87d9cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70679717540d48b7b34a080c0a87d9cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70679717540d48b7b34a080c0a87d9cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerTagsTestJSON-129816779 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 70679717540d48b7b34a080c0a87d9cd Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerTagsTestJSON-129816779 Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerTagsTestJSON-129816779-project Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c930a822bdf84b3e8d099c3ddec6784c Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerTagsTestJSON-129816779-project Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '58fef053-8bd4-4717-be36-c9004c234100'} Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:53:48.456321 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] Returning 404 to user: Instance 58fef053-8bd4-4717-be36-c9004c234100 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7ad6b9e-1d50-4efb-8220-e7c3bc4b839f tempest-ServerTagsTestJSON-129816779 tempest-ServerTagsTestJSON-129816779-project] 10.222.0.23 "GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100" status: 404 len: 111 microversion: 2.26 time: 0.088364 Oct 13 08:53:48.461568 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2514/4711] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:48 2022] GET /compute/v2.1/servers/58fef053-8bd4-4717-be36-c9004c234100 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:53:48.965393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:48.966832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:48.982887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:48.985390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:48.988655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:48.990030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:48.991254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:48.992459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:49.344762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:49.361755 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a8761c8-4058-444b-9916-2476be24c73f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1314 microversion: 2.1 time: 0.400891 Oct 13 08:53:49.364555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2198/4712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:48 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:50.387900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:50.388560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:50.407835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:50.408491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:50.408946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:50.409671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:50.410133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:50.410594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:50.830730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:50.846015 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d50f1c29-ca23-41ed-b298-7100908d4441 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1497 microversion: 2.1 time: 0.460290 Oct 13 08:53:50.846903 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2515/4713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:50 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1497 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:50.876554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:50.880331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:50.891639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:50.894239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:50.897015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:50.898191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:50.901954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:50.902683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:50.903474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:50.961992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lazy-loading 'flavor' on Instance uuid 2e60281a-d237-4574-bae3-8041cccd1e08 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:53:51.088575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:51.111402 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf3ef429-3dd4-46c1-98a0-c32f8b53d364 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "POST /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08/action" status: 200 len: 32 microversion: 2.1 time: 0.237986 Oct 13 08:53:51.112401 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2199/4714] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:53:50 2022] POST /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:53:51.121995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:51.122721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:51.136491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:51.137061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:51.137727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:51.139510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:51.141419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:51.141938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:51.487694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:51.503493 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8b155d2-392d-4924-adbe-95e7fc1bcd27 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.383802 Oct 13 08:53:51.505375 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2516/4715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:51 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:52.530702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:52.532071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:52.552423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:52.554965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:52.555591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:52.557229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:52.558446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:52.560917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:53.183314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:53.197367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2dbc41d-6309-4195-9554-7e549bc15af5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.671072 Oct 13 08:53:53.200214 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2200/4716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:52 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:53.467709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:53.475539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:53.476633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:53.478491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:53.509264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:53:53.577518 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dda02841-0a2b-4ca0-98ba-f42b08b1a476 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action" status: 202 len: 0 microversion: 2.1 time: 0.125991 Oct 13 08:53:53.579123 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2517/4717] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:53:53 2022] POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:53:53.593684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:53.595388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:53.608366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:53.609270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:53.610146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:53.611270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:53.612384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:53.613213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:53.823732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:53.833794 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1afbd41e-7b62-41e1-9706-03c27c1789ac tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.249830 Oct 13 08:53:53.841505 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2201/4718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:53 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:54.231608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:54.232323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:54.257524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:54.258041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:54.258518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:54.259296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:54.259733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:54.260167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:54.842993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:54.853525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b44133ea-ae8f-4f55-bfed-71980cf5ac11 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.629451 Oct 13 08:53:54.860415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:54.861597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:54.867130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2518/4719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:54 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:54.872173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:54.875149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:54.875864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:54.879261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:54.879887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:54.880470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:55.733740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:55.764140 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fbb79de5-8e55-4cff-ad65-3b5e172ea346 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.904979 Oct 13 08:53:55.766699 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2202/4720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:54 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:55.896472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:55.897246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:55.912213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:55.914459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:55.915311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:55.917632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:55.918208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:55.919351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:56.213245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:56.227234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62ed078e-ccaa-4ecc-998d-255266f46eac tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.335542 Oct 13 08:53:56.228195 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2519/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:55 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:53:56.789445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:56.790070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:56.809071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:56.818997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:56.820386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:56.822660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:56.823297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:56.824059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:57.252384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:57.253164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:57.268250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:57.269517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:57.270109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:57.274843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:57.275529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:57.277302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:57.869831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:57.887269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23cbc7c1-6cbd-4b22-8d9e-e61114b6d7b6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.632256 Oct 13 08:53:57.892906 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2520/4722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:57 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:58.470449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1139859040", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:53:58.558938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:53:58.559366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:53:58.559845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:53:58.560262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:53:58.560674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:53:58.587618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:58.588385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:58.588824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:58.589554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:58.590009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:58.598738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:58.640835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Getting quotas for project 6cdb743eafa448b7947a6c07b106b00c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:53:58.668434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Getting quotas for user a23d25f9e3ce4f39b63b862508891c7f and project 6cdb743eafa448b7947a6c07b106b00c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:53:58.682179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:53:58.684924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:53:58.722785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:53:58.769458 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e30f95c-e162-4539-a74e-659608f97d99 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.538476 Oct 13 08:53:58.770142 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2521/4723] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 08:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:53:58.791596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:58.792220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:58.927258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:58.940510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08bea7e4-9fe7-46ad-9a23-30bbd2dafad9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 2.156633 Oct 13 08:53:58.943512 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2203/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:56 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:58.955488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:58.958288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:58.983803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:58.987137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:58.987854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:58.988852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:58.990244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:58.991723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:59.286699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:59.294554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:59.296017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:59.297167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f62ffb4-38ce-4705-96f8-4103fcc8e46d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1278 microversion: 2.54 time: 0.510139 Oct 13 08:53:59.297732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2522/4725] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:53:58 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1278 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:53:59.596460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:53:59.606631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-42ecdda6-f037-4085-b851-87223124447a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.661017 Oct 13 08:53:59.607260 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2204/4726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:58 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:53:59.966123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:53:59.967008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:53:59.975040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:59.976111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:59.976562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:53:59.978934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:53:59.979403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:53:59.979838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:00.295884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:00.325208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:00.326479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:00.337831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:00.338383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93782591-8332-4aba-8e51-f2b9a0e42791 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.372464 Oct 13 08:54:00.339143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2523/4727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:53:59 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:00.340126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:00.340786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:00.341740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:00.342459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:00.343167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:00.441818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:00.457223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:00.459048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:00.461035 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20a8c89d-c8e3-4e43-82b2-247239f52923 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1330 microversion: 2.54 time: 0.140971 Oct 13 08:54:00.461877 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2205/4728] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:00 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:00.563968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c85d8f17-1abf-4556-b503-d663a93a27a1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: .version_select at 0x7f5375bbb160>, body: {"keypair": {"name": "tempest-keypair-51424753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzHsm3yfVz8ZkkpTJE87AjLnnUSKK+nhMbq4bHHS1kfXIBryqOXIROvkzHbKiC7EeCSZQpARzO2yln5PqtpfSaq3IyR5wL07MiXD6ls703pzBppOUw/HFoBYxNNcA8zPA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:00.582200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c85d8f17-1abf-4556-b503-d663a93a27a1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:54:00.588991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c85d8f17-1abf-4556-b503-d663a93a27a1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:54:00.630280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:00.630975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:00.634222 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c85d8f17-1abf-4556-b503-d663a93a27a1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.112836 Oct 13 08:54:00.640773 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2524/4729] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:54:00 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:00.644392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:00.645290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:00.645728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:00.646798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:00.647931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:00.648532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:00.919169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:00.933628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4efe48d5-fe51-4afa-a9cc-f3eb56c88714 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.307590 Oct 13 08:54:00.950010 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2206/4730] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:00 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:01.364489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:01.365214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:01.375800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.376780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.377907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:01.379535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.380226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.381034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:01.488144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:01.488960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:01.500613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.501106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.501543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:01.503045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.503519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.503946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:01.601731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:01.619153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:01.624285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:01.627276 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb551cbf-9e0a-4318-a8b9-0bc76406f72a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1336 microversion: 2.54 time: 0.142863 Oct 13 08:54:01.629033 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2207/4731] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:01 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1336 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:01.732596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:01.747989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a936ce9a-7696-475c-ac97-869746f74a29 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.388956 Oct 13 08:54:01.748951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2525/4732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:01 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:01.977153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:01.978365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:01.990177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.992039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.992878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:01.993912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:01.995367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:01.996371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:02.261023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:02.278816 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6aaa7b3-4f2c-47b6-be35-14edcd8c927e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.302293 Oct 13 08:54:02.280285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2208/4733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:01 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:02.458392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-308524480", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7a3a358-8f5e-4e38-984b-35dd1ec4122e"}], "security_groups": [{"name": "tempest-securitygroup--386564120"}], "key_name": "tempest-keypair-51424753", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:02.633961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] validate_networks() for [('b7a3a358-8f5e-4e38-984b-35dd1ec4122e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:54:02.658706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:02.660099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:02.668076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:02.668858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:02.669538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:02.670832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:02.671527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:02.672323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:02.755366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:02.770312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:02.773214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:02.779120 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c76b6e29-6e85-4ecb-a141-d5d3be3ea0e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1336 microversion: 2.54 time: 0.124000 Oct 13 08:54:02.780606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2209/4734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:02 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:02.787154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:02.789355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:02.797866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:02.799518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:02.800216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:02.801301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:02.802006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:02.802590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.053226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:03.077130 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79dedc13-0174-47d8-bbc6-43cd5ac6ed4c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.294978 Oct 13 08:54:03.108701 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2210/4735] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:02 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:03.304022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:03.304735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:03.311985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.312531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.312968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.314143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.314812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.315535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.495885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:54:03.496516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:54:03.497105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:54:03.497761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:54:03.498395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:54:03.510530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.511018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.511458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.512370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.513146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.513653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.541928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:03.542634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:54:03.549085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:54:03.565719 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c28a0aab-98a9-4dc9-9824-ced8df2183ab tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.262746 Oct 13 08:54:03.565981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:54:03.568080 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2211/4736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:03 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:03.568628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:54:03.646319 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a490573-7e73-4762-9cff-b832d7a9180d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.192373 Oct 13 08:54:03.648171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2526/4737] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:54:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:54:03.661039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-28093011-60cd-4fff-be42-2df587309372 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:03.662908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-28093011-60cd-4fff-be42-2df587309372 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:03.737532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28093011-60cd-4fff-be42-2df587309372 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:03.746400 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-28093011-60cd-4fff-be42-2df587309372 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1236 microversion: 2.1 time: 0.090714 Oct 13 08:54:03.758611 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2212/4738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:03 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:03.810649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:03.811285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:03.820185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.820715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.821153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.821883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:03.822342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:03.822798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:03.840795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:04.115397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:04.116609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:04.134766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.135382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.135928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.136843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.137331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.137809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.227738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.240409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.242724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.244435 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-072658e6-c800-438c-89c4-7ad316413988 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1336 microversion: 2.54 time: 0.437725 Oct 13 08:54:04.245669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2527/4739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:03 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1336 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:04.335798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.348839 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d097ce2-a680-4f21-9fc7-5c88245bdd66 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1678 microversion: 2.1 time: 0.236709 Oct 13 08:54:04.350219 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2213/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:04 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:04.592497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:04.593071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:04.613764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.619053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.631189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.632057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.632535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.632967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.770886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:04.771507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:04.784379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.784893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.785341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.788450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:04.788955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:04.789480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:04.876683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.891140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-362c8c64-f3ca-4397-a0cc-f25fddce186f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.302582 Oct 13 08:54:04.892696 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2528/4741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:04 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:04.950987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:04.961995 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f78bc48a-8160-4837-89b4-0925020d8712 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1240 microversion: 2.1 time: 0.192087 Oct 13 08:54:04.963039 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2214/4742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:04 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1240 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:05.271969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:05.273012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:05.283510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.284397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.288244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.289092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.289657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.290296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.373158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:05.374604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:05.382359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.397919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.398654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.402985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.403477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.405025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.447606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:05.459306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:05.463388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:05.464978 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-868fc760-26d8-4a95-8bdb-30503b08be7f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1336 microversion: 2.54 time: 0.196926 Oct 13 08:54:05.466022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2529/4743] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:05 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1336 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:05.645525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:05.646225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:05.652975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.653471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.653903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.654645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.655091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.655730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.760225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'services' on Instance uuid b66eb356-e05e-45dc-a8ce-6aa7ea45163b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:05.871121 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32cf0400-3e0a-40a5-9c8e-905d6c529b17 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments/16778e46-05e7-4f5a-b281-86c165925c93" status: 202 len: 0 microversion: 2.1 time: 0.228958 Oct 13 08:54:05.876193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2530/4744] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:54:05 2022] DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments/16778e46-05e7-4f5a-b281-86c165925c93 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:54:05.894478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:05.899080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:05.910963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.911792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.912527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.914270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:05.914953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:05.915536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:05.980098 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f99c033-6d17-488a-a75c-d9f057859306 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097553 Oct 13 08:54:05.981411 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2531/4745] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:05 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:05.993344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:05.994493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:06.003300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.004546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.005226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.006327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.007302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.008089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.105788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.114895 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b384d4bf-ad0d-46b4-8b98-4af58fad59e2 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1655 microversion: 2.1 time: 0.745619 Oct 13 08:54:06.115473 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2215/4746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:05 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1655 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:06.120564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:06.121451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:06.127790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.128470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.129080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.129950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.130585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.131165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.179794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.187976 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-047766b4-a420-4ebc-85dd-f9c25ceb8289 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.205332 Oct 13 08:54:06.188558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2532/4747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:05 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:06.193493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:06.207929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.208286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.208631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.233936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Going to try to start instance {{(pid=127030) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 08:54:06.236082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.252582 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-07912097-668e-44dc-aef1-b79c70408894 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1294 microversion: 2.1 time: 0.134566 Oct 13 08:54:06.254659 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2216/4748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:06 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:06.290816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-adb174c0-341c-496d-b7bf-078793aea68a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action" status: 202 len: 0 microversion: 2.1 time: 0.100695 Oct 13 08:54:06.295527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2533/4749] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:54:06 2022] POST /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:54:06.300239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:06.300854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:06.307621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.308439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.308954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.309738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.310199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.310796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.330022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:06.495636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:06.496861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:06.508408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.510470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.512168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.514680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.515164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.515601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.638305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.649730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.652609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.654116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f66ebbe-76e2-42be-9a47-a83a36a7613f tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1357 microversion: 2.54 time: 0.165214 Oct 13 08:54:06.656207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2534/4750] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:06 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:06.672667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:06.680938 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-103d615e-2f97-4f36-b114-398fe5291eaa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1664 microversion: 2.1 time: 0.384490 Oct 13 08:54:06.691701 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2217/4751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:06 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1664 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:06.703271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-106bdfe6-df8f-465a-b7ae-d3d03e269364 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Action: 'create', calling method: .version_select at 0x7f5375dd7ee0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-747173631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0I93UluaA2QCzRVHdvEj/g4CWFXwUjNQnmWXTir5NUsi+eNr0dtzAmzMDrTgoN0e5DlRsxqjSpNBElAsfpHmCxVs3s5K66Mz3drOUD4twGphRn+y+06N2iNbceIUa4Og=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:06.739181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-106bdfe6-df8f-465a-b7ae-d3d03e269364 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Getting quotas for project 6cdb743eafa448b7947a6c07b106b00c. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:54:06.754113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-106bdfe6-df8f-465a-b7ae-d3d03e269364 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Getting quotas for user a23d25f9e3ce4f39b63b862508891c7f and project 6cdb743eafa448b7947a6c07b106b00c. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:54:06.810881 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-106bdfe6-df8f-465a-b7ae-d3d03e269364 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.117176 Oct 13 08:54:06.811710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2535/4752] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:54:06 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 13 08:54:06.825547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-747173631", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:06.828704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:06.840041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.840529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.840966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.841667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:06.842114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:06.842567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:06.993496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:54:06.994617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:54:06.995259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:54:06.995837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:54:06.996419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:54:06.998213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:07.001524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.033090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.035829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.045850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.047365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.048408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.050447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.138112 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf5dd431-6f88-48e0-a66d-1fbe806fa020 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146101 Oct 13 08:54:07.143853 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2536/4753] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:06 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:07.177562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.201326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.201737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.202184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.203031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.203500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.203997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.213873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:07.214869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.226521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.228192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.230014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.232974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.233727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.234423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.255995 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e01f8aee-98ad-49dc-8ee9-c957c28e0a2e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "POST /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe/action" status: 202 len: 1139 microversion: 2.54 time: 0.436896 Oct 13 08:54:07.257727 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2218/4754] 10.222.0.23 () {62 vars in 1320 bytes} [Thu Oct 13 08:54:06 2022] POST /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe/action => generated 1139 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 13 08:54:07.290113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:07.291980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.307707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.313381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.313969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.315931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.316764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.317781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.490448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:07.502193 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61fe499b-2e22-45de-8cca-9af1b2bbeca0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1294 microversion: 2.1 time: 0.219809 Oct 13 08:54:07.514538 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2219/4755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:07 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1294 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:07.514538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:07.514538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.519393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:07.524306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.525146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.525752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.526647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.527287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.527984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.529409 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cce4e092-1a45-438f-b508-306633544ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.320718 Oct 13 08:54:07.533075 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2537/4756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:07 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:07.696569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:07.712130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:07.713846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:07.714928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:07.715414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:07.731432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.734197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.734962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.738180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:07.739149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:07.739924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:07.754029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99138f11-b29a-4687-94b3-a32ee9da8d4b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.235464 Oct 13 08:54:07.776198 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2220/4757] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:07 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:08.092267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:08.104276 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3381dbff-734d-4408-9f9f-3da001075b37 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1664 microversion: 2.1 time: 0.397093 Oct 13 08:54:08.108464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2538/4758] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:07 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1664 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:08.152143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:08.154685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:08.172634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.173429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.175804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.177853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.180105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.181957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.278618 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c946cc6-97c0-4789-ac85-366fdaff6f9c tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129639 Oct 13 08:54:08.279459 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2221/4759] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:08 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:08.525445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:08.526243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:08.534516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.538880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.539592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.540412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.540884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.541590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.557053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:08.559849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:08.579986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.580545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.582792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.583692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.585567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.591592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.811096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:08.820937 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de919baf-8082-4b32-aa06-2f1bd4aa5ef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.300242 Oct 13 08:54:08.835384 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2539/4760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:08 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:08.842133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:08.858584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:08.873989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.874499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.874940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.875696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:08.876093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:08.876514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:08.902932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:08.913822 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab467994-a2be-4737-b38e-4df3afdc375e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.360584 Oct 13 08:54:08.930981 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2222/4761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:08 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:09.016235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:09.036043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:09.037827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:09.039515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a9508d9-2ddf-45bf-96f1-3232e56445e1 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.203132 Oct 13 08:54:09.054828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2540/4762] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:08 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:09.144716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:09.145366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:09.159262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.159766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.160210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.160925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.161510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.161950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.293651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:09.297591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:09.311632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.312428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.314917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.316074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.316706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.320210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.386076 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e240b05-7b1f-40a8-b084-2d0dfdb12a3a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096353 Oct 13 08:54:09.386728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2541/4763] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:09 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:09.496803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:09.505692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e30c19e-a987-4aeb-9a95-43b3fd436c7f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1668 microversion: 2.1 time: 0.365393 Oct 13 08:54:09.507966 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2223/4764] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:09 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:09.717650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:09.740487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.742510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.745868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.772750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] Creating event network-changed:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:54:09.783571 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-db11ec25-6663-41e8-a8f0-2a17f3b12ae9 req-c06c150f-efc2-4f85-8950-25ba68b885de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070535 Oct 13 08:54:09.785587 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2542/4765] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:09.848588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:09.849808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:09.863341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.864305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.864305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.864981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.865444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.866425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.945303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:09.946018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:09.960345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.961141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.962001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:09.962905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:09.963512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:09.964092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:10.503025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:10.509680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:10.511992 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfae1494-c20e-4d82-a21e-8aee99b8e941 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.571544 Oct 13 08:54:10.512593 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2543/4766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:09 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:10.537150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:10.543221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:10.555656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:10.556417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:10.557019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:10.557914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:10.558560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:10.559133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:10.585753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:10.598874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8cfef22-f6e1-40be-8f91-8ce16ba05c55 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.756166 Oct 13 08:54:10.599565 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2224/4767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:09 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:10.610322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:10.619725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:10.631966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:10.632786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:10.634399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:10.635381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:10.636045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:10.637168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:10.705614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48dbb219-fa93-4572-9abb-702ce1fc7b57 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103495 Oct 13 08:54:10.712288 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2225/4768] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:10 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:10.781112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:10.796615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:10.798150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:10.803420 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-226037bb-3833-4422-86ef-8979d4d1a001 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.269529 Oct 13 08:54:10.804309 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2544/4769] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:10 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:11.540478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:11.541082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:11.549985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.550490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.550926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.553495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.555139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.555900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.621588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:11.623055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:11.629671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.630385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.631978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.633129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.633878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.634515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.789385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:11.806382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2312df30-13c5-42a6-b607-aa743af4d2b3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.188882 Oct 13 08:54:11.807350 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2545/4770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:11 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:11.812332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:11.814813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:11.822048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.822912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.823557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.824613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.825218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.825799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.869295 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e88eb80e-d021-45fd-803d-11c487113565 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059864 Oct 13 08:54:11.870334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2546/4771] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:11 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:11.875428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:11.876152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:11.885368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.885998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.886572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.887379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:11.887936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:11.889210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:11.954638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:11.967576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d008493-ad56-4313-b876-967a6b01673c tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.431377 Oct 13 08:54:11.978937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:11.982181 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2226/4772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:11 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:11.990575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:11.992561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:11.993750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52232594-dae7-4ef5-9366-e1dd21d0b2af tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.122339 Oct 13 08:54:11.994433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2547/4773] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:11 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:12.834080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:12.835240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:12.843466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:12.844045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:12.844552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:12.845435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:12.845986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:12.846588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:12.882645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:12.886521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:12.895034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:12.895812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:12.896393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:12.897233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:12.897806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:12.898503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:12.935490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-778bf5b5-8e45-4e2a-a898-a7a735dfa8c4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057292 Oct 13 08:54:12.936442 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2548/4774] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:54:12 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:54:12.995233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:12.996263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.009568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.010219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.010748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.011527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.011931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.013546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.084156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.093204 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2191c5a3-ffbf-41a1-b1a4-f3cc04e60378 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.263300 Oct 13 08:54:13.107242 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2227/4775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:12 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:13.112800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:13.115133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.123006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.123913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.124749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.125621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.126236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.126841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.209155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.217747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.219458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.220785 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8948663-adec-432e-a7c9-707117b1210c tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.112983 Oct 13 08:54:13.230873 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2228/4776] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:13 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:13.249848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:13.252337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.262030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.262767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.264043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.264958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.265636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.266247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.273908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.288251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8820833d-a126-4d1e-86e3-b6ce17e0b3d2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.296776 Oct 13 08:54:13.289344 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2549/4777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:12 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:13.294040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Cannot 'reboot' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action HTTP/1.1 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 28 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: {"reboot": {"type": "HARD"}} Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'reboot' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e26bcffe-464d-44d5-be6a-f52f46be2500', 'body': {'reboot': {'type': 'HARD'}}} Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:54:13.295988 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.299969 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.301909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 409 to user: Cannot 'reboot' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:13.302989 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8c9cd71-d26f-4112-b736-7f898612df0b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action" status: 409 len: 145 microversion: 2.1 time: 0.071045 Oct 13 08:54:13.303830 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2229/4778] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:54:13 2022] POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:54:13.315964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:13.319622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.330927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.331439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.331880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.337584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.338231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.338861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.372206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Cannot 'rebuild' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action HTTP/1.1 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 65 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'rebuild' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e26bcffe-464d-44d5-be6a-f52f46be2500', 'body': {'rebuild': {'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375'}}} Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:54:13.374256 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 409 to user: Cannot 'rebuild' instance e26bcffe-464d-44d5-be6a-f52f46be2500 while it is in vm_state rescued {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a8f059e-bb29-405a-aa74-cbea43b1ae32 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action" status: 409 len: 146 microversion: 2.1 time: 0.063928 Oct 13 08:54:13.378270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2550/4779] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:54:13 2022] POST /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500/action => generated 146 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:54:13.387956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:13.387956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.395746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.403456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.403456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.403456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.403456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.403456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.427498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:54:13.483325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:13.532113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d26ae39-068e-4589-a621-460a2de8a855 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 204 len: 0 microversion: 2.1 time: 0.148899 Oct 13 08:54:13.533424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2230/4780] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:54:13 2022] DELETE /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:54:13.542127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:13.542766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:13.548387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:13.549683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:13.551750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.552479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.553721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.554749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:13.555282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:13.555935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:13.973111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:13.982704 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02156124-acd1-4f10-bbd2-3a82e3ecb5e2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1690 microversion: 2.1 time: 0.445422 Oct 13 08:54:13.996827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2551/4781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:13 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1690 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:14.122440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:14.124327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:14.131212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:14.136363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.136948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.137456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.138158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.138664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.139436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.251946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:14.252692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:14.260058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.260930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.261618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.262697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.263404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.264044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.302482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:14.314337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2cac9541-9087-412d-aad8-e04e95476b34 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.198730 Oct 13 08:54:14.315196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2231/4782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:14 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:14.321082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:14.321699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:14.336816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.337317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.337755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.338663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:14.339323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:14.339755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:14.404145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:14.414524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:14.416164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:14.417506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88f6480b-80dd-4473-aa72-f4fbdf2272ea tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.169640 Oct 13 08:54:14.429767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2552/4783] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:14 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:14.523526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:14.533708 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32f7ff7f-bb18-4d2a-b420-b983714f50f7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.216505 Oct 13 08:54:14.534635 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2232/4784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:14 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:15.005455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:15.006076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:15.024486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.025493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.026168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.027334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.028720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.029380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.217307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.225584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-869537c2-a6c5-40f7-906c-4bd914c3f298 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1690 microversion: 2.1 time: 0.223892 Oct 13 08:54:15.226169 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2553/4785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:15 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:15.341513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:15.342220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:15.349232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.349931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.350915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.351974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.352452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.353145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.445456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:15.446073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:15.453478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.455178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.455868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.456914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.457641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.458367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.544028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.554485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.556367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.558086 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4299b115-0772-4e4a-83a1-c2bfe302377a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.116626 Oct 13 08:54:15.560475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2554/4786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:15 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:15.565812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:15.566641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:15.574107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.575125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.575779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.576681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:15.577299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:15.578321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:15.752998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.768433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8cb494ea-1ad4-437d-8759-e83227e32630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.206059 Oct 13 08:54:15.769313 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2555/4787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:15 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:15.876898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:15.885600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6dfeb0fb-965d-45a8-bae5-3a26bf2c16ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.549266 Oct 13 08:54:15.886473 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2233/4788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:15 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:16.249147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:16.249774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:16.256888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.257432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.258006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.258766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.259215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.259824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.457184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:16.469723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-027b633d-727c-40c7-b946-20f9bb940790 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1690 microversion: 2.1 time: 0.222746 Oct 13 08:54:16.471701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2556/4789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:16 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:16.623003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:16.624327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:16.631504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.631999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.632637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.633508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.634121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.634755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.724791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:16.734802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:16.737052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:16.738569 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-987479c2-71f4-4e64-8cb0-a556ece4a166 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.149192 Oct 13 08:54:16.739634 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2234/4790] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:16 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:16.792766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:16.793448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:16.811682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=22 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:16.813551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.814081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.814747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.815572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.816016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.816535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.823729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-plugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:16.850576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.851230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.851721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.886128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] Creating event network-vif-plugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:54:16.891180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3a2620d6-6427-4e66-affa-c1184f039633 req-c2ccccce-a8a7-4e58-90e2-16d1103432ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072004 Oct 13 08:54:16.894686 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2235/4791] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:16.913888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:16.914797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:16.925679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.926208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.927339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:16.928207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:16.928836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:16.929280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.199153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.201880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.212544 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9bbdcfd2-df51-4575-8693-d8a7912a2e8c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.306713 Oct 13 08:54:17.214240 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ac43ad1-9cc8-49ad-b691-2e2b788ecca6 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.420133 Oct 13 08:54:17.226428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2557/4792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:16 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:17.226840 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2236/4793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:16 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:17.496258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:17.497300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:17.507374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.510569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.511490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.514232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.517559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.522918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.602775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:17.608541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.609203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Searching by: {'deleted': False, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:54:17.619692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.620169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.620602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.621486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.622155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.622942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.659234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:54:17.664909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.675149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46aa6004-cf41-40b6-9270-b4ea2a0b551b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1622 microversion: 2.1 time: 0.183928 Oct 13 08:54:17.676204 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2237/4794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:17 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1622 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:17.718351 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c424d941-5f68-4feb-8a7a-97698e64eb74 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.120179 Oct 13 08:54:17.718988 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2558/4795] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 08:54:17 2022] GET /compute/v2.1/servers => generated 334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:17.738238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:17.745073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.746253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Searching by: {'deleted': False, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 08:54:17.753388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.754119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.754990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.755899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.757068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.757666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.765028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:17.766283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:17.777538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.778037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.778505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.779235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.779687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.780118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.824140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 08:54:17.873631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.880336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:17.881059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:17.881689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:17.913534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.926896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.929121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:17.930796 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f097e96b-2533-4790-a56c-d4e5ff9d77e7 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.169629 Oct 13 08:54:17.932115 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2559/4796] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:17 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:17.994460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66eb356-e05e-45dc-a8ce-6aa7ea45163b", "name": "network-vif-deleted", "tag": "c71e6397-f767-4e93-91e6-f5d0635999b4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:18.016130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.017620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.018447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.081440 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] Creating event network-vif-deleted:c71e6397-f767-4e93-91e6-f5d0635999b4 for instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b on n-h1-858384-11 Oct 13 08:54:18.095964 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e238bf64-9e58-4898-9a4f-29050af9639e req-e8445dbe-39b5-4929-bfca-9af9d96b06b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106435 Oct 13 08:54:18.098246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2560/4797] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:18.133176 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e841e4e9-c58f-49b7-be89-e44f1f962664 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.403433 Oct 13 08:54:18.141777 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2238/4798] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 08:54:17 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:18.159138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d27f6ce3-5c67-4407-9c21-c8e11d6f535a tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:18.170697 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d27f6ce3-5c67-4407-9c21-c8e11d6f535a tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015756 Oct 13 08:54:18.179364 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2561/4799] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:54:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:18.241655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:18.242837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:18.243424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:18.243551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:18.252362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.253184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.253914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.254242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.254366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.255588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.256453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.257079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.257602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.262959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.263455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.264692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.265723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:18.529027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:18.548343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad0bb5fb-1ef2-4ad0-8cc2-d7825b284ca8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1361 microversion: 2.1 time: 0.311603 Oct 13 08:54:18.551057 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2562/4800] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:18 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:18.701805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:18.704231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:18.716920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.718233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.718941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.720980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.725824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.726715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.778945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.779447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.779888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.780340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'fault' on Instance uuid b66eb356-e05e-45dc-a8ce-6aa7ea45163b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:18.843486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:18.854309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ecbd980-d7d0-4fa0-af0e-a4dd6939a2c2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 200 len: 1335 microversion: 2.1 time: 0.157097 Oct 13 08:54:18.855302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2563/4801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:18 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:18.928737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:18.939446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eac3fc19-ce63-48ba-8ca5-6bd863734ed5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.703533 Oct 13 08:54:18.940136 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2239/4802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:18 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:18.957619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:18.958270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:18.974241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.974842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.977364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:18.978419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:18.979045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:18.984363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.122353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.123400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:19.135580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.137997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.138489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.142357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.142894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.143346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.172200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:19.190264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:19.194860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:19.201282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0a785b0-0dcb-44d0-99f3-becee5f3c945 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.248008 Oct 13 08:54:19.203100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2564/4803] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:18 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:19.224524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:54:19.384659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:19.407543 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77a054db-35ba-44ad-b88c-bb4d4d485ecf tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 204 len: 0 microversion: 2.1 time: 0.288670 Oct 13 08:54:19.411343 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2240/4804] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:54:19 2022] DELETE /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:54:19.417405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.418083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:19.431373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.431878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.432447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.433265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.433714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.434628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.581972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.582746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:19.591493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.594343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.595088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.598123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.598759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.599299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.661910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:19.672479 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-511495e1-5b6d-458e-811a-955a0ad0ab42 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1702 microversion: 2.1 time: 0.258245 Oct 13 08:54:19.674159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2565/4805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:19 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1702 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:19.881029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.883039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: b66eb356-e05e-45dc-a8ce-6aa7ea45163b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:19.891138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:19.896595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.898867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.901233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.903698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.904714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.905892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.908291 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-edaccf7e-f4ba-4da7-9c28-ed772a17d0a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1549 microversion: 2.1 time: 0.334023 Oct 13 08:54:19.913261 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2241/4806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:19 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1549 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:19.933892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b HTTP/1.1 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b66eb356-e05e-45dc-a8ce-6aa7ea45163b'} Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:19.936381 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. Oct 13 08:54:19.941430 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:19.944009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 404 to user: Instance b66eb356-e05e-45dc-a8ce-6aa7ea45163b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:19.944580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.945072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:19.945901 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1719f94b-3e74-4278-a7d5-1cda58e8ec95 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b" status: 404 len: 111 microversion: 2.1 time: 0.069907 Oct 13 08:54:19.947137 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2566/4807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:19 2022] GET /compute/v2.1/servers/b66eb356-e05e-45dc-a8ce-6aa7ea45163b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:54:19.955930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.956479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.957385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.958441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:19.958913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:19.959421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:19.960479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74558f16-3189-4c5e-b278-f29428988ba2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '.version_select at 0x7f5376e47c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:19.989569 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74558f16-3189-4c5e-b278-f29428988ba2 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236405028" status: 202 len: 0 microversion: 2.1 time: 0.038405 Oct 13 08:54:19.990148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2567/4808] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236405028 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:54:20.005441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:20.006827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:20.014312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.015391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.016280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:20.017278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.018686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.019350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:20.144953 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e47f1f1f-5433-4293-9317-7891644fb2c0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209071 Oct 13 08:54:20.145868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2242/4809] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:54:19 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:20.229324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:20.230291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:20.236607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.237374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.238067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:20.239032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.239712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.241596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:20.359898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:20.375606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a33547c-bc1a-4615-bed6-fc4e8ae53051 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1503 microversion: 2.1 time: 0.383704 Oct 13 08:54:20.377387 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2568/4810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:19 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:20.398149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:20.408302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:20.416602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:20.418124 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9366dbea-58e4-4768-a6dc-3f760b45797a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.193042 Oct 13 08:54:20.432069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2243/4811] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:20 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:20.697418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:20.698502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:20.704847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.705627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.706224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:20.707143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:20.707761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:20.708348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:21.285654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:21.296378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ec8f145-7db4-4d32-92ba-adf5755939c1 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1702 microversion: 2.1 time: 0.602878 Oct 13 08:54:21.297351 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2569/4812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:20 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1702 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:21.401790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:21.403224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:21.410842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:21.411664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:21.412349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:21.413292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:21.413844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:21.414533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:21.459829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:21.460668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:21.476796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:21.480794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:21.483792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:21.484711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:21.485335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:21.485925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:21.655384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:21.666827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:21.670042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:21.672232 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0560d716-bd29-46c4-bdfc-8ab34f156b92 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.228980 Oct 13 08:54:21.673728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2570/4813] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:21 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:21.796903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:21.809256 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55cdf2bc-997a-419a-b01c-a69ed8c7b2e5 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1483 microversion: 2.1 time: 0.411315 Oct 13 08:54:21.810614 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2244/4814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:21 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1483 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:21.959975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-174233013", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:22.021997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] validate_networks() for [('2ff7a555-66ce-473c-816b-f2dd4357c597', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:54:22.320592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:22.321199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:22.338114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:22.338780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:22.339286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:22.340252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:22.340708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:22.341136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:22.708728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:22.711168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:22.722738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-268c3989-14e7-4728-9af0-e19fed838343 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1702 microversion: 2.1 time: 0.406615 Oct 13 08:54:22.723884 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2245/4815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:22 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1702 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:22.729872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:22.734777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:22.754434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:22.755401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:22.757389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:22.758259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:22.759961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:22.761571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:22.877055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:22.894604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:22.896871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:22.898337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8d42d55-5da8-4544-b7de-f967f776494e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.172465 Oct 13 08:54:22.899026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2246/4816] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:22 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:23.697318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:23.781571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:23.782173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:23.782543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:23.815319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:54:23.815874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:54:23.816190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:54:23.816599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:54:23.817175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:54:23.826862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] Creating event network-changed:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:54:23.839928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:23.840426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:23.840862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:23.841583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:23.842041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:23.842489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:23.842856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-46d450e3-2748-480a-8ac6-76ab7e9e6127 req-cf89fd80-cea7-46c2-bd1a-72a71d173d8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194803 Oct 13 08:54:23.856642 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2247/4817] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:23.867149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:23.867888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:23.890710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:23.891251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:23.894057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:23.900647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:23.901474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:23.902187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:23.926775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Getting quotas for project 91b82b44cc3d4b8e9268995b95c49434. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:54:23.948511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Getting quotas for user 7db00c490a4246a7901bcaff5d0e73cb and project 91b82b44cc3d4b8e9268995b95c49434. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:54:23.981846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:54:23.984822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:54:24.100183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7beef9a2-2dbf-45af-91e6-aa555146e419 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.145190 Oct 13 08:54:24.101462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2571/4818] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:54:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:54:24.106730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:24.107595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:24.145185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:24.145897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:24.150709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:24.152623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:24.153339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:24.153894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:24.203051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:24.216225 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca3171a4-905c-4ecc-a546-f50c5d6f5241 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1634 microversion: 2.1 time: 0.358211 Oct 13 08:54:24.217476 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2248/4819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:23 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1634 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:24.222455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1bcf9271-7f08-4eb6-a8e7-85ddda622fb8 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:24.223272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bcf9271-7f08-4eb6-a8e7-85ddda622fb8 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:24.366761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1bcf9271-7f08-4eb6-a8e7-85ddda622fb8 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:24.376085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1bcf9271-7f08-4eb6-a8e7-85ddda622fb8 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1213 microversion: 2.1 time: 0.157228 Oct 13 08:54:24.421773 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2249/4820] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:24 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:24.496064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:24.513551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:24.515041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:24.516220 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42ce72f7-17b2-4915-8e6c-f48b99a953e5 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.413505 Oct 13 08:54:24.516795 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2572/4821] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:24 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:25.244513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:25.245128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:25.253378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.264230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.264946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.270960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.271874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.272725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.356450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.358968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.361762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.362396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lazy-loading 'fault' on Instance uuid ed1a537c-036c-4605-b3eb-4000bf1e3a73 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:25.405596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:25.406218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:25.420753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.420753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.421105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.427696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.434113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.434687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.512409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3681c8dbae004d1eb8f381f28a41b55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696ab20443ee4b6cb24865bfe4ab0db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:25.534886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79200567-ad6b-4e09-863d-81a001fea247 tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 200 len: 1360 microversion: 2.1 time: 0.288027 Oct 13 08:54:25.556543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2250/4822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:25 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:25.574034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:25.576220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:25.601098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.601823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.603179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.605821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.606434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.613558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.790760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:25.803278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fab63a5d-3e26-4e9d-998b-e049d6af904b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1217 microversion: 2.1 time: 0.401327 Oct 13 08:54:25.827682 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2573/4823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:25 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1217 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:25.871902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:25.886375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:25.888759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:25.888918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1a537c-036c-4605-b3eb-4000bf1e3a73", "name": "network-vif-deleted", "tag": "4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:25.894286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c902e77-b19a-43d0-b7b9-6e1b96145711 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.334857 Oct 13 08:54:25.898553 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2251/4824] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:25 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:25.932972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:25.933728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:25.934356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:25.956265 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] Creating event network-vif-deleted:4ef3d7ff-f4e6-4ff9-b602-1e0b1e8a492c for instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 on n-h2-858384-11 Oct 13 08:54:25.962337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c7cf9f0a-3709-4b4c-a469-77f4e718ee38 req-9f4c33a0-b172-46f5-8b05-aca3a1a09caf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077436 Oct 13 08:54:25.963336 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2574/4825] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:54:26.564293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:26.565645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] [instance: ed1a537c-036c-4605-b3eb-4000bf1e3a73] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:26.577593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.583279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.584189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:26.585144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.585760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.586630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:26.619736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] HTTP exception thrown: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Request method failure captured: Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 HTTP/1.1 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9HcLKD-ZTt3DZxq6eJgKeEId_om_a7rMa2Q5nVVLxSLr14Q5ymVX0PKpAiDLh9s0pbKmVZQbMRROStz232x3cyzXJi2ApoELu40SG4fKhjGJGIIN_6fqO_2Wj0KXLr3RLb5aVAwXexzYlEZrWMA4Cc0UPeUFeb0MiCgUhWe8CRa-LY Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 696ab20443ee4b6cb24865bfe4ab0db1 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersTestJSON-1816958163 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/696ab20443ee4b6cb24865bfe4ab0db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_696ab20443ee4b6cb24865bfe4ab0db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/696ab20443ee4b6cb24865bfe4ab0db1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/696ab20443ee4b6cb24865bfe4ab0db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersTestJSON-1816958163 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 696ab20443ee4b6cb24865bfe4ab0db1 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersTestJSON-1816958163 Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersTestJSON-1816958163-project Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 3681c8dbae004d1eb8f381f28a41b55b Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersTestJSON-1816958163-project Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ed1a537c-036c-4605-b3eb-4000bf1e3a73'} Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:26.621850 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. Oct 13 08:54:26.626100 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:54:26.639368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Returning 404 to user: Instance ed1a537c-036c-4605-b3eb-4000bf1e3a73 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:26.640553 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-839342b9-4e7e-40f9-8dc9-0701da0a535e tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73" status: 404 len: 111 microversion: 2.1 time: 0.080190 Oct 13 08:54:26.645669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2252/4826] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:26 2022] GET /compute/v2.1/servers/ed1a537c-036c-4605-b3eb-4000bf1e3a73 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:54:26.654523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08f806f8-8253-42af-a34f-8c18177fdbec tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] Calling method '.version_select at 0x7f5375d58ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:26.700526 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08f806f8-8253-42af-a34f-8c18177fdbec tempest-ServersTestJSON-1816958163 tempest-ServersTestJSON-1816958163-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018598068" status: 202 len: 0 microversion: 2.1 time: 0.051604 Oct 13 08:54:26.701131 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2575/4827] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018598068 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:54:26.837219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:26.838330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:26.851352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.851863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.855240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:26.856514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.857174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.858902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:26.928407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:26.929312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:26.936534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.937025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.937464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:26.938167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:26.938644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:26.954826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:27.234554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:27.247773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:27.249617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:27.260374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a842dbe-6e44-4649-b2d7-200f87fec927 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.336485 Oct 13 08:54:27.266255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2576/4828] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:26 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:27.341664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:27.355669 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80f827e3-0f3f-49a8-9c28-3982cfc55832 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1271 microversion: 2.1 time: 0.523313 Oct 13 08:54:27.357189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2253/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:26 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1271 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:28.293006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:28.293806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:28.300879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:28.330076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:28.333467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:28.339067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:28.339836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:28.342680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:28.382191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:28.383106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:28.386264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:28.398807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:28.399305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:28.399744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:28.414129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:28.419340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:28.419799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:28.593197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:28.608891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:28.617890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:28.619691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8fbaf08e-cac7-4479-ba95-873d4baeb351 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.330851 Oct 13 08:54:28.620765 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2577/4830] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:28 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:29.025101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:29.038243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-120896d3-bead-4aa8-8a9b-5f3beddcca36 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.659943 Oct 13 08:54:29.041587 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2254/4831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:28 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:29.649809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:29.650374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:29.664979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:29.665487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:29.665939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:29.666710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:29.671482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:29.672790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:29.828363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:29.846980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:29.857821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:29.863482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6d760e6-7314-4812-872c-05f8e42a37fd tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.216599 Oct 13 08:54:29.880871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2578/4832] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:29 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:30.068146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:30.069532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:30.107018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:30.113047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:30.114627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:30.117350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:30.118041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:30.140473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:30.674040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:30.685360 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a637c51d-7dd8-4018-812a-3ab88fd58f1b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.622519 Oct 13 08:54:30.689142 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2255/4833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:30 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:30.900877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:30.904960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:30.919219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:30.922753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:30.925819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:30.926811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:30.927280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:30.930207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:31.167339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:31.195952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:31.198182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:31.199859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23366dbb-1713-4013-8c27-6761bc7d4a12 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.308675 Oct 13 08:54:31.201156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2579/4834] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:30 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:31.713581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:31.714204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:31.728699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:31.729495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:31.730104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:31.732758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:31.736419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:31.737183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:31.848844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdfe0d68-073b-4038-aa08-886e05a3f0ae", "tag": "3f918a99-9c7a-49de-a97b-8b3a25963506"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:31.902112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:31.903047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:31.903501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:31.942912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] Creating event network-changed:3f918a99-9c7a-49de-a97b-8b3a25963506 for instance fdfe0d68-073b-4038-aa08-886e05a3f0ae on n-h1-858384-11 Oct 13 08:54:31.959066 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e945200c-92c8-42b3-a47d-6dce39b5176c req-31048760-752e-41db-bb90-ba5cd1986665 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131941 Oct 13 08:54:31.960725 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2580/4835] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:32.188537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:32.208059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f8c87c1-9121-4e10-97d6-814338a07488 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.498940 Oct 13 08:54:32.211693 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2256/4836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:31 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:32.228616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:32.229600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:32.245516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:32.248800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:32.249472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:32.250397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:32.254436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:32.255067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:32.443054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:32.457837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:32.466031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:32.467878 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfcb1f5c-e144-47dd-9761-eba79537570e tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.244323 Oct 13 08:54:32.468680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2581/4837] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:32 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:32.736741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:32.737568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:32.749606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:32.750116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:32.753113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:32.753916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:32.754394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:32.754863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:32.837485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:54:33.102922 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1bc79b1f-f15e-4598-ad39-2d01f8c6f57a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 204 len: 0 microversion: 2.1 time: 0.370315 Oct 13 08:54:33.103944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2257/4838] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:54:32 2022] DELETE /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:54:33.113244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:33.113868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:33.131991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.132758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.133380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.135567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.137809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.139459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.235114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:33.235831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:33.249965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.253925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.254799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.258121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.258914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.259577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.429045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:33.438725 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23a4ce0f-88bf-4ed8-9d9a-07093c16ad07 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1507 microversion: 2.1 time: 0.329943 Oct 13 08:54:33.443512 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2582/4839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:33 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:33.504316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:33.505175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:33.515278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.516647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.518947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.519985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:33.523015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:33.523784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:33.533922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:33.692038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:33.704729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:33.710742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:33.712699 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08535abf-73a0-4147-9fcd-7968244efed4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1408 microversion: 2.54 time: 0.212824 Oct 13 08:54:33.714244 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2583/4840] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:33 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:54:33.723594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:33.734387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4837faab-40cf-4ebd-9ef5-57c7fcad7909 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.503523 Oct 13 08:54:33.737878 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2258/4841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:33 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:34.472211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:34.473483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:34.482115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:34.484175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:34.493976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:34.495029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:34.498806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:34.499773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:34.501293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:34.502862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:34.740683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:34.741350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:34.744874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:34.769852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:34.770969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:34.779929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:34.781695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:34.783115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:34.783737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:34.994537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:35.008627 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-834a0a67-f2df-4ff1-9214-a9070f62a72d tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1507 microversion: 2.1 time: 0.540029 Oct 13 08:54:35.032267 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2584/4842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:34 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:35.056080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:35.059425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:35.078841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:35.079649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:35.080336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:35.081791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:35.082529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:35.085642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:35.117689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:35.136290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:35.160035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:35.161728 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-44d7b105-c3f0-4ee2-9bc5-951f7e507259 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1426 microversion: 2.54 time: 0.426022 Oct 13 08:54:35.163484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2259/4843] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:34 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1426 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:35.415742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:35.435367 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-92d4d7d4-bec2-4ab5-8eab-cfe8d346c3b1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.401452 Oct 13 08:54:35.441428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2585/4844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:35 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:36.053697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:36.054553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:36.064523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.065464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.066531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.067951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.068798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.069501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.194349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:36.194990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:36.208022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.208580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.209585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.210308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.210795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.211696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.327576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:36.342172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:36.344549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:36.345930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3bc3571-84ee-49dc-bb14-8d644bb12898 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1414 microversion: 2.54 time: 0.157013 Oct 13 08:54:36.347070 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2586/4845] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:36 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:36.438694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:36.452510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-241e547f-440f-43f8-9347-618ef57ecfcb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1507 microversion: 2.1 time: 0.416544 Oct 13 08:54:36.454276 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2260/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:36 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:36.473930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:36.475462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:36.481767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.482350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.482974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.483823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:36.484731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:36.485329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:36.871455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:36.889486 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf959e3a-c6a0-4b62-a293-966aca032454 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.418600 Oct 13 08:54:36.890951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2587/4847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:36 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:37.378283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:37.380506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:37.396743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.398295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.400884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:37.402128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.403625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.404411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:37.484026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:37.485382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:37.495112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.496689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.497384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:37.504004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.504822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.506384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:37.535062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:37.551933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:37.558890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:37.563641 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4dbf958-d2a5-4416-9755-fc00af5c9a09 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1414 microversion: 2.54 time: 0.192376 Oct 13 08:54:37.565651 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2261/4848] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:37 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1414 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:37.633462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:37.641616 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eee43645-b562-4cbe-826d-b3b6e776c93a tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1465 microversion: 2.1 time: 0.161679 Oct 13 08:54:37.642233 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2588/4849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:37 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:37.917281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:37.918303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:37.939606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.941292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.946393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:37.948861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:37.949662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:37.950783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.346921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26bcffe-464d-44d5-be6a-f52f46be2500", "name": "network-vif-deleted", "tag": "9fc3c969-9c67-4efd-b2bd-44b5179a906d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:38.382681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.383981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.384476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.437509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] Creating event network-vif-deleted:9fc3c969-9c67-4efd-b2bd-44b5179a906d for instance e26bcffe-464d-44d5-be6a-f52f46be2500 on n-h1-858384-11 Oct 13 08:54:38.451823 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0fe0871f-294f-46ce-bd11-f0e6f99b7d33 req-6fb62c06-fc01-4eee-a87b-fae6a3c939df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110605 Oct 13 08:54:38.453054 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2589/4850] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:38.481585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:38.503858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:38.515900 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1a43bba-46e9-4a83-9968-625900f7f78e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.604578 Oct 13 08:54:38.522894 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2262/4851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:37 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:38.604491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:38.605992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:38.626314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.627149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.627627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.632039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.632703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.634435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.670955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:38.671149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:38.697419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.700502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.729687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.730675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.731227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.732556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.843456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:38.843995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:38.844480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:38.845013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'fault' on Instance uuid e26bcffe-464d-44d5-be6a-f52f46be2500 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:38.877054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:38.915218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:38.928745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:38.936998 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a3f0d3d6-a531-47a4-928f-c1657ad772a4 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1414 microversion: 2.54 time: 0.347748 Oct 13 08:54:38.954362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2590/4852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:38 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1414 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:38.966931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:38.982985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f5f8408f-2a50-4435-8ef9-e6f3e2e1a520 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 200 len: 1311 microversion: 2.1 time: 0.317605 Oct 13 08:54:38.996762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2263/4853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:38 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:39.551284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:39.553082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:39.559196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:39.564901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:39.565706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:39.566347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:39.567606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:39.569239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:39.570230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:39.946467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfe0d68-073b-4038-aa08-886e05a3f0ae", "name": "network-vif-plugged", "status": "completed", "tag": "3f918a99-9c7a-49de-a97b-8b3a25963506"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:39.967510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:39.968074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:39.968461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:39.997179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] Creating event network-vif-plugged:3f918a99-9c7a-49de-a97b-8b3a25963506 for instance fdfe0d68-073b-4038-aa08-886e05a3f0ae on n-h1-858384-11 Oct 13 08:54:40.008569 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1545ba15-025d-4985-8a29-a160d06ff593 req-364eb95f-475a-4577-b105-212b4dc0c7ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067261 Oct 13 08:54:40.009556 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2264/4854] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:40.020330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.022017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.043573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.044349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.044958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.045959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.048624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.049152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.169873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.194373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.196887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2c20fa8-2a24-4631-a207-1400eebe1992 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.652937 Oct 13 08:54:40.208122 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2591/4855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:39 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:40.208122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.208122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: e26bcffe-464d-44d5-be6a-f52f46be2500] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.220187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.220600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.221044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.221759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.222218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.222670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.224017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.226496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.230817 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdedd3d0-db1a-41e0-ab3a-8286d9924dcc tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1399 microversion: 2.54 time: 0.220057 Oct 13 08:54:40.246129 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2265/4856] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:40 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1399 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:40.256456 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 HTTP/1.1 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e26bcffe-464d-44d5-be6a-f52f46be2500'} Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:40.258180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 404 to user: Instance e26bcffe-464d-44d5-be6a-f52f46be2500 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe23356a-ede9-497b-b516-eba846c94015 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500" status: 404 len: 111 microversion: 2.1 time: 0.060797 Oct 13 08:54:40.265128 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2592/4857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:40 2022] GET /compute/v2.1/servers/e26bcffe-464d-44d5-be6a-f52f46be2500 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:54:40.268160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.268658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.270379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9af30bfc-4f54-4398-a36d-9bc226cc306d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '.version_select at 0x7f5375545e50>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.292274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.293147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.298590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.301499 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9af30bfc-4f54-4398-a36d-9bc226cc306d tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-747173631" status: 204 len: 0 microversion: 2.54 time: 0.044444 Oct 13 08:54:40.305851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.305851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.305851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.306523 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2266/4858] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:54:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-747173631 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 08:54:40.345298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:54:40.352024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.352573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.383194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.388150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.388728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.393322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.393883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.395228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.458842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:54:40.464810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac262495-9691-4d7d-b0f0-be6ba747acbb tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 204 len: 0 microversion: 2.1 time: 0.200100 Oct 13 08:54:40.468059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2593/4859] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:54:40 2022] DELETE /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:54:40.489743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.492921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.510435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.511325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.512959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.514705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.516550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.517973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.592018 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-161bdcc7-2dab-4ace-b778-8151254e8cba tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "DELETE /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 204 len: 0 microversion: 2.54 time: 0.276669 Oct 13 08:54:40.592703 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2267/4860] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 08:54:40 2022] DELETE /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 08:54:40.606478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:40.609154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:40.617585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.618446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.619139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.620047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:40.620728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:40.621667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:40.785821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.812971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.820591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.826001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd2c87be-4cc4-4996-a231-acc7eb1721a6 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1405 microversion: 2.54 time: 0.226359 Oct 13 08:54:40.827270 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2268/4861] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:40 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:40.827387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:40.840931 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18fec5fd-6643-43e2-8c53-7eca56b5707f tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.361933 Oct 13 08:54:40.846487 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2594/4862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:40 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:41.227185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:41.228860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:41.240526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.241545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.242187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:41.243421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.244105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.245828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:41.499514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:41.508927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b5b11c6-9386-4cb1-97bc-82d9f33f602a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.288227 Oct 13 08:54:41.511560 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2269/4863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:41 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:41.865578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:41.866197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:41.869688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:41.870560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:41.890457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.895208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.895656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:41.897376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.897861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.900469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.901169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.901616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:41.905251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:41.905714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:41.906141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:41.906693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:42.107856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:42.118580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:42.121270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:42.143284 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-92b7bb1f-3341-478b-9170-e25d34746614 tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1405 microversion: 2.54 time: 0.287611 Oct 13 08:54:42.144186 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2595/4864] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:41 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:42.246427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:42.259006 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d0b7dfa-f7a0-4e16-9a9d-126b36602ec4 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.397693 Oct 13 08:54:42.260283 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2270/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:41 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:42.540449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:42.541968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:42.552698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:42.555114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:42.555787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:42.556911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:42.557548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:42.558193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:42.803301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:42.814208 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d928e416-dfb1-44e6-aaa8-eda4a318d29b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.282811 Oct 13 08:54:42.832957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2596/4866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:42 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:43.169593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:43.170207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:43.184048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.184732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.185341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.186249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.187205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.188185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.247736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.248391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.248657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.249119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lazy-loading 'fault' on Instance uuid 18c5d848-befb-45b1-bf19-7117f0e6cbbe {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:43.288298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:43.289060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:43.301950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.305327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.308714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.312049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.313645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.315341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.334786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:43.343361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:43.350944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a23d25f9e3ce4f39b63b862508891c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cdb743eafa448b7947a6c07b106b00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:43.352146 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d80ae5e-131a-46d6-bd03-30a707509c3b tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 200 len: 1410 microversion: 2.54 time: 0.186584 Oct 13 08:54:43.352740 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2271/4867] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:43 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 1410 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:54:43.848160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:43.848786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:43.859045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:43.861466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.862051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.862540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.866389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:43.867146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:43.867618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:43.874119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc4632bd-d49b-4a39-bebc-901f6c72bf3b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.586818 Oct 13 08:54:43.877176 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2597/4868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:43 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:44.392409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:44.401456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] [instance: 18c5d848-befb-45b1-bf19-7117f0e6cbbe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:44.443766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:44.444278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:44.445475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:44.446640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:44.447335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:44.447932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:44.468192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] HTTP exception thrown: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Request method failure captured: Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe HTTP/1.1 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9ImnmAuKqGL4DnnRY6-4_Pi2uqtiVb00UN_Yvt0oaT0WQ-Ez_HV-lKPZn7F50yRmvY3mD0h2lvfCgz0I9I-yvgNSr23UI_O4OunRra62zOGdi6Us8gqjNYFW29ZU8ZolLyHaVU1ZWZ-goApug-9is1go_xw2bfnVQnQcUWtZo77qDE Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.54 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 6cdb743eafa448b7947a6c07b106b00c Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerShowV254Test-1100663831 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cdb743eafa448b7947a6c07b106b00c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6cdb743eafa448b7947a6c07b106b00c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6cdb743eafa448b7947a6c07b106b00c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6cdb743eafa448b7947a6c07b106b00c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerShowV254Test-1100663831 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 6cdb743eafa448b7947a6c07b106b00c Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerShowV254Test-1100663831 Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerShowV254Test-1100663831-project Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a23d25f9e3ce4f39b63b862508891c7f Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerShowV254Test-1100663831-project Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '18c5d848-befb-45b1-bf19-7117f0e6cbbe'} Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:44.470977 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. Oct 13 08:54:44.475960 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:44.477569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] Returning 404 to user: Instance 18c5d848-befb-45b1-bf19-7117f0e6cbbe could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:44.478839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdab5bea-2972-4beb-ba87-3f9f1dd6cd8a tempest-ServerShowV254Test-1100663831 tempest-ServerShowV254Test-1100663831-project] 10.222.0.23 "GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe" status: 404 len: 111 microversion: 2.54 time: 0.093816 Oct 13 08:54:44.502527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2598/4869] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:54:44 2022] GET /compute/v2.1/servers/18c5d848-befb-45b1-bf19-7117f0e6cbbe => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:54:44.706848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:44.715289 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b0bb659-5e5d-4017-8743-259b1239da28 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1313 microversion: 2.1 time: 0.871042 Oct 13 08:54:44.719203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2272/4870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:43 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:44.906742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:44.907916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:44.916638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:44.917475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:44.918156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:44.919238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:44.919913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:44.920656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:45.441224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:45.450498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b49755fa-a8ae-4054-b5d4-7a31cf3d4716 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1522 microversion: 2.1 time: 0.550819 Oct 13 08:54:45.455298 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2599/4871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:44 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:45.742039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:45.742717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:45.757610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:45.758129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:45.758614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:45.759351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:45.759806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:45.760234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.017844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b77467f-18ba-48eb-b6f1-9e756e117b76", "name": "network-vif-deleted", "tag": "8a67e02e-c3f7-4028-af3d-1aa1956358f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:46.044134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.047141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.050035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.071944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:46.093213 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] Creating event network-vif-deleted:8a67e02e-c3f7-4028-af3d-1aa1956358f6 for instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 on n-h1-858384-11 Oct 13 08:54:46.111517 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0d362069-1755-41fe-ac47-05b4190d72a8 req-844c1cff-d864-4a51-a470-bce5ea790d38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096749 Oct 13 08:54:46.112741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2600/4872] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:54:46.392848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:46.407326 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b547dfe3-fee5-494d-8137-8f974c98d9a0 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1496 microversion: 2.1 time: 0.669882 Oct 13 08:54:46.407924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2273/4873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:45 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1496 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:46.440929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:46.459037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:46.478765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:46.479389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:46.480399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.481291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.481903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.483421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.484460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.485066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.492104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.496523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.497726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.499791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.503202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.507691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.575066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lazy-loading 'flavor' on Instance uuid fdfe0d68-073b-4038-aa08-886e05a3f0ae {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:46.618855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.620137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.641242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.642087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lazy-loading 'fault' on Instance uuid 8b77467f-18ba-48eb-b6f1-9e756e117b76 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:54:46.752887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f577a999e944e4ba79bd4771b2ddac2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa87d8db3d2480cbde8aeb42f51ac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:46.814662 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf34ac9d-6a0f-48ab-8eea-14fcc973f5b7 tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 200 len: 1312 microversion: 2.1 time: 0.336214 Oct 13 08:54:46.817142 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2274/4874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:46 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 1312 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:46.854867 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6739e241-96f7-4a99-8163-10a749db1610 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "POST /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae/action" status: 200 len: 32 microversion: 2.1 time: 0.422133 Oct 13 08:54:46.855865 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2601/4875] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:54:46 2022] POST /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:54:46.873526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:46.878896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:46.917730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.920961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.922491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:46.927201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:46.929759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:46.933499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:47.682101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:47.697129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-170c6cc8-e4df-4475-ae99-d5766260ffe1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.833788 Oct 13 08:54:47.700444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2275/4876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:46 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:47.850618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:47.852483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] [instance: 8b77467f-18ba-48eb-b6f1-9e756e117b76] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:47.878954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:47.882873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:47.885590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:47.886794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:47.890819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:47.891523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:47.917860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] HTTP exception thrown: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Request method failure captured: Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 HTTP/1.1 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9E037eMR9ApFRSfl5FNRTU_1-KgGdK-fF1QgJvBMngf_ROhld7Cs47xEAwdyC-MzykQAHCNrNdERMXsKcIFzX-2TIBAQR1jc6IcKsGh_hzrApheRqX5pOucuIc1dAQ9YsriXVfC2v_GmT9S6RVP3-52WfOtOhONZbWikc4ba6oSflU Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/caa87d8db3d2480cbde8aeb42f51ac3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: caa87d8db3d2480cbde8aeb42f51ac3d Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1917507201 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6f577a999e944e4ba79bd4771b2ddac2 Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1917507201-project Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8b77467f-18ba-48eb-b6f1-9e756e117b76'} Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:47.928355 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. Oct 13 08:54:47.932410 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:54:47.934473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] Returning 404 to user: Instance 8b77467f-18ba-48eb-b6f1-9e756e117b76 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:54:47.936119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5da1cb8b-4988-424c-b262-7b9daedf9b5b tempest-ServerRescueNegativeTestJSON-1917507201 tempest-ServerRescueNegativeTestJSON-1917507201-project] 10.222.0.23 "GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76" status: 404 len: 111 microversion: 2.1 time: 0.093986 Oct 13 08:54:47.937221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2602/4877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:47 2022] GET /compute/v2.1/servers/8b77467f-18ba-48eb-b6f1-9e756e117b76 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:54:48.726808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:48.728986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:48.745027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:48.751290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:48.752192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:48.753723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:48.754602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:48.762765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:48.763277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:49.341407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:49.351094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4704e5be-5f1c-4c4a-8fe5-19e7848443a1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.628257 Oct 13 08:54:49.360210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2276/4878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:48 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:50.384210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:50.386283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:50.414089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:50.414920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:50.415945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:50.416693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:50.421650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:50.426265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:51.668017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:51.683406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1dc9211-bd38-4a4e-8fa8-6b45967901bc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 1.304673 Oct 13 08:54:51.685369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2603/4879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:50 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:54:52.729253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:52.729866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:52.755476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:52.762836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:52.763972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:52.767159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:52.771052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:52.772189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:53.268134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:53.294070 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a55556fa-131f-4c90-8cad-2fe59d9f0abc tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.568537 Oct 13 08:54:53.300801 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2277/4880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:52 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:54.323104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:54.325472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:54.346284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:54.348678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:54.353461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:54.355746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:54.357635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:54.362825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:54.913562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:54.929263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe1a02a6-eb6c-444a-a64d-96f37a7b1369 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.615013 Oct 13 08:54:54.932543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2604/4881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:54 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:55.960928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:55.963235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:55.983715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:55.984512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:55.987577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:55.989971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:55.990808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:55.992998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:56.068078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:54:57.091612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:57.102908 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62c9be8b-69c2-4269-9403-3a027bdcd461 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 1.146619 Oct 13 08:54:57.104529 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2278/4882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:55 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:57.814113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-616410738", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "e0d9e8f6-5244-492f-99cc-4419f5d54963"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:54:57.891422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] validate_networks() for [('e0d9e8f6-5244-492f-99cc-4419f5d54963', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:54:58.128101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:58.129287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:58.137038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:58.137532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:58.137972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:58.138796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:58.139150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:58.139575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:58.668843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:54:58.687948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2432b49c-5246-4311-ac51-b1af291f213e tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.563507 Oct 13 08:54:58.691278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2279/4883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:58 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:54:59.197634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:54:59.198128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:54:59.198561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:54:59.199186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:54:59.200697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:54:59.234994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:59.235884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:59.236853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:59.238175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:59.238831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:59.239974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:59.279584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Getting quotas for project 5c1618924e3042deaa804928761e5930. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:54:59.288029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Getting quotas for user 87f44f47c72544daac503f4a0c1db525 and project 5c1618924e3042deaa804928761e5930. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:54:59.304542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:54:59.307212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:54:59.393530 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5100245f-c253-475a-9587-be8268d96595 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.583888 Oct 13 08:54:59.394914 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2605/4884] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:54:59.408077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ab5b743-e5b2-4439-a974-ef8ef3b85827 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:59.409682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ab5b743-e5b2-4439-a974-ef8ef3b85827 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:59.719557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:54:59.721229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:54:59.740128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:59.741272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:59.742607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:54:59.751705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:54:59.752476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:54:59.753041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:00.341411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ab5b743-e5b2-4439-a974-ef8ef3b85827 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:00.354361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ab5b743-e5b2-4439-a974-ef8ef3b85827 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1218 microversion: 2.1 time: 0.947111 Oct 13 08:55:00.355380 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2280/4885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:59 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1218 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:00.604402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:00.624028 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65ddbcda-0487-4f48-a39f-d31bfc4c9feb tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.910681 Oct 13 08:55:00.625219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2606/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:54:59 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:01.390580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:01.393092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:01.466801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:01.501652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:01.502967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:01.504000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:01.504711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:01.505507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:01.655911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:01.656557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:01.684955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:01.685521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:01.685998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:01.686783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:01.691478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:01.692049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:02.037232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:02.059366 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d98df909-e0c5-4cc1-8019-5d62fe6b1509 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1278 microversion: 2.1 time: 0.681830 Oct 13 08:55:02.065816 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2281/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:01 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1278 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:02.255881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:02.269745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d522719-5505-4b79-8b9d-1cd5db6abe49 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.624540 Oct 13 08:55:02.294778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2607/4888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:01 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:03.093246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:03.093927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:03.104414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:03.112185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:03.113594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:03.121179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:03.123401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:03.123523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:03.303875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:03.304508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:03.315936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:03.316421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:03.319531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:03.324674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:03.325347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:03.326836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:03.433436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:03.454912 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff9e857e-1516-479b-b0e1-815012f41a37 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1276 microversion: 2.1 time: 0.364833 Oct 13 08:55:03.458152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2282/4889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:03 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:04.048734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:04.065705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d374c5ea-76dd-4be3-9655-2b7031b7a78f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.769006 Oct 13 08:55:04.066659 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2608/4890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:03 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:04.480792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:04.482023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:04.491036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:04.491808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:04.492445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:04.493366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:04.493991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:04.494638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:04.990294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:04.998976 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d1551e6-2393-434e-bfa7-e7ae62b613e5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.522053 Oct 13 08:55:05.005685 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2283/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:04 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:05.100034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:05.102358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:05.115299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.121030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.121820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.128179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.129295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.130737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.485889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:05.488342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:05.500358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.500862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.501506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.506860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.507776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.508425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.552793 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19b85ef3-dc42-48b6-b60a-d143a0cf14db tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070969 Oct 13 08:55:05.553846 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2284/4892] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:55:05 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:55:05.663514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:05.664510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:05.687914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.688802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.689470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.691206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.691686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.692650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.727457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:55:05.850325 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1bffa55b-d717-4f56-bca2-2174b0c99abf tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 204 len: 0 microversion: 2.1 time: 0.196876 Oct 13 08:55:05.853805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2285/4893] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:55:05 2022] DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:55:05.864209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:05.867297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:05.875287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.876202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.877052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:05.878811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:05.879511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:05.880524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:06.009806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:06.056694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb3be8ff-6425-4e45-972c-48d6ac701ac2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.943643 Oct 13 08:55:06.069159 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2609/4894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:05 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:06.089508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:06.096016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:06.096908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:06.100361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-678ce3d9-2415-4a49-9fae-2eccfe352b43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1674 microversion: 2.1 time: 0.241675 Oct 13 08:55:06.104304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:06.105428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:06.105621 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2286/4895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:05 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:06.106440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:06.107397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:06.108073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:06.108716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:06.422436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:06.433545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a65b88bc-8d40-4f9a-a5da-22dbfb8fecb3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.342610 Oct 13 08:55:06.434155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2610/4896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:06 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:06.590252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e43f9887-b5be-412e-9b13-345b9c8cb24a tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53755a2310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:06.711989 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e43f9887-b5be-412e-9b13-345b9c8cb24a tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/28630d69-601a-43af-8690-85ca5378664c" status: 200 len: 351 microversion: 2.1 time: 0.125760 Oct 13 08:55:06.712810 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2287/4897] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:55:06 2022] GET /compute/v2.1/os-volumes/28630d69-601a-43af-8690-85ca5378664c => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:06.747141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8054a4e8-c934-4049-9e23-f717a1fbfc55", "tag": "eb8fda45-70bb-47e3-9c28-264f1e1fb645"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:06.785215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:06.788310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:06.792591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:06.850681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] Creating event network-changed:eb8fda45-70bb-47e3-9c28-264f1e1fb645 for instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 on n-h1-858384-11 Oct 13 08:55:06.868085 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-03562ac9-dfdf-45d7-b038-e21908d1f8f8 req-88ab4988-2624-4074-9abf-59777b8f38c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125564 Oct 13 08:55:06.869404 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2611/4898] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:07.097531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:07.099534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:07.119259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.122082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.131234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:07.133438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:07.137138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.138665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.141755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.146458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.149051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.157902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.162390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.163153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.163639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.164081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.452308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:07.464303 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2884fc59-ce22-4429-9ebd-3e76917cfdaf tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.371881 Oct 13 08:55:07.465410 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2288/4899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:07 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:07.470906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:07.479595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:07.497550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.498441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.499368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.500466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:07.502976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:07.503674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:07.818829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:07.832844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd86bc3c-4aa3-4a7d-99b4-d2d20b68b7ae tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1674 microversion: 2.1 time: 0.707969 Oct 13 08:55:07.835443 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2612/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:07 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1674 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:07.915553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:07.927287 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3664807c-0527-4e48-94c2-80c2941aeb9d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.460444 Oct 13 08:55:07.927909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2289/4901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:07 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:08.491460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:08.492088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:08.513454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:08.513957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:08.514424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:08.518937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:08.519484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:08.520127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:08.863348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:08.864058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:08.884379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:08.888147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:08.888653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:08.892445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:08.892946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:08.898724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:09.259466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:09.297040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:09.407781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:09.444153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61a42c1e-4f54-4e3d-8b23-ed584586ede2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.943154 Oct 13 08:55:09.447116 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2613/4902] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:08 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:09.475893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:09.483404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:09.508624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:09.517693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:09.518316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:09.523442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:09.524855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:09.525292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:09.929861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:09.949801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:09.959535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6fcc50d9-bad7-417c-9d96-2ba41fd92ebb tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.503106 Oct 13 08:55:09.960598 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2614/4903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:09 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:09.966775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-307de06c-cf9d-4396-9764-a198738674cf tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f5375dd79d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:09.971519 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f104a22-3d5e-42f9-a95b-72447ed3a0c8 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1674 microversion: 2.1 time: 1.109516 Oct 13 08:55:09.972145 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2290/4904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:08 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1674 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:10.103649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-307de06c-cf9d-4396-9764-a198738674cf tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/c6d1fa03-0c0b-4d5d-ad6f-09f1dea5f6fd" status: 200 len: 350 microversion: 2.1 time: 0.140959 Oct 13 08:55:10.105369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2615/4905] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:55:09 2022] GET /compute/v2.1/os-volumes/c6d1fa03-0c0b-4d5d-ad6f-09f1dea5f6fd => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:10.472625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:10.473277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:10.485342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:10.487019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:10.487517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:10.488043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:10.488771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:10.493982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:10.496642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:10.987036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:10.988367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:10.992342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:11.022882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:11.023504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:11.023971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:11.024730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:11.035049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:11.035819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:11.523045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:11.536810 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a1dff5b-a134-4c0c-a801-bc304e004ae3 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 1.068308 Oct 13 08:55:11.537411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2291/4906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:10 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:11.555758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:11.556380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:11.592489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:11.593003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:11.593540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:11.607026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:11.609099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:11.610548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:11.782839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:11.795258 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4eecd2a-a70d-4f01-ac8f-31b71c98c803 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1607 microversion: 2.1 time: 0.256757 Oct 13 08:55:11.800181 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2292/4907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:11 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1607 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:11.969599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:11.980245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7ef76e5-af83-4c0b-9b0a-0fde44892f5b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.996901 Oct 13 08:55:11.986121 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2616/4908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:10 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:12.451968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a0cad5-37ea-4141-a2a1-b0edefe9af7c", "name": "network-vif-deleted", "tag": "ebaa941e-ae3b-4ff6-a00c-9e62819673f8"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:12.466181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:12.466702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:12.467142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:12.533266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] Creating event network-vif-deleted:ebaa941e-ae3b-4ff6-a00c-9e62819673f8 for instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c on n-h2-858384-11 Oct 13 08:55:12.545032 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-13db0456-a81f-41d3-a477-aaad6cd53099 req-94e760fe-5496-4469-9a18-805df52dcc3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.534751 Oct 13 08:55:12.550977 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2293/4909] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:12.563528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:12.564681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:12.580260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:12.584995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:12.586069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:12.587994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:12.590664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:12.592014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:12.824933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:12.826105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:12.858744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:12.863213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:12.864527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:12.867615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:12.877071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:12.877857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:13.001095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:13.001819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:13.003343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:13.008870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lazy-loading 'fault' on Instance uuid e3a0cad5-37ea-4141-a2a1-b0edefe9af7c {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:55:13.138562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:13.148555 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc6c887a-9cb2-4ded-9836-f86072cc5c1f tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 200 len: 1327 microversion: 2.1 time: 0.327809 Oct 13 08:55:13.149166 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2294/4910] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:12 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 1327 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:13.165530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:13.166158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:13.172647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:13.176586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:13.177242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:13.178106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:13.178619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:13.179058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:13.312078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:13.322262 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea20d41f-6d50-4137-8fba-545398952da1 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.762834 Oct 13 08:55:13.333725 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2617/4911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:12 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:13.478932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:13.483290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:13.492477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a2b831b1-e930-4073-b2e0-aecc0f834a4c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.341925 Oct 13 08:55:13.493724 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2295/4912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:13 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:14.184113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.188832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:14.207111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.209155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.211524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.213465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.237579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.238641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.263194 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c HTTP/1.1 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e3a0cad5-37ea-4141-a2a1-b0edefe9af7c'} Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:14.265116 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:14.271160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7a90e0c-2056-4e19-90a0-00e833a59d43 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 404 len: 111 microversion: 2.1 time: 0.095206 Oct 13 08:55:14.272235 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2618/4913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:55:14.280871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ea60019-a356-492e-9f63-551bc467d812 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '.version_select at 0x7f5375555700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.312575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-150c6fa7-10fb-4e3a-8284-2c7637be9ffb tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f537ac08b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.355917 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ea60019-a356-492e-9f63-551bc467d812 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106326991" status: 202 len: 0 microversion: 2.1 time: 0.082823 Oct 13 08:55:14.370495 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2296/4914] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106326991 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:55:14.372514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.373086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:14.420199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.420811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.421258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.422255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.435091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.435616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.458711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-150c6fa7-10fb-4e3a-8284-2c7637be9ffb tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b1b19923-793b-40f8-ba41-49d312610f9b" status: 200 len: 350 microversion: 2.1 time: 0.151782 Oct 13 08:55:14.468218 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2619/4915] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/os-volumes/b1b19923-793b-40f8-ba41-49d312610f9b => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:14.490631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7804ebc-f28d-4236-8622-8d841b5719fe tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f5375c59ee0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.760692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7804ebc-f28d-4236-8622-8d841b5719fe tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.285443 Oct 13 08:55:14.761902 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2620/4916] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:14.780597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.781328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:14.834038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.834886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.835337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.837200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:14.837668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:14.838100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:14.892408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:14.907571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20b3b110-f2c6-493e-8a63-384b64238a4b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.538643 Oct 13 08:55:14.918192 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2297/4917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:14.929042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be3a1f38-5a87-4022-a38e-366277055d44 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53755e5dc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:14.947143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:15.137148 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be3a1f38-5a87-4022-a38e-366277055d44 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.217528 Oct 13 08:55:15.147392 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2298/4918] 10.222.0.23 () {58 vars in 1149 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:15.152504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7c13985-c46d-4933-8c1c-07222478708d tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53753cb310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:15.279833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7c13985-c46d-4933-8c1c-07222478708d tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.131085 Oct 13 08:55:15.280534 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2299/4919] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 08:55:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:15.308615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38c1eb5f-0c28-472f-bad6-0d00656db68a tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53754e3700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:15.496316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38c1eb5f-0c28-472f-bad6-0d00656db68a tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205608 Oct 13 08:55:15.497250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2300/4920] 10.222.0.23 () {58 vars in 1167 bytes} [Thu Oct 13 08:55:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:55:15.516394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcf621da-f312-4b73-a034-beb335a3969b tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53755e55e0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:15.715778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dcf621da-f312-4b73-a034-beb335a3969b tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.204716 Oct 13 08:55:15.722512 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2301/4921] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 08:55:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:15.735541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f18d45e-d345-4ae5-a46d-924dedf09e61 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53770dcf70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:15.844991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f18d45e-d345-4ae5-a46d-924dedf09e61 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.116951 Oct 13 08:55:15.845568 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2302/4922] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:55:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:15.860281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7d08b7a7-4804-4e1c-8aec-86a76af236af tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f53755fc280>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:15.998783 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7d08b7a7-4804-4e1c-8aec-86a76af236af tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.142698 Oct 13 08:55:16.010002 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2303/4923] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Oct 13 08:55:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:16.017820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:16.019456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:16.046198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:16.047538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:16.047994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:16.054950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:16.056374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:16.057708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:16.434734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:16.445646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cf475590-c2b0-45b2-a2e1-9fe8baf1f1f6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 1.682751 Oct 13 08:55:16.452638 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2621/4924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:14 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:16.459639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54971c94-ee31-48c1-a9bd-5accdfb159a4 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] Calling method '.version_select at 0x7f5377036dc0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:16.908669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:16.921766 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a352b94b-c1cb-411d-b7fa-45851517fd42 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1482 microversion: 2.1 time: 0.907235 Oct 13 08:55:16.922477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2304/4925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:16 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1482 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:16.953214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:16.968033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:16.980928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:16.987801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:16.995143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:16.995925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:16.996407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:16.996878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:17.158359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54971c94-ee31-48c1-a9bd-5accdfb159a4 tempest-VolumesTestJSON-1148846982 tempest-VolumesTestJSON-1148846982-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.703748 Oct 13 08:55:17.160189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2622/4926] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 08:55:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:17.204184 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f556fb55-bbe3-46d3-8ca2-a54cd64df06f tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "POST /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae/action" status: 202 len: 0 microversion: 2.1 time: 0.255659 Oct 13 08:55:17.209239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2305/4927] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:55:16 2022] POST /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:55:17.215644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:17.223501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:17.247204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:17.247896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:17.248472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:17.249358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:17.249952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:17.254761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:17.391005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-126447902", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "5fc27ad8-a729-4fa9-8fbb-e584076b822d"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:17.499884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] validate_networks() for [('5fc27ad8-a729-4fa9-8fbb-e584076b822d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:55:18.589495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:55:18.590472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:55:18.591092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:55:18.592057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:55:18.592903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:55:18.624095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:18.624985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:18.625828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:18.626997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:18.627711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:18.628347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:18.660436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Getting quotas for project c9952fc6ff2d4d9b9d68b511dbf0fa38. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:55:18.670643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Getting quotas for user 9b6d982ed2c14befb7f8accd226cfae2 and project c9952fc6ff2d4d9b9d68b511dbf0fa38. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:55:18.691850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:55:18.696387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:55:18.823714 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97a1e04e-9adb-4ff1-b38e-da3d4dbd45a8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648917 Oct 13 08:55:18.836315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2623/4928] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:55:18.853931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:18.856730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:18.870155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:18.871080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:18.871826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:18.873073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:18.873799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:18.874680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:18.998066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:19.014819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99c2392e-1ac4-4be5-9b4c-046821a40536 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1490 microversion: 2.1 time: 1.803218 Oct 13 08:55:19.016043 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2306/4929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:17 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1490 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:19.106808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:19.125840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b70e5a4-b992-4661-b782-20ef20a88057 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.284608 Oct 13 08:55:19.130149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2624/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:18 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:19.157774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e5c69b-9845-4578-8259-b39681567f18 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:19.158675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4e5c69b-9845-4578-8259-b39681567f18 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:19.250273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8054a4e8-c934-4049-9e23-f717a1fbfc55", "name": "network-vif-plugged", "status": "completed", "tag": "eb8fda45-70bb-47e3-9c28-264f1e1fb645"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:19.272232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:19.282271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:19.287893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:19.288785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:19.334508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] Creating event network-vif-plugged:eb8fda45-70bb-47e3-9c28-264f1e1fb645 for instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 on n-h1-858384-11 Oct 13 08:55:19.346250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b4e5c69b-9845-4578-8259-b39681567f18 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:19.357235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bbc7fb5a-9345-423f-b2e2-58743696048a req-8ffdedb9-8e02-4210-8c17-abb680ff81e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339688 Oct 13 08:55:19.357727 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4e5c69b-9845-4578-8259-b39681567f18 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1227 microversion: 2.1 time: 0.222381 Oct 13 08:55:19.358331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2625/4931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:19 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1227 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:19.374074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2307/4932] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:19.571232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48a1cffe-2c51-478d-8750-7a3cf807019b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: .version_select at 0x7f53758a05e0>, body: {"keypair": {"name": "tempest-keypair-1899288514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7h+qy2LG8N9QcYA38xP2b/vMoIyUl3mksszDWyq1/MIjatWczEeR6P1kHTc95w6nX3hGNyq/2GTlQk9+X5pHQqeWbd9XEll1+X3jUJQPN81C3bjs/k4S1s5uvqhXPiew=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:19.613175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-48a1cffe-2c51-478d-8750-7a3cf807019b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for project b33b27b3068d4e799a52eb001d6c1800. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:55:19.628735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-48a1cffe-2c51-478d-8750-7a3cf807019b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for user 0f5d980244c14d37b8d352b0038a0ee3 and project b33b27b3068d4e799a52eb001d6c1800. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:55:19.699526 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48a1cffe-2c51-478d-8750-7a3cf807019b tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132270 Oct 13 08:55:19.700491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2626/4933] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:55:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:20.052534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:20.059439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:20.071770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.072344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.072798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.073598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.074062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.074655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.162113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:20.163706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:20.181558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.181978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.182437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.196254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.196745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.197189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.537875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:20.552498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9425d04b-342a-42fb-b97c-fb1f3d79d05e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.395355 Oct 13 08:55:20.553097 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2627/4934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:20 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:20.561772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:20.563398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:20.581981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.582872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.583752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.584855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:20.586563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:20.587544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:20.633461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:20.655057 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b5e058f-ed2b-408f-ab18-40f0883d2165 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1490 microversion: 2.1 time: 0.606547 Oct 13 08:55:20.656742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2308/4935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:20 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1490 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:20.704379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:20.716919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ece3f86-6cea-42ca-a633-662951fe7b49 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1279 microversion: 2.1 time: 0.162201 Oct 13 08:55:20.733909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2628/4936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:20 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:21.584819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:21.585525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:21.606502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:21.610029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:21.610849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:21.613638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:21.615770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:21.616420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:21.682738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:21.683587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:21.702550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:21.703347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:21.704513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:21.718534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:21.721263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:21.724467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:22.403967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:22.424068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:22.437208 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2be2a675-b192-4020-959b-f74ee31b0630 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1490 microversion: 2.1 time: 0.760534 Oct 13 08:55:22.447683 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b8f7804-6805-4aef-a5aa-8ecad6c3e89d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1318 microversion: 2.1 time: 0.870161 Oct 13 08:55:22.448008 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2629/4937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:21 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1490 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:22.456545 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2309/4938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:21 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:22.460721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:22.461631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:22.479062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:22.481235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:22.481944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:22.483492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:22.485393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:22.489856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:22.649055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:22.661329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a57a852-e8f9-47a0-a30c-ecc487b4e3c9 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1285 microversion: 2.1 time: 0.211803 Oct 13 08:55:22.666720 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2630/4939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:22 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:23.430945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-446459009", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "806f7ab8-11c1-4c81-94b2-9485da4c48dc"}], "security_groups": [{"name": "tempest-securitygroup--1616976359"}], "key_name": "tempest-keypair-1899288514", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:23.474609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:23.475985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:23.497188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:23.499577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:23.500048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:23.502573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:23.505878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:23.506567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:23.703029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] validate_networks() for [('806f7ab8-11c1-4c81-94b2-9485da4c48dc', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:55:23.979914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:23.992031 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-164fa48b-6541-4b73-89de-354f98402eb2 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1496 microversion: 2.1 time: 0.522550 Oct 13 08:55:23.994716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2631/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:23 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1496 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:23.999397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:24.000036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:24.017877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.021214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.021829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.022769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.025654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.026936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.269969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:24.280964 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef010f1f-d9b2-433a-996c-0030acfd6a7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1508 microversion: 2.1 time: 0.285119 Oct 13 08:55:24.304653 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2632/4941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:23 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:24.313490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:24.319880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:24.333998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.334805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.335592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.336501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.337386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.337977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.729265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:24.741527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e10d1583-6749-4a76-b0f5-589955e2fdd5 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.434090 Oct 13 08:55:24.757925 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2633/4942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:24 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:24.770967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:24.778599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:24.790002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.790794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.792232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.793459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:24.794440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:24.795427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:24.871734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:55:25.187637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:55:25.188182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:55:25.188598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:55:25.189016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:55:25.191024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:55:25.199883 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4cecd63f-4eb0-4a9c-ac6a-9d5bab776347 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 204 len: 0 microversion: 2.1 time: 0.434012 Oct 13 08:55:25.202763 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2634/4943] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:55:24 2022] DELETE /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:55:25.213617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.214320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.216507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.224675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.225121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:25.227588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:25.230351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.232037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.246808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.248022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.249132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.252164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.256968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.258355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.285105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for project b33b27b3068d4e799a52eb001d6c1800. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:55:25.295073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Getting quotas for user 0f5d980244c14d37b8d352b0038a0ee3 and project b33b27b3068d4e799a52eb001d6c1800. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:55:25.323513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:55:25.325885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:55:25.427920 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab7365d0-7366-41e8-a5a0-3daa7729eafa tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.998244 Oct 13 08:55:25.430691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2310/4944] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:55:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:55:25.445322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffe77f19-bc06-499c-b1ec-5beeb94449d3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:25.446249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ffe77f19-bc06-499c-b1ec-5beeb94449d3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:25.555307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ffe77f19-bc06-499c-b1ec-5beeb94449d3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:25.564352 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ffe77f19-bc06-499c-b1ec-5beeb94449d3 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1237 microversion: 2.1 time: 0.126140 Oct 13 08:55:25.578172 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2311/4945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:25 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:25.770480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:25.771174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:25.782881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.787277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.789684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.792492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:25.793635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:25.794927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:25.840405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:25.856321 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b086153-8095-4ddc-bbae-1d0b0912586a tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.649286 Oct 13 08:55:25.859107 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2635/4946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:25 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:26.043714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229c9e00-49db-43df-8b88-e0e16c371131", "tag": "0e63b03d-d7ec-4e9a-9baa-4991167744cd"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:26.084275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:26.084825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:26.088092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:26.111496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] Creating event network-changed:0e63b03d-d7ec-4e9a-9baa-4991167744cd for instance 229c9e00-49db-43df-8b88-e0e16c371131 on n-h2-858384-11 Oct 13 08:55:26.118955 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1395dac6-9a0b-41f9-94df-7f4149fa9f11 req-fd4ebefa-758a-4a5d-818e-1a0e5ed23ea6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080931 Oct 13 08:55:26.119938 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2636/4947] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:26.194848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:26.226922 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd984a7d-6faa-4349-9864-5fa0d2c39547 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.461210 Oct 13 08:55:26.227924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2312/4948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:25 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:26.589675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:26.591167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:26.614341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:26.615001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:26.615594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:26.616402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:26.616961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:26.617735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:26.729399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:26.740913 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-feed4d51-efb8-4ad1-8add-516360f2ea1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1289 microversion: 2.1 time: 0.155692 Oct 13 08:55:26.742507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2637/4949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:26 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1289 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:26.882136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:26.883254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:26.908085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:26.908949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:26.909626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:26.910778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:26.914075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:26.915084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:27.253706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:27.254995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:27.283511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:27.286418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:27.286910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:27.290177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:27.293950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:27.294639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:27.529885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:27.543169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51448aa9-195f-454b-9a6f-cab9c29196ce tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.665773 Oct 13 08:55:27.544182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2313/4950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:26 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:27.658500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:27.671186 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88d44808-d09f-4aeb-96ce-8237e6fef7f8 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.422063 Oct 13 08:55:27.674507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2638/4951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:27 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:27.765118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:27.765701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:27.773833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:27.774396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:27.774894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:27.775620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:27.776081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:27.777002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:27.962237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:27.979285 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea8a6cf9-da9c-458a-8b18-76f3ec33978a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1295 microversion: 2.1 time: 0.215142 Oct 13 08:55:27.981691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2314/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:27 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1295 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:28.298561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:28.299110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:28.307031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.312287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.312946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.313859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.314539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.317143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.570381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:28.576116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:28.584381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.584882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.585481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.586575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.587433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.587890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.646252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:28.704430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:28.721122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b71b16ae-9c78-4cf4-9703-1c0bd7f14017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.427246 Oct 13 08:55:28.723289 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2639/4953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:28 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:28.731078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:28.731707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:28.756351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.758822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.759867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.762278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:28.764517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:28.765400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:28.790581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:28.969212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:28.981599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95b2ab30-df2d-4d51-86b0-7392c7dbdc2a tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.256807 Oct 13 08:55:28.982902 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2640/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:28 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:28.989286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:28.993490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:29.007397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.008348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.009670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.011549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.012174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.012779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.082599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:29.095902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-972f9698-cb45-4ff0-8fa8-6f5adc7bde37 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 200 len: 1502 microversion: 2.1 time: 0.526760 Oct 13 08:55:29.096719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2315/4955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:28 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 1502 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:29.107173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:29.109294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:29.125547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.126498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.129194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.137145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.137652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.138377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.327959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:29.340547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e25a54bd-5afa-47d7-9a64-c7ae3dbef909 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.355988 Oct 13 08:55:29.341148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2641/4956] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:28 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:29.371445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:29.373484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:29.386141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:29.389733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.390238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.390716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.391433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.391923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.394207 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be6dcaa7-4f68-4142-b426-5cd0b849ee38 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.290863 Oct 13 08:55:29.395383 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2316/4957] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:29 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:29.405000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.585451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfe0d68-073b-4038-aa08-886e05a3f0ae", "name": "network-vif-deleted", "tag": "3f918a99-9c7a-49de-a97b-8b3a25963506"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:29.621596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.624794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.625476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.655905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:29.683605 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] Creating event network-vif-deleted:3f918a99-9c7a-49de-a97b-8b3a25963506 for instance fdfe0d68-073b-4038-aa08-886e05a3f0ae on n-h1-858384-11 Oct 13 08:55:29.690120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:29.697512 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-795c9796-03ef-4ac0-bf94-aae8eb3e75c8 req-fcc029c5-3b32-48d4-a473-ffda2b25bc54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114660 Oct 13 08:55:29.700370 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2317/4958] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:29.700885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32059329-cd7b-4f2b-8f88-23b231a98aaa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.340940 Oct 13 08:55:29.714431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2642/4959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:29 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:29.728118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1221515980"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:29.731504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:29.745539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.746039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.746522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:29.747247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:29.747704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:29.756558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.007957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:30.008926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:30.021554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.023120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.035495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.036585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.037846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.038477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.357806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:30.374940 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ddb66ffb-b89d-4f35-9420-30af186b0fc0 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.370963 Oct 13 08:55:30.392421 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2643/4960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:30 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:30.398933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:30.403158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: fdfe0d68-073b-4038-aa08-886e05a3f0ae] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:30.409695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.416517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.421864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.423253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.425161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.426320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.460491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] HTTP exception thrown: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Request method failure captured: Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae HTTP/1.1 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9IMQXD6_QeqEFllxzL6Neq0bbt5-z3FPovDdrQCOvn5cYtsaK6vuZy2vXCA2BPNDcNtPF6qGnX4-Q4xV7NBoYjQI8MxMag4r7FGrpVRNFtXZJcxg4ywU4K24KU33n9-4apDbIAae05eksGHle5dNnMPlSEQ2gvXSbyayXDcAqZW1N8 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 91b82b44cc3d4b8e9268995b95c49434 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 91b82b44cc3d4b8e9268995b95c49434 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueTestJSON-640334660-project Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 7db00c490a4246a7901bcaff5d0e73cb Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueTestJSON-640334660-project Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fdfe0d68-073b-4038-aa08-886e05a3f0ae'} Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:30.464881 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. Oct 13 08:55:30.471985 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:30.475803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Returning 404 to user: Instance fdfe0d68-073b-4038-aa08-886e05a3f0ae could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:30.483096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f129ea8c-2467-400e-ac9d-5fe8ee871e95 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae" status: 404 len: 111 microversion: 2.1 time: 0.084871 Oct 13 08:55:30.485841 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2644/4961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:30 2022] GET /compute/v2.1/servers/fdfe0d68-073b-4038-aa08-886e05a3f0ae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:55:30.498846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:30.499893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:30.516130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.517883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.533099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.535006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.539838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.542481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.864398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:30.877157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0422019f-c863-4f0c-8786-cc28e5ccbd93 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.386526 Oct 13 08:55:30.880561 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2645/4962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:30 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:30.892116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:30.892941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:30.907321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.911275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.912005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.912963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:30.916886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:30.917792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:30.988185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:55:31.142217 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a78aa530-f78e-46ef-b0bb-c02ac57f191b tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 204 len: 0 microversion: 2.1 time: 0.257480 Oct 13 08:55:31.143551 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2646/4963] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:55:30 2022] DELETE /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:55:31.156729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:31.159331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:31.195955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:31.196463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:31.196904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:31.197635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:31.198091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:31.198555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:31.841319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:31.854139 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0b15a96-0681-4982-a15d-ae298191da4d tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1489 microversion: 2.1 time: 0.705662 Oct 13 08:55:31.866829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2647/4964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:31 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1489 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:31.884608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:31.888861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:31.923075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:31.930588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:31.934369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:31.937157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:31.942689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:31.945495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:32.627461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:32.643920 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af86d82b-18d8-4e47-b2c2-85fd0e5f745c tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.774280 Oct 13 08:55:32.647056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2648/4965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:31 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:32.655439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:32.656063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:32.669685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:32.670575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:32.671027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:32.675157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:32.684627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:32.685119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:32.995610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:33.009772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c666f07-7618-4af8-9c22-7dc86d50c3fb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.361350 Oct 13 08:55:33.012029 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2649/4966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:32 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:33.424674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe63e6ce-008c-42fe-bc1a-08074bddc761", "tag": "da053914-cd89-4804-985d-f6becf2cd89a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:33.448889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:33.451371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:33.451983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:33.452565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:33.495383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] Creating event network-changed:da053914-cd89-4804-985d-f6becf2cd89a for instance fe63e6ce-008c-42fe-bc1a-08074bddc761 on n-h2-858384-11 Oct 13 08:55:33.518455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0f2184be-7fcc-470e-95cd-71b216e51f6d req-eb68205c-90f5-4e3d-9f23-fa6a0b93b4cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479166 Oct 13 08:55:33.529676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2650/4967] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:33.556862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:33.573989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:33.574807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:33.575887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:33.576360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:33.583460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:33.583950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:33.584394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:33.626367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d623455b-d58c-4e6d-8f6b-f4374345791c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 3.903429 Oct 13 08:55:33.630769 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2318/4968] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:55:29 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 3910 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 13 08:55:33.672838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:33.673987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:33.693520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:33.694151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:33.694699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:33.695509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:33.696049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:33.696561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:33.866053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:33.883474 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df83273a-05d5-42a9-b062-b96522b89a73 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1489 microversion: 2.1 time: 0.349073 Oct 13 08:55:33.895053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2651/4969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:33 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1489 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:34.057010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:34.057643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:34.087474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:34.087977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:34.088424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:34.089132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:34.089583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:34.090003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:34.192695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:34.196533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-438b4b35-6497-4beb-915e-4b6eda596365 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.528467 Oct 13 08:55:34.199363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2319/4970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:33 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:34.449184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:34.460097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70a69fee-e974-45df-8b9c-b34257f0ec72 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.418215 Oct 13 08:55:34.465329 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2652/4971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:34 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:34.702498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e60281a-d237-4574-bae3-8041cccd1e08", "name": "network-vif-deleted", "tag": "d23dab75-bc19-4ddb-9369-45577916ba37"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:34.729814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:34.730909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:34.732812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:34.742862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:34.752397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] Creating event network-vif-deleted:d23dab75-bc19-4ddb-9369-45577916ba37 for instance 2e60281a-d237-4574-bae3-8041cccd1e08 on n-h1-858384-11 Oct 13 08:55:34.759772 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0b5e8614-e175-4c4b-9d1e-c540a7a81ff5 req-806a8793-c40c-4af7-b2ae-899ff8d83014 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061892 Oct 13 08:55:34.765222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2320/4972] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:34.924680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:34.925330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:34.950902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:34.951457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:34.953019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:34.955670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:34.957840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:34.959274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.109337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.112018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.112705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.114386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lazy-loading 'fault' on Instance uuid 2e60281a-d237-4574-bae3-8041cccd1e08 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:55:35.139363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229c9e00-49db-43df-8b88-e0e16c371131", "name": "network-vif-plugged", "status": "completed", "tag": "0e63b03d-d7ec-4e9a-9baa-4991167744cd"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:35.172064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.173729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.175136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.219609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] Creating event network-vif-plugged:0e63b03d-d7ec-4e9a-9baa-4991167744cd for instance 229c9e00-49db-43df-8b88-e0e16c371131 on n-h2-858384-11 Oct 13 08:55:35.250583 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a322f22d-34fb-4784-b4c2-7ce4ba2f143f req-8bc4f358-4878-44d0-a66a-7a1e70a4ac70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118757 Oct 13 08:55:35.252067 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2321/4973] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:35.267894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:35.270707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:35.283723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:35.285706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.286443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.287079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.288005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.288640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.289270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.559294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:35.657322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:35.668816 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6095c625-89ca-4dac-86d5-5ec3fcba08a3 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.414136 Oct 13 08:55:35.669412 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2322/4974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:35 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:35.678465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:35.679078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:35.685674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.686634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.687314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.688272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:35.689239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:35.689848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:35.917577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:35.929477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64d1ee7b-50fd-43bc-b41e-6ae9bc7d6295 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.255028 Oct 13 08:55:35.931269 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2323/4975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:35 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:35.997693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db00c490a4246a7901bcaff5d0e73cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b82b44cc3d4b8e9268995b95c49434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:36.007426 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08a5c2b5-38e5-4ba9-b901-017d798f1ffa tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 200 len: 1304 microversion: 2.1 time: 1.102035 Oct 13 08:55:36.011236 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2653/4976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:34 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 1304 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:36.699715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:36.701674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:36.717438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:36.719538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:36.720815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:36.722908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:36.724234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:36.725781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:36.958896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:36.960174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:36.969071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:36.969926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:36.970624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:36.971789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:36.972547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:36.973727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:37.000408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:37.010558 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9b5ba02-176c-4c37-85fc-43c69d0d2fa2 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1327 microversion: 2.1 time: 0.321882 Oct 13 08:55:37.011780 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2324/4977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:36 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1327 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:37.038497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:37.046629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] [instance: 2e60281a-d237-4574-bae3-8041cccd1e08] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:37.069195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:37.070988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:37.072464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:37.075542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:37.076287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:37.079184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:37.106126 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] HTTP exception thrown: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Request method failure captured: Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 HTTP/1.1 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IMQXD6_QeqEFllxzL6Neq0bbt5-z3FPovDdrQCOvn5cYtsaK6vuZy2vXCA2BPNDcNtPF6qGnX4-Q4xV7NBoYjQI8MxMag4r7FGrpVRNFtXZJcxg4ywU4K24KU33n9-4apDbIAae05eksGHle5dNnMPlSEQ2gvXSbyayXDcAqZW1N8 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 91b82b44cc3d4b8e9268995b95c49434 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91b82b44cc3d4b8e9268995b95c49434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 91b82b44cc3d4b8e9268995b95c49434 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerRescueTestJSON-640334660 Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerRescueTestJSON-640334660-project Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 7db00c490a4246a7901bcaff5d0e73cb Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerRescueTestJSON-640334660-project Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '2e60281a-d237-4574-bae3-8041cccd1e08'} Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:37.112817 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. Oct 13 08:55:37.118601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:55:37.122399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] Returning 404 to user: Instance 2e60281a-d237-4574-bae3-8041cccd1e08 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:37.128301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69cf49be-167a-4750-ac51-71a7743e2eb7 tempest-ServerRescueTestJSON-640334660 tempest-ServerRescueTestJSON-640334660-project] 10.222.0.23 "GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08" status: 404 len: 111 microversion: 2.1 time: 0.094294 Oct 13 08:55:37.130175 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2325/4978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:37 2022] GET /compute/v2.1/servers/2e60281a-d237-4574-bae3-8041cccd1e08 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:55:37.464159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:37.501184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cb3426c-1a67-4b83-aebd-783ff0e3af2c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.543514 Oct 13 08:55:37.514445 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2654/4979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:36 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:38.037058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:38.038463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:38.059668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.060307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.060665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.064174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.064945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.065477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.434983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:38.447610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32bea174-c8e5-4e28-97c3-2ea41b9a7a23 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1528 microversion: 2.1 time: 0.414881 Oct 13 08:55:38.458577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2326/4980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:38 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:38.476565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:38.478328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:38.490578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.492008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.493491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.495439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.496246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.499891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.528196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:38.529215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:38.539357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.539730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.548322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.549104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:38.549591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:38.550040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:38.797996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:38.809870 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9b87b27-2592-4cdb-bc4c-59b0786bc699 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1528 microversion: 2.1 time: 0.337396 Oct 13 08:55:38.814282 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2655/4981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:38 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:39.126050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:39.141136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-591752d2-6a7d-4922-af46-56158df0c689 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.616174 Oct 13 08:55:39.144875 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2327/4982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:38 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:39.311072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:39.312196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:39.325082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:39.327108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:39.327749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:39.329784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:39.330458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:39.332466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:39.374024 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] HTTP exception thrown: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Request method failure captured: Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 HTTP/1.1 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9J0-ix7bUKI04z9YpaKAFb265K10K5zzT3QbYLQGZ9TJ6H5Gw3vRxMMnw5Djg9bfbQSb01vCnZQgwOL6owssTa7p2TRdaRCDToVWyh2f6AxRi7ZxBQzByPymL0_r4NfH27UixMas0N3PIqpJ27EEWK_EYSLEvifomATRkYzX8INYfM Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: e2c69e9b352d4356b6336d366534fa3f Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: e2c69e9b352d4356b6336d366534fa3f Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestMultiTenantJSON-892124806-project Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9878a05394594709b88e7713f4354eaf Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806-project Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '229c9e00-49db-43df-8b88-e0e16c371131'} Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:39.381902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:39.387180 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:39.389145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Returning 404 to user: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:39.390350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46a267df-712d-4eff-a957-df94f819ead6 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] 10.222.0.23 "DELETE /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 404 len: 111 microversion: 2.1 time: 0.553213 Oct 13 08:55:39.391596 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2656/4983] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:55:38 2022] DELETE /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 111 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:55:39.402989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:39.408206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:39.422207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:39.422933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:39.423619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:39.430067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:39.435447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:39.436381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:39.747898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe63e6ce-008c-42fe-bc1a-08074bddc761", "name": "network-vif-plugged", "status": "completed", "tag": "da053914-cd89-4804-985d-f6becf2cd89a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:39.764097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:39.765089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:39.766050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:39.775466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:55:39.788260 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] Creating event network-vif-plugged:da053914-cd89-4804-985d-f6becf2cd89a for instance fe63e6ce-008c-42fe-bc1a-08074bddc761 on n-h2-858384-11 Oct 13 08:55:39.796706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-11e65f00-069f-4942-8210-ef24fbbc24aa req-b2395f1b-bb93-43d0-bf29-73d803c8ea2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058309 Oct 13 08:55:39.798093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2657/4984] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:40.101037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:40.112784 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8cd2a55c-4605-4837-a6d2-818eae23b8fe tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1528 microversion: 2.1 time: 0.713969 Oct 13 08:55:40.120103 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2328/4985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:39 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1528 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:40.143052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Action: 'update', calling method: >, body: {"server": {"name": "229c9e00-49db-43df-8b88-e0e16c371131_new"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:40.146055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:40.155228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.156300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.157575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.165946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:40.167485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:40.171746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.173020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.175759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.176606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.182056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.182790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.183751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.184412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.185609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.211027 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] HTTP exception thrown: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Request method failure captured: Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 HTTP/1.1 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 64 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9J0-ix7bUKI04z9YpaKAFb265K10K5zzT3QbYLQGZ9TJ6H5Gw3vRxMMnw5Djg9bfbQSb01vCnZQgwOL6owssTa7p2TRdaRCDToVWyh2f6AxRi7ZxBQzByPymL0_r4NfH27UixMas0N3PIqpJ27EEWK_EYSLEvifomATRkYzX8INYfM Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: e2c69e9b352d4356b6336d366534fa3f Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e2c69e9b352d4356b6336d366534fa3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: e2c69e9b352d4356b6336d366534fa3f Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806 Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestMultiTenantJSON-892124806-project Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9878a05394594709b88e7713f4354eaf Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-892124806-project Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "229c9e00-49db-43df-8b88-e0e16c371131_new"}} Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '229c9e00-49db-43df-8b88-e0e16c371131', 'body': {'server': {'name': '229c9e00-49db-43df-8b88-e0e16c371131_new'}}} Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:55:40.220976 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:40.226085 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:40.228738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] Returning 404 to user: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:40.229821 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00f9ca6e-3aa3-4d02-9ec7-0cbaa507fe85 tempest-ServersNegativeTestMultiTenantJSON-892124806 tempest-ServersNegativeTestMultiTenantJSON-892124806-project] 10.222.0.23 "PUT /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 404 len: 111 microversion: 2.1 time: 0.091519 Oct 13 08:55:40.235096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2658/4986] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 08:55:40 2022] PUT /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:55:40.245313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:40.249460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:40.261729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.262570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.263276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.264225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.265532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.266265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.338382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:55:40.475148 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df2088a2-bda9-4962-b018-b82db23fd306 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "DELETE /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 204 len: 0 microversion: 2.1 time: 0.237621 Oct 13 08:55:40.476198 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2659/4987] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:55:40 2022] DELETE /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:55:40.497008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:40.498114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:40.505442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.506516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.507143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.508894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:40.509751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:40.510513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:40.826073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:40.839742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70223a35-8489-4bff-a1d3-27d249e16e24 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1534 microversion: 2.1 time: 0.356685 Oct 13 08:55:40.842605 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2660/4988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:40 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1534 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:55:40.852859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:40.872336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-437238ee-5e5f-40d4-9131-a7fa8cf655a7 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.710168 Oct 13 08:55:40.884595 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2329/4989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:40 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:41.871334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:41.873056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:41.897928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:41.898590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:41.901530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:41.902369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:41.904467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:41.908268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:41.908755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:41.909192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:41.909495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:41.910006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:41.910478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:41.911017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:41.911477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:41.918230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:42.228172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:42.260320 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8453b822-b6f1-4cfc-b2ff-141a07d28b56 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1534 microversion: 2.1 time: 0.397523 Oct 13 08:55:42.268499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2661/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:41 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1534 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:42.511532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:42.527132 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a8c601c-1875-40b3-aaa3-88973399fa17 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1363 microversion: 2.1 time: 0.633116 Oct 13 08:55:42.536814 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2330/4991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:41 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1363 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:43.304630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:43.306156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:43.340237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:43.341663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:43.344225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:43.345388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:43.363777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:43.364387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:43.575117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:43.575821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:43.630259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:43.635094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:43.637790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:43.640481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:43.642711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:43.645925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:44.602879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6d982ed2c14befb7f8accd226cfae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9952fc6ff2d4d9b9d68b511dbf0fa38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:44.613185 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a37b9d5f-e491-4021-a8ac-08224df9c331 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 200 len: 1534 microversion: 2.1 time: 1.314010 Oct 13 08:55:44.623040 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2662/4992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:43 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 1534 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:44.650802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-plugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:44.684698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:44.687514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:44.689336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:44.735237 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] Creating event network-vif-plugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:55:44.752260 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-004c5ba7-cc68-4589-84fa-a6ea28f3a70a req-89c6290d-db43-4fcb-b7c3-d59172c14a21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126764 Oct 13 08:55:44.758031 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2663/4993] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:44.770482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229c9e00-49db-43df-8b88-e0e16c371131", "name": "network-vif-deleted", "tag": "0e63b03d-d7ec-4e9a-9baa-4991167744cd"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:44.797005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:55:44.814386 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-531d0874-a7d5-46e0-88fc-36bc8ed0711a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1549 microversion: 2.1 time: 1.255794 Oct 13 08:55:44.816724 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2331/4994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:43 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1549 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:55:44.817713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:44.820435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:44.820890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:44.855264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:44.856037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:44.888030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:44.891517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:44.892524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:44.895524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:44.902058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:44.903675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] Creating event network-vif-deleted:0e63b03d-d7ec-4e9a-9baa-4991167744cd for instance 229c9e00-49db-43df-8b88-e0e16c371131 on n-h2-858384-11 Oct 13 08:55:44.904503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:44.932505 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-04970073-4a69-485f-98e3-9e7ad37b12c3 req-ab87980c-4c44-441e-8eec-ff3af54f46af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161875 Oct 13 08:55:44.941555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2664/4995] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:45.223596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e28045d4-157f-4b77-be7d-0ee5930ca3b0 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378894 Oct 13 08:55:45.224191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2332/4996] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:55:44 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:55:45.657608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:55:45.660087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] [instance: 229c9e00-49db-43df-8b88-e0e16c371131] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:55:45.691443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:45.694291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:45.697499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:45.698659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:45.700575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:45.704098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:45.735873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] HTTP exception thrown: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Request method failure captured: Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 HTTP/1.1 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9JmrhsfBMfstnOC0R1SJZllwTcnx-Q-BqLcDkR7Q7SEMsUX4IDM1Ay7dEVkdIiPpJa01xAtd6CxjK3FR9Wrzv3E-94ThlKfgPdQcBhoMLOPkOsC7X8OKCnRhCDqiC_GXtcMKgxZDwZMrXw_vTwH0pXbNYoQ6eES-70g1m0bCifJvBw Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c9952fc6ff2d4d9b9d68b511dbf0fa38 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1700128704 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9952fc6ff2d4d9b9d68b511dbf0fa38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9952fc6ff2d4d9b9d68b511dbf0fa38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9952fc6ff2d4d9b9d68b511dbf0fa38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9952fc6ff2d4d9b9d68b511dbf0fa38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1700128704 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c9952fc6ff2d4d9b9d68b511dbf0fa38 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1700128704 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1700128704-project Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 9b6d982ed2c14befb7f8accd226cfae2 Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1700128704-project Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '229c9e00-49db-43df-8b88-e0e16c371131'} Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:45.752051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. Oct 13 08:55:45.757415 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:55:45.759616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] Returning 404 to user: Instance 229c9e00-49db-43df-8b88-e0e16c371131 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:55:45.763249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07ce2b18-0db7-44d2-806f-912f44f6f751 tempest-ServersNegativeTestMultiTenantJSON-1700128704 tempest-ServersNegativeTestMultiTenantJSON-1700128704-project] 10.222.0.23 "GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131" status: 404 len: 111 microversion: 2.1 time: 0.113069 Oct 13 08:55:45.765528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2665/4997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:55:45 2022] GET /compute/v2.1/servers/229c9e00-49db-43df-8b88-e0e16c371131 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:55:47.325865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe63e6ce-008c-42fe-bc1a-08074bddc761", "tag": "da053914-cd89-4804-985d-f6becf2cd89a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:55:47.347623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:55:47.348116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:55:47.348550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:55:47.371590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] Creating event network-changed:da053914-cd89-4804-985d-f6becf2cd89a for instance fe63e6ce-008c-42fe-bc1a-08074bddc761 on n-h2-858384-11 Oct 13 08:55:47.380177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3a4af631-f4d6-4c70-9022-32c08feee304 req-91a84aeb-3428-430d-9ebf-9829b2eb6606 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058967 Oct 13 08:55:47.392993 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2333/4998] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:06.120027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef2822c0-b490-4949-a414-b8f8ffdc79b9", "device": "/dev/sdb"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:06.123239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:06.151323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:06.155773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:06.176282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:06.181548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:06.188913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:06.195137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:06.195575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:06.198285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:06.769304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8dad8227-8608-4b3d-80d4-10e06633a654 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "POST /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652322 Oct 13 08:56:06.770661 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2666/4999] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:56:06 2022] POST /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:10.471982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:10.473335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=65 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:10.479492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-add6ed71-a44a-42a6-ae70-ebfadab0ad8d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Action: 'create', calling method: .version_select at 0x7f5375660670>, body: {"keypair": {"name": "tempest-keypair-1650510233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElf4VkS5GiDyAhy2T4d47FNtGlQ/F2AgN57mim3ieiNwMe6oZ4DUQSky4dsIupdEfPzpvXRMGkI69/HYiNk5gfcCee5lfuny0rnbPq29TvrDyNa350dRCeB2IF5+f/Y/w=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:10.609285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-add6ed71-a44a-42a6-ae70-ebfadab0ad8d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Getting quotas for project 65a5cba0679244b9a6319d2c56a09092. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:56:10.650901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-add6ed71-a44a-42a6-ae70-ebfadab0ad8d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Getting quotas for user 4966ceab0ec143938dadab574388ab2f and project 65a5cba0679244b9a6319d2c56a09092. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:56:10.781750 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-add6ed71-a44a-42a6-ae70-ebfadab0ad8d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.307664 Oct 13 08:56:10.787242 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2334/5000] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 08:56:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 320 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 08:56:13.098327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1092967115", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:13.284754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] validate_networks() for [('5aab060a-b04a-4383-a35a-0a879d26467d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:56:16.751775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:17.511103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:56:17.511672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:56:17.512150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:56:17.512755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:56:17.513532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:56:17.537513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:17.542543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:17.543287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:17.545503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:17.549425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:17.552123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:17.660546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Getting quotas for project 06c10f60df4e46d197feaf50c61c9613. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:56:17.702497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Getting quotas for user 3def4ff04d90453c86a20abbc5a6d1c4 and project 06c10f60df4e46d197feaf50c61c9613. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:56:17.772877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:56:17.795693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:56:18.056270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-697117b6-92c4-443e-9007-cfa488ee1eb6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.670527 Oct 13 08:56:18.069915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2667/5001] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:56:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 5684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:56:18.076265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9621cc8b-fc7b-4a32-9a87-869ec8acdc75 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:18.077893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9621cc8b-fc7b-4a32-9a87-869ec8acdc75 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:18.500915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9621cc8b-fc7b-4a32-9a87-869ec8acdc75 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:18.510135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9621cc8b-fc7b-4a32-9a87-869ec8acdc75 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1223 microversion: 2.1 time: 0.438257 Oct 13 08:56:18.510773 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2335/5002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:18 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1223 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:19.534220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:19.534864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:19.553469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:19.553966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:19.554432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:19.555137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:19.555590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:19.556031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:19.661546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1267407004", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c5720803-3f47-45f7-bc4a-31852acc7041"}, {"port": "01e186e1-d83c-443f-8e64-efaaf93dc4f0", "tag": "port-1"}, {"port": "5e71739d-9381-4cde-b83b-8bfabaab47db", "tag": "port-2"}, {"uuid": "520af795-7458-458c-8a0e-d29534c52ad9", "tag": "net-1"}, {"uuid": "520af795-7458-458c-8a0e-d29534c52ad9"}, {"uuid": "cf48e7ed-75e6-4178-9abc-04e9f5d5059a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cf48e7ed-75e6-4178-9abc-04e9f5d5059a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a343a092-b011-4262-9a45-f30abf3f19f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ec8ac705-2e0c-45be-8dac-82b2c714c263", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "17def535-5483-4ba1-a042-5d9cf8708050", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1991297527"}], "key_name": "tempest-keypair-1650510233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:19.828628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:19.843482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3a3b97e-0b80-4a17-bdee-cb5ecbc79b50 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1219 microversion: 2.1 time: 0.313099 Oct 13 08:56:19.844644 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2668/5003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:19 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1219 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:20.121813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] validate_networks() for [('c5720803-3f47-45f7-bc4a-31852acc7041', None, None, None, None, None), (None, None, '01e186e1-d83c-443f-8e64-efaaf93dc4f0', None, None, None), (None, None, '5e71739d-9381-4cde-b83b-8bfabaab47db', None, None, None), ('520af795-7458-458c-8a0e-d29534c52ad9', None, None, None, None, None), ('520af795-7458-458c-8a0e-d29534c52ad9', None, None, None, None, None), ('cf48e7ed-75e6-4178-9abc-04e9f5d5059a', '10.2.2.100', None, None, None, None), ('cf48e7ed-75e6-4178-9abc-04e9f5d5059a', '10.2.2.200', None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:56:20.873860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:20.875916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:20.915706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:20.916874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:20.917581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:20.931393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:20.933387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:20.934836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:21.823916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:21.841458 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16a93c69-401d-46f9-bafa-bfed2feea031 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1281 microversion: 2.1 time: 0.975342 Oct 13 08:56:21.868680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2669/5004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:20 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1281 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:22.868718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:22.869339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:22.882245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:22.902400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:22.904650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:22.906941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:22.907446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:22.907891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:23.177941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:23.188069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5c15281a-4e9c-491d-93bd-bab0db845ef0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1281 microversion: 2.1 time: 0.323454 Oct 13 08:56:23.204658 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2670/5005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:22 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:24.229682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:24.230841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:24.251505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.252297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.252774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:24.253522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.253971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.255574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:24.619123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:24.632844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e275c4e7-8864-40fa-bb14-c594a4574c94 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.416869 Oct 13 08:56:24.638879 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2671/5006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:24 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:24.647471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:24.651334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:24.668009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.668990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.670916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:24.672701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.673638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.675050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:24.887935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:24.899578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86f29c9f-fd64-429d-bc30-e68172484ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.259132 Oct 13 08:56:24.900404 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2672/5007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:24 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:24.923877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1193360091"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:24.928908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:24.937625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.938398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.939089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:24.940203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:24.940849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:24.941467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:25.269377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2cffff54-f655-4730-b529-3ce3e7136f08 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.348900 Oct 13 08:56:25.271499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2673/5008] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:56:24 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 13 08:56:25.663440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:25.664785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:25.678839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:25.679631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:25.680332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:25.681584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:25.682286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:25.682958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:25.946840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:25.957621 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b5272b7-9773-4d38-8b21-953dc2d15650 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.302698 Oct 13 08:56:25.974667 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2674/5009] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:25 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:26.985052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:26.985726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:26.998155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:27.002304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:27.003022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:27.003931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:27.004558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:27.006338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:27.326156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:27.335155 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-feec807f-a288-4f7d-b424-21bae6821557 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.353697 Oct 13 08:56:27.335578 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2675/5010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:26 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:27.375979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:27.390664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:27.391467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:27.392382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:27.410986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] Creating event network-changed:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:56:27.426302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9b1c82fc-be4e-4804-a4eb-342e40851bdd req-fb90f30a-3a92-43b7-b9e4-a9e489df696b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052129 Oct 13 08:56:27.427382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2676/5011] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:56:27.775955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-unplugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:27.789726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:27.794571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:27.812389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:27.815226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:27.815817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:27.850862 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] Creating event network-vif-unplugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:56:27.872972 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7c673b83-9515-4125-878d-0a6877899aa3 req-1a0c005d-c8f1-4edb-a903-ee4c94938329 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103149 Oct 13 08:56:27.879301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2677/5012] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:56:28.363831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:28.365847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:28.378888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:28.379533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:28.380048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:28.381587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:28.382461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:28.383097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:28.509712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:28.738221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:28.754988 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ad3eaeb-0f77-444a-91ae-1da5696f30c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.398342 Oct 13 08:56:28.757827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2678/5013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:28 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:29.778783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:29.780222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:29.795335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:29.796114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:29.797313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:29.799018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:29.799790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:29.800411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:29.918607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:56:29.919791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:56:29.920292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:56:29.920820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:56:29.921104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:56:29.941674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:29.944103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:29.944727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:29.947210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:29.947834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:29.949441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:29.995840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Getting quotas for project 65a5cba0679244b9a6319d2c56a09092. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:56:30.003424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Getting quotas for user 4966ceab0ec143938dadab574388ab2f and project 65a5cba0679244b9a6319d2c56a09092. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:56:30.260165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:56:30.263271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a343a092-b011-4262-9a45-f30abf3f19f4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ec8ac705-2e0c-45be-8dac-82b2c714c263',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17def535-5483-4ba1-a042-5d9cf8708050',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:56:30.341732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:30.350597 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8445ab7d-1158-4c77-8517-c10ea639da6f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.575909 Oct 13 08:56:30.362451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2679/5014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:29 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:30.908591 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95e408f8-69ff-422c-b1f3-6987ca513ed2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.261935 Oct 13 08:56:30.916860 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2336/5015] 10.222.0.23 () {62 vars in 1189 bytes} [Thu Oct 13 08:56:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 11271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 08:56:30.921564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:30.922185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:31.379114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:31.380184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:31.413932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:31.414775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:31.416222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:31.419880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:31.451920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:31.462584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:31.672082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:31.682958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:31.684440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:31.690821 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5949866-9e19-4a23-9cc9-48fd0002b866 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1286 microversion: 2.42 time: 0.773190 Oct 13 08:56:31.692010 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2680/5016] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:30 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1286 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:31.955736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:31.969210 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85ba72c9-7e0d-4202-85a1-127e9a18617f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.596669 Oct 13 08:56:31.975732 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2337/5017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:31 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:32.731575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:32.737903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:32.754727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:32.756424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:32.757620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:32.758711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:32.759550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:32.760215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:32.948272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:32.972194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:32.974908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:32.981175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85899ae2-0b5c-49f3-a042-39566555f9a5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1528 microversion: 2.42 time: 0.265681 Oct 13 08:56:32.984922 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2681/5018] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:32 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:32.999914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:33.001322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:33.013368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:33.018696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:33.020150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:33.023550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:33.024287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:33.035995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:33.381184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-plugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:33.398448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:33.399156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:33.400059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:33.414936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] Creating event network-vif-plugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:56:33.422617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f7e79d48-ac0d-4ef3-83af-0f01668b2299 req-6081e837-5a72-442b-91f7-5243ba560e1c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046958 Oct 13 08:56:33.423796 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2682/5019] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:34.016823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:34.017538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:34.034876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:34.053293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:34.053854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:34.054668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:34.055181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:34.055646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:34.191012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:34.210364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:34.213003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:34.215292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0f643a0-5701-484f-9768-133bc80f6a00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1594 microversion: 2.42 time: 0.202779 Oct 13 08:56:34.216288 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2683/5020] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:34 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1594 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:34.274179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:34.292506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-13cfaf76-6ab8-4486-bd78-2b4ddfb52fd6 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 1.297094 Oct 13 08:56:34.307482 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2338/5021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:32 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:35.269468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:35.270705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:35.292452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:35.295222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:35.300910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:35.305508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:35.306029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:35.308458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:35.323861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:35.324633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:35.356278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:35.356278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:35.356607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:35.357899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:35.358635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:35.361758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:35.464490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:35.483035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:35.487732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:35.490252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ce66ef9-9fdf-439d-855b-15839da64095 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1594 microversion: 2.42 time: 0.250217 Oct 13 08:56:35.511045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2684/5022] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:35 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1594 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:36.519935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:36.520689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:36.525403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:36.545564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:36.549557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:36.556735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:36.560001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:36.564661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:36.568621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:36.732227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:36.780078 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2dc7b86e-4a37-443e-bf6c-0b8eae19195e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 1.459298 Oct 13 08:56:36.780725 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2339/5023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:35 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:37.016781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "name": "network-vif-plugged", "status": "completed", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:37.073040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:37.090350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:37.099647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:37.165656 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] Creating event network-vif-plugged:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:56:37.186949 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2bc8aae9-4033-4e12-88ff-9df01c63cc81 req-f7ec02dc-4945-464c-9d5d-0be4e658b07e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175536 Oct 13 08:56:37.192520 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2340/5024] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:37.807704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:37.808543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:37.835873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:37.840417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:37.841239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:37.845705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:37.847326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:37.850393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:37.859817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:37.872171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:37.872891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:37.879438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:37.888080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2dbcf6b-295b-4771-9a80-f74893f312af tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1662 microversion: 2.42 time: 1.372989 Oct 13 08:56:37.910043 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2685/5025] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:36 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1662 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:38.374691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:38.390650 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4bd07fe-a9e9-41a7-b220-4d1090b024f2 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1323 microversion: 2.1 time: 0.587127 Oct 13 08:56:38.391263 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2341/5026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:37 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:38.931386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:38.932888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:38.967048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:38.973324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:38.974001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:38.974826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:38.980217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:38.980895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:39.511059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15eed560-7459-4a2d-bf9e-ccaac66bbe6b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: .version_select at 0x7f5375d12820>, body: {"keypair": {"name": "tempest-keypair-328748764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQMObMP9nxn4QlvVW5u6K4nLLiY1otYq85iYoA+cUrScOsmBnvCT0VlAbayPZn4OZBwYF4WQ00Q3WTpehqkWNx2L+EghveQ85e/Gdy92ew4t+SMMM++VUXrz7v8Hed5SA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:39.546984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:39.573404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:39.576049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-15eed560-7459-4a2d-bf9e-ccaac66bbe6b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:56:39.588691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:39.590138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb8c61fb-ed7c-4d4c-8a3b-4203c0831112 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1709 microversion: 2.42 time: 0.663820 Oct 13 08:56:39.596991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2342/5027] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:38 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1709 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:39.608038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:39.608658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:39.619523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-15eed560-7459-4a2d-bf9e-ccaac66bbe6b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:56:39.620791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:39.623561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:39.626548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:39.627382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:39.628050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:39.628655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:39.720071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15eed560-7459-4a2d-bf9e-ccaac66bbe6b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.096681 Oct 13 08:56:39.723328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2686/5028] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:56:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:39.971220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:40.012686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:40.176161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:40.192100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c35496e0-fe9e-46d2-b98a-ae874e7efd03 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1518 microversion: 2.1 time: 0.586821 Oct 13 08:56:40.196472 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2343/5029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:39 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1518 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:40.227509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:40.230889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:40.257515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.258519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.261310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:40.267733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.269013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.269879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:40.359791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lazy-loading 'flavor' on Instance uuid 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:56:40.624314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:40.626381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:40.632893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:40.655922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.662541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.664750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:40.665718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.667762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.672369 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-297bb910-4b81-41c8-8b91-84caf69b6dc1 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action" status: 200 len: 32 microversion: 2.1 time: 0.445612 Oct 13 08:56:40.676205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2687/5030] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:56:40 2022] POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:56:40.676406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:40.694614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:40.699807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:40.717173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.724063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.726045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:40.727459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:40.731674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:40.733673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:41.413567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:41.425847 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17fb23ec-8f95-4bf0-9edf-c6dd1394c47a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.743225 Oct 13 08:56:41.450833 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2688/5031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:40 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:41.847973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:41.868567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:41.875107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:41.880847 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f041374-839d-42d9-9a34-0fe42a3e89fd tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1709 microversion: 2.42 time: 1.261841 Oct 13 08:56:41.881465 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2344/5032] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:40 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1709 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:42.467689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:42.469570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:42.487779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:42.489829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:42.491208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:42.493296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:42.493956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:42.497420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:42.811347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:42.821325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49871700-f7f4-411c-a328-c97ad4d0c771 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.359015 Oct 13 08:56:42.842808 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2689/5033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:42 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:42.909031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:42.910463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:42.920315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:42.922982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:42.924117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:42.927544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:42.928885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:42.929499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:43.853463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:43.855119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:43.876325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:43.877187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:43.882340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:43.890357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:43.892098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:43.894485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:44.115010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:44.125374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:44.136910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:44.138326 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-acaa0906-bc3f-4d2e-bd9d-3ed1274a6d9a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1756 microversion: 2.42 time: 1.234352 Oct 13 08:56:44.138989 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2345/5034] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:42 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1756 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:44.393758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:44.410692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cafc41c1-fbc8-47b1-a61c-cf3beaf37cc8 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.560948 Oct 13 08:56:44.414094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2690/5035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:43 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:45.172898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:45.174590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:45.186006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:45.191358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:45.193277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:45.195152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:45.197019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:45.200072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:45.445909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:45.447011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:45.462628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:45.464561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:45.466072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:45.467590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:45.472833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:45.476255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:46.207196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:46.235503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:46.240700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:46.253403 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d702d912-8a5f-40c7-bac8-084cd1e761a2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1803 microversion: 2.42 time: 1.079770 Oct 13 08:56:46.262375 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2346/5036] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:45 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1803 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:46.299569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2033487524", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d510c72-59c1-4539-8bec-64f07cb7d4c4"}], "security_groups": [{"name": "tempest-securitygroup--1572308750"}], "key_name": "tempest-keypair-328748764", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:46.792120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] validate_networks() for [('6d510c72-59c1-4539-8bec-64f07cb7d4c4', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:56:46.835074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:46.849607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2bb8e21d-5f5b-4e1a-b184-2d808167b9e0 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 1.416077 Oct 13 08:56:46.852865 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2691/5037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:45 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:56:47.287305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:47.287929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:47.293726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:47.294194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:47.304063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:47.307649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:47.310591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:47.313649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:47.695375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:47.769448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:47.789448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:47.792353 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88bcc4ba-eb4c-4311-a9b3-4da59433a40c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1803 microversion: 2.42 time: 0.509511 Oct 13 08:56:47.792969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2692/5038] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:47 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1803 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:47.886641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:47.888008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:47.912250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:47.915216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:47.918642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:47.919676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:47.921560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:47.922158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:48.536144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:48.547003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ac96755-c10f-4016-a6e5-761d37eb7a22 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.673534 Oct 13 08:56:48.550844 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2693/5039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:47 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:48.745881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:56:48.746510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:56:48.747904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:56:48.748462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:56:48.749190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:56:48.762094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:48.763001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:48.763625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:48.765474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:48.766245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:48.767046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:48.795566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:56:48.803308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:56:48.821163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:48.821771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:48.823469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:56:48.827416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:56:48.855322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:48.855831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:48.863902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:48.864919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:48.865411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:48.870312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:48.912693 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f46778c-567c-4cdf-89eb-343972dd8acf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.619014 Oct 13 08:56:48.917232 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2347/5040] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:56:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:56:48.932277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9a5edf8-38f0-442b-9c81-3ab658fc7027 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:48.933327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9a5edf8-38f0-442b-9c81-3ab658fc7027 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:49.128888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9a5edf8-38f0-442b-9c81-3ab658fc7027 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:49.143609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9a5edf8-38f0-442b-9c81-3ab658fc7027 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1241 microversion: 2.1 time: 0.216532 Oct 13 08:56:49.145617 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2348/5041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:48 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1241 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:49.582427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:49.583351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:49.605268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:49.613326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:49.618977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:49.621463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:49.624714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:49.627611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:49.656728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:49.898763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:49.911138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e420dcf9-98ac-44f8-8b39-98bf98317896 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.336756 Oct 13 08:56:49.912816 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2349/5042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:49 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:49.914228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:49.938477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:49.940836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:49.946768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db406f5d-babd-47ef-9192-0c418a4ec649 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1850 microversion: 2.42 time: 1.129889 Oct 13 08:56:49.952088 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2694/5043] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:48 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1850 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:50.172247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:50.173061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:50.192215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:50.195197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:50.197473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:50.198452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:50.201088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:50.203452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:50.367877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:50.380712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6db1827-9f47-40e3-8da3-ee1379063765 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1245 microversion: 2.1 time: 0.209579 Oct 13 08:56:50.399517 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2350/5044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:50 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1245 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:50.945127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:50.946451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:50.964902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:50.966486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:50.967143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:50.971157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:50.972077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:50.972752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:50.993227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:50.993826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:51.009000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:51.012767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:51.014036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:51.018146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:51.018873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:51.021178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:51.077384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=73 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:51.717244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:51.734993 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a777c471-ac04-48c9-96b6-3aaa07062301 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.785268 Oct 13 08:56:51.740323 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2695/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:50 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:51.745367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:51.767730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:51.791874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:51.792373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:51.792812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:51.793529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:51.793980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:51.794426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:51.964730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:51.976887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0dfcc23e-6cf2-4fd0-a3e1-dfc2a2b8c4b6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1299 microversion: 2.1 time: 0.235169 Oct 13 08:56:51.977476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2696/5046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:51 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:52.046344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:52.056795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:52.065354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "a1303ad6-f0c5-46da-8664-cbc040d72825"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:52.080442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:52.083877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f978ccfc-a9d4-404e-bd04-8162ade8b5d7 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1850 microversion: 2.42 time: 1.096827 Oct 13 08:56:52.086165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:52.086686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:52.087127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:52.090713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2351/5047] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:50 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1850 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:56:52.112609 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] Creating event network-changed:a1303ad6-f0c5-46da-8664-cbc040d72825 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:56:52.128717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ecd2cd2a-4b83-43c2-8d31-678f41337978 req-ef3fd6ce-4110-47f8-94de-0ef0d012ffef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068016 Oct 13 08:56:52.129939 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2697/5048] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:52.760357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:52.761175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:52.770528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:52.771032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:52.771483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:52.772204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:52.772666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:52.773108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:53.005722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:53.006387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:53.030791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:53.031882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:53.040392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:53.041943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:53.047188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:53.055018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:53.267832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:53.276487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99eea03e-8fd0-48ce-a7bf-2d3c242ebc9a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1299 microversion: 2.1 time: 0.276528 Oct 13 08:56:53.291499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2698/5049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:52 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1299 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:53.296893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:53.315409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:53.329976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:53.335302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:53.336420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:53.336958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:53.338039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:53.338673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:53.339243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:53.351120 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b3567bed-e069-45ec-8995-fd1a7c328012 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.595143 Oct 13 08:56:53.352325 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2352/5050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:52 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:54.103022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:54.114717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:54.116315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:54.117572 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53edfcb7-27c4-478a-8d1a-7de008952763 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1871 microversion: 2.42 time: 0.824645 Oct 13 08:56:54.127347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2699/5051] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:53 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1871 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:54.200963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "01e186e1-d83c-443f-8e64-efaaf93dc4f0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:54.225920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:54.228806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:54.229388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:54.267720 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] Creating event network-changed:01e186e1-d83c-443f-8e64-efaaf93dc4f0 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:56:54.281753 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-dfa6ce53-6086-4061-804f-038dfcd63ea1 req-89b24683-ce84-420a-8e19-14dc1e8edfba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084010 Oct 13 08:56:54.283865 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2353/5052] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:54.315302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:54.326903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:54.349119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:54.350040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:54.353160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:54.355673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:54.356418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:54.357139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:54.381869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:54.383469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:54.402911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:54.405925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:54.408155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:54.414978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:54.416225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:54.418745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:55.158217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:55.167668 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22447fbd-980d-4c1c-bc3d-941e0e214d7d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.858776 Oct 13 08:56:55.190432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2700/5053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:54 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:55.193832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:55.195231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:55.222377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:55.224726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:55.227157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:55.228225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:55.231823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:55.232923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:55.249654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:55.277459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c72b3fa6-68ec-414a-b7c3-07e21c0f2a3b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.900896 Oct 13 08:56:55.280014 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2354/5054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:54 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:56.004629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:56.040315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:56.051513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:56.052861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49af10d0-907e-4ed1-985e-1449bb9678f6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1871 microversion: 2.42 time: 0.875308 Oct 13 08:56:56.066434 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2701/5055] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:55 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1871 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:56.212666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:56.214741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:56.226169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.228601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.234030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.237115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.238544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.239340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.303705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:56.304322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:56.329330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.331179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.331987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.333019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.333659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.334265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.386723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:56.625032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:56.638723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83986818-f75b-4ec4-b1ac-85e4e4c13d9b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.338976 Oct 13 08:56:56.658749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2702/5056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:56 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:56.670222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:56.671065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:56.697106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.699457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.701019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.707679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:56.709210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:56.710395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:56.914054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:56.926735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lazy-loading 'services' on Instance uuid 8054a4e8-c934-4049-9e23-f717a1fbfc55 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:56:56.943740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0966ca8-b04e-4636-9245-c6bd85e40cce tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.736075 Oct 13 08:56:56.964186 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2355/5057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:56 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:56.974068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "5e71739d-9381-4cde-b83b-8bfabaab47db"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:57.011989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.020220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.020949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:57.039658 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] Creating event network-changed:5e71739d-9381-4cde-b83b-8bfabaab47db for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:56:57.047753 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8470cc9e-7c19-47c2-88db-8ac80866bb54 req-3034b765-4c1c-4ee2-a4d0-5fca78366a70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078978 Oct 13 08:56:57.049570 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2356/5058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:57.097029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:57.098102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:57.122988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.126931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.132710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:57.133278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.133853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.134187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:57.161628 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5488796e-d638-4db8-8903-02ed1774cdc1 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55/os-volume_attachments/ef2822c0-b490-4949-a414-b8f8ffdc79b9" status: 202 len: 0 microversion: 2.1 time: 0.501282 Oct 13 08:56:57.174052 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2703/5059] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:56:56 2022] DELETE /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55/os-volume_attachments/ef2822c0-b490-4949-a414-b8f8ffdc79b9 => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:56:57.227796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb83b0a4-076d-43e8-937b-34c4c8663bb5", "tag": "2d423ff2-ad3a-46ce-81bd-13a543e39c4d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:56:57.288043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.290031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.291160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:57.319200 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] Creating event network-changed:2d423ff2-ad3a-46ce-81bd-13a543e39c4d for instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 on n-h1-858384-11 Oct 13 08:56:57.338398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-22e1163f-b2d3-4b7b-b0d4-05f01d0a037d req-61fa5a7a-13c9-4419-8740-e4cfb81f1acc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116394 Oct 13 08:56:57.344845 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2704/5060] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:56:57.679970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:57.681125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:57.707670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.708986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.712124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:57.716058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:57.718078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:57.719920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:58.026055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:58.038280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:58.055309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:58.066549 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7cc6a945-509a-4b5e-9fd4-2aa776886ab4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.985736 Oct 13 08:56:58.084481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2357/5061] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:57 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:56:58.094194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:58.100332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:58.121960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:58.122571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:58.123135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:58.123964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:58.124537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:58.125083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:58.381478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:58.389308 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67be604d-0980-438e-b073-f65feeaded9d tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.714542 Oct 13 08:56:58.389957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2705/5062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:57 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:58.709817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:56:58.723866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6059e094-5111-4ef2-91b1-c84559f4a8e8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.637897 Oct 13 08:56:58.724465 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2358/5063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:58 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:56:59.098474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:59.099191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:59.110349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:59.110937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:59.111380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:59.131499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:59.131984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:59.132432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:59.418717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:56:59.419324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:56:59.421322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:59.422017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:56:59.437080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:59.437543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:59.449217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:56:59.451312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:56:59.453681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:56:59.456341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:00.246755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:00.267723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:00.273172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:00.276758 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b5283ed-619b-4c3d-a55b-2cab92dfc410 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 1.181652 Oct 13 08:57:00.279766 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2706/5064] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:56:59 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:00.296573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "afb29497-31a2-4019-b86d-20fc1d02f81e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:00.322570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:00.323305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:00.324652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:00.357754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] Creating event network-changed:afb29497-31a2-4019-b86d-20fc1d02f81e for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:00.366475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-46a0fb12-448f-4598-aa58-d2f0e8b68c7e req-840b098e-8436-48f1-bad3-c4e574b8ed10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083782 Oct 13 08:57:00.371554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2707/5065] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:00.387012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:00.388635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:00.406510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:00.407361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:00.408827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:00.409853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:00.410608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:00.411293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:00.756292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:00.773580 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7433a0be-98c9-4ba1-b835-af2794f78806 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 1.358856 Oct 13 08:57:00.780897 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2359/5066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:56:59 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:00.896668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:00.900335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:00.904211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:00.919179 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eaa6d80d-d7e6-45af-a464-5c0339b1219a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.546203 Oct 13 08:57:00.923295 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2708/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:00 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:00.933102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:00.945351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:00.948874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:00.950142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:00.952668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:00.956646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:01.006108 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aec5d298-149a-4a48-ac93-a5a6ce9c1f25 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/ips" status: 200 len: 145 microversion: 2.1 time: 0.113111 Oct 13 08:57:01.007601 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2360/5068] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:57:00 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/ips => generated 145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:01.308696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:01.310005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:01.323552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:01.325380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:01.326030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:01.327523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:01.329975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:01.336587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:01.808525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:01.809554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:01.823735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:01.831407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:01.831798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:01.832606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:01.833203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:01.833499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:02.025639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:02.057028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:02.059080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:02.076987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37a58d9c-f322-4f0f-bb24-c056bd77dcfe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.768536 Oct 13 08:57:02.090921 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2709/5069] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:01 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:02.106333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:02.107269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:02.115167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:02.116045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:02.118129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:02.118972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:02.119448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:02.119884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:02.581688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:02.592766 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bda075c2-cf13-4c68-a262-b4a3cd63824c tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.788394 Oct 13 08:57:02.596709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2361/5070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:01 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:02.614647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "603d44c4-9c9d-4c91-a69d-281b2bfcc655"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:02.614899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:02.627921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:02.628763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:02.629561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:02.637664 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9cd5c37-3892-4c8b-a5b8-809b305c4899 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.545121 Oct 13 08:57:02.644034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2710/5071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:02 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:02.662168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] Creating event network-changed:603d44c4-9c9d-4c91-a69d-281b2bfcc655 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:02.671243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-99ce80c4-2324-4aec-b2f8-ce4bb3be24fd req-46bea119-ee64-4435-8abb-764fd05c8f8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071797 Oct 13 08:57:02.672792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2362/5072] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:02.728945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb83b0a4-076d-43e8-937b-34c4c8663bb5", "name": "network-vif-plugged", "status": "completed", "tag": "2d423ff2-ad3a-46ce-81bd-13a543e39c4d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:02.761377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:02.764541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:02.767255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:02.789968 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] Creating event network-vif-plugged:2d423ff2-ad3a-46ce-81bd-13a543e39c4d for instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 on n-h1-858384-11 Oct 13 08:57:02.797088 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-983a6153-fd65-4102-8505-47fddbe70577 req-102b8b0a-a7fa-4644-bdb1-9f6444314890 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072080 Oct 13 08:57:02.799059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2711/5073] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:03.117838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:03.120214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:03.145600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.155569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.156791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:03.158172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.160986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.161802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:03.622701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:03.624002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:03.631748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.643243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.643929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:03.644841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.645484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.646094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:03.770772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:03.784962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:03.786672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:03.793106 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac1f4b7d-95f0-423f-a73e-a18072bf11ce tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.687473 Oct 13 08:57:03.794244 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2363/5074] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:03 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:03.799647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:03.802843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:03.819509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.820286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.820883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:03.825210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:03.825879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:03.826509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:04.110247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:04.121626 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2c5f78b-7ae2-40ea-a874-5d4875144b1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1367 microversion: 2.1 time: 0.325938 Oct 13 08:57:04.123696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2364/5075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:03 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:04.179423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:04.189343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d517f4f-1bc2-48ca-9d8a-6460809d6157 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.570923 Oct 13 08:57:04.190584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2712/5076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:03 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:04.798458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "a00270e9-c028-4ccb-830f-06b0da6b95bc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:04.806516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:04.808253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:04.809110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:04.821165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:04.821869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:04.841723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:04.845335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:04.846038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:04.852886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:04.853908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:04.860863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:04.867016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] Creating event network-changed:a00270e9-c028-4ccb-830f-06b0da6b95bc for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:04.887038 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-088478fa-8f10-4250-a3a7-c44a0811fc39 req-42cc472e-f69f-46ea-a6cb-3647d17f95f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122167 Oct 13 08:57:04.888914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2365/5077] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:05.150112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:05.151787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:05.163731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.165456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.168161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.169270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.171361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.174911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.419610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:05.439532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:05.443182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:05.450289 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3039dc7a-0d32-4005-8413-ee3788b14128 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.635021 Oct 13 08:57:05.452004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2713/5078] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:04 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:05.459153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:05.460699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:05.470898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.472550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.473222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.474861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.475566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.476232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.752980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:05.770138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f7f03d6-ca30-4e08-a6c8-64dfa5234fa5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1557 microversion: 2.1 time: 0.624541 Oct 13 08:57:05.771457 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2366/5079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:05 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1557 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:05.802587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:05.804737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:05.817831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:05.818882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.819557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.820629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.822383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:05.823068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:05.824091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:05.836540 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a0531df-8107-4012-9e8d-610406ff3ed4 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.373205 Oct 13 08:57:05.837722 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2714/5080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:05 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:06.056197 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50bba38b-fdec-4e7a-824a-133ca4aa4a5a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262572 Oct 13 08:57:06.057275 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2367/5081] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:57:05 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:06.487432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:06.488207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:06.522735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:06.523743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:06.524342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:06.528283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:06.529044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:06.530071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:06.861066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:06.861687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:06.878041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:06.878791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:06.879435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:06.880349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:06.881115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:06.881717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:06.995666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:07.009169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:07.010726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:07.011897 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee993973-b5ac-46ca-b34b-9ac9068a4dd0 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.531717 Oct 13 08:57:07.017587 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2715/5082] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:06 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:07.049529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "19000e35-57c3-405f-89d5-1b2f93667c01"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:07.057280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:07.064344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:07.065727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:07.066589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:07.081859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] Creating event network-changed:19000e35-57c3-405f-89d5-1b2f93667c01 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:07.088378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5fb0a605-b955-40ea-91bc-39117539cdb0 req-f12cfb29-1511-4021-abee-8a0de08c54b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069068 Oct 13 08:57:07.089645 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2716/5083] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:07.266135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:07.267211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:07.280364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:07.281084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:07.283937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:07.284866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:07.291563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:07.292304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:07.533751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:07.541807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ef0a6a2-cf6c-4863-8aff-1eb64862130e tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.684982 Oct 13 08:57:07.543028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2368/5084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:06 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:08.046658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:08.047294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:08.064088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.066590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.067052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.069847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.070329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.070792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.086008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:08.101754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-adf9368b-c87e-451e-a199-8feb2ca11f89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.841148 Oct 13 08:57:08.110540 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2717/5085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:07 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:08.479156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:08.479772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:08.501795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.505910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.506758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.507699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.508698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.509539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.603351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:57:08.642086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:08.659099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:08.662567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:08.664469 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30274954-c443-4b9e-95df-b2355ec40faf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.623006 Oct 13 08:57:08.684095 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2369/5086] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:08 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:08.702185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:08.703127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:08.720890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.721452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.721900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.724890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.725636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.726095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.800557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-489e4e5c-3678-43f5-aa85-48a615213e7b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 204 len: 0 microversion: 2.1 time: 0.326454 Oct 13 08:57:08.805058 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2718/5087] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:57:08 2022] DELETE /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:57:08.815968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:08.818705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:08.836905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.838016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.838711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.839800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:08.842343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:08.843027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:08.850127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:09.124241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:09.136871 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-216595ca-9bf4-4a3e-8d82-0e6644ebee07 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.451511 Oct 13 08:57:09.138309 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2370/5088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:08 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:09.150559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:09.152313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:09.166276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.169215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.173724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.174807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.175503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.176530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.205056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:09.214702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a877a028-e396-4713-9e2c-7a725d4652bc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1514 microversion: 2.1 time: 0.408104 Oct 13 08:57:09.216537 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2719/5089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:08 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:09.221644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb83b0a4-076d-43e8-937b-34c4c8663bb5", "tag": "2d423ff2-ad3a-46ce-81bd-13a543e39c4d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:09.227765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:09.236695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.237108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.266582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.319863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] Creating event network-changed:2d423ff2-ad3a-46ce-81bd-13a543e39c4d for instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 on n-h1-858384-11 Oct 13 08:57:09.333440 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f9a7ccc7-7031-4e70-801c-ef41be7286ac req-83e1cc5d-8cf1-495e-8e4d-4a182c07c8f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115416 Oct 13 08:57:09.334086 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2720/5090] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:09.638397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:09.649293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f67e894-f424-4371-ba39-2b470b2c25e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.509653 Oct 13 08:57:09.650069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2371/5091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:09 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:09.679153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1080484035"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:09.685194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:09.700600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:09.701604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:09.713821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.717329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.726863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.727719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.728638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.729721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.730437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.731256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.732270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:09.732969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:09.736345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:09.747519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.272625 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70648937-70cf-4864-9521-1db5adb156d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.600839 Oct 13 08:57:10.273298 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2721/5092] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:09 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 13 08:57:10.314943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:10.315796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:10.333773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.334277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.335262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.336160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.339602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.340495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.468104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:10.484311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:10.501593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:10.503418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21d49fb6-3444-4031-985a-54e99a14e330 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.806687 Oct 13 08:57:10.507194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2372/5093] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:09 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:10.514607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:10.516377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:10.543263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.546706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.551189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.552961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.553702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.554898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.914623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:10.924767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ddae6292-abdb-4bab-920e-720defbea7a8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1514 microversion: 2.1 time: 0.415662 Oct 13 08:57:10.928709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2373/5094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:10 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:10.945353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:10.948162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:10.950671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:10.982889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.985436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.986317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:10.988047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:10.988750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:10.990064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.019117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:11.031284 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f4e2e4c-91d8-4938-8163-40de74c13517 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.744486 Oct 13 08:57:11.045771 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2722/5095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:10 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:11.060367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-unplugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:11.091930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.093164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.095497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.132405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] Creating event network-vif-unplugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:57:11.137528 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b9d86eb8-c97c-4d13-982d-d7617e390f20 req-4afc2939-20bc-476f-849b-298cffe1e6ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090248 Oct 13 08:57:11.138691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2723/5096] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:11.543475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:11.545542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:11.555464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.556221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.557023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.558264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.559255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.559939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.633836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:11.645301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1243ab2f-e1c9-493a-a134-85aa7b100bdb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.715325 Oct 13 08:57:11.645901 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2374/5097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:10 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:11.921832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:11.922221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0770f08-b326-4a84-b9e0-3529de0d5131"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:11.925537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:11.932085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.932868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.933285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:11.933816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.934843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.935694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.936843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.937829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:11.939138 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bafce02d-44de-4e4a-a674-040fbda78841 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.403194 Oct 13 08:57:11.943785 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2724/5098] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:11 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:11.958256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:11.959262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:11.981895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.982787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.983438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:11.984411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:11.986017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:11.986756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.243498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:12.259206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36529a27-5f5f-486e-8748-4542a9b19440 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1514 microversion: 2.1 time: 0.308806 Oct 13 08:57:12.259811 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2725/5099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:11 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:12.281021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:12.284504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:12.300692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.301571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.302254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.303280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.304007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.304673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.402033 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5187a30-3fcd-4577-8f07-ab3af8a42328 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484886 Oct 13 08:57:12.406315 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2375/5100] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:57:11 2022] POST /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:12.629734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:12.638919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c3141418-bbca-4dad-804d-d1701f2be0d5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1524 microversion: 2.1 time: 0.367084 Oct 13 08:57:12.663413 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2726/5101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:12 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1524 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:12.675973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:12.676684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:12.689764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.698912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.699590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.700529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.701211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.701871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.965508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:12.966123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:12.979833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.980554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.981178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:12.982141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:12.990971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:12.996978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.191137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.203504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6dfc4390-f23c-4b7e-821d-dee7492a4017 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.532938 Oct 13 08:57:13.210759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2376/5102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:12 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:13.265229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8054a4e8-c934-4049-9e23-f717a1fbfc55", "name": "network-vif-deleted", "tag": "eb8fda45-70bb-47e3-9c28-264f1e1fb645"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:13.301381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:13.302371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:13.303256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.331031 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] Creating event network-vif-deleted:eb8fda45-70bb-47e3-9c28-264f1e1fb645 for instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 on n-h1-858384-11 Oct 13 08:57:13.344251 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-09e91244-45ff-4ed6-8ebb-b88b41edd6c1 req-68dc8fed-bd89-4793-8bdc-596c7d6673c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085695 Oct 13 08:57:13.346136 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2377/5103] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:13.351583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:13.368998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:13.376153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:13.376993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:13.377698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.378677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:13.379387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:13.380048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.553357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.565870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.567774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.569342 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2713e732-a03c-405d-b0f4-bcc0a14f13c3 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.607993 Oct 13 08:57:13.571283 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2727/5104] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:12 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:13.587372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.597245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-338631dd-4841-46b9-a3a6-8ab45d26a0b5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 200 len: 1303 microversion: 2.1 time: 0.249597 Oct 13 08:57:13.597856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2378/5105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:13 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 1303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:13.678775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:13.680531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:13.690888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:13.691610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:13.692415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.693353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:13.694210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:13.694979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:13.909558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:13.920183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4d919e81-5d40-40e0-9759-6de279050290 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1504 microversion: 2.1 time: 0.245407 Oct 13 08:57:13.921888 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2728/5106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:13 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:13.949831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a737b381-1cd8-422b-be46-895ea7204b3a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'create', calling method: .version_select at 0x7f53755e5af0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-533070290", "description": "tempest-description-2069616066"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:14.229530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:14.230179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:14.245710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.246248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.252071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.252871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.253376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.254039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.666811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:14.679116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d75e98ab-698e-4f00-ab48-c08a3732e332 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1686 microversion: 2.1 time: 0.450373 Oct 13 08:57:14.680073 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2729/5107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:14 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1686 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:14.686078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:14.686978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:14.697728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.698602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.699278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.712086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.714236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.715003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.764928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a737b381-1cd8-422b-be46-895ea7204b3a tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.820276 Oct 13 08:57:14.774127 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2379/5108] 10.222.0.23 () {60 vars in 1180 bytes} [Thu Oct 13 08:57:13 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:14.779306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:14.779931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: 8054a4e8-c934-4049-9e23-f717a1fbfc55] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:14.792767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.794621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.795089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.795812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.798998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.799456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.831144 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] HTTP exception thrown: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Request method failure captured: Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 HTTP/1.1 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IIKbNbQof7OFg0kkR7HiLXrEN4IfS-hPwh_-PeJcMJg8R14jZ3ED9QHXPW4fkvzetHRd8hnQx6biaavHTMgyKQba3h_3O2sYhLGvunyS-AxFw5KfGO7ZtgCLnpDzj5g-dJS-6SDTmeoqHKwoLpAuD3FV1oFWBxDarLRyKmtuCKJ5U Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5c1618924e3042deaa804928761e5930 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c1618924e3042deaa804928761e5930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c1618924e3042deaa804928761e5930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c1618924e3042deaa804928761e5930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c1618924e3042deaa804928761e5930"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5c1618924e3042deaa804928761e5930 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotTestJSON-1909021271-project Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 87f44f47c72544daac503f4a0c1db525 Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotTestJSON-1909021271-project Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8054a4e8-c934-4049-9e23-f717a1fbfc55'} Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:57:14.833375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. Oct 13 08:57:14.838436 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:57:14.840613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Returning 404 to user: Instance 8054a4e8-c934-4049-9e23-f717a1fbfc55 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:57:14.841718 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57cdacbd-6c98-457f-8095-135a34829695 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55" status: 404 len: 111 microversion: 2.1 time: 0.066506 Oct 13 08:57:14.842548 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2380/5109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:14 2022] GET /compute/v2.1/servers/8054a4e8-c934-4049-9e23-f717a1fbfc55 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:57:14.872829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-533070290"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:14.873671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:14.885120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.890023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.895579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:14.896584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:14.898067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:14.899235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:15.177507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:15.192636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:15.194078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:15.195475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2fa649b-d496-4a15-a267-69911baab72c tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1892 microversion: 2.42 time: 0.513259 Oct 13 08:57:15.197193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2730/5110] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:14 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1892 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:15.276968 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Adding security group 96848a52-0937-4382-a8a1-7a16a0abae72 to port a3e6022e-da82-4f41-8d62-276ebcd594dc Oct 13 08:57:15.707977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:15.709284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:15.717167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:15.717746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:15.718464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:15.719404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:15.720101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:15.720755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:15.884145 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8915a01f-c07e-4513-b7d0-aa07d1820afc tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action" status: 202 len: 0 microversion: 2.1 time: 1.035780 Oct 13 08:57:15.884963 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2381/5111] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:14 2022] POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:57:15.897173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-533070290"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:15.897988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:15.913557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:15.914794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:15.916290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:15.917187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:15.921086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:15.922160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:16.249243 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Removing security group 96848a52-0937-4382-a8a1-7a16a0abae72 from port a3e6022e-da82-4f41-8d62-276ebcd594dc Oct 13 08:57:16.629140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:16.639522 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09f4afbb-17e7-4d75-8ee4-f23eb91cad66 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1686 microversion: 2.1 time: 0.935673 Oct 13 08:57:16.640126 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2731/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:15 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1686 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:16.670470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:16.694968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:16.695459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:16.695897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:16.713405 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] Creating event network-changed:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:57:16.729216 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e4c6fd85-9f49-43a6-9173-bffa62ae8da5 req-2d9ac371-94ce-49bc-84db-3596999302c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067856 Oct 13 08:57:16.739558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2732/5113] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:16.745220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:16.751463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:16.765167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:16.765928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:16.766614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:16.767710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:16.768373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:16.768971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:17.167010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:17.177662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:17.179462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:17.181432 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-838beb8a-bf78-49ea-aee7-da7822804993 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.440445 Oct 13 08:57:17.182506 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2733/5114] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:16 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:17.195655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-plugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:17.208201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:17.208951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:17.209548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:17.224238 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] Creating event network-vif-plugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:57:17.231665 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-59a95fd5-1fa7-48e7-92df-81d4029aca51 req-d421bb55-a13f-4976-a782-02d7e692d3a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046883 Oct 13 08:57:17.232832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2734/5115] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:17.366491 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-70639b5c-acd8-4ca1-b6df-d89cc367a27f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action" status: 202 len: 0 microversion: 2.1 time: 1.476386 Oct 13 08:57:17.367022 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2382/5116] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:15 2022] POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action => generated 0 bytes in 1478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:57:17.378190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89cc38db-0b68-4ce5-884e-d52b839cdbfa tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'create', calling method: .version_select at 0x7f537ab34e50>, body: {"pool": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:17.668011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:17.668606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:17.680451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:17.682082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:17.682587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:17.683642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:17.687040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:17.688029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:18.256228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:18.272259 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b4a89da-fadc-41ca-a880-da45a85d7287 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1686 microversion: 2.1 time: 0.608787 Oct 13 08:57:18.273901 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2383/5117] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:17 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1686 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:18.280569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:18.282471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:18.300715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:18.301749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:18.302854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:18.304035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:18.304857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:18.305876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:18.762256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:18.781102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:18.785646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:18.791578 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52b721bc-8d01-4010-acb6-4aa8a4831791 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.515542 Oct 13 08:57:18.792161 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2384/5118] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:18 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:18.841751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:18.854990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:18.855807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:18.856464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:18.870191 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] Creating event network-changed:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:57:18.877137 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d2f2da86-e532-4c4b-8909-7e1d25ef2ae8 req-435c7ced-bc85-4f21-b3c8-3f56e487d5c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Oct 13 08:57:18.878675 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2385/5119] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:19.306636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:19.307720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:19.328215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:19.331221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:19.332339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:19.334466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:19.336182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:19.336894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:20.171025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:20.188495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9186abc-a8a7-4921-891f-cd747738cbe3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.883169 Oct 13 08:57:20.194968 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2386/5120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:19 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:20.210946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:20.211914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:20.220021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:20.221747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:20.224032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:20.225071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:20.230139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:20.231037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:20.655780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:20.668672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:20.670676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:20.677942 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7109d3d0-d753-4b1e-9476-bb2e329892fc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.475819 Oct 13 08:57:20.683989 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2387/5121] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:20 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:21.217165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:21.217942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:21.231055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.232100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.232889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.237641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.245091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.246328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.617368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:21.625532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2618843-cb47-4834-a105-cd7996ac7815 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.412686 Oct 13 08:57:21.633205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2388/5122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:21 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:21.709919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:21.711038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:21.713533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89cc38db-0b68-4ce5-884e-d52b839cdbfa tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.339476 Oct 13 08:57:21.715119 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2735/5123] 10.222.0.23 () {60 vars in 1170 bytes} [Thu Oct 13 08:57:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:21.718572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.719063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.723456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.726661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.727312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.727945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.729133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.234"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:21.732690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:21.758848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.760003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.760827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.761784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:21.762583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:21.763275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:21.845873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:57:21.848562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquired lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:57:22.264052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:22.274155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:22.284625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:22.285879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a7991c36-a851-4822-ba27-aba9f5d13cb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.580187 Oct 13 08:57:22.307604 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2389/5124] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:21 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:22.663410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:22.664219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:22.691387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:22.692690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:22.694347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:22.697900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:22.701832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:22.702721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:22.761478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:23.009738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:23.020346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a2c7443-133c-4bde-84e3-97023b600844 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.363648 Oct 13 08:57:23.022748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2390/5125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:22 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:23.318812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:23.319541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:23.351950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:23.352447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:23.352879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:23.366904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:23.370316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:23.374528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:23.956403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:23.968790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:23.971641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:23.973060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71cc7858-add5-4573-a4fb-105ab82548bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.659180 Oct 13 08:57:23.974172 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2391/5126] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:23 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:24.048847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:24.049530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:24.057683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:24.059587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:24.060593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:24.063886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:24.064680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:24.066212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:24.288247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Building network info cache for instance {{(pid=127030) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:57:24.461639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:24.471912 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4919fd6-d7fc-44dc-b51c-cb9d4fcb8d77 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.427136 Oct 13 08:57:24.481815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2392/5127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:24 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:24.505331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:24.534388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:24.535179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:24.536062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:24.565732 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] Creating event network-changed:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:57:24.573512 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4047401f-d765-4ee0-b01f-132685cbd583 req-2482d9a2-de17-499b-95b2-322ab813697a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090320 Oct 13 08:57:24.579205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2393/5128] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:25.004387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:25.005089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:25.026840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:25.027628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:25.030597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:25.031341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:25.034001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:25.034001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:25.535735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Updating instance_info_cache with network_info: [{"id": "a3e6022e-da82-4f41-8d62-276ebcd594dc", "address": "fa:16:3e:e4:f1:94", "network": {"id": "5aab060a-b04a-4383-a35a-0a879d26467d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-362663555-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "06c10f60df4e46d197feaf50c61c9613", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3e6022e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:57:25.557707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Releasing lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:57:25.560529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3a3192e-de43-41ca-9c94-a22bd958013b tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action" status: 202 len: 0 microversion: 2.1 time: 3.835840 Oct 13 08:57:25.562110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2736/5129] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:21 2022] POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action => generated 0 bytes in 3839 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 13 08:57:25.575655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:25.578424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:25.602048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:25.604869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:25.605909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:25.607326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:25.608160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:25.608875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:25.669989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:25.920112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:25.934657 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c1082ed-83e5-4827-959f-4874d363b167 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.369221 Oct 13 08:57:25.936094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2737/5130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:25 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:25.951744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.234"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:25.963857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:25.982143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:25.987921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:25.996312 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-198b8540-2464-4d03-8184-bbd6fa1fb33a tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.996289 Oct 13 08:57:26.001073 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2394/5131] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:24 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:26.447967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:26.457090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:26.457620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:26.458295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:26.460207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:26.461888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:26.463868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:26.970801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:26.971540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:26.994054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:26.994576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:26.995021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:26.995754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:26.996221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:27.009672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:27.104274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 13 08:57:27.105308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquired lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 13 08:57:27.418570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:27.430149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-483f13f8-a948-4a77-b0fd-76e0ef10104b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.463801 Oct 13 08:57:27.431578 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2395/5132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:26 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:27.437563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-107757281", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "e0d9e8f6-5244-492f-99cc-4419f5d54963"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:27.510372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] validate_networks() for [('e0d9e8f6-5244-492f-99cc-4419f5d54963', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:57:28.229859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:57:28.231029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:57:28.232628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:57:28.233457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:57:28.234938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:57:28.248420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:28.249182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:28.249793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:28.252059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:28.252878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:28.254342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:28.282432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Getting quotas for project 5c1618924e3042deaa804928761e5930. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:57:28.292244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Getting quotas for user 87f44f47c72544daac503f4a0c1db525 and project 5c1618924e3042deaa804928761e5930. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:57:28.311967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:57:28.316521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:57:28.387471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bf76417-8acd-43c3-b5e3-38fa454bc4dc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954451 Oct 13 08:57:28.388250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2396/5133] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:57:28.396317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:28.397022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:28.404892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:28.405664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:28.406834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:28.408168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:28.408947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:28.409639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:28.708324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:28.726256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:28.747158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:28.754271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-398377d0-7f57-45e1-b0ac-29096c072088 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.363219 Oct 13 08:57:28.757983 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2397/5134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:28 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:28.780089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd2e9de-099f-4148-88e9-3b6fb5c0cac3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:28.783409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fd2e9de-099f-4148-88e9-3b6fb5c0cac3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:28.954348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fd2e9de-099f-4148-88e9-3b6fb5c0cac3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:28.966838 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fd2e9de-099f-4148-88e9-3b6fb5c0cac3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1218 microversion: 2.1 time: 0.207444 Oct 13 08:57:28.972473 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2398/5135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:28 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:28.989421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:28.990043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:28.998139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:28.998968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:28.999411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:29.000158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:29.001387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:29.001516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:29.156866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Building network info cache for instance {{(pid=127030) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 13 08:57:29.311900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:29.323678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-500b7ad6-dd68-4ad5-ba53-933cd0d5e980 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.347701 Oct 13 08:57:29.324305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2399/5136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:28 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:29.333316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:29.355200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:29.356112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:29.357117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:29.377857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] Creating event network-changed:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:57:29.385095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-972393d7-99d1-4798-9956-6770830433ab req-8ccc3d76-4db4-4bfc-97fb-cab35718c543 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059417 Oct 13 08:57:29.386781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2400/5137] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:29.786500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:29.788004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:29.802367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:29.803197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:29.803823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:29.805275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:29.805978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:29.806927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.272838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:30.293027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:30.294970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:30.296391 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aec69c05-0e2a-4d3f-bf54-67a4e7fc4597 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.516011 Oct 13 08:57:30.311462 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2401/5138] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:29 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:30.322167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:30.323727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:30.332194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.333299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.334237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.335997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.336766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.337436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.501330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:30.503142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Updating instance_info_cache with network_info: [{"id": "a3e6022e-da82-4f41-8d62-276ebcd594dc", "address": "fa:16:3e:e4:f1:94", "network": {"id": "5aab060a-b04a-4383-a35a-0a879d26467d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-362663555-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "06c10f60df4e46d197feaf50c61c9613", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa3e6022e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 08:57:30.519787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Releasing lock "refresh_cache-9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" {{(pid=127030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 13 08:57:30.520776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e5e2da4-4211-4933-94e8-55929fae1990 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action" status: 202 len: 0 microversion: 2.1 time: 4.583309 Oct 13 08:57:30.521838 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2738/5139] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:25 2022] POST /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843/action => generated 0 bytes in 4585 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 13 08:57:30.527795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad98b2e5-57c1-4221-8112-f463dec60cff tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1270 microversion: 2.1 time: 0.207093 Oct 13 08:57:30.528486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2402/5140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:30 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:30.532312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:30.532975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:30.542840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.543558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.544163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.545027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.545657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.546083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.567743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2404d786-6db2-41b7-90ee-3af8922d7dad tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '.version_select at 0x7f53755e5820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:30.799522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:30.808624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68a9b982-cbc0-42f8-a067-063d6f593b41 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.285608 Oct 13 08:57:30.809909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2739/5141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:30 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:30.852547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:30.854655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:30.862014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.862927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.863603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.864569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.865242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.865838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.921869 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-380cebe5-3add-4d1a-8c9d-e101534e0cea tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073406 Oct 13 08:57:30.923560 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2740/5142] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:57:30 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:30.935529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:30.936582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:30.944671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.945427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.946076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.947069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:30.947732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:30.948365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:30.984223 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a894d94-52af-44df-ad08-b4ae2cf8ddf9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131" status: 200 len: 194 microversion: 2.1 time: 0.053971 Oct 13 08:57:30.985726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2741/5143] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 08:57:30 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:31.327248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:31.328457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:31.337210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:31.340057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:31.342042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:31.348162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:31.349098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:31.350572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:32.009335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:32.040123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:32.053445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:32.055537 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4130fbf4-d166-43af-ab22-2ecf5e6e98bc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.733271 Oct 13 08:57:32.064784 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2742/5144] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:31 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:32.083985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:32.087860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:32.120798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:32.121320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:32.121781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:32.122545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:32.139886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:32.140074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:32.340733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:32.362293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c10bad8b-cc6e-401a-b858-be9d49837cb8 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1276 microversion: 2.1 time: 0.294432 Oct 13 08:57:32.363038 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2743/5145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:32 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:32.386172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:32.399540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:32.415499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:32.417664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:32.425855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:32.427036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:32.428117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:32.428754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:32.682106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:32.690906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8dad7e60-d0e5-43a3-8f34-0ef2047f7807 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.325771 Oct 13 08:57:32.717299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2744/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:32 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:33.097536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:33.099142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:33.112595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.113610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.114369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:33.116975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.118033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.124032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:33.188301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2404d786-6db2-41b7-90ee-3af8922d7dad tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/953956f5-907a-401d-a4e9-9502a1bcdaf2" status: 202 len: 0 microversion: 2.1 time: 2.642929 Oct 13 08:57:33.189755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2403/5147] 10.222.0.23 () {58 vars in 1263 bytes} [Thu Oct 13 08:57:30 2022] DELETE /compute/v2.1/os-floating-ips/953956f5-907a-401d-a4e9-9502a1bcdaf2 => generated 0 bytes in 2661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:57:33.199768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d195ede1-fbc5-4476-8683-6f1df99cf479 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '.version_select at 0x7f5375c20af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:33.747374 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d195ede1-fbc5-4476-8683-6f1df99cf479 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/96848a52-0937-4382-a8a1-7a16a0abae72" status: 202 len: 0 microversion: 2.1 time: 0.551910 Oct 13 08:57:33.748268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2404/5148] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 08:57:33 2022] DELETE /compute/v2.1/os-security-groups/96848a52-0937-4382-a8a1-7a16a0abae72 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:57:33.754720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:33.755700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:33.791854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:33.805065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.807278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.808316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:33.809519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.811260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.811997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:33.821457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:33.822940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:33.824128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3adb092-62ab-4054-898f-48e73fbb807f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.732236 Oct 13 08:57:33.824697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2745/5149] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:33 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:33.873044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:33.874698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:33.882879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.883643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.884283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:33.886227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:33.886938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:33.887604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.219701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:34.243312 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-886cab52-5506-4592-b36f-dd5ccd7fb5fa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.370896 Oct 13 08:57:34.244545 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2746/5150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:33 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:34.266541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:34.267206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:34.278002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.279048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.279940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.280902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.282123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.282843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.350750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:57:34.387151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:34.396775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3bc2044a-e4a8-47a2-a285-6e2715af9316 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.647192 Oct 13 08:57:34.418653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2405/5151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:33 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:34.432781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aebaa031-90d0-4dfb-8204-f10a687b7f98"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:34.436615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:34.447981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.451044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.453998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.454997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.456498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.458265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.536831 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd5e7e5f-96d7-4ec9-a5e9-1008315c36c5 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 204 len: 0 microversion: 2.1 time: 0.287444 Oct 13 08:57:34.538725 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2747/5152] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:57:34 2022] DELETE /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:57:34.551746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:34.552732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:34.563972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.564652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.565285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.566379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.567198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.567799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.865571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:34.881350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-abdb553b-ed30-45bd-ac9e-f14dc086cd60 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1510 microversion: 2.1 time: 0.338659 Oct 13 08:57:34.888376 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2748/5153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:34 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:34.906567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:34.907713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:34.928047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.929613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.931918 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95a0243d-e119-4703-bc83-6af22413cbdb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "POST /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511025 Oct 13 08:57:34.932174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.932909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2406/5154] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:57:34 2022] POST /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:34.935669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.936629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.937393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:34.964979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd85a03-ffe1-4235-9a08-7d405afca0ec", "tag": "85733ca2-fb6f-4b38-9d03-062cd363dc6b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:34.990903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:34.991700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:34.992310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.051804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] Creating event network-changed:85733ca2-fb6f-4b38-9d03-062cd363dc6b for instance dcd85a03-ffe1-4235-9a08-7d405afca0ec on n-h2-858384-11 Oct 13 08:57:35.070041 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-45da1ce1-8250-42c1-98a0-e59f63ebd433 req-39a4e3a5-385d-4904-ba0c-3a1b54520e52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135460 Oct 13 08:57:35.071044 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2407/5155] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:35.285323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:35.287282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:35.295927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.296837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.297649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.298644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.299346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.300010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.510437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:35.524380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:35.526119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:35.527730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76ed99a2-7817-43d6-9b34-3fcdac9994e6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.634653 Oct 13 08:57:35.528810 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2749/5156] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:34 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:35.534790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:35.536204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:35.550224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.551627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.553880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.555727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.556732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.557824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.762551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:35.771310 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71732433-b956-4a42-8fbb-e1dd1b646cdd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.241233 Oct 13 08:57:35.773249 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2750/5157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:35 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:35.806650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:35.815573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8718927b-6e13-4e9f-a4fe-1d5a8db9b0e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.536459 Oct 13 08:57:35.818108 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2408/5158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:35 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:35.922968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:35.924221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:35.933786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.934871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.935689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.937583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:35.938728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:35.939832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:35.967783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:36.173021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:36.182638 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f09a7a2f-e4aa-4377-aeb5-ff35d2625c3f tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1510 microversion: 2.1 time: 0.266051 Oct 13 08:57:36.183915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2751/5159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:35 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:36.556280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:36.557213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:36.570953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:36.571992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:36.573721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:36.575898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:36.577321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:36.578871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:36.797171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:36.797790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:36.809216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:36.809919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:36.817737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:36.818847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:36.830810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:36.831623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:37.150391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:37.164097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e09ab5b5-926e-4d0a-a9d5-5463d3aa1678 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.369904 Oct 13 08:57:37.185568 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2752/5160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:36 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:37.194600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:37.196495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:37.204244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:37.220030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:37.222958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:37.224763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:37.225939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:37.227693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:37.229773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:37.501840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:37.515083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:37.523581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:37.525195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db546451-75ef-45d6-b5de-97fe276d4592 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.973771 Oct 13 08:57:37.527425 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2409/5161] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:36 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:37.539888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:37.541914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:37.558761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:37.562009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:37.562866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:37.565278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:37.566045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:37.567790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:37.739678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:37.760167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7fdc9b09-bc17-47bf-956d-9d5fc7afc027 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.569244 Oct 13 08:57:37.763624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2753/5162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:37 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:38.100848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:38.135896 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3a4200e9-e2c0-4970-826e-fb57fe8adc16 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1510 microversion: 2.1 time: 0.607018 Oct 13 08:57:38.137308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2410/5163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:37 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:38.193802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:38.195091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:38.208074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.208801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.209438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.214022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.214716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.221249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.467290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:38.476835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ccec25bd-f49b-4c33-86f2-e7d1262d20a6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.286953 Oct 13 08:57:38.489333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2754/5164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:38 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:38.554678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:38.555360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:38.558614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:38.569950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.583238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.584021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.588513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.591897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.595312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.620818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:38.787725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:38.788715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:38.801889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.804726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.806777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.807782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:38.810277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:38.811050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:38.959857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:39.107988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:39.121998 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd602713-4244-4d28-930f-dbcd53e22423 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.338863 Oct 13 08:57:39.138072 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2755/5165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:38 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:39.165046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:39.165768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:39.178262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:39.179067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:39.180967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:39.181964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:39.184416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:39.187416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:39.365240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:39.376314 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f12c9a4-a355-4cd1-9a1a-9baba102d781 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1468 microversion: 2.1 time: 0.214275 Oct 13 08:57:39.377099 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2756/5166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:39 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:39.505824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:39.506861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:39.524340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:39.525213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:39.525918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:39.526917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:39.527620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:39.528291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:39.735966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:39.750419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:39.756308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:39.763429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-439baf83-be10-4c58-9550-bb6c2bbff3f4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 1.212598 Oct 13 08:57:39.773407 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2411/5167] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:38 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:39.807407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b54ebbd-048b-4251-9d2f-ae9f6f5c3843", "name": "network-vif-deleted", "tag": "a3e6022e-da82-4f41-8d62-276ebcd594dc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:39.821415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:39.826859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:39.830885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:39.878172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] Creating event network-vif-deleted:a3e6022e-da82-4f41-8d62-276ebcd594dc for instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 on n-h1-858384-11 Oct 13 08:57:39.893388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9ec4b30c-ad97-4f9a-821b-029deff4d0ed req-14452ff1-6fc9-4d3b-a309-00a0bdef8246 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090777 Oct 13 08:57:39.897189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2412/5168] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:40.147899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:40.149154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:40.166939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.172371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.175789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.178594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.182018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.186199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.257577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:40.267938 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba63460a-5a4c-4dbb-90bb-b17fea42defc tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.765830 Oct 13 08:57:40.272817 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2757/5169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:39 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:40.405731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:40.407296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:40.420269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.421267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.422584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.423572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.424336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.425003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.487598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.488348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.488958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.489487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lazy-loading 'fault' on Instance uuid 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:57:40.705260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:40.727625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3def4ff04d90453c86a20abbc5a6d1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c10f60df4e46d197feaf50c61c9613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:40.736785 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5b88b55-8c5f-425c-b506-dea7d693a895 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.582083 Oct 13 08:57:40.740493 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-449ef2c2-931c-4526-901c-6ddda644efd3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 200 len: 1313 microversion: 2.1 time: 0.339024 Oct 13 08:57:40.740975 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2413/5170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:40 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:40.760093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2758/5171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:40 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:40.803208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:40.803924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:40.827495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.828158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.828690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:40.830274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:40.830845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:40.831393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.297069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:41.297712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:41.315656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.319283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.322221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.327330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.329627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.330954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.661631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:41.677853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:41.684369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:41.685879 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0816d909-1b73-4141-8600-e72a15747bc2 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.886621 Oct 13 08:57:41.687237 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2414/5172] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:40 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:41.766556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:41.767343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:41.779132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:41.782093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.782768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.783322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.784296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.786818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.787434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.845172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:41.856773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a950eca7-976a-4614-ada4-038027ca8bbd tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.563501 Oct 13 08:57:41.860503 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2759/5173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:41 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:41.894710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:41.895832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] [instance: 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:41.914470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.915327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.915998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.917412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:41.918133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:41.918802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:41.959452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] HTTP exception thrown: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Request method failure captured: Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 HTTP/1.1 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9KrtxdbtRFe1ML_w6D55h79i1f8MCKmP18ONMaEGHHdD7mMenC-CPdkeUQyK9c3MA6sIM13c_uzfZLkQrz3FZMJXIyUp4a3jhN39-ID-t2el-ZUiGVlcp-iBYTDICtfMzI6ipXTQYRoB1SeEstQO5fdKYd_wGtAjs1zr2dAesR7vwg Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 06c10f60df4e46d197feaf50c61c9613 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-752191757 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06c10f60df4e46d197feaf50c61c9613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_06c10f60df4e46d197feaf50c61c9613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06c10f60df4e46d197feaf50c61c9613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/06c10f60df4e46d197feaf50c61c9613"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-752191757 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 06c10f60df4e46d197feaf50c61c9613 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-752191757 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerRescueTestJSONUnderV235-752191757-project Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3def4ff04d90453c86a20abbc5a6d1c4 Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-752191757-project Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '9b54ebbd-048b-4251-9d2f-ae9f6f5c3843'} Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:57:41.961755 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. Oct 13 08:57:41.966949 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:57:41.971322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] Returning 404 to user: Instance 9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:57:41.972460 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3200ac30-3bb8-4a24-8956-f86a5910c4f3 tempest-ServerRescueTestJSONUnderV235-752191757 tempest-ServerRescueTestJSONUnderV235-752191757-project] 10.222.0.23 "GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843" status: 404 len: 111 microversion: 2.1 time: 0.094556 Oct 13 08:57:41.975311 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2760/5174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:41 2022] GET /compute/v2.1/servers/9b54ebbd-048b-4251-9d2f-ae9f6f5c3843 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:57:42.348529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:42.367258 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d3f46eca-a1c7-4f5a-91e1-03d90f262f78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.606689 Oct 13 08:57:42.368249 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2415/5175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:41 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:42.715023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:42.715786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:42.728075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:42.728573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:42.729013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:42.730836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:42.735320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:42.735906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:42.898492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:42.899193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:42.912622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:42.915360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:42.916821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:42.919239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:42.920912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:42.921546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:43.215631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:43.241570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:43.246672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:43.247929 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61c60544-1571-4569-8da2-aa458fb8db42 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.537130 Oct 13 08:57:43.250735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2761/5176] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:42 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:43.396565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:43.397503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:43.412116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:43.413187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:43.419035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:43.422594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:43.423305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:43.425658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:43.530742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:43.552614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4eaa5523-75f5-4cfa-923f-b8cb8eab596b tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.660583 Oct 13 08:57:43.574279 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2416/5177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:42 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:43.732669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:43.748306 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dfe94694-6649-4c8e-8aab-5cc86e14d094 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.355900 Oct 13 08:57:43.760761 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2762/5178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:43 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:43.841745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:43.842391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:43.856205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:43.857218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:43.858979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:43.861636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:43.868075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:43.868664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:43.914680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb25cc65-838d-465a-8d91-abafca0eb673 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.086279 Oct 13 08:57:43.922802 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2417/5179] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:57:43 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:44.284685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:44.285996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:44.303790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.311227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.312146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:44.315489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.319303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.319953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:44.577456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:44.577920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:44.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:44.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.619325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:44.893968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:44.905642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:44.907518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:44.909053 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c11c3199-3e29-4e08-b55e-a4ee5785e60f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.635628 Oct 13 08:57:44.910127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2763/5180] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:44 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:44.923010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:44.923871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:44.930791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.931635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.932260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:44.933937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:44.934618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:44.935223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:45.094105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:45.122155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ac4b3b0-c30b-46b0-b60d-f01ca2e07d04 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.533638 Oct 13 08:57:45.123707 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2418/5181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:44 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:45.243650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:45.263000 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b49beb6-2342-4d79-b93a-9d7d0d9146b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1681 microversion: 2.1 time: 0.349814 Oct 13 08:57:45.265671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2764/5182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:45.939207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:45.940248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:45.953865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:45.954688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:45.955296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:45.956185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:45.957000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:45.957604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.153608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:46.154229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:46.170308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.170841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.171255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.172397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.172780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.173220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.400062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:46.410465 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4398faca-47c2-43c4-974a-ad7eeecc0b49 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.260898 Oct 13 08:57:46.425105 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2765/5183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:46 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:46.430705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:46.431319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:46.440108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.440647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.441100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.441824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.442364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.442777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.524716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:46.535917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:46.537380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:46.538601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c42ed2d6-8ee9-4bfb-947d-5afa10944980 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.606570 Oct 13 08:57:46.544812 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2419/5184] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:45 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:46.633285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:46.646747 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-850b46ce-0303-4f39-a3d5-ad53c7fde338 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.220150 Oct 13 08:57:46.648154 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2766/5185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:46 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:46.777726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:46.778641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:46.785307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.785989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.786656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.788033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.788686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.789264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.923776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c182a9fb-a00b-434d-8f38-1bd1f588c019"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:46.926239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:46.932532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.933023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.933467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:46.934381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:46.935034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:46.935656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:47.136874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:47.146156 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d46c06b4-3277-4159-987b-5892df21c2f7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.372222 Oct 13 08:57:47.146998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2420/5186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:46 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:47.228399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:47.296646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8a1fc20-5407-4e6d-a17c-862ac181edb8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376995 Oct 13 08:57:47.298618 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2767/5187] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:57:46 2022] POST /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:47.442059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:47.444306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:47.464281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:47.465116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:47.465808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:47.467104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:47.468425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:47.469143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:47.568607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:47.569313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:47.596487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:47.597408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:47.597841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:47.598604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:47.599057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:47.599837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:47.868581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:47.881508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a374de0-6136-4295-8c8d-bf341668add5 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.449201 Oct 13 08:57:47.882126 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2421/5188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:47 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:48.769084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:48.787176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:48.792495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:48.800169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b97b17a3-896d-4445-9fae-49bcf9017f04 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 1.231914 Oct 13 08:57:48.815251 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2768/5189] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:47 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:48.905926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:48.909479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:48.930261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:48.934340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:48.936382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:48.938257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:48.939835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:48.943652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.190952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:49.191643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:49.212333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.213094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.213572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.214309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.214795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.215220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.507066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:49.524042 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94fac7ec-7c46-471b-b059-526465e16afc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.337574 Oct 13 08:57:49.526971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2769/5190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:49 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:49.553839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:49.557363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:49.601819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.602318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.606779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.607549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.608024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.608464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.659138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:49.674016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50a3b0ac-0f92-45c9-a946-5e5d49313f4d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.768267 Oct 13 08:57:49.676911 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2422/5191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:48 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:49.846545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:49.852153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:49.867759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.868779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.870021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:49.873321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:49.875416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:49.876156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.036754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:50.051496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79b33c5e-6462-4b47-96cc-0f0ba6f690f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.503726 Oct 13 08:57:50.053380 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2770/5192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:49 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:50.101540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "19000e35-57c3-405f-89d5-1b2f93667c01"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:50.131918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.134256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.136661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.185081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] Creating event network-vif-plugged:19000e35-57c3-405f-89d5-1b2f93667c01 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:50.200565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2bdcef92-52d9-4281-8a71-d8b72e5e9bf3 req-b6748018-750b-4caa-88c5-d12e1af7bac5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122265 Oct 13 08:57:50.208705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2771/5193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:50.221689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:50.223330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:50.240958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.241766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.243153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.244078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.245137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.247308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.529118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:50.541062 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f017201d-5ba6-4ffe-9d79-236f8f334ef7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.329622 Oct 13 08:57:50.542035 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2772/5194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:50.568590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:50.571242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:50.581866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.583726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.585430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.587469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.589203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.589704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.626778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:50.658996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:50.666518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:50.674166 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5869e93a-43f8-4a19-824e-72a442acdd93 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.838691 Oct 13 08:57:50.679871 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2423/5195] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:49 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:50.704949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:50.707116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:50.721517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.722308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.723800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.724730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.739717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.741595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.759025 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31fd0a32-6209-4cb2-8217-4e9a5525ba73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.191104 Oct 13 08:57:50.764972 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2773/5196] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:50 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:57:50.773402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:50.791046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:50.805557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.813944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.815370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.821684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.822595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.823107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.904145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c81d9570-b7b6-4f6c-9e86-c0e1bb793db5 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.135097 Oct 13 08:57:50.905548 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2774/5197] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:57:50 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:50.914506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:50.919948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:50.937583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.938093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.938633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:50.946263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:50.946866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:50.947394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.548975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:51.573358 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b477e79-7756-4aa0-ba39-455010880292 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1670 microversion: 2.1 time: 0.665061 Oct 13 08:57:51.577207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2775/5198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1670 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:51.584685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:51.595634 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c27a64a-cb02-43d8-8b5b-e55064915552 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.897158 Oct 13 08:57:51.596531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:51.598212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:51.626374 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2424/5199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:50 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:51.629395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.634348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.634875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.635635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.636113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.636549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.705088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:51.705896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:51.723952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.724570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.725126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.725957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.726927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.727839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.732546 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ab1cf99-81d5-45a5-91b9-0d728469e4d9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131" status: 200 len: 194 microversion: 2.1 time: 0.152402 Oct 13 08:57:51.737014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2776/5200] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 08:57:51 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:51.748214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:51.750638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:51.771287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.774188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.775810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:51.777598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:51.779003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:51.780179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.013983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lazy-loading 'services' on Instance uuid fe63e6ce-008c-42fe-bc1a-08074bddc761 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:57:52.226859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1a6c55c1-547e-4eb0-a596-921a6728ae1c tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131" status: 202 len: 0 microversion: 2.1 time: 0.485437 Oct 13 08:57:52.231630 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2777/5201] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:57:51 2022] DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/e0770f08-b326-4a84-b9e0-3529de0d5131 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:57:52.248343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "afb29497-31a2-4019-b86d-20fc1d02f81e"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "a1303ad6-f0c5-46da-8664-cbc040d72825"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "603d44c4-9c9d-4c91-a69d-281b2bfcc655"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "01e186e1-d83c-443f-8e64-efaaf93dc4f0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:52.282682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:52.283947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:52.286361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.320209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Creating event network-vif-plugged:afb29497-31a2-4019-b86d-20fc1d02f81e for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:52.325665 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Creating event network-vif-plugged:a1303ad6-f0c5-46da-8664-cbc040d72825 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:52.326680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Creating event network-vif-plugged:603d44c4-9c9d-4c91-a69d-281b2bfcc655 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:52.327675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] Creating event network-vif-plugged:01e186e1-d83c-443f-8e64-efaaf93dc4f0 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:52.340692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8ba29447-1f27-4d0c-9e1b-77eea5adb6a1 req-bda46692-7231-48ad-9e36-54754a459443 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.102997 Oct 13 08:57:52.344772 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2778/5202] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:52.532346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:52.543650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:52.556681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:52.560411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-381e707e-87d9-4f6e-9d70-5147d6735c01 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.857998 Oct 13 08:57:52.574438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2425/5203] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:51 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:52.607910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:52.612048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:52.622472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:52.624623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:52.637006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:52.637581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:52.638487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:52.638990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:52.639681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.641559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:52.642656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.643522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:52.644203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.650665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:52.651183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:52.655361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:52.906946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:52.914983 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7982b0e-066a-4431-87ec-36c6d161abbc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1670 microversion: 2.1 time: 0.313619 Oct 13 08:57:52.917480 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2779/5204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:52 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1670 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:53.029807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:53.038147 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9b0bfa9-33d2-4f35-a345-f3f79d5ef826 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.420855 Oct 13 08:57:53.063984 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2426/5205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:52 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:53.596392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:53.598456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:53.613433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:53.616218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:53.616964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:53.618812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:53.620554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:53.621631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:53.945362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:53.946048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:53.963354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:53.963860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:53.964310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:53.965050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:53.965508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:53.965945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:53.989489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:54.014391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:54.021288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:54.025017 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9fb92a5-1170-4d3c-9993-2067b86d0e89 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.436115 Oct 13 08:57:54.028403 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2780/5206] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:53 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:54.070254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:54.071238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:54.080899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.083025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.083731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.084810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.085446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.086079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.459116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:54.473670 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5708db40-b363-4793-9151-a2bc8587d1a2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.404352 Oct 13 08:57:54.475171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2781/5207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:54 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:54.486616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "a00270e9-c028-4ccb-830f-06b0da6b95bc"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-plugged", "status": "completed", "tag": "5e71739d-9381-4cde-b83b-8bfabaab47db"}, {"server_uuid": "dcd85a03-ffe1-4235-9a08-7d405afca0ec", "name": "network-vif-plugged", "status": "completed", "tag": "85733ca2-fb6f-4b38-9d03-062cd363dc6b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:54.486928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:54.506135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9e63061-4175-46ed-a9f0-af32d3aa6c8f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.565640 Oct 13 08:57:54.508103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.508849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.509589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.509738 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2427/5208] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:53 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:54.534719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Creating event network-vif-plugged:a00270e9-c028-4ccb-830f-06b0da6b95bc for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:54.535598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Creating event network-vif-plugged:5e71739d-9381-4cde-b83b-8bfabaab47db for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:57:54.536362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] Creating event network-vif-plugged:85733ca2-fb6f-4b38-9d03-062cd363dc6b for instance dcd85a03-ffe1-4235-9a08-7d405afca0ec on n-h2-858384-11 Oct 13 08:57:54.541092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:54.544746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:54.570691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c5a26ecf-e60e-4bb6-926c-a8a7caee00b8 req-797caa0d-8301-482e-9000-56bca9d9733d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093435 Oct 13 08:57:54.572015 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2782/5209] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:54.579073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.588882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.589558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.590358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.591126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.591496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.737954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38632b25-d410-43e5-833d-932120e411bc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 200 len: 324 microversion: 2.1 time: 0.202169 Oct 13 08:57:54.739327 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2428/5210] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:57:54 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:57:54.751487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:54.752347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:54.783417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.784557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.788841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:54.791696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:54.792810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:54.794997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.059444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:55.060439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:55.083212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.084385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.091086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.096171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.097690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.098444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.114781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:55.457024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:55.465864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-366ab6c3-6b72-4f90-a764-19c268f29ffe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.720494 Oct 13 08:57:55.469386 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2783/5211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:54 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:55.500480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:55.501599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:55.521044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.521543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.526992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.527950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.529013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.530516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.538245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:57:55.628768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:55.668813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:55.672754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:55.678736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1387d0b-ecdd-41d0-9e98-90fa09c76a12 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.624228 Oct 13 08:57:55.679569 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2429/5212] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:55 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:55.696979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:55.706257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:55.733321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.733883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.737561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.738353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:55.738866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:55.739307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:55.910590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:55.921841 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afe59b72-68e6-490d-84c5-28151b936911 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 0.426097 Oct 13 08:57:55.924054 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2784/5213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:55 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:57:56.115996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:56.134353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2fbfe32-0c35-4e9b-89a1-33343c88015a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.450282 Oct 13 08:57:56.135774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2430/5214] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:55 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:56.161997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:56.163146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:56.171499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:56.173226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:56.173978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:56.175082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:56.175837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:56.176493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:56.611796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-unplugged", "status": "completed", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:56.636951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:56.637508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:56.642941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:56.676541 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] Creating event network-vif-unplugged:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 08:57:56.695518 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-95c1ad76-fd35-4235-a531-7ce6e22e2e78 req-51f334ef-bda3-4097-bf95-25f9b6f65561 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089309 Oct 13 08:57:56.698645 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2431/5215] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:57:56.721012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:56.722074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:56.732004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:56.732878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:56.742678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:56.743868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:56.744586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:56.745280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:56.982033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:56.996325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f626414-804f-478c-8d98-8e0067c6522f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.838109 Oct 13 08:57:56.998969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2785/5216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:56 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:57.071829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:57.078680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:57.100179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:57.102693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:57.104585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:57.106036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:57.108057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:57.108512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:57.512770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:57.538826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:57.542172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:57.548511 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88255181-aab1-408f-9b63-9fd139b38800 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1880 microversion: 2.42 time: 0.840771 Oct 13 08:57:57.551849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2432/5217] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:56 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1880 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:57.565558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:57.568780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:57.585259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:57.592440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:57.593765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:57.600933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:57.605840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:57.620036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:58.437665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:58.457589 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10b86bc0-8b1c-498e-8e08-e261f89735b2 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1318 microversion: 2.1 time: 1.409350 Oct 13 08:57:58.460544 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2786/5218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:57 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1318 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:58.587484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:58.588361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:58.591314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:58.605986 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f5263ce-903c-47e7-ab3e-a24af3769126 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 1.048598 Oct 13 08:57:58.610341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2433/5219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:57 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:57:58.625663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:58.627935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:58.631415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:58.632772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:58.633834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:58.635423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:58.921347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-899889785", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "b7a3a358-8f5e-4e38-984b-35dd1ec4122e"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:57:59.062776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] validate_networks() for [('b7a3a358-8f5e-4e38-984b-35dd1ec4122e', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:57:59.398531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:59.409510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:59.419853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:57:59.421966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bc77b33-afb1-4fae-88ba-5c24dc0ffa25 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2839 microversion: 2.42 time: 0.839017 Oct 13 08:57:59.425864 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2787/5220] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:57:58 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2839 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:57:59.454099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:59.455585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:59.481188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:59.489046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:59.494390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:59.495199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:59.498672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:59.499375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:59.820798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-603034e5-edfe-42b2-a030-4be8726336a4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.371334 Oct 13 08:57:59.821991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2788/5221] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:57:59 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f/os-interface => generated 1832 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 08:57:59.827434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:57:59.828062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:57:59.845841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:59.846336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:59.846809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:57:59.847597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:57:59.848056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:57:59.848484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:00.438707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:00.460515 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32daaf13-6570-4567-bfc8-96cdc56cca8c tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1507 microversion: 2.1 time: 0.637314 Oct 13 08:58:00.462084 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2789/5222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:57:59 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:00.492429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d276f6-1d6c-4ac5-b832-3b1b08152397", "device": "/dev/sdb"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:00.496303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:00.512300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:00.513171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:00.515512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:00.519341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:00.520150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:00.520827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:01.109271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df4bb2ad-b8ba-4f2e-a48b-f1901c285e24 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "POST /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619308 Oct 13 08:58:01.110132 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2790/5223] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:58:00 2022] POST /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:01.251256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:58:01.252253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:58:01.252974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:58:01.253672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:58:01.254349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:58:01.273469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:01.278270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:01.279056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:01.280071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:01.286486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:01.287621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:01.334961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:01.368520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:01.416242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:58:01.426163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:58:01.556134 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f31144b1-840e-40ad-9f37-85db7b43f7f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.638891 Oct 13 08:58:01.564945 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2434/5224] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 08:58:01.568967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aeb6863e-86e8-45b5-b2da-80ffbfab0884 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:01.569688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aeb6863e-86e8-45b5-b2da-80ffbfab0884 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:01.755356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aeb6863e-86e8-45b5-b2da-80ffbfab0884 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:01.766123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aeb6863e-86e8-45b5-b2da-80ffbfab0884 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1214 microversion: 2.1 time: 0.201781 Oct 13 08:58:01.767895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2791/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:01 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:02.796058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:02.796761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:02.825565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:02.826369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:02.835261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:02.836967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:02.844579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:02.845391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:03.147257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:03.160284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f9bd09df-d7af-4d7b-b25a-9e2b2503a8c7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1218 microversion: 2.1 time: 0.369363 Oct 13 08:58:03.168709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2435/5226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:02 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:03.838992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "tag": "a1303ad6-f0c5-46da-8664-cbc040d72825"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:03.883457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:03.912179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:03.913413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:03.969108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] Creating event network-changed:a1303ad6-f0c5-46da-8664-cbc040d72825 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 08:58:03.996757 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-29a78750-97aa-4604-84f8-d291b368b77e req-a1b2b79e-1b6d-467b-b3ef-9e188edf6a91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166511 Oct 13 08:58:04.000711 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2792/5227] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:04.195422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:04.196707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:04.213138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:04.221062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:04.228402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:04.229650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:04.233016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:04.236042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:04.884372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:04.902050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef38fc71-fc6c-470e-be0f-15897aa7687d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1274 microversion: 2.1 time: 0.709862 Oct 13 08:58:04.911887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2436/5228] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:04 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1274 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:05.944863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:05.946460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:05.963319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:05.968605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:05.970798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:05.982743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:05.993153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:05.997606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:06.351522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:06.360376 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47bcb773-acd3-4853-beca-46292b11a061 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1272 microversion: 2.1 time: 0.430786 Oct 13 08:58:06.362227 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2793/5229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:05 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1272 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:07.394261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:07.395354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:07.542925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:07.553212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.071s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:07.565932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:07.570502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:07.572119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:07.572577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:07.760472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:07.760985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:07.780092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=86 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:07.788582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:07.792368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:07.796520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:07.798982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:07.803029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:07.803475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:07.989307 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06a915be-02e6-4e2e-8aef-53e52de21126 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/aebaa031-90d0-4dfb-8204-f10a687b7f98" status: 200 len: 194 microversion: 2.1 time: 0.217386 Oct 13 08:58:07.993514 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2794/5230] 10.222.0.23 () {58 vars in 1413 bytes} [Thu Oct 13 08:58:07 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/aebaa031-90d0-4dfb-8204-f10a687b7f98 => generated 194 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:08.017524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:08.018587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:08.033033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:08.040834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:08.042243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:08.043219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:08.068811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:08.070939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:08.396467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lazy-loading 'services' on Instance uuid fe63e6ce-008c-42fe-bc1a-08074bddc761 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:58:08.475216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:08.496667 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-482d7020-a914-48f3-81ca-4c33c877abf8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 1.107802 Oct 13 08:58:08.497575 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2437/5231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:07 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:08.518755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-03064fb4-4ed0-4633-af05-1a0e77365a94 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: .version_select at 0x7f53756b5e50>, body: {"keypair": {"name": "tempest-keypair-2135380825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxebln5nZeHj+RT/5JMTeyR1YpB6/0SwkkyFpnJ8EOuahEuQpu5Af5EBAgSOlXzvJqY6NtuNYR9kGMjvi47RP1p3jcUgFkx50AY7GJtRwAuMG3YYj0pnB7tqpVN94VnXQ=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:08.582142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-03064fb4-4ed0-4633-af05-1a0e77365a94 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:08.594723 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d075423-fed1-465e-b5dd-025f93794adb tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/aebaa031-90d0-4dfb-8204-f10a687b7f98" status: 202 len: 0 microversion: 2.1 time: 0.595606 Oct 13 08:58:08.603003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2795/5232] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:58:07 2022] DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments/aebaa031-90d0-4dfb-8204-f10a687b7f98 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:58:08.607295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-03064fb4-4ed0-4633-af05-1a0e77365a94 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:08.644275 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-03064fb4-4ed0-4633-af05-1a0e77365a94 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145142 Oct 13 08:58:08.645581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2438/5233] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:58:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:09.525686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:09.526634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:09.556585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:09.561014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:09.563788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:09.565001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:09.569247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:09.569882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:09.822540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-128110245", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:09.974070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] validate_networks() for [('f016b286-7e2f-4836-80be-a205528d3fd1', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:58:10.382442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:10.394226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d071dda7-5160-45bf-a331-d2e56c991d62 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.870482 Oct 13 08:58:10.399964 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2439/5234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:09 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:10.990221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:58:10.991376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:58:10.992159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:58:10.992863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:58:10.993454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:58:11.010687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:11.023336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:11.023801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:11.025227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:11.025522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:11.025957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:11.098888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Getting quotas for project a5d7b7aa7f7d4f6c84189db0a530a1f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:11.128283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Getting quotas for user c4f7b7beca1944019b70932ebc6f553c and project a5d7b7aa7f7d4f6c84189db0a530a1f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:11.155930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:58:11.168789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:58:11.258084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2afc896a-9aa8-4e2d-b39a-1291a1e0cc24 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982529 Oct 13 08:58:11.259112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2796/5235] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:58:11.270792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27153f53-17eb-4b56-a25b-c9303f144f3b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:11.271431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27153f53-17eb-4b56-a25b-c9303f144f3b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:11.318537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:11.398911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27153f53-17eb-4b56-a25b-c9303f144f3b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:11.409939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27153f53-17eb-4b56-a25b-c9303f144f3b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1216 microversion: 2.1 time: 0.142047 Oct 13 08:58:11.411210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2440/5236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:11 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:11.426984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:11.427607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:11.440045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:11.440547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:11.440990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:11.441710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:11.442167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:11.453040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:11.662576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175e2d98-d9aa-46f7-adf1-2ce368904597", "tag": "42eae411-1007-40e2-975a-42934cc8a57d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:11.683153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:11.683645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:11.684086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:11.719080 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] Creating event network-changed:42eae411-1007-40e2-975a-42934cc8a57d for instance 175e2d98-d9aa-46f7-adf1-2ce368904597 on n-h1-858384-11 Oct 13 08:58:11.725231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e6dc7a1c-dd41-43cb-880a-adfb020c51de req-5c54bc64-5c19-45c1-b004-ee60fba5e805 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066810 Oct 13 08:58:11.725917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2441/5237] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:58:11.893709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:11.902925 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86554b0b-4dcb-49f5-a2e5-35996adcc4ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.481665 Oct 13 08:58:11.909091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2797/5238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:11 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:12.439227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:12.440543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:12.446175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442385321", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d510c72-59c1-4539-8bec-64f07cb7d4c4"}], "security_groups": [{"name": "tempest-securitygroup--1843060268"}], "key_name": "tempest-keypair-2135380825", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:12.473541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:12.474048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:12.477815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:12.482660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:12.484887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:12.489848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:12.528991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:12.654594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:12.663899 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7110de7-796f-4120-9f20-f177c9e4ed6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1212 microversion: 2.1 time: 0.230083 Oct 13 08:58:12.667969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2798/5239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:12 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1212 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:12.934337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:12.935002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:12.943206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:12.943965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:12.944577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:12.945555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:12.946232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:12.946854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:12.998839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] validate_networks() for [('6d510c72-59c1-4539-8bec-64f07cb7d4c4', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:58:13.125471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:13.143660 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff61502f-2afa-4aed-bbdd-2d1598149f0d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.213381 Oct 13 08:58:13.144183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2799/5240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:12 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:13.692636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:13.693320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:13.703349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:13.705364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:13.706118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:13.707198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:13.709351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:13.710033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:13.797960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:13.808741 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eafc228b-fbad-42a4-bf77-3f527fddceff tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1274 microversion: 2.1 time: 0.119918 Oct 13 08:58:13.809724 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2800/5241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:13 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:13.999608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:58:14.002689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:58:14.003492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:58:14.004893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:58:14.006296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:58:14.024128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.026495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.026495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.030470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.030470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.030470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.062004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:14.068316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:14.083419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:58:14.086175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:58:14.148085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-693395e9-4976-4940-a281-9c06b627851d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.735525 Oct 13 08:58:14.149579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2442/5242] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:58:14.162254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-243ec2a1-800f-4980-be80-e1a76f9e5145 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:14.163528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-243ec2a1-800f-4980-be80-e1a76f9e5145 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:14.202932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:14.203689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:14.210378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.210819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.211257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.211980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.212417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.212841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.305940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-243ec2a1-800f-4980-be80-e1a76f9e5145 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:14.324254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-243ec2a1-800f-4980-be80-e1a76f9e5145 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1241 microversion: 2.1 time: 0.167299 Oct 13 08:58:14.327639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2801/5243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:14 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:14.711212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:14.720036 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a83d86fc-6996-403d-b881-43d54e998003 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.550955 Oct 13 08:58:14.728773 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2443/5244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:14 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:14.836086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:14.837124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:14.855986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.857834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.858554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.861228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:14.862453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:14.864025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:14.903384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:15.002709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:15.026861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f535796-c379-41ea-a646-7b32b264df40 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1274 microversion: 2.1 time: 0.195838 Oct 13 08:58:15.027541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2802/5245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:14 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:15.353524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:15.354844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:15.365378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:15.366186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:15.368853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:15.370283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:15.370938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:15.373025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:15.755558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:15.756280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:15.766703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:15.767201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:15.770274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:15.771266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:15.771910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:15.773920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:15.922123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:15.948520 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c188bdb-7bb1-4771-82a8-8d0b43369b16 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1293 microversion: 2.1 time: 0.596947 Oct 13 08:58:15.949786 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2444/5246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:15 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:16.052300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:16.053124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:16.063182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:16.064199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:16.064891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:16.065865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:16.066641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:16.068032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:16.398353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:16.411612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63514439-7671-4b0f-afa5-d3e290ecc0d2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.365130 Oct 13 08:58:16.412675 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2445/5247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:16 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:16.536177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:16.559356 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95b1dc9b-063d-4894-8414-d7295e72ed3c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.808115 Oct 13 08:58:16.562363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2803/5248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:15 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:16.956927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175e2d98-d9aa-46f7-adf1-2ce368904597", "name": "network-vif-plugged", "status": "completed", "tag": "42eae411-1007-40e2-975a-42934cc8a57d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:16.976990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:16.977632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:16.990877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:16.991655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:16.992404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:16.993296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:16.993885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:16.995617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.004422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.005994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.006905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.040521 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] Creating event network-vif-plugged:42eae411-1007-40e2-975a-42934cc8a57d for instance 175e2d98-d9aa-46f7-adf1-2ce368904597 on n-h1-858384-11 Oct 13 08:58:17.049796 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d694e9d2-6c8f-4f25-98ce-a0441f68ba6f req-17801f79-1c59-4563-9fe7-e8da5ed622eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099182 Oct 13 08:58:17.053770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2446/5249] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:58:17.133583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:17.150680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68731cc2-8f58-448b-bc7a-9b1e5bd8804d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1299 microversion: 2.1 time: 0.177145 Oct 13 08:58:17.157650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2804/5250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:16 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:17.293833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:17.320598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.321206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.322359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.335644 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] Creating event network-changed:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h1-858384-11 Oct 13 08:58:17.341968 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ea003e4e-5d5b-4a0e-9e6f-f92d73cef347 req-3362e9e3-aa00-4042-b077-dfdc0367d9b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052969 Oct 13 08:58:17.343340 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2447/5251] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:17.438333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:17.439297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:17.451649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.452359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.453199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.453999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.454653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.455706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.585987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:17.587482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:17.594962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.595821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.596514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.597485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:17.598176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:17.598869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:17.799479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:17.810309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20c1e1d7-14cb-499b-9540-ad77486505ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1314 microversion: 2.1 time: 0.228731 Oct 13 08:58:17.813953 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2448/5252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:17 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:17.828997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:17.838822 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a436478-96e8-4400-a461-2959849e4c28 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.406526 Oct 13 08:58:17.839836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2805/5253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:17 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:18.175961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:18.176617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:18.188837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.189617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.190267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:18.191408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.192090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.192706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:18.638890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:18.653175 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-633431e9-2fc6-43e7-ba48-ba0b8ea2a7c1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.481933 Oct 13 08:58:18.655566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2449/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:18 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:18.835278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:18.835914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:18.844379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.845122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.845757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:18.846710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.847339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.847972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:18.867384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:18.868239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:18.878928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.881176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.887573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:18.888551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:18.889075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:18.890153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.089275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:19.103043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2724c4dd-7c18-4af9-99d0-f62c23a6173b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.239369 Oct 13 08:58:19.105942 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2450/5255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:18 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:19.112398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:19.115552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:19.133753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.134960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.134960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.135430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.136072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.136673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.171631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:19.177445 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73a168f5-50db-4e3c-8f7c-05f679a56510 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069746 Oct 13 08:58:19.178678 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2451/5256] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:58:19 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:58:19.360190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:19.368509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ab164c1-8909-4509-a609-bf2ea24e3c1e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1501 microversion: 2.1 time: 0.537425 Oct 13 08:58:19.369230 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2806/5257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:18 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1501 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:19.398471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:19.414329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.415103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.415628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.487405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Going to try to stop instance {{(pid=127031) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:58:19.532916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:19.536552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:19.555559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.562831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.563586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.564633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.565304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.566078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.601185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d1c0b07-9593-484f-829a-5b18c978a4db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597/action" status: 202 len: 0 microversion: 2.1 time: 0.208134 Oct 13 08:58:19.602817 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2452/5258] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:58:19 2022] POST /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:58:19.618509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:19.619271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:19.633478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.634507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.635613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.637999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.638731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.640280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.643386 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5883f86a-5604-41a2-92f5-06a4299b4df9 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116244 Oct 13 08:58:19.648639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2807/5259] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:58:19 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:58:19.678417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:19.679456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:19.685961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.686888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.687577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.689106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.689791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.690477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.888192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:19.902231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1569983b-f21c-4ce0-a916-7ccb914773b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.291620 Oct 13 08:58:19.904051 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2453/5260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:19 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:19.915985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:19.917154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:19.925808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.926782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.927463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.928423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:19.929520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:19.930962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:19.979960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:58:20.044861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:20.057666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-51fdb9c0-d9ad-48c5-94c3-240b637f289e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.383553 Oct 13 08:58:20.058893 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2808/5261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:19 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:20.078902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1b1c92-30da-4eca-afa5-9cf97d50c61e", "tag": "49bc2fb8-b196-43ad-9a02-385f5ffc86f5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:20.093932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.096880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.100167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.112856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eed4c622-61ef-4019-9f32-3d6b831cd742 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 204 len: 0 microversion: 2.1 time: 0.206307 Oct 13 08:58:20.114294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2454/5262] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:58:19 2022] DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:58:20.121944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] Creating event network-changed:49bc2fb8-b196-43ad-9a02-385f5ffc86f5 for instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e on n-h1-858384-11 Oct 13 08:58:20.130757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:20.132021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:20.134232 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a67e8e38-28dc-4e3f-a87f-83243059cc61 req-ff4fe78c-c203-4bd6-9bab-0987b07600e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071397 Oct 13 08:58:20.136892 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2809/5263] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:20.146861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.147367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.147805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.148574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.149025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.149455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.150869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:20.154486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:20.164562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.165438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.166234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.167295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.168000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.168930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.325970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:20.335885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-515396bb-4cb9-4601-ac59-7816f2ed6c68 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1673 microversion: 2.1 time: 0.215110 Oct 13 08:58:20.336478 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2455/5264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:20 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:20.931515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:20.933042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:20.941211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.941816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.942396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:20.943224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:20.943932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:20.944438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:21.017212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:21.036527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36001ef0-8ff9-4b4e-8267-a46fb0812b26 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.897240 Oct 13 08:58:21.037281 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2810/5265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:20 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:21.090616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:21.092160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:21.098432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:21.101585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:21.102389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:21.102639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:21.103635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:21.104715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:21.105525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:21.106123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:21.119119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d69ae2bc-a06e-476e-967a-a6d9eb8f151e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.191664 Oct 13 08:58:21.119909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2456/5266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:20 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:21.360205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:21.360821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:21.367337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:21.367820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:21.368257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:21.368965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:21.369421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:21.370367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:21.463540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:21.475535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b946d3d4-272f-4b2f-a923-b0c900e5ce1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.389029 Oct 13 08:58:21.490432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2811/5267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:21 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:21.614963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:21.626170 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf8b14a4-92aa-41aa-a350-1ec8ba43c140 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1673 microversion: 2.1 time: 0.270484 Oct 13 08:58:21.627643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2457/5268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:21 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:22.062856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:22.064375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:22.074753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.075512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.075960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.076670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.079352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.079998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.143025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:22.144475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:22.152112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.152610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.153049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.153779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.154397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.154857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.296657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:22.304890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-acfdbe3e-2fc7-4d32-82c9-207063a2daab tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.248172 Oct 13 08:58:22.319255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2812/5269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:22 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:22.324374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:22.336090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93e08228-a5d6-4319-9ce4-96c79fc646dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.196887 Oct 13 08:58:22.337716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2458/5270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:22 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:22.502299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:22.503423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:22.511168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.511764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.512297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.513269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.513829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.515211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.651424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:22.651821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:22.673342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.673888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.674370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.680681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:22.681988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:22.682675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:22.931229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:22.944141 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2351ccc5-7b03-449c-a22d-206061ec529d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.445731 Oct 13 08:58:22.944748 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2813/5271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:22 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:23.017250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:23.050700 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-435b41cd-5784-4d91-98a3-8b0d95c14907 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1673 microversion: 2.1 time: 0.391381 Oct 13 08:58:23.054214 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2459/5272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:22 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1673 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:23.334862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:23.335526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:23.343837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.344325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.344755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:23.345458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.350090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.351300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:23.364101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:23.364815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:23.380347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.381424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.381896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:23.383633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.384116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.386451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:23.739680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:23.753853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85bf8c82-8c7c-4cfb-b31c-94d6c645e70c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.427858 Oct 13 08:58:23.756265 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2814/5273] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:23 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:23.797251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:23.810455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea6a1758-4998-49d4-8347-993ba579965f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.452686 Oct 13 08:58:23.811734 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2460/5274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:23 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:23.969234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:23.970497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:23.977997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.979021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.979703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:23.980693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:23.981562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:23.982203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.081209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:24.082341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:24.089655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:24.091690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:24.099831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.102109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.104313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.105836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.107191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.107873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.256147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:24.262604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:24.264894 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-49a852af-e83e-4bcb-8dbb-093ff3e86137 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1605 microversion: 2.1 time: 0.191510 Oct 13 08:58:24.266036 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2461/5275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:24 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:24.273335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-66fb9d57-7aea-4489-9db2-c58fe79b2c59 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.306207 Oct 13 08:58:24.275468 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2815/5276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:23 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:24.623320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe63e6ce-008c-42fe-bc1a-08074bddc761", "name": "network-vif-deleted", "tag": "da053914-cd89-4804-985d-f6becf2cd89a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:24.649051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.649779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.650941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.668329 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] Creating event network-vif-deleted:da053914-cd89-4804-985d-f6becf2cd89a for instance fe63e6ce-008c-42fe-bc1a-08074bddc761 on n-h2-858384-11 Oct 13 08:58:24.674777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-640ecef1-71bc-48c8-9fcb-70c4b154c0a3 req-019511e6-e14f-4693-9e36-289e46a0f50f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055191 Oct 13 08:58:24.678833 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2462/5277] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:24.775463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:24.781937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:24.785633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:24.803300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.804084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.804727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.805461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.805972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.806436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.841735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:24.843384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:24.859476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.862263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.863637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:24.866503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:24.868315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:24.871167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.095578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:25.105268 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f750e5ba-d37c-4d8d-a7a9-d910ccb88e50 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.329512 Oct 13 08:58:25.122615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2816/5278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:24 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:25.255191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:25.270581 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d431cce-1d55-4979-a5dd-0823a6aaffcf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.436904 Oct 13 08:58:25.291914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2463/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:24 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:25.296466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:25.297097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:25.307176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.307687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.308497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.308840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.309327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.309732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.318419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:25.319051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:25.339173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.339686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.350235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.353497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.354011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.355598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.379845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.380794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.381447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.382108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lazy-loading 'fault' on Instance uuid fe63e6ce-008c-42fe-bc1a-08074bddc761 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:58:25.471196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d980244c14d37b8d352b0038a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b27b3068d4e799a52eb001d6c1800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:25.488576 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b70d1557-7615-4d70-82d4-7275d08f6716 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 200 len: 1327 microversion: 2.1 time: 0.196286 Oct 13 08:58:25.489823 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2817/5280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:25 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 1327 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:25.494628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "name": "network-vif-plugged", "status": "completed", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:25.505722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:25.506736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:25.507411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:25.524265 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] Creating event network-vif-plugged:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h1-858384-11 Oct 13 08:58:25.530939 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-81557a9a-aff7-4555-b515-6eeb34e13a45 req-49409f1f-3460-44ed-9505-194710c145dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038925 Oct 13 08:58:25.533237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2818/5281] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:25.680143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:25.702947 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-270adaa6-b61f-4e8a-982e-75d6f0106101 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.398552 Oct 13 08:58:25.705037 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2464/5282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:25 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:26.130630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:26.132120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:26.147395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.148328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.149591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.151502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.152242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.152960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.295004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:26.296214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:26.311151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.312626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.313249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.314299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.316015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.316645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.534034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:26.552691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-01fd5451-03ba-4183-ae22-cbeb501665de tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1316 microversion: 2.1 time: 0.423466 Oct 13 08:58:26.553775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2819/5283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:26 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:26.572411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:26.573487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:26.584285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.585206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.586307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.587729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:26.595700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.596846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.597478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.599442 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ed37996-d9db-4cd2-93f1-dab05bf2aa05 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.308630 Oct 13 08:58:26.600092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2465/5284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:26 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:26.603848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:26.620979 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 HTTP/1.1 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fe63e6ce-008c-42fe-bc1a-08074bddc761'} Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:26.622709 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:26.629315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:26.631331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:26.632997 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-939fbc16-84c0-4585-8da1-2391df764ffc tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 404 len: 111 microversion: 2.1 time: 0.075588 Oct 13 08:58:26.638533 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2820/5285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:26 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:58:26.647208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86f94eee-fb18-4e0f-8490-a565ae5c9e50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '.version_select at 0x7f5375e5a430>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:26.672686 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86f94eee-fb18-4e0f-8490-a565ae5c9e50 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899288514" status: 202 len: 0 microversion: 2.1 time: 0.031862 Oct 13 08:58:26.673288 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2466/5286] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899288514 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:58:26.731298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:26.732000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:26.745062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.745669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.746373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:26.749879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:26.751489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:26.754075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:27.552508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1b1c92-30da-4eca-afa5-9cf97d50c61e", "name": "network-vif-plugged", "status": "completed", "tag": "49bc2fb8-b196-43ad-9a02-385f5ffc86f5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:27.593769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:27.594748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:27.595415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:27.610517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] Creating event network-vif-plugged:49bc2fb8-b196-43ad-9a02-385f5ffc86f5 for instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e on n-h1-858384-11 Oct 13 08:58:27.618270 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0d63d43c-23d6-4641-81ab-46dbf6c25268 req-fab1e60f-becb-41b1-90e9-c2492dece5a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071137 Oct 13 08:58:27.619975 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2467/5287] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:27.626544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:27.628028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:27.637261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:27.638286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:27.640343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:27.641319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:27.642286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:27.657469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:27.669151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:27.878079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:27.892700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d17af5f-75a8-4d44-a243-cef893679b52 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 1.167269 Oct 13 08:58:27.894762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2821/5288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:26 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:27.899580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:27.900392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:27.907324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:27.908094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:27.908736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:27.909871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:27.910718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:27.911379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:28.135928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:28.146507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53d9d1a0-a1b0-40df-ac65-e63de0d97547 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.524889 Oct 13 08:58:28.147282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:28.166800 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2468/5289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:27 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:28.183672 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e22edc6b-83f6-4dac-a1f6-3b2c2f9b53c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.287306 Oct 13 08:58:28.186615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2822/5290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:27 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:28.361948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-762895344", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:28.441273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] validate_networks() for [('f016b286-7e2f-4836-80be-a205528d3fd1', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:58:28.919755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:28.921549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:28.932836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:28.933640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:28.934395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:28.936711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:28.937374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:28.938164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:29.043370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:58:29.044724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:58:29.045584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:58:29.046275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:58:29.047035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:58:29.062056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:29.062885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:29.063591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:29.065052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:29.065763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:29.067085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:29.089841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Getting quotas for project a5d7b7aa7f7d4f6c84189db0a530a1f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:29.111354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Getting quotas for user c4f7b7beca1944019b70932ebc6f553c and project a5d7b7aa7f7d4f6c84189db0a530a1f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:29.157630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:58:29.165146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:58:29.289122 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08358e14-6cdb-4b6d-a540-ee4c560b90c8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931364 Oct 13 08:58:29.301568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:29.305579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2469/5291] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:58:29.313246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0ce04fa-dd83-45ca-8c13-5f7baa3dd071 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1367 microversion: 2.1 time: 0.398460 Oct 13 08:58:29.333590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:29.334215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:29.339994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2823/5292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:28 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:29.350514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab454426-a1bf-416b-8057-77560cd98655 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:29.353195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab454426-a1bf-416b-8057-77560cd98655 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:29.363045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:29.365034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:29.367130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:29.371380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:29.372411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:29.374742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:29.645783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab454426-a1bf-416b-8057-77560cd98655 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:29.654437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab454426-a1bf-416b-8057-77560cd98655 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1216 microversion: 2.1 time: 0.312355 Oct 13 08:58:29.656693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2824/5293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:29 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1216 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:30.040888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:30.058912 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8062e3ff-8342-433f-8f40-da4677801175 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.751942 Oct 13 08:58:30.059662 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2470/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:29 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:30.354015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:30.356925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:30.380273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.380804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.383076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.384812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.385282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.386635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.654565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:30.672538 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5c6ae45f-d692-4338-a5bf-889be3949798 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1557 microversion: 2.1 time: 0.321455 Oct 13 08:58:30.673709 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2825/5295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:30 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1557 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:30.688437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:30.689508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:30.697497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:30.698467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:30.704852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.705404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.705794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.707541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.708304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.709848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.709971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.710358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.710817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.712451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:30.713837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:30.715415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:30.863926 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-461c7fd1-dd5a-4f8c-ac5c-0b6ac202f970 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170797 Oct 13 08:58:30.865199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2826/5296] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 08:58:30 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:58:30.880825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:30.893616 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c0b02ba-1735-4585-8ced-08d66ee8bb53 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1268 microversion: 2.1 time: 0.209284 Oct 13 08:58:30.895142 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2471/5297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:30 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:31.088881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:31.089500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:31.108657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:31.117245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:31.120193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:31.121079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:31.126074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:31.127618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:31.587502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:31.603091 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e40303fb-85ee-46db-91c0-7babcb32c56a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.516547 Oct 13 08:58:31.603091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2827/5298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:31 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:31.922014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:31.922711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:31.933804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:31.934307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:31.934776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:31.935496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:31.936510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:31.938091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:32.091674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:32.108418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aea803c7-0389-4d43-a175-5fce648515d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1274 microversion: 2.1 time: 0.190127 Oct 13 08:58:32.109316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2472/5299] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:31 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:32.627744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:32.628444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:32.643364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:32.644112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:32.646612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:32.647648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:32.653755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:32.657293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:33.142069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:33.143252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:33.146228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:33.159017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:33.159768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:33.164075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:33.165134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:33.166014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:33.166676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:33.218345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:33.238948 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d882cd27-bade-4c17-b027-ca3454b8735d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.615634 Oct 13 08:58:33.242120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2828/5300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:32 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:34.266530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:34.268111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:34.300422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:34.301242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:34.301955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:34.304556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:34.305300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:34.307691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:34.400864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:34.421709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-48971f84-c9e8-4053-bedf-2e391255fb6a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 1.282390 Oct 13 08:58:34.422445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2473/5301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:33 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:35.145648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:35.169892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3dfafcb6-e8e5-4af1-b500-98d3e4864f76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.907135 Oct 13 08:58:35.174305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1b1c92-30da-4eca-afa5-9cf97d50c61e", "tag": "49bc2fb8-b196-43ad-9a02-385f5ffc86f5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:35.176923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2829/5302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:34 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:35.327789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:35.332738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:35.341552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:35.402336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] Creating event network-changed:49bc2fb8-b196-43ad-9a02-385f5ffc86f5 for instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e on n-h1-858384-11 Oct 13 08:58:35.439391 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-80bce9c8-3ec4-4e2e-b3d8-86a53be6fe7b req-9914b817-e248-4737-b51a-1f30d5251f99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269291 Oct 13 08:58:35.440066 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2474/5303] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:58:35.460905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:35.463920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:35.497910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:35.501431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:35.502950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:35.507138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:35.509222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:35.510422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:35.975410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:35.994251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6cf47d51-93e4-43e0-8594-38ce29cd5485 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.551688 Oct 13 08:58:35.995045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2830/5304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:35 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:36.205338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:36.207082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:36.226040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:36.226873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:36.227527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:36.229362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:36.231333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:36.236438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:36.517413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:36.543952 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6767b9c-fdff-458c-b717-1ad4740ae821 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.345231 Oct 13 08:58:36.546007 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2475/5305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:36 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:37.022566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:37.023680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:37.032896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:37.033798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:37.034250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:37.034995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:37.035649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:37.036255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:37.410091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:37.425747 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e62f142-574d-4c1c-a578-6c53ab963243 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.411908 Oct 13 08:58:37.427680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2831/5306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:37 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:37.483260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed19514-32cb-4108-948f-877680adbcb1", "tag": "97df10b8-084c-4935-a371-07926bf153bd"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:37.512172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:37.513171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:37.517226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:37.547588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] Creating event network-changed:97df10b8-084c-4935-a371-07926bf153bd for instance bed19514-32cb-4108-948f-877680adbcb1 on n-h2-858384-11 Oct 13 08:58:37.560360 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3de8d5b1-5547-47df-a6b8-bf6a3251646d req-9ced5683-3ac1-49b2-a15b-ac18a2afd868 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083635 Oct 13 08:58:37.562212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2476/5307] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:37.571430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:37.572123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:37.587731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:37.588668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:37.589190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:37.590441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:37.591183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:37.592007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:37.877988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:37.894765 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ca00c49-70c0-4a26-87cd-42369fd80c43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.328660 Oct 13 08:58:37.896340 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2832/5308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:37 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:38.453212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:38.454269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:38.474922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:38.475426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:38.479105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:38.481457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:38.483670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:38.484525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:38.837513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:38.855629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-799661d2-a1be-4073-9149-a2fb1e9e48b8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.407125 Oct 13 08:58:38.857016 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2477/5309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:38 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:38.929622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:38.931472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:38.941400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:38.944350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:38.944920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:38.945427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:38.946601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:38.947950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:38.948586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.331970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:39.346819 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b945271f-409f-43b4-8303-3a7fb1dc7fda tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.426125 Oct 13 08:58:39.347621 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2833/5310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:38 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:39.614798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:39.615296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:39.620795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:39.621482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:39.623886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.624346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.624776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.625491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.625948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.626377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.642469 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 HTTP/1.1 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fe63e6ce-008c-42fe-bc1a-08074bddc761'} Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:39.644359 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-62e354c1-24c5-47b6-856c-4cffe2def42a tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 404 len: 111 microversion: 2.1 time: 0.034945 Oct 13 08:58:39.650705 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2478/5311] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:58:39 2022] DELETE /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:58:39.656972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:39.658834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: fe63e6ce-008c-42fe-bc1a-08074bddc761] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:39.662124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:39.666527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.667188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.667740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.668527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.669054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.669572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.688437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 HTTP/1.1 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fe63e6ce-008c-42fe-bc1a-08074bddc761'} Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:39.690308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance fe63e6ce-008c-42fe-bc1a-08074bddc761 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:39.695895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7072f092-9f1e-42b7-989a-349e613625d4 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761" status: 404 len: 111 microversion: 2.1 time: 0.041214 Oct 13 08:58:39.696678 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2834/5312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:39 2022] GET /compute/v2.1/servers/fe63e6ce-008c-42fe-bc1a-08074bddc761 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:58:39.882227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:39.882973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:39.903695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.904206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.905220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:39.905955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:39.906536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:39.906882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:40.163927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:40.177301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5993470-4774-462d-9c8a-a00d96b0b6f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.298464 Oct 13 08:58:40.194211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2479/5313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:39 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:40.369116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:40.369821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:40.385431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:40.385934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:40.386376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:40.387326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:40.387955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:40.388546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:40.859905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:40.875869 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfd34ace-9fc3-4b5f-ba59-9fdd2f7f90bf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.507408 Oct 13 08:58:40.878255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2835/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:40 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:41.206230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:41.207997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:41.224485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:41.226296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:41.227797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:41.229399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:41.231275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:41.232328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:41.632985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:41.650840 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63d558b2-93b9-4371-a4b9-15cd89cb4d00 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.445669 Oct 13 08:58:41.667885 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2480/5315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:41 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:41.904801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:41.905662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:41.913488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:41.914236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:41.914886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:41.915801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:41.916431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:41.917050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:42.148486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:42.157947 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-807a7aaa-db76-4ad4-9771-8d2226336d9a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.256954 Oct 13 08:58:42.158700 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2836/5316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:41 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:42.677403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:42.678458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:42.689554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:42.690241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:42.691615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:42.692651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:42.693434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:42.694331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:42.885388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:42.895189 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ab4848d-3b29-41ca-94f0-9488c21bcbcf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.222780 Oct 13 08:58:42.896502 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2481/5317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:42 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:43.183516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:43.184144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:43.206119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:43.206661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:43.207114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:43.207843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:43.208308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:43.208744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:43.412345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:43.425527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9105ae48-1cd6-4b2c-937f-914203d378f6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.246524 Oct 13 08:58:43.426895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2837/5318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:43 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:43.924770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:43.926130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:43.946803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:43.948277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:43.949715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:43.952347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:43.952904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:43.954349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.170685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:44.194714 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16633998-6f10-45f2-a79e-c0b368e62e8b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.277560 Oct 13 08:58:44.195687 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2482/5319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:43 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:44.298252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:44.300152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:44.312417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.313172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.313614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.314602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.315068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.315488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.341113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c HTTP/1.1 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e3a0cad5-37ea-4141-a2a1-b0edefe9af7c'} Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:44.347223 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:44.354069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-def11e5d-4c1b-49b8-b1dd-bf713427f693 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 404 len: 111 microversion: 2.1 time: 0.061713 Oct 13 08:58:44.372173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:44.372755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] [instance: e3a0cad5-37ea-4141-a2a1-b0edefe9af7c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:44.377930 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2838/5320] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:58:44 2022] DELETE /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:58:44.381376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.381882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.382315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.385059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.387572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.388427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.418246 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] HTTP exception thrown: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Request method failure captured: Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c HTTP/1.1 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9FGgAlaS84B9nmCEaKHrh6z6giAdn7UsDvUF3LzrIf6N-Qza8Q-6iEdC6Glg8pIsjbnJc51wysQ-0qYu8QwEk5EzhXi5ONC_SrG9DUKVYoNe10kDL1iR8T_R81W2w3Ak1BJjTjlawI1vk6z0skCUIIt9GnwRE_YisymkGumTIrNp_o Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b33b27b3068d4e799a52eb001d6c1800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b33b27b3068d4e799a52eb001d6c1800 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1163499637 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 0f5d980244c14d37b8d352b0038a0ee3 Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeTestJSON-1163499637-project Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e3a0cad5-37ea-4141-a2a1-b0edefe9af7c'} Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:44.425267 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] Returning 404 to user: Instance e3a0cad5-37ea-4141-a2a1-b0edefe9af7c could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-349f5f27-3db6-4af7-bb11-056627e11731 tempest-AttachVolumeTestJSON-1163499637 tempest-AttachVolumeTestJSON-1163499637-project] 10.222.0.23 "GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c" status: 404 len: 111 microversion: 2.1 time: 0.069728 Oct 13 08:58:44.435857 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2483/5321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:44 2022] GET /compute/v2.1/servers/e3a0cad5-37ea-4141-a2a1-b0edefe9af7c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:58:44.450573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:44.451847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:44.464984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.465966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.466627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.469460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.470153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.472839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.769752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:44.781769 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-454d3bb5-7a87-4429-87a1-66c5c8f70eeb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.336057 Oct 13 08:58:44.783130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2839/5322] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:44 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:44.835919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed19514-32cb-4108-948f-877680adbcb1", "name": "network-vif-plugged", "status": "completed", "tag": "97df10b8-084c-4935-a371-07926bf153bd"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:44.868074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:44.869840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:44.871072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:44.916384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] Creating event network-vif-plugged:97df10b8-084c-4935-a371-07926bf153bd for instance bed19514-32cb-4108-948f-877680adbcb1 on n-h2-858384-11 Oct 13 08:58:44.931218 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1316d526-bfb5-4755-bd9a-2e99917a9059 req-88d7169e-5121-4c8c-88da-e6fbc78e5ecb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097572 Oct 13 08:58:44.932721 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2484/5323] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:45.225493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:45.226106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:45.249035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:45.249533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:45.249971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:45.250712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:45.251163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:45.251586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:45.280842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:45.471791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:45.483908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69cb5c02-8bdd-4670-88fc-1d52ffe70800 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.261451 Oct 13 08:58:45.485229 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2840/5324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:45 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:45.812921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:45.813912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:45.833556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:45.834278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:45.834863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:45.837029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:45.837606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:45.840976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:46.446173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:46.459209 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-448e6f70-a5b7-4ffe-9bc9-444b4c6fd2d3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.654110 Oct 13 08:58:46.460353 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2485/5325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:45 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:46.508227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:46.509504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:46.517936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:46.518785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:46.519444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:46.520380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:46.521048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:46.521570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:46.651464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:46.652116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:46.666570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:46.667589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:46.668262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:46.669229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:46.670465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:46.671215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:46.847407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lazy-loading 'services' on Instance uuid dcd85a03-ffe1-4235-9a08-7d405afca0ec {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:58:47.051159 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ceb91560-e686-486e-b4eb-8458566e1567 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec/os-volume_attachments/41d276f6-1d6c-4ac5-b832-3b1b08152397" status: 202 len: 0 microversion: 2.1 time: 0.398783 Oct 13 08:58:47.052626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2486/5326] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:58:46 2022] DELETE /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec/os-volume_attachments/41d276f6-1d6c-4ac5-b832-3b1b08152397 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:58:47.374607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:47.391722 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a61bdff2-3719-4673-9e26-ab60d31ee63c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1316 microversion: 2.1 time: 0.887530 Oct 13 08:58:47.392733 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2841/5327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:46 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:47.487697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:47.489201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:47.497376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:47.498305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:47.499044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:47.500009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:47.500736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:47.501404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:47.805081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:47.814618 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c92ccf9b-57b7-46d2-a1a1-f15a4c3695ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.334703 Oct 13 08:58:47.827761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2487/5328] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:47 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:48.415656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:48.416965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:48.436026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:48.436799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:48.439836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:48.440478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:48.444985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:48.447061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:48.841609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:48.842254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:48.853168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:48.856765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:48.858054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:48.859077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:48.861201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:48.861825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:48.875688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:49.059669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:49.072395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c7b3a45-2c5f-4b1f-81b0-bc998878c02d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1504 microversion: 2.1 time: 0.661128 Oct 13 08:58:49.086669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2842/5329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:48 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:49.096996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:49.097623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:49.104874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:49.105514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:49.106051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:49.106945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:49.108525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:49.109247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:49.143797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:58:49.416022 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ead19e67-96a3-4b9e-92c2-3425df2b86e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 204 len: 0 microversion: 2.1 time: 0.322937 Oct 13 08:58:49.418014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:49.424343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2843/5330] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:58:49 2022] DELETE /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:58:49.432507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:49.436638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:49.439010 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-edb47403-d3a6-4667-826a-7a390b608cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1511 microversion: 2.1 time: 0.599651 Oct 13 08:58:49.455042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:49.455750 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2488/5331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:48 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1511 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:49.456962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:49.464676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:49.465700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:49.469754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:49.470392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:49.848566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:49.860816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73a59b68-abd7-4895-bf9b-09f78a0f8cf2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1510 microversion: 2.1 time: 0.434944 Oct 13 08:58:49.863839 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2844/5332] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:49 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:50.468031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:50.469892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:50.484311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:50.487561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:50.488354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:50.489595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:50.490569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:50.498128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:50.889331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:50.889953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:50.900607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:50.901108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:50.906229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:50.907045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:50.907527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:50.907967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:50.978938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:51.006612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d0287fc-dcb5-44fa-95d0-5526dd7a4274 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1488 microversion: 2.1 time: 0.530831 Oct 13 08:58:51.006612 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2489/5333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:50 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1488 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:51.023929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:51.027811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:51.046168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.046528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.050021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.051009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.051503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.051956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.153829 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e225dbc3-42b1-4bc3-a53f-08a8c13bf799 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 200 len: 194 microversion: 2.1 time: 0.135708 Oct 13 08:58:51.155461 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2490/5334] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:58:51 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:51.176275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:51.177381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:51.186809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:51.209865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.211973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a094d979-f1ad-4112-88af-91c5bbbcde4b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1510 microversion: 2.1 time: 0.326907 Oct 13 08:58:51.212694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.215224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.216324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.217377 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2845/5335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:50 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:51.218862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.219722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.569171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:51.581675 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c823a727-c911-402d-a7e5-3edadbd5a176 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.420132 Oct 13 08:58:51.585141 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2491/5336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:51.616882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:51.617431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:51.626247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.626765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.639099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.640186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:51.640874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:51.641519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:51.985579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed19514-32cb-4108-948f-877680adbcb1", "name": "network-vif-deleted", "tag": "97df10b8-084c-4935-a371-07926bf153bd"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:52.063336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.064116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.065998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.106608 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] Creating event network-vif-deleted:97df10b8-084c-4935-a371-07926bf153bd for instance bed19514-32cb-4108-948f-877680adbcb1 on n-h2-858384-11 Oct 13 08:58:52.125225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:52.133928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-84c6b949-7f50-469b-ab4c-53304a6c6cdf req-6e96ffd8-014b-46c2-bce9-f236879e195c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141264 Oct 13 08:58:52.138052 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2492/5337] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:58:52.141651 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-02f8a758-b655-45cc-b646-204afea07902 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.528644 Oct 13 08:58:52.143155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2846/5338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:52.173775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:52.175048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:52.189106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.191835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.193599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.194760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.196718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.197525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.241110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:52.242000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:52.262023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.262575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.263113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.263925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.264864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.271887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.370893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.371384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.380669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.381541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lazy-loading 'fault' on Instance uuid bed19514-32cb-4108-948f-877680adbcb1 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:58:52.520729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:52.533347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8da698ad-2636-4c2c-b3de-b7ae254a1a1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 200 len: 1306 microversion: 2.1 time: 0.294458 Oct 13 08:58:52.534235 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2847/5339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:52 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:52.563542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:52.571802 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b2b8b6d-9bc9-43a3-bafd-c5f18b8dd93b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.407063 Oct 13 08:58:52.574657 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2493/5340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:52 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:52.598103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:52.599133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:52.609486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.610053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.610516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.611227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:52.613261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:52.613706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:52.864477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:52.876612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dcb3c4bf-a578-4a6e-8d6a-30351fa882bd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.282387 Oct 13 08:58:52.878527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2848/5341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:52 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:53.077251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-766215013", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "b7a3a358-8f5e-4e38-984b-35dd1ec4122e"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:53.179940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] validate_networks() for [('b7a3a358-8f5e-4e38-984b-35dd1ec4122e', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:58:53.561568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:53.562196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:53.570692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.571628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.572377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.573241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.573926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.574291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.603313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 HTTP/1.1 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bed19514-32cb-4108-948f-877680adbcb1'} Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:53.605475 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:58:53.611621 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:53.613848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:53.615290 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-909b2aa2-4fbe-4afc-a281-e8c2957b5ce9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 404 len: 111 microversion: 2.1 time: 0.058234 Oct 13 08:58:53.616564 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2849/5342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:53 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:58:53.627817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:53.629297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:53.637109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.638362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.639153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.640322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.640847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.641673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.826916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:58:53.828156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:58:53.828926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:58:53.829549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:58:53.830162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:58:53.851590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.854550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.855308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.859179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:53.860370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:53.861530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:53.923040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:58:53.945660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:58:53.955332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:53.971209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8c5efd9-fa2c-401c-b2b3-c341a534b691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.348710 Oct 13 08:58:53.973182 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2850/5343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:53 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:53.983686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:58:53.988511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:58:54.111495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f32c7e1f-9b59-44a4-89b9-8cfa30494a43 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037209 Oct 13 08:58:54.121704 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2494/5344] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:58:54.127007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5b6e2be-eb4b-436d-a319-4fc66b1e3643 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:54.128361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5b6e2be-eb4b-436d-a319-4fc66b1e3643 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:54.261915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5b6e2be-eb4b-436d-a319-4fc66b1e3643 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:54.274692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5b6e2be-eb4b-436d-a319-4fc66b1e3643 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1214 microversion: 2.1 time: 0.152959 Oct 13 08:58:54.275308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2851/5345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:54 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:54.394056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8bdc64f-d38d-4456-b821-175fe6d76c43 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8bdc64f-d38d-4456-b821-175fe6d76c43 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 163 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": 12345, "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 12345 Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:58:54.409489 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 13 08:58:54.415111 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:58:54.417462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8bdc64f-d38d-4456-b821-175fe6d76c43 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:54.419331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8bdc64f-d38d-4456-b821-175fe6d76c43 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.031038 Oct 13 08:58:54.423515 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2495/5346] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:58:54.433783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:54.434047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:54.453704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.456533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.458684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:54.459614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.460615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.461057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:54.749791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:54.760489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c2e9e5e-12b5-437c-b171-844737366949 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.332198 Oct 13 08:58:54.761520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2852/5347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:54 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:54.788173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:54.789468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:54.803693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.804410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.805264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:54.807770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.808693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.814522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:54.815915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:54.820019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:54.830061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.834901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.837607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:54.844492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:54.845060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:54.848857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:55.056881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:55.069097 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e90b041c-a155-47b5-abf0-4b33455784f7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.285899 Oct 13 08:58:55.091880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2496/5348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:54 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:55.239349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:55.254507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:55.259002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:55.260688 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68773977-9880-48f2-8f50-ab8d42b5f260 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2958 microversion: 2.42 time: 0.450598 Oct 13 08:58:55.267592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2853/5349] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 08:58:54 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2958 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:58:55.299909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:55.300684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:55.300845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:55.301825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:55.309295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:55.310825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:55.311462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:55.312537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:55.313166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:55.313927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:55.314686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:55.316603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:55.317678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:55.322241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:55.324626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:55.325470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:55.495399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:55.504861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2fa5255-c4ec-4d1a-81f3-457d6fa02920 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1210 microversion: 2.1 time: 0.210092 Oct 13 08:58:55.505778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2854/5350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:55 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:55.533934 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82f1eefd-e712-4618-9e53-ecb22925a1d6 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.240185 Oct 13 08:58:55.544115 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2497/5351] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 08:58:55 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f/os-interface => generated 1832 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 08:58:56.254165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:56.255766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:56.261167 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 08:58:56.266650 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 08:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec (ip 10.222.0.23) !!! Oct 13 08:58:56.272199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.276077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.276857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.277782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.280898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.281878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.385717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:58:56.465832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:58:56.533353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:56.534093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:56.545222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.550176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.551189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.552454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.553274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.554069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.646282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b98799b-6450-4f57-8dcf-ca491ed87617 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 204 len: 0 microversion: 2.1 time: 0.384832 Oct 13 08:58:56.646973 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2855/5352] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:58:56 2022] DELETE /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:58:56.656941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:56.657652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:56.678157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.678711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.679149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.679864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:56.680316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:56.680737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:56.788040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:56.805305 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b04cd8ec-6665-407e-b1cf-ce706582bd7e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1272 microversion: 2.1 time: 0.272852 Oct 13 08:58:56.838561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2498/5353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:56 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:57.202503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:57.219322 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86c7cf29-e3fa-41e0-b4e1-c136ae6edbe3 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1513 microversion: 2.1 time: 0.565818 Oct 13 08:58:57.221922 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2856/5354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:56 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1513 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:57.832146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:57.833969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:57.844521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:57.848122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:57.850253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:57.851291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:57.853265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:57.853959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:58.246649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:58.247415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:58.262953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:58.264822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:58.265432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:58.268404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:58.269978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:58.270592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:58.640856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:58.653406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-320d791f-0cdf-4bae-ad8c-6343c95ed77d tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1513 microversion: 2.1 time: 0.410696 Oct 13 08:58:58.669909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2857/5355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:58 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:58.674972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f3b9fd0-588a-4518-84bc-993edd90aa60 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1902631220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa79e0db-0365-44f3-8b01-c32d464029fd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:58:58.789653 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9f3b9fd0-588a-4518-84bc-993edd90aa60 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f3b9fd0-588a-4518-84bc-993edd90aa60 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 358 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1902631220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa79e0db-0365-44f3-8b01-c32d464029fd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: exception: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1902631220', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fa79e0db-0365-44f3-8b01-c32d464029fd'}], 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:58:58.798948 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. Oct 13 08:58:58.803737 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:58:58.807171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f3b9fd0-588a-4518-84bc-993edd90aa60 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Block Device fa79e0db-0365-44f3-8b01-c32d464029fd is not bootable. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:58:58.810557 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f3b9fd0-588a-4518-84bc-993edd90aa60 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.139462 Oct 13 08:58:58.811348 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2858/5356] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:58:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:58:58.821789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:58.823651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:58.843830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:58.843830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:58.843830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:58.843830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:58.849391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:58.849872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:58.960167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:58.973129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2bb3cecc-b2cd-40a6-bd16-822c00c029ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 1.145105 Oct 13 08:58:58.974849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2499/5357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:57 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:58:59.523187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:58:59.536845 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5ef5ec4-5b64-4b90-ac63-27367388a804 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.720744 Oct 13 08:58:59.537441 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2859/5358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:58 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:58:59.562701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:59.563503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:59.582892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:59.584238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:59.595236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:59.596431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:59.597273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:59.597965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:59.676815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:58:59.677432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:58:59.686147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:59.686928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:59.687603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:58:59.688824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:58:59.689482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:58:59.690678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:00.200229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:00.214000 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89fdc6d1-79e1-49fc-8ab0-c9cb818ef146 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1513 microversion: 2.1 time: 0.538903 Oct 13 08:59:00.214608 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2860/5359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:59 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1513 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:00.227474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72", "tag": "755db9b2-1ba0-4a55-8d23-b72a365b4408"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:00.240032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:00.255061 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c88b6a31-6096-45dd-8754-f1d4a708ec85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.696942 Oct 13 08:59:00.259191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2500/5360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:58:59 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:00.264632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:00.267313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:00.267945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:00.319908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] Creating event network-changed:755db9b2-1ba0-4a55-8d23-b72a365b4408 for instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 on n-h2-858384-11 Oct 13 08:59:00.347805 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-403e602d-ec3c-4372-a0f6-96c070a2994a req-51acdab8-aa1d-43b4-8d52-2ff593474076 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128278 Oct 13 08:59:00.354693 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2861/5361] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:00.640301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd85a03-ffe1-4235-9a08-7d405afca0ec", "name": "network-vif-deleted", "tag": "85733ca2-fb6f-4b38-9d03-062cd363dc6b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:00.671550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:00.674316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:00.676223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:00.717671 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] Creating event network-vif-deleted:85733ca2-fb6f-4b38-9d03-062cd363dc6b for instance dcd85a03-ffe1-4235-9a08-7d405afca0ec on n-h2-858384-11 Oct 13 08:59:00.730996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5b03b717-a9de-438a-9e3d-cd158f0b4762 req-513c2acf-af6a-46f4-a112-437325a03653 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096598 Oct 13 08:59:00.733594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2862/5362] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:00.787010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:00.788014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:00.801794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:00.803312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:00.805696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:00.806956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:00.808865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:00.812211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:01.238740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:01.239802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:01.259395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:01.259888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:01.260329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:01.272911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:01.273424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:01.275429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:01.392557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:01.393063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:01.393505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:01.393967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lazy-loading 'fault' on Instance uuid dcd85a03-ffe1-4235-9a08-7d405afca0ec {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:01.498400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:01.512177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b265580-70de-4a95-acc8-872cce4f559b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 1.248952 Oct 13 08:59:01.512955 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2501/5363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:00 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:02.239092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:02.264496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3da1c9d5-1bff-4515-8c39-cdea68a59af6 tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1308 microversion: 2.1 time: 1.030423 Oct 13 08:59:02.276991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2863/5364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:01 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1308 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:02.536588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:02.537390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:02.557766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:02.558488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:02.560578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:02.563670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:02.565634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:02.567378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.014095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:03.028270 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f2cd6d5e-56d5-400f-998a-6b176c360536 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.492450 Oct 13 08:59:03.029392 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2502/5365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:02 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:03.299455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:03.300124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:03.317515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.318012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.318467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.327660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.332689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.333152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.379633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-897a976a-96b8-424f-970d-f7d93e68008f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-161249859", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "312a3023-32f8-4474-bfa0-ae0f09977375", "destination_type": "local"}, {"source_type": "volume", "uuid": "6e9f650a-fd5b-4e17-a16f-2c6ab8212d0f", "destination_type": "invalid"}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-897a976a-96b8-424f-970d-f7d93e68008f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 494 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-161249859", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "312a3023-32f8-4474-bfa0-ae0f09977375", "destination_type": "local"}, {"source_type": "volume", "uuid": "6e9f650a-fd5b-4e17-a16f-2c6ab8212d0f", "destination_type": "invalid"}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-161249859', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '312a3023-32f8-4474-bfa0-ae0f09977375', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6e9f650a-fd5b-4e17-a16f-2c6ab8212d0f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'invalid' Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:03.384219 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-897a976a-96b8-424f-970d-f7d93e68008f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:03.389323 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-897a976a-96b8-424f-970d-f7d93e68008f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011343 Oct 13 08:59:03.392635 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2503/5366] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:59:03.410615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:03.411776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:03.429008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:03.432610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.433143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.433594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.436728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.437761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.438218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.438594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.439114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.439419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lazy-loading 'fault' on Instance uuid dcd85a03-ffe1-4235-9a08-7d405afca0ec {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:03.439643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.506280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f44f47c72544daac503f4a0c1db525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1618924e3042deaa804928761e5930', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:03.518993 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e0310ef2-09a4-41ef-a310-1368eb20486e tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 200 len: 1308 microversion: 2.1 time: 0.227982 Oct 13 08:59:03.519592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2864/5367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:03 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:03.872616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:03.890396 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81e730be-32e8-417d-9c07-c90fa33002c3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.496097 Oct 13 08:59:03.894866 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2504/5368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:03 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:03.931461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:03.932416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:03.939545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.940389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.941096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:03.942951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:03.943708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:03.944401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.053250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:04.055272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:04.082662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:04.094828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:04.101952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.103128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.104109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.105080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.108721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.113725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.267843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:04.288054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:04.297225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c60a5fa7-1180-4092-bb55-e58dc746c531 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.381642 Oct 13 08:59:04.300628 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2865/5369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:03 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:04.485477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-042bef11-9aea-4476-a40d-476e2a1afa7f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626771594", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-042bef11-9aea-4476-a40d-476e2a1afa7f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 491 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626771594", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-626771594', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.490902 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 13 08:59:04.495047 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.501236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-042bef11-9aea-4476-a40d-476e2a1afa7f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:04.502423 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-042bef11-9aea-4476-a40d-476e2a1afa7f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022373 Oct 13 08:59:04.503500 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2866/5370] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:04 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:59:04.521719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:04.522610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:04.532175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.532897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.536826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.537582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.538004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.538498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.705045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:04.715257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99779dd6-1a86-440b-b63c-2a41801af156 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.663765 Oct 13 08:59:04.728388 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2505/5371] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:04 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:04.738551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:04.739179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] [instance: dcd85a03-ffe1-4235-9a08-7d405afca0ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:04.752453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.752952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.753388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.754106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:04.754592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:04.755022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:04.791349 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] HTTP exception thrown: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Request method failure captured: Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec HTTP/1.1 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IIKbNbQof7OFg0kkR7HiLXrEN4IfS-hPwh_-PeJcMJg8R14jZ3ED9QHXPW4fkvzetHRd8hnQx6biaavHTMgyKQba3h_3O2sYhLGvunyS-AxFw5KfGO7ZtgCLnpDzj5g-dJS-6SDTmeoqHKwoLpAuD3FV1oFWBxDarLRyKmtuCKJ5U Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 5c1618924e3042deaa804928761e5930 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c1618924e3042deaa804928761e5930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5c1618924e3042deaa804928761e5930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5c1618924e3042deaa804928761e5930"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5c1618924e3042deaa804928761e5930"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 5c1618924e3042deaa804928761e5930 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1909021271 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotTestJSON-1909021271-project Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 87f44f47c72544daac503f4a0c1db525 Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotTestJSON-1909021271-project Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'dcd85a03-ffe1-4235-9a08-7d405afca0ec'} Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:04.793140 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. Oct 13 08:59:04.800356 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:04.802680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] Returning 404 to user: Instance dcd85a03-ffe1-4235-9a08-7d405afca0ec could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:04.804269 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f7aee48-a1e0-46dc-92ee-db291acfa69a tempest-VolumesSnapshotTestJSON-1909021271 tempest-VolumesSnapshotTestJSON-1909021271-project] 10.222.0.23 "GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec" status: 404 len: 111 microversion: 2.1 time: 0.069621 Oct 13 08:59:04.805591 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2506/5372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:04 2022] GET /compute/v2.1/servers/dcd85a03-ffe1-4235-9a08-7d405afca0ec => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:04.959915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:04.971114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3f7c20f7-36fc-4fc1-b00c-2ff133e41ce6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.455168 Oct 13 08:59:04.971707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2867/5373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:04 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:05.000426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:05.001736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:05.012887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.016005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.018482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:05.021351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.022696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.027973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:05.610228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:05.623820 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca872d52-560e-40f0-95c7-bcad94e3218f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.628241 Oct 13 08:59:05.625018 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2507/5374] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:04 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:05.744097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:05.744791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:05.757128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.761079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.762262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:05.765055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.765704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.766306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:05.852529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39c4679c-b8fa-4f6e-8d2d-083fe6fbcb0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39c4679c-b8fa-4f6e-8d2d-083fe6fbcb0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 416 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.860971 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 08:59:05.865683 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:05.871527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-39c4679c-b8fa-4f6e-8d2d-083fe6fbcb0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:05.877239 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-39c4679c-b8fa-4f6e-8d2d-083fe6fbcb0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.031433 Oct 13 08:59:05.878271 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2508/5375] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:05.894192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:05.895243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:05.909314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.910923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.911477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:05.919921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:05.920561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:05.921126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:06.072140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:06.081227 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f4f418eb-c6d9-40b2-9924-62ab2cc1c648 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.343734 Oct 13 08:59:06.083617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2868/5376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:05 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:06.722972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:06.735826 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-819edcf2-494b-4cc2-80f0-5b163ef43af3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.848407 Oct 13 08:59:06.751941 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2509/5377] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:05 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:06.764296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:06.764995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:06.775965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:06.778755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:06.789076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:06.790240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:06.790780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:06.791261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.022654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:07.032907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-846d5d06-e6a0-4335-a141-f9c10621ec87 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.273059 Oct 13 08:59:07.036525 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2869/5378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:06 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:07.109625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:07.110533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:07.121218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.125719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.126255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.127053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.127520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.130692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.155107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:07.246786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e3acbd-78be-471e-bc65-58ab6e4e64c1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-662991552", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": -1, "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:07.295731 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b4e3acbd-78be-471e-bc65-58ab6e4e64c1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Flavor -1 could not be found. Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e3acbd-78be-471e-bc65-58ab6e4e64c1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 205 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-662991552", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": -1, "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: exception: Flavor -1 could not be found. Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-662991552', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': -1, 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:07.300370 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4e3acbd-78be-471e-bc65-58ab6e4e64c1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4e3acbd-78be-471e-bc65-58ab6e4e64c1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.062505 Oct 13 08:59:07.308991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2870/5379] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:07 2022] POST /compute/v2.1/servers => generated 73 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:59:07.321958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:07.322694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:07.334460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.337381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.337897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.338936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.339405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.339833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.530136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:07.545110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8946ec6f-0e4c-4440-9e9a-ca28fa7ab8bb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.235234 Oct 13 08:59:07.546319 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2871/5380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:07 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:07.570435 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:07.577403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:07.593654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.594835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.595548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.596589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.597301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.597968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.658710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:07.672583 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fc7e9c6-7d66-4efd-80f6-b7968e144195 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.562386 Oct 13 08:59:07.673477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2510/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:07 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:07.678512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:07.690234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:07.697141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.698267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.698925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.699825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.701012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.701644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.772303 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa9cd0c8-6cb2-4657-a8eb-652fda85c530 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/ips" status: 200 len: 150 microversion: 2.1 time: 0.097517 Oct 13 08:59:07.774876 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2511/5382] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 08:59:07 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/ips => generated 150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:07.799316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c182a9fb-a00b-434d-8f38-1bd1f588c019"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:07.804571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:07.826809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.827308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.831146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.832226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:07.832880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:07.835135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:07.867224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:07.899195 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77bc50b1-6439-4ad9-b41e-0fa59c7e2f85 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.332651 Oct 13 08:59:07.901886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2872/5383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:07 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:08.075199 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/os-volume_attachments HTTP/1.1 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 74 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: {"volumeAttachment": {"volumeId": "c182a9fb-a00b-434d-8f38-1bd1f588c019"}} Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '8c1b1c92-30da-4eca-afa5-9cf97d50c61e', 'body': {'volumeAttachment': {'volumeId': 'c182a9fb-a00b-434d-8f38-1bd1f588c019'}}} Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:08.077188 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 Oct 13 08:59:08.082023 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.084439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 400 to user: Invalid volume: volume c182a9fb-a00b-434d-8f38-1bd1f588c019 is already attached to instances: fb83b0a4-076d-43e8-937b-34c4c8663bb5 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:08.095404 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a79d90c6-8e2e-4c27-bf7b-b7e2d8318084 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.310087 Oct 13 08:59:08.096608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2512/5384] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 08:59:07 2022] POST /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e/os-volume_attachments => generated 174 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:08.106865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:08.107689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:08.125974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.131251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.131935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.134188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.137004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd72aec9-42af-4003-b7d5-773e6578ad9c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-235108938", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:08.139960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.140419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd72aec9-42af-4003-b7d5-773e6578ad9c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 172 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-235108938", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-235108938', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi -1 Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:08.143779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 13 08:59:08.150394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:08.153772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd72aec9-42af-4003-b7d5-773e6578ad9c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:08.154910 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd72aec9-42af-4003-b7d5-773e6578ad9c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022204 Oct 13 08:59:08.160056 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2513/5385] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:08.172021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:08.173074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:08.185541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.186447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.187203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.188204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.190739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.191476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.244699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:59:08.352134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:08.418255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:08.456977 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b43570f4-a854-4d19-b3d5-8575f8134797 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 204 len: 0 microversion: 2.1 time: 0.355657 Oct 13 08:59:08.464456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2873/5386] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:59:08 2022] DELETE /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 08:59:08.479777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:08.482359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:08.504274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.505454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.508174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.512181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.513998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.514523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.723488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:08.733913 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9fcf9018-0069-4912-8306-1acd4db2099d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.572497 Oct 13 08:59:08.758916 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2514/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:08 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:08.770724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:08.771735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:08.784474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.785024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:08.789035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.790226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.792782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.793538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.795854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.798184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-295fd9e2-a349-45ed-b5e5-b4cccbb395ea tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1682 microversion: 2.1 time: 0.328670 Oct 13 08:59:08.801520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2874/5388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:08 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1682 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:08.814564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:08.815837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:08.844063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.844835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.846988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:08.847903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:08.849691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:08.856476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:09.194566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:09.210288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76a25371-ff19-4b76-bba1-d05517b11d20 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.407360 Oct 13 08:59:09.221507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2875/5389] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:08 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:09.266097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72", "name": "network-vif-plugged", "status": "completed", "tag": "755db9b2-1ba0-4a55-8d23-b72a365b4408"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:09.281084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:09.281580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:09.282018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:09.323137 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] Creating event network-vif-plugged:755db9b2-1ba0-4a55-8d23-b72a365b4408 for instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 on n-h2-858384-11 Oct 13 08:59:09.335238 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-88112e6c-1e93-4457-a6b2-bb54d74fdf3d req-c1317e5f-8270-4dae-aa76-cc63cfa0575a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076587 Oct 13 08:59:09.336013 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2876/5390] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:09.474056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:09.490690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59e94c8d-c82a-46b7-b0de-f2a77128ba00 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.729985 Oct 13 08:59:09.491303 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2515/5391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:08 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:09.552691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-535b2dda-f4de-4d8a-90a5-161d2864657c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2096581313", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:09.557739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-535b2dda-f4de-4d8a-90a5-161d2864657c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-535b2dda-f4de-4d8a-90a5-161d2864657c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 216 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2096581313", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2096581313', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:09.559402 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-535b2dda-f4de-4d8a-90a5-161d2864657c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-535b2dda-f4de-4d8a-90a5-161d2864657c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012929 Oct 13 08:59:09.564488 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2877/5392] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:09 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:09.571216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:09.571839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:09.595690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:09.596250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:09.596700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:09.597434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:09.597899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:09.598334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:09.827699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:09.830358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:09.846852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:09.846852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:09.847172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:09.847869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:09.848329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:09.848764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:10.307406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:10.317083 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1519a31-5a43-4cd2-9649-29002b4b29c0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.749635 Oct 13 08:59:10.317686 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2516/5393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:09 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:10.320875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:10.331436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eaf575cf-887a-4ebe-991e-9caaddbaa017 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1682 microversion: 2.1 time: 0.510039 Oct 13 08:59:10.333990 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2878/5394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:09 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1682 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:10.347154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:10.348061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:10.363009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:10.367074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:10.367848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:10.369852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:10.370889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:10.373931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:10.514054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:10.515311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:10.526828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:10.527899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:10.528736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:10.529931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:10.530902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:10.531551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:10.788062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:10.807048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-323b1ea4-a545-4d69-a3ea-0a9652b8e8a8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.463741 Oct 13 08:59:10.809455 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2517/5395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:10 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:10.989821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:11.004751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7518030e-acb4-460f-a62c-99e96d278aad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1314 microversion: 2.1 time: 0.495432 Oct 13 08:59:11.007025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2879/5396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:10 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:11.042082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1375876454", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-key-961356334", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:11.190187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] validate_networks() for [('f016b286-7e2f-4836-80be-a205528d3fd1', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:59:11.365816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:11.366459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:11.383220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:11.384961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:11.388386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:11.391732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:11.396573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:11.398325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:11.610300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:11.628476 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-369289e6-b3d5-45ce-bca1-17fb4a7067cf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1614 microversion: 2.1 time: 0.266877 Oct 13 08:59:11.642941 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2880/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:11 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1614 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:11.668848 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Invalid key_name provided. Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 246 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1375876454", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-key-961356334", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid key_name provided. Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1375876454', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'key_name': 'tempest-key-961356334', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-961356334 not found for user c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:11.671795 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 13 08:59:11.676943 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:11.680930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid key_name provided. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:11.682181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f68ee88-75bf-493d-9102-724d659695e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.645253 Oct 13 08:59:11.683017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2518/5398] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:11 2022] POST /compute/v2.1/servers => generated 70 bytes in 647 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 13 08:59:11.691844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:11.692464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:11.704896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:11.705406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:11.705849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:11.706602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:11.707080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:11.707492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:11.893986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1b1c92-30da-4eca-afa5-9cf97d50c61e", "name": "network-vif-deleted", "tag": "49bc2fb8-b196-43ad-9a02-385f5ffc86f5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:11.935543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:11.935543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:11.942198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:11.995588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] Creating event network-vif-deleted:49bc2fb8-b196-43ad-9a02-385f5ffc86f5 for instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e on n-h1-858384-11 Oct 13 08:59:12.021405 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8189c96f-49bb-4376-bc4c-eeb4bc00e991 req-f00715e5-064d-4043-9e58-4b68213565be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130008 Oct 13 08:59:12.026256 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2519/5399] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:59:12.032196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:12.037531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:12.053544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.053971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.054506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.057391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.058142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.061499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.120207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:12.131380 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9dc51237-4977-4066-b448-556e302191ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.441592 Oct 13 08:59:12.148428 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2881/5400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:11 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:12.172542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:12.173261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:12.187408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.187914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.194736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.199820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.205379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.206476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.330882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:12.343443 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea3ebf75-7435-4d0f-b274-bdfe6c87886a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1501 microversion: 2.1 time: 0.315479 Oct 13 08:59:12.344379 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2520/5401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:12 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:12.371154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:12.373584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:12.388123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.390041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.391432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.396667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.397294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.397851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.483690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c014be6-6dc9-4b05-b1a9-d96fcabd8905 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.116290 Oct 13 08:59:12.484941 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2521/5402] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:12 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:59:12.645895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:12.655229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:12.658987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:12.679011 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f4537a43-df07-4781-bf20-8f61ff52765d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.518307 Oct 13 08:59:12.681990 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2882/5403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:12 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:12.688614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.691127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.692492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.693371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.696625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.697207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.842035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:12.850561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:12.851378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:12.852186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'fault' on Instance uuid 8c1b1c92-30da-4eca-afa5-9cf97d50c61e {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:12.977119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1735036979", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:13.047041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:13.089668 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ce1e9c4-46ad-4238-a2d3-6a732b1e33dd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 200 len: 1331 microversion: 2.1 time: 0.438842 Oct 13 08:59:13.123609 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2522/5404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:12 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 1331 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:13.160980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.security_group_api [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Neutron security group does_not_exist not found {{(pid=127030) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 13 08:59:13.161786 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 258 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1735036979", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1735036979', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 13 08:59:13.174031 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 13 08:59:13.181864 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:13.197743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:13.202270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-813c371a-4634-4020-a23f-cbfd33bc09e2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.230547 Oct 13 08:59:13.207897 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2883/5405] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:12 2022] POST /compute/v2.1/servers => generated 106 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 08:59:13.223449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:13.227460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:13.243977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.244495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.244925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:13.245647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.246108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.246772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:13.496317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:13.499169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:13.519241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.532446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.533172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:13.535452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.545155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.545899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:13.670292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9552523-a0a0-4e83-8fdc-32949eb17bb2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.177924 Oct 13 08:59:13.674755 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2884/5406] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:13 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:13.754138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:13.765923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff3dfd0f-f64d-4660-a926-8b0aee64bc70 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.550520 Oct 13 08:59:13.780074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2523/5407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:13 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:13.797236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:13.798332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:13.806006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.807772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.810995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:13.811935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:13.812636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:13.819136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.120325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:14.121305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:14.136041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.152628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.158469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.170842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.177994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.187701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.233315 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e HTTP/1.1 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8c1b1c92-30da-4eca-afa5-9cf97d50c61e'} Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:14.244310 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 08:59:14.249159 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.251505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:14.254095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7896251b-c3e1-42fd-914f-8c88cad37f1c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 404 len: 111 microversion: 2.1 time: 0.137655 Oct 13 08:59:14.257381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2524/5408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:14 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:14.279906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c18ed13e-8b7f-400c-b1cc-dea608ccda48 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '.version_select at 0x7f5375f63ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:14.318820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:14.329689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b35f06d-8164-4e80-8105-310153bff370 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.537534 Oct 13 08:59:14.330272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2885/5409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:13 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:14.334874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c18ed13e-8b7f-400c-b1cc-dea608ccda48 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135380825" status: 202 len: 0 microversion: 2.1 time: 0.073965 Oct 13 08:59:14.336123 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2525/5410] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 08:59:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135380825 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:14.384613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:14.390685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: ba7cc37e-9abe-4266-ac27-f5937423a7ec] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:14.416460 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/ba7cc37e-9abe-4266-ac27-f5937423a7ec HTTP/1.1 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ba7cc37e-9abe-4266-ac27-f5937423a7ec'} Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.425033 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance ba7cc37e-9abe-4266-ac27-f5937423a7ec could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29b9a29e-59f3-49ff-8eef-c346c57e5eef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ba7cc37e-9abe-4266-ac27-f5937423a7ec" status: 404 len: 111 microversion: 2.1 time: 0.056126 Oct 13 08:59:14.439383 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2526/5411] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:59:14 2022] DELETE /compute/v2.1/servers/ba7cc37e-9abe-4266-ac27-f5937423a7ec => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:14.440660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:14.440660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:14.447663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.452970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.453621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.461059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.461878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.462732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.687272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:14.689700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:14.710688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.717484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.718206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.727436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:14.727936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:14.728399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:14.842253 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32133df0-9f99-4f2a-a6f2-af1e4586599a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.160676 Oct 13 08:59:14.849076 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2527/5412] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:14 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:59:15.127257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:15.142711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a11a2d3-01d5-474f-89b0-c06779dc7a0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.708030 Oct 13 08:59:15.143971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2886/5413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:14 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:15.198789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:15.199834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:15.222772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:15.223268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:15.223714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:15.224432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:15.229703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:15.230145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:15.858896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:15.861568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:15.872370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:15.875809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:15.876496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:15.881988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:15.882856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:15.883676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:15.977267 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-24d456a0-ad5b-4e4a-bdfb-d3f366eff31a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.123287 Oct 13 08:59:15.982940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2887/5414] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:15 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:59:16.551658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:16.562368 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5cc3a370-501e-4f16-b04e-863e8bda07f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 1.385814 Oct 13 08:59:16.568687 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2528/5415] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:15 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:16.599618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:16.600862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:59:16.601602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 9223372036854775808 could not be found. Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '9223372036854775808'} Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:16.604951 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:16.612106 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:16.612106 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:16.612106 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:16.612106 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 13 08:59:16.612106 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:16.613741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:16.616435 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae4a7cae-4272-49b2-bb14-0e51882824e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022259 Oct 13 08:59:16.619333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2888/5416] 10.222.0.23 () {58 vars in 1188 bytes} [Thu Oct 13 08:59:16 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:59:16.629529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:16.630656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:16.644279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:16.645182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:16.648322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:16.649278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:16.649971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:16.650714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:16.990649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:16.992988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:17.012273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.012840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.013308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.014027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.014536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.024075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.162857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-461c9950-24e5-479f-b60c-ab055922fce6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.175703 Oct 13 08:59:17.164036 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2889/5417] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:16 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 13 08:59:17.237980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:17.264386 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb8d9e8a-53b4-4394-a541-161cceefcc0a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.639827 Oct 13 08:59:17.265319 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2529/5418] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:16 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:17.292364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:17.293076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:17.313923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.314450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.314876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.315587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.316042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.316460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.459076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:17.460002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:17.469316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.470069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.471143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.473256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:17.474145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:17.475115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:17.741082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'services' on Instance uuid fb83b0a4-076d-43e8-937b-34c4c8663bb5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:17.900680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0c2f55d-9764-4021-bd4a-4748f8f40afa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments/c182a9fb-a00b-434d-8f38-1bd1f588c019" status: 202 len: 0 microversion: 2.1 time: 0.424242 Oct 13 08:59:17.908834 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2530/5419] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 08:59:17 2022] DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments/c182a9fb-a00b-434d-8f38-1bd1f588c019 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:17.972356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:17.994748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:17.995651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:18.008864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.010814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.010814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.010814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.014939 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04de16e4-1ebf-4657-ad70-8543ad25ee32 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.724375 Oct 13 08:59:18.015175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.024558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.027272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2890/5420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:17 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:18.040444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:18.041415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Failed to fetch instance by id -1 {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 13 08:59:18.042233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance -1 could not be found. Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance -1 could not be found. Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '-1'} Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:18.044840 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:18.050063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:18.050063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:18.050063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 13 08:59:18.050063 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:18.052678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:18.056854 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2bcfa9ab-0877-415e-a254-13ea838fcda6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019273 Oct 13 08:59:18.063014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2891/5421] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 08:59:18 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:59:18.077251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:18.081596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:18.096110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.100032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.101503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.107413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.108959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.110174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.138654 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-975bc06a-7738-4f4e-9f74-1e936a32925b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.218637 Oct 13 08:59:18.148046 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2531/5422] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:17 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:18.179210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:18.182056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:18.196598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.197603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.201408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.205440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.208564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.211208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.268590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:18.328643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c538defe-7070-47ed-aeb0-a7a812ae3710 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.153663 Oct 13 08:59:18.332853 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2532/5423] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:18 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:18.516971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:18.527824 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0363b68e-34e8-46bd-9dd4-8246392d823d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.460721 Oct 13 08:59:18.531732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2892/5424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:18 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:18.557326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:18.558289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:18.569631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.571338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.572223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:18.574529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:18.576598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:18.577276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.110269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:19.139882 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae9aa50a-8795-41d5-b68a-9cdeedb8d44a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.583572 Oct 13 08:59:19.143870 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2533/5425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:18 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:19.158572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:19.160942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:19.189761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:19.190488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 3120a1c9-02c4-4d45-80e1-26803c073e87] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:19.201123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.208430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.209033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.212987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.213870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.214183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.220233 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/3120a1c9-02c4-4d45-80e1-26803c073e87/action HTTP/1.1 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 19 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: {"forceDelete": {}} Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3120a1c9-02c4-4d45-80e1-26803c073e87', 'body': {'forceDelete': {}}} Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:19.232709 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 3120a1c9-02c4-4d45-80e1-26803c073e87 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9bc39355-59a1-41d9-abac-1680a065862d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/3120a1c9-02c4-4d45-80e1-26803c073e87/action" status: 404 len: 111 microversion: 2.1 time: 0.067091 Oct 13 08:59:19.239787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2534/5426] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:19 2022] POST /compute/v2.1/servers/3120a1c9-02c4-4d45-80e1-26803c073e87/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:19.245099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:19.245720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:19.274909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.275469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.275914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.276644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.277074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.277512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.321901 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1e27e8f-e068-4972-9278-4d1926a7eeef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167769 Oct 13 08:59:19.327249 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2893/5427] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:19 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:19.347125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:19.349276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:19.369068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.380190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.396108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.401632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:19.404389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:19.407593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:19.507949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57c58954-e874-49d5-b48f-4ae880161ee0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.166382 Oct 13 08:59:19.509299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2894/5428] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:19 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:19.981206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:19.993404 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-297b6960-ddc1-4f3a-bdbc-7098e9ffd162 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.751825 Oct 13 08:59:19.994025 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2535/5429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:19 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:20.021110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:20.021110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:20.027731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.029110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.029781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.030806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.031489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.032158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.337353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:20.340013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:20.358830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.359998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.359998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.360197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.360696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.361197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.446107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fad4099d-3d59-4d45-8080-fd03d3360fbc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112085 Oct 13 08:59:20.458615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:20.501822 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2536/5430] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:20 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:59:20.509579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ffe8324-78ef-457f-b45f-98dc3bc6cdc2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.494619 Oct 13 08:59:20.513335 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2895/5431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:20 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:20.521384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:20.526209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:20.538794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.540510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.541843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.542976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.543642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.544721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.569648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:20.573726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 2ea9c560-a197-4ee2-be91-81081ca972a7] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:20.592881 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/2ea9c560-a197-4ee2-be91-81081ca972a7/action HTTP/1.1 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 39 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: {"os-getConsoleOutput": {"length": 10}} Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '2ea9c560-a197-4ee2-be91-81081ca972a7', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:20.601619 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. Oct 13 08:59:20.607684 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:20.609793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 2ea9c560-a197-4ee2-be91-81081ca972a7 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:20.611188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46055979-72ff-49f1-a341-2c165263735a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/2ea9c560-a197-4ee2-be91-81081ca972a7/action" status: 404 len: 111 microversion: 2.1 time: 0.047987 Oct 13 08:59:20.612250 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2896/5432] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:20 2022] POST /compute/v2.1/servers/2ea9c560-a197-4ee2-be91-81081ca972a7/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:20.626647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:20.637326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:20.655351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.656719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.662387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.663475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:20.664434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:20.665103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:20.688306 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46ab5f9b-bfb8-45a3-becf-bb7f33834011 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.171133 Oct 13 08:59:20.692488 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2537/5433] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:20 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:20.777824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:21.506182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:21.516549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:21.578135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.582706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.587003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:21.593184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.598591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.602082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:21.623316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:21.665702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1dca2b01-675c-42ad-894e-c5b27b37a79b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 1.046811 Oct 13 08:59:21.670205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2897/5434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:20 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:21.699163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:21.701374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:21.720395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.725895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.734025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:21.736538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.748364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.755086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:21.771495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1273dc25-e74b-4d72-b17e-085e40a08571 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.266868 Oct 13 08:59:21.772137 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2538/5435] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:21 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:21.795254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:21.806737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:21.844465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.844967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.845548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:21.854958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:21.858616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:21.859475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:22.001900 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85f4969a-0330-416b-80b1-2978bbfabf4b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.223564 Oct 13 08:59:22.005601 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2539/5436] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:21 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:22.401552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:22.411093 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07c564d9-e273-4ab7-bcca-a00460e4b725 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.718411 Oct 13 08:59:22.432856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2898/5437] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:21 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:22.442340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:22.446353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 10b36aa1-4615-40ca-8243-872b1a6ce7cc] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:22.469299 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/10b36aa1-4615-40ca-8243-872b1a6ce7cc HTTP/1.1 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '10b36aa1-4615-40ca-8243-872b1a6ce7cc'} Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:22.481039 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:22.494292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 10b36aa1-4615-40ca-8243-872b1a6ce7cc could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:22.500559 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd5af276-de42-42ce-af4d-8c2f98be762e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/10b36aa1-4615-40ca-8243-872b1a6ce7cc" status: 404 len: 111 microversion: 2.1 time: 0.064299 Oct 13 08:59:22.502789 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2540/5438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:22 2022] GET /compute/v2.1/servers/10b36aa1-4615-40ca-8243-872b1a6ce7cc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:22.525513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:22.527680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:22.565642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:22.566768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:22.567455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:22.569652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:22.571885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:22.573179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:22.785302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:22.788019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:22.803889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:22.804907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:22.805294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:22.806085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:22.806894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:22.807540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:22.868227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ee8160c-c192-457e-8d48-27684a20bff8 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087794 Oct 13 08:59:22.872798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2541/5439] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:22 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:23.013587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:23.017558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:23.041501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.050629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.051118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.052832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.053329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.053775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.170506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2acd77bc-712a-49ba-baf2-f426e02f57c6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 14 microversion: 2.1 time: 0.160635 Oct 13 08:59:23.178114 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2542/5440] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:23 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:23.212931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:23.226237 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff12aed9-3c8f-4da7-8360-65c35d9592fd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.714031 Oct 13 08:59:23.246451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2899/5441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:22 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:23.271817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:23.272605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:23.331145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.331680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.332134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.332881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.342540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.343119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.645520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:23.655519 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-803a247f-4782-45a0-b67f-ff5ee516f08b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.397689 Oct 13 08:59:23.668348 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2543/5442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:23 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:23.884141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:23.886771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:23.906749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.908463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.922352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.923109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:23.923603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:23.924022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:23.955304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b30b9a5-42ea-441b-9ffa-8ec807fb52f2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1683596705", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b30b9a5-42ea-441b-9ffa-8ec807fb52f2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 238 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1683596705", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1683596705', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.977346 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b30b9a5-42ea-441b-9ffa-8ec807fb52f2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:23.984280 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b30b9a5-42ea-441b-9ffa-8ec807fb52f2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035198 Oct 13 08:59:23.990786 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2544/5443] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:24.008513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:24.009505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:24.035593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1785c8de-193b-4bbf-a60f-ac95a8e1da99 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150651 Oct 13 08:59:24.035796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.036355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.036893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.037203 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2900/5444] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:23 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:24.037914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.038472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.038999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.184854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:24.189917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:24.212500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.213315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.215647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.217673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.218163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.218879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.345352 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-86e623e7-498b-4b48-a8cd-4d9a5138c84a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action" status: 200 len: 8203 microversion: 2.1 time: 0.163707 Oct 13 08:59:24.354154 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2901/5445] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:24 2022] POST /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72/action => generated 8203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:24.360023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:24.362642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:24.377311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.379390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.382517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.383622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.425309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.426152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.464325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:24.474742 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2ce106d-761b-42d8-a0df-13e72e552932 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.482370 Oct 13 08:59:24.481801 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2545/5446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:23 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:24.511445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:24.514030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:24.526967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.530830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.532529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.535715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:24.536567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:24.537406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:24.786618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:24.795721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-728fc69e-c51e-4e9d-9bd6-d27eeebbaa2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.288238 Oct 13 08:59:24.805858 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2546/5447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:24 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:25.053581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:25.059464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.073153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.074622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.077307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.081952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.088157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.093669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.143835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:25.158101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93b22a30-f6b1-4b61-bf36-067588106aa7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.802566 Oct 13 08:59:25.159009 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2902/5448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:24 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:25.187147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:25.188392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.198036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.202554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.203315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.204357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.206211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.208460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.267608 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f1caa3ed-c45c-48d9-bbaa-ae3a0347bdc6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221577 Oct 13 08:59:25.274487 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2547/5449] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:25 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:25.280176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2db8b2c1-ad30-4ef4-b429-1f05deaef4d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2008854452", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2db8b2c1-ad30-4ef4-b429-1f05deaef4d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 235 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2008854452", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2008854452', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.293949 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 13 08:59:25.300725 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.311120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2db8b2c1-ad30-4ef4-b429-1f05deaef4d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:25.315950 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2db8b2c1-ad30-4ef4-b429-1f05deaef4d4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.039236 Oct 13 08:59:25.316869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2548/5450] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:25.325503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:25.333169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.374585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.375989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.377168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.378241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.379091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.379764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.628337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:25.637179 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ff2619c-477c-45a5-b94a-bc22ff6de1e3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.315477 Oct 13 08:59:25.638396 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2549/5451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:25.662627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:25.663254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.672006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.672717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.673560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.674992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.676160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.677204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.857206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:25.870293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c180ecf-1d66-4a4f-b28f-5a2b2689f9cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.210665 Oct 13 08:59:25.871608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2550/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:25.898923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:25.899461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: dd992ee3-d7cc-44e6-91bd-4cbed84b4606] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.917143 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/dd992ee3-d7cc-44e6-91bd-4cbed84b4606/action HTTP/1.1 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 13 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: {"pause": {}} Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'dd992ee3-d7cc-44e6-91bd-4cbed84b4606', 'body': {'pause': {}}} Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:25.935605 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance dd992ee3-d7cc-44e6-91bd-4cbed84b4606 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-388d6459-fd61-498c-97fa-9c61c4192747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/dd992ee3-d7cc-44e6-91bd-4cbed84b4606/action" status: 404 len: 111 microversion: 2.1 time: 0.045710 Oct 13 08:59:25.941464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2551/5453] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:25 2022] POST /compute/v2.1/servers/dd992ee3-d7cc-44e6-91bd-4cbed84b4606/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:25.956494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:25.957043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:25.977119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.978292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:25.979459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.979936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.985021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:25.985773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:25.987297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:25.990389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80ba9978-ae63-4bd4-9c0d-d80df25f099e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.805290 Oct 13 08:59:26.002457 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2903/5454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:25 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:26.020987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:26.021666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.035279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.036417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.037525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.042518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.043171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.043857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.333999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:26.350573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e3bac78-a80f-4a11-b78c-0da0a0c296f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.406677 Oct 13 08:59:26.353468 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2552/5455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:26.364908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:26.374073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:26.375894 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba28103c-7da0-442b-b46d-9a0d843ba570 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.360132 Oct 13 08:59:26.376802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2904/5456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:26 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:26.377035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.388850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:26.390178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.398275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.398836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.399284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.400105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.400449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.400921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.405306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.405819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.406288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.407178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.408033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.408699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.532437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ed158ffe-5027-4c57-85f9-26538bcc1421 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177584 Oct 13 08:59:26.539748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2553/5457] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:26 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:26.552053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:26.552688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.577275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.577798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.578243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.585044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.587137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.587656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.708862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:26.728795 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-519262f8-d36a-4526-be42-64e866730069 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.349129 Oct 13 08:59:26.734234 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2905/5458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:26 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:26.760566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:26.761109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.774492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.776393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.776896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.778917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.779419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.779907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.828955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:26.841033 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47b4348c-80e1-487b-a148-37e090206bd6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.299556 Oct 13 08:59:26.844200 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2554/5459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:26 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:26.871914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:26.872798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.876584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:26.920467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.925061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.930781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.933402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.934477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.937017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.969916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f843ee17-40a4-43fe-a1eb-661fedc7b50d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.213673 Oct 13 08:59:26.975939 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2906/5460] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:26 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:26.983201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:26.984908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:26.995246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:26.997020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:26.998625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:26.999928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.000619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.001405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.014765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:27.171124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Locking {{(pid=127031) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 13 08:59:27.286366 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b5077cd-22cd-4206-b159-0e1235601701 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.418423 Oct 13 08:59:27.287415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2555/5461] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:26 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:27.299905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:27.300649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:27.317439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.319775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.320483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.323392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.325283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.326052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.436512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:27.449563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7810722e-c6bd-4aeb-ac58-e59311f9b383 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1509 microversion: 2.1 time: 0.471843 Oct 13 08:59:27.450640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2907/5462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:26 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1509 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:27.550609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:27.553279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:27.572221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.577444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.579698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.580982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.581692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.583588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.663863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8701ac2f-55ce-4c99-ba60-73fc00f50a3f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117399 Oct 13 08:59:27.666966 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2908/5463] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:27 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:59:27.789983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:27.801372 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6eda5afc-0580-4a98-8564-4f7ba3bb4e2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.509486 Oct 13 08:59:27.804805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2556/5464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:27 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:27.835545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:27.852414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.852910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.853347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.932776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action HTTP/1.1 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: {"os-stop": {}} Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '2ee2cdd6-5903-4004-b00c-56cfe6448598', 'body': {'os-stop': {}}} Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked Oct 13 08:59:27.939742 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:27.944816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 409 to user: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 is locked {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:27.944816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d16f2f4-12e3-4b05-b7c6-56aa67b0f43c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 409 len: 107 microversion: 2.1 time: 0.110992 Oct 13 08:59:27.946120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2909/5465] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:27 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 107 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:59:27.953661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:27.954511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:27.973364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.973990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.974569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:27.977759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:27.979227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:27.980383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.093558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Unlocking {{(pid=127031) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 13 08:59:28.214100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88bed652-1cbd-4113-bc87-dd40f473eb4d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.265193 Oct 13 08:59:28.217432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2557/5466] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:27 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:28.224886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:28.237339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.239671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.241199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.288419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 08:59:28.393109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce50ba5f-427d-4f73-a696-0e22b957f1ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.172779 Oct 13 08:59:28.397393 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2910/5467] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:28 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:28.405510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:28.406982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:28.416383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.419306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.420089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.421510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.422230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.423498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.475872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:28.476659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:28.497938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.500085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.501312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.504359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.506122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.512157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.847581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:28.858937 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29479cb8-43e4-4058-90bd-64de00061879 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.456682 Oct 13 08:59:28.866723 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2558/5468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:28 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:28.873702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:28.877238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:28.893947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.894359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.899949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:28.900734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:28.901221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:28.901644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.003001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6fddd7b3-f31e-4dc2-8559-2f938057bc88 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140065 Oct 13 08:59:29.004165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2559/5469] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 08:59:28 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 08:59:29.102446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:29.112506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:29.113180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.131574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.131574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.133798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1216cf9-4155-479a-a9b3-d7af44fd6014 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1489 microversion: 2.1 time: 0.659323 Oct 13 08:59:29.134448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.134998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.141429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.141825 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2911/5470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:28 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1489 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:29.141959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.161336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:29.162255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.173664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.177612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.178125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.178912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.180072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.180514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.231810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 08:59:29.238146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:29.266269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'pause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state paused Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 13 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: {"pause": {}} Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'pause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state paused Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'pause': {}}} Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state paused. Cannot pause while the instance is in this state. Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state paused Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:29.268204 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state paused Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'pause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state paused {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:29.276817 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcc5f1a3-8a2a-4f58-b497-00eb521d4954 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 143 microversion: 2.1 time: 0.119088 Oct 13 08:59:29.278175 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2912/5471] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:29 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 143 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 08:59:29.290389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:29.290959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.304490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.306090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.309917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.311002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.311681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.312589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.467524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-135ddc83-cffe-4801-86d1-20441e8038ba tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.187427 Oct 13 08:59:29.467875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6d70f7e0-04bb-4b4f-a198-0148139bf0c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 204 len: 0 microversion: 2.1 time: 0.359805 Oct 13 08:59:29.468477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2560/5472] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 08:59:29 2022] DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 08:59:29.469619 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2913/5473] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:29 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:29.487647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:29.488491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.504494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:29.508524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.519930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.520773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.521606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.522954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.523763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.524386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.537143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.537649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.538196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.546832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.549152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.549616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.896016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:29.907809 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e447e1b-cf66-404b-af38-033a05d0b5a9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1496 microversion: 2.1 time: 0.424685 Oct 13 08:59:29.938969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2914/5474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:29 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1496 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:29.947858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:29.951554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:29.959442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.960350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.961033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:29.962023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:29.962756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:29.963677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:30.209932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:30.218220 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8bc2b779-e812-4d4a-ab7e-205d587188dc tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1681 microversion: 2.1 time: 0.735166 Oct 13 08:59:30.223949 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2561/5475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:29 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1681 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:30.332100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:30.348962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3de32a67-067f-49c3-9102-103df992fea0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.408381 Oct 13 08:59:30.349993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2915/5476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:29 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:30.943396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:30.943624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:30.973068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:30.973776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:30.974353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:30.975228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:30.975838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:30.977344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.253769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:31.254654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:31.276779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.280308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.280789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.287066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.287558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.288191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.556534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:31.568180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-478867bc-c526-4ae6-b8db-719f77f43248 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.628986 Oct 13 08:59:31.569741 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2562/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:30 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:31.581521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:31.588410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:31.610055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.610617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.612051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.615816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.616306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.616867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.757011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:31.765492 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49e0974f-f0e6-4be3-86d1-0b7f23a19500 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1681 microversion: 2.1 time: 0.515458 Oct 13 08:59:31.766626 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2916/5478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:31 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1681 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:31.773733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:31.779933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:31.805410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.807076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.809519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:31.812401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:31.814149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:31.816360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.234347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:32.242565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba9bbbe5-367d-4ec1-aaa6-9c6b925446dd tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.474641 Oct 13 08:59:32.243162 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2917/5479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:31 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:32.278419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:32.280783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:32.298032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.298581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.299031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.299969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.300520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.300951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.328799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action HTTP/1.1 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 28 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: {"reboot": {"type": "SOFT"}} Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bed19514-32cb-4108-948f-877680adbcb1', 'body': {'reboot': {'type': 'SOFT'}}} Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:32.332018 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:32.337129 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11f9aa46-ba46-4187-889e-3916009bff21 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action" status: 404 len: 111 microversion: 2.1 time: 0.072580 Oct 13 08:59:32.354825 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2918/5480] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:32 2022] POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:32.360267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:32.361107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:32.367522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.368017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.368459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.369170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.369627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.370059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.687088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:32.705219 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7441f52-b1e4-49ba-aa37-a92b240c458c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.346325 Oct 13 08:59:32.705775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2919/5481] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:32 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:32.729405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:32.730315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:32.737292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.739235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.739878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:32.740796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:32.741466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:32.742072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:33.082697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:33.105135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-705ee0d8-0e80-421b-95c4-7bce05c88a5d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 1.530906 Oct 13 08:59:33.105801 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2563/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:31 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:33.143145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:33.144089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:33.173940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:33.181814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:33.185205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:33.186188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:33.188560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:33.189557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:33.331712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:33.344360 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-deed390a-8bde-42f0-9a7a-b096742e820c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.618676 Oct 13 08:59:33.345691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2920/5483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:32 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:33.372358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:33.375074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 4ebaf411-e53a-4f83-9843-2eb11048e53b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:33.394615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/4ebaf411-e53a-4f83-9843-2eb11048e53b/action HTTP/1.1 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 28 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: {"reboot": {"type": "SOFT"}} Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4ebaf411-e53a-4f83-9843-2eb11048e53b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. Oct 13 08:59:33.397112 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. Oct 13 08:59:33.402052 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:33.416372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 4ebaf411-e53a-4f83-9843-2eb11048e53b could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:33.418016 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd2fcafb-7e69-448c-b18e-64aa29866a2c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/4ebaf411-e53a-4f83-9843-2eb11048e53b/action" status: 404 len: 111 microversion: 2.1 time: 0.049920 Oct 13 08:59:33.423111 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2921/5484] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:33 2022] POST /compute/v2.1/servers/4ebaf411-e53a-4f83-9843-2eb11048e53b/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:33.436558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:33.448146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:33.468380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:33.476970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:33.480398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:33.484137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:33.486650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:33.487344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:33.625045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:33.635192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fd7eb29-e6af-417c-a142-0b0cb5258fdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1613 microversion: 2.1 time: 0.522841 Oct 13 08:59:33.639581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2564/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:33 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1613 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:34.129908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:34.131215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:34.149358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.149854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.150297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.155265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.155757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.156202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.208677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:34.440120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:34.472938 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8bc98a2d-9814-431e-b2f6-eaae22baf070 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 1.044414 Oct 13 08:59:34.475527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2922/5486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:33 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:34.487510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb83b0a4-076d-43e8-937b-34c4c8663bb5", "name": "network-vif-deleted", "tag": "2d423ff2-ad3a-46ce-81bd-13a543e39c4d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:34.553706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.564088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.565687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.628546 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] Creating event network-vif-deleted:2d423ff2-ad3a-46ce-81bd-13a543e39c4d for instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 on n-h1-858384-11 Oct 13 08:59:34.647851 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-02f0cffc-35ca-4e16-a0b0-12c8b56c5cea req-f0edb989-cb27-47b3-af9a-e1bd5efd5c6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160077 Oct 13 08:59:34.659808 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2923/5487] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 08:59:34.694523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:34.695977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:34.703780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:34.707195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.708087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.708868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.709894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.710592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.711259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.805191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:34.818131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-53e5f245-c726-45a5-9fbe-89295cec18d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.692795 Oct 13 08:59:34.820280 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2565/5488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:34 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:34.838854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:34.841919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:34.883551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.885056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.886363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.887430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.889342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.890740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.964652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:34.977126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6817388-bcba-46fa-ac1e-ba32b89e478e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.314060 Oct 13 08:59:34.977724 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2924/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:34.983866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:34.984703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:34.987223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:34.988105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'fault' on Instance uuid fb83b0a4-076d-43e8-937b-34c4c8663bb5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:35.003169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:35.007078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:35.020947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.021456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.024507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.025483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.032529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.033256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.062258 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action HTTP/1.1 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 65 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bed19514-32cb-4108-948f-877680adbcb1', 'body': {'rebuild': {'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375'}}} Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 13 08:59:35.065037 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 08:59:35.070628 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:35.077622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:35.092509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-454fd8d7-3b8d-49db-b10b-ae0293ceaf36 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action" status: 404 len: 111 microversion: 2.1 time: 0.095584 Oct 13 08:59:35.093108 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2925/5490] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:34 2022] POST /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:35.109343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:35.110048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:35.136440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.138383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.138869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.139816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.140361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.174885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.272832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:35.284253 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8cdc73c-8b4f-49d8-a385-d1f1290280a6 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 200 len: 1331 microversion: 2.1 time: 0.460001 Oct 13 08:59:35.298820 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2566/5491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:34 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 1331 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:35.547937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:35.561331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd369dab-370d-4dd3-9c1a-c95b0f925723 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.457683 Oct 13 08:59:35.573543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2926/5492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:35 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:35.592001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:35.592628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:35.606183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.606891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.607751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.608488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.608949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.609385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.848382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:35.849235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:35.856179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.856715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.857157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:35.857872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:35.858325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:35.858772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.095794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:36.098160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:36.105249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9309d48-61c5-4745-87b5-0421a0af1db7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.261465 Oct 13 08:59:36.106345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2927/5493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:35 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:36.133407 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04d039f2-9af2-48ec-b7bf-336c85d862ef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.546660 Oct 13 08:59:36.134021 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2567/5494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:35 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:36.158078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:36.161771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 06f76ad0-7070-46f1-80ba-ca30543be752] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.179159 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/06f76ad0-7070-46f1-80ba-ca30543be752/action HTTP/1.1 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 65 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '06f76ad0-7070-46f1-80ba-ca30543be752', 'body': {'rebuild': {'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375'}}} Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 13 08:59:36.182174 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. Oct 13 08:59:36.188552 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.195423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 06f76ad0-7070-46f1-80ba-ca30543be752 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:36.197465 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e82fcdcb-3cc3-40d6-8cf5-ea759fd773e4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/06f76ad0-7070-46f1-80ba-ca30543be752/action" status: 404 len: 111 microversion: 2.1 time: 0.042630 Oct 13 08:59:36.199858 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2928/5495] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:36 2022] POST /compute/v2.1/servers/06f76ad0-7070-46f1-80ba-ca30543be752/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:36.207257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:36.208187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.218496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.222019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.222687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.223855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.224445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.224979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.323661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:36.324288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.345195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.346390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.350371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.351687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.351814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.353315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.386701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 HTTP/1.1 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fb83b0a4-076d-43e8-937b-34c4c8663bb5'} Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.396963 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 08:59:36.405616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.408848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:36.408848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-81e3ccb5-97c6-4713-8599-fac4e50ec312 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 404 len: 111 microversion: 2.1 time: 0.092231 Oct 13 08:59:36.411012 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2929/5496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:36 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 08:59:36.423036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9327659-5a0e-4180-ae68-274b5d766dfd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '.version_select at 0x7f53766553a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:36.473949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9327659-5a0e-4180-ae68-274b5d766dfd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-328748764" status: 202 len: 0 microversion: 2.1 time: 0.057754 Oct 13 08:59:36.475543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2930/5497] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 08:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-328748764 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:59:36.483097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:36.491560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2582374f-1357-423d-aa3b-d77ec6130c05 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.288111 Oct 13 08:59:36.495842 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2568/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:36.531224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:36.532759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.541631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.542506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.543634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.545022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.545880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.546872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.832746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:36.843916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-692ca1da-1e93-4fb8-bc21-09be9fce4309 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.317496 Oct 13 08:59:36.847930 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2931/5499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:36.878499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:36.879258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: ab310214-1c9d-4cd2-b8c7-f780fcdc0686] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.911371 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/ab310214-1c9d-4cd2-b8c7-f780fcdc0686/action HTTP/1.1 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 15 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: {"restore": {}} Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ab310214-1c9d-4cd2-b8c7-f780fcdc0686', 'body': {'restore': {}}} Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:36.918877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance ab310214-1c9d-4cd2-b8c7-f780fcdc0686 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b3d4d022-22c9-49c8-a2dc-95ee0e24ba73 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/ab310214-1c9d-4cd2-b8c7-f780fcdc0686/action" status: 404 len: 111 microversion: 2.1 time: 0.049947 Oct 13 08:59:36.929792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2569/5500] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:36 2022] POST /compute/v2.1/servers/ab310214-1c9d-4cd2-b8c7-f780fcdc0686/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:36.941483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:36.942804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:36.951342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.951957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.952558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:36.953375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:36.955241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:36.956082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:37.136596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:37.137603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:37.157060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:37.160681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:37.163902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:37.164773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:37.165255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:37.165748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:37.624408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:37.644006 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3efd5376-205e-4301-83f1-68199c3237e9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.710166 Oct 13 08:59:37.644627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2932/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:37.672791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:37.673818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:37.683750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:37.686158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:37.689427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:37.690563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:37.691302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:37.692320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:37.796830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:37.805568 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ee2805b-05d1-4d36-807b-84f39ecf594b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.672957 Oct 13 08:59:37.809947 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2570/5502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:37 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:38.108565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:38.126263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3409fc5a-7c13-4ef1-9724-214f4c1a9934 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.458130 Oct 13 08:59:38.130916 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2933/5503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:37 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:38.161643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:38.165351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:38.173564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.182003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.185150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.187630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.192487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.193184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.241912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0923b072-e2d8-4409-bb95-2847f8eec64f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: .version_select at 0x7f53764dd160>, body: {"keypair": {"name": "tempest-keypair-1849097910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZjmEGi58Q1yXZzch+pW3bQCSo3yjNEL0PAV6FsnTle/ndTO//8bXVcxQvtp4Sy1Rp2UU/PuhZHuYYxZpG7xuf1K3q6DHWFDW8vzXV+2QkE5+wz3g8bXZiw8loisUVE+g=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:38.260061 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'restore' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 15 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: {"restore": {}} Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'restore' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'restore': {}}} Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state active. Cannot restore while the instance is in this state. Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:38.266025 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:38.271526 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:38.271526 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:38.271526 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:38.271526 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:38.271526 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:38.273860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'restore' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:38.277030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67a0ec24-8533-4413-9a42-938a9351d685 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 145 microversion: 2.1 time: 0.121142 Oct 13 08:59:38.278316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2571/5504] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:38 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:59:38.288821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0923b072-e2d8-4409-bb95-2847f8eec64f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:59:38.290507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:38.293014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:38.305169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.305875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0923b072-e2d8-4409-bb95-2847f8eec64f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:59:38.308558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.309366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.310363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.312089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.317273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.356952 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0923b072-e2d8-4409-bb95-2847f8eec64f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121593 Oct 13 08:59:38.360638 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2934/5505] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 08:59:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:38.646643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:38.664127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d3f724f3-b1e1-4851-a2e8-326433d46d23 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.376014 Oct 13 08:59:38.665194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2572/5506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:38.700708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:38.701480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:38.719623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.720126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.723864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.726339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.726871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.730451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.752712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:38.837312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:38.838864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:38.855345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.859722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.860471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:38.861508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:38.864065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:38.866219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:39.401402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:39.425524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5ccf977-41a0-4f43-90b4-dcc8e21523d2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1655 microversion: 2.1 time: 0.592722 Oct 13 08:59:39.431912 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2573/5507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:38 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1655 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:39.460351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:39.491058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:39.491963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:39.492544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:39.543105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Going to try to start instance {{(pid=127031) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 08:59:39.644029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4030b38e-2dca-41eb-a86e-44fd14329863 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.193323 Oct 13 08:59:39.645184 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2574/5508] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:39 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:39.660733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:39.674385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:39.684374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:39.692493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:39.693227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:39.694142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:39.694778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:39.695377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:39.739917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:39.758107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d3165dc-e2b5-47d6-af35-efaed7140746 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 1.060108 Oct 13 08:59:39.760472 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2935/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:39.788613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:39.794303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 7aca91be-cd2a-4aa4-9525-1c26433261e5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:39.808363 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/7aca91be-cd2a-4aa4-9525-1c26433261e5/action HTTP/1.1 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 14 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: {"resume": {}} Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '7aca91be-cd2a-4aa4-9525-1c26433261e5', 'body': {'resume': {}}} Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:39.816771 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:39.820527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:39.820527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:39.820527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. Oct 13 08:59:39.820527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:39.821649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 7aca91be-cd2a-4aa4-9525-1c26433261e5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:39.822954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa3d4663-3507-475b-9266-e48155a6329c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/7aca91be-cd2a-4aa4-9525-1c26433261e5/action" status: 404 len: 111 microversion: 2.1 time: 0.041209 Oct 13 08:59:39.823849 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2936/5510] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:39 2022] POST /compute/v2.1/servers/7aca91be-cd2a-4aa4-9525-1c26433261e5/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:39.836642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:39.838744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:39.861285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:39.863949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:39.865706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:39.866643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:39.868272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:39.872758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.155422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:40.168540 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3ed6b89-2675-457a-83e0-32824897e39e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1664 microversion: 2.1 time: 0.511087 Oct 13 08:59:40.171215 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2575/5511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:39 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1664 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:40.415062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:40.436806 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9251c2ed-0238-4c2a-a697-e9aabd854ad0 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.605355 Oct 13 08:59:40.440865 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2937/5512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:39 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:40.470529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:40.471718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:40.485930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.486664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.490718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.492282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.492870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.493411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.766920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:40.776349 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa611b4c-cc3f-4bd2-9d22-173e2a867887 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.310911 Oct 13 08:59:40.782350 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2576/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:40 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:40.810302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:40.810790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:40.834266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.835023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.835470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.839738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.843374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.844005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.899447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'resume' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 14 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: {"resume": {}} Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'resume' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'resume': {}}} Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state active. Cannot resume while the instance is in this state. Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:40.905965 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 08:59:40.909461 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:40.911136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'resume' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:40.920973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6a53a516-a913-4f30-830f-74276f48a5ca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 144 microversion: 2.1 time: 0.115393 Oct 13 08:59:40.922177 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2938/5514] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:40 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 144 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 08:59:40.930629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:40.931406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:40.945254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.949936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.950663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:40.951583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:40.953930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:40.954660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:41.200293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:41.201063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:41.221986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:41.223533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:41.226255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:41.227154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:41.239023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:41.239564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:41.606856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:41.616194 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c37472ae-0376-4094-94f9-604ec40edd1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1664 microversion: 2.1 time: 0.421148 Oct 13 08:59:41.652695 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2939/5515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:41 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1664 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:41.852922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:41.867804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-90bcf1dd-f8fe-428c-a7ca-7a49d1d0196f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.941320 Oct 13 08:59:41.868566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2577/5516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:40 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:41.893057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:41.893734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:41.903750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:41.904273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:41.904741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:41.905508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:41.905975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:41.914544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.251845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:42.260391 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc043298-0e8c-4b35-ae42-54f08c824919 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.371680 Oct 13 08:59:42.260981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2940/5517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:41 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:42.447294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bb95ccf-2aa7-4490-9bae-be1bcbcbfb27 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bb95ccf-2aa7-4490-9bae-be1bcbcbfb27 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 160 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: {"server": {"name": "", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f016b286-7e2f-4836-80be-a205528d3fd1"}]}} Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'server': {'name': '', 'imageRef': '312a3023-32f8-4474-bfa0-ae0f09977375', 'flavorRef': '452', 'networks': [{'uuid': 'f016b286-7e2f-4836-80be-a205528d3fd1'}]}}} Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '' Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 08:59:42.452659 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 13 08:59:42.455829 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 08:59:42.458497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bb95ccf-2aa7-4490-9bae-be1bcbcbfb27 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:42.459675 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bb95ccf-2aa7-4490-9bae-be1bcbcbfb27 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017364 Oct 13 08:59:42.460829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2578/5518] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 08:59:42.470379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:42.471253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:42.486178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.486719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.487165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.487892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.489802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.490444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.652889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:42.653801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:42.669512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.671507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.672334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.674891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.675557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.685819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.842494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:42.856801 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a0f373bd-8230-46fd-984d-585066b8bd89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.391542 Oct 13 08:59:42.880024 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2941/5519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:42 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:42.907030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:42.909783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:42.937884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.939817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.940657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:42.942258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:42.943103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:42.944589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.091604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:43.110341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5414ec6a-f229-44f7-8409-77a05ba9b366 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.462095 Oct 13 08:59:43.113475 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2579/5520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:42 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:43.141208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:43.142064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:43.153644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.155062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.156182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.159065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.160669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.161327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.363550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:43.380197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f859b2b5-7b5f-4205-8e6a-ff94433f5ae1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.482498 Oct 13 08:59:43.381321 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2942/5521] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:42 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:43.415371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:43.416397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 44283f87-035f-4006-abd9-70e3f35d6ce4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:43.425901 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/44283f87-035f-4006-abd9-70e3f35d6ce4/action HTTP/1.1 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 14 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: {"shelve": {}} Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '44283f87-035f-4006-abd9-70e3f35d6ce4', 'body': {'shelve': {}}} Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 08:59:43.438195 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 08:59:43.441579 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 08:59:43.441579 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 08:59:43.441579 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. Oct 13 08:59:43.441579 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 08:59:43.441858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 44283f87-035f-4006-abd9-70e3f35d6ce4 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 08:59:43.444970 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90ee9263-98d5-4bea-a807-86995c2dcd12 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/44283f87-035f-4006-abd9-70e3f35d6ce4/action" status: 404 len: 111 microversion: 2.1 time: 0.038335 Oct 13 08:59:43.445832 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2943/5522] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:43 2022] POST /compute/v2.1/servers/44283f87-035f-4006-abd9-70e3f35d6ce4/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 08:59:43.456554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-225631682", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d510c72-59c1-4539-8bec-64f07cb7d4c4"}], "security_groups": [{"name": "tempest-securitygroup--2904529"}], "key_name": "tempest-keypair-1849097910", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:43.577814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:43.589507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6dbcb21b-89dc-4b0a-977b-2062bc075a22 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.449618 Oct 13 08:59:43.599913 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2580/5523] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:43 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:43.613557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:43.614200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:43.620519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.621514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.622098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.623156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.624215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.624930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.711497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] validate_networks() for [('6d510c72-59c1-4539-8bec-64f07cb7d4c4', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 08:59:43.789893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:43.798868 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca8d02ec-0457-4e58-97cd-20a1a1a9b380 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.197687 Oct 13 08:59:43.817580 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2581/5524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:43 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:43.828566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:43.829300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:43.840756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.844797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.845733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.847007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:43.847556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:43.848005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:43.908634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:43.924739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Unlocking {{(pid=127031) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 13 08:59:44.036765 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c70c01c1-51cb-416b-84e2-ff16cb62b713 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.217685 Oct 13 08:59:44.040023 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2582/5525] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:43 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:44.052843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:44.053899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:44.063480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.064793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.065484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.066497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.067217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.067857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.249844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:44.271260 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5febaa93-6215-45ca-9257-85d6ecc3fe79 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.228842 Oct 13 08:59:44.279109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2583/5526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:44 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:44.291735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:44.292618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:44.324102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.325809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.325904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.332644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.333233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.334305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.552125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 08:59:44.552674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 08:59:44.553137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 08:59:44.553631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 08:59:44.554131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 08:59:44.572440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.574840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.575613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.576566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.577355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:44.578005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.581286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.586910 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be28ef40-e464-4687-a2b4-cfa50b84f73d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.304663 Oct 13 08:59:44.587550 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2584/5527] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:44.593771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:44.594318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:44.602913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.603421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.603880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.604585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.605050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.605485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.620054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 08:59:44.628218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 08:59:44.644044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 08:59:44.646645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 08:59:44.656629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lazy-loading 'flavor' on Instance uuid cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 08:59:44.712905 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ac6d106-c8ba-4efd-a8be-6ec1af393ef2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.260989 Oct 13 08:59:44.722757 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2944/5528] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 08:59:43 2022] POST /compute/v2.1/servers => generated 399 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 08:59:44.754653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:44.755850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:44.790584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.793606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.794991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:44.798196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:44.799364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:44.801650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:45.216142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:45.248818 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2cd8f71-4202-4024-977e-72ff3a86e074 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.524339 Oct 13 08:59:45.272422 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2945/5529] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:45.272422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ab2acd8-a5a0-4efe-a363-75d170f0fa01 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:45.276558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3ab2acd8-a5a0-4efe-a363-75d170f0fa01 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:45.319043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-150ed748-bb03-41c8-948c-3c93830833c6 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.730018 Oct 13 08:59:45.323338 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2585/5530] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:44 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:45.364928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:45.369939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:45.400363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:45.402048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:45.406739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:45.407698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:45.408992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:45.411940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:45.421726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ab2acd8-a5a0-4efe-a363-75d170f0fa01 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:45.429350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ab2acd8-a5a0-4efe-a363-75d170f0fa01 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1241 microversion: 2.1 time: 0.170299 Oct 13 08:59:45.433315 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2946/5531] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:45 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:45.454598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:45.456711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:45.476715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:45.481310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:45.481810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:45.486748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:45.487323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:45.490683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:45.774033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:45.783883 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d1ffafe1-756b-447b-b17b-2f6f9a73720c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.347910 Oct 13 08:59:45.784565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2947/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:45 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:46.198586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:46.220638 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8d7d905-6440-475c-9f51-2043472e165d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.898556 Oct 13 08:59:46.223643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2586/5533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:45 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:46.254943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:46.258687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:46.283698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.294487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.296827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:46.297849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.302395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.303196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:46.463062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:46.464997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:46.479756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.481512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.485496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:46.486631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.487326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.489137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:46.569253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e7ca363-3d1d-4a04-9d9b-4cf2e9057746 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.312217 Oct 13 08:59:46.578282 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2948/5534] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:46 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 08:59:46.607674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:46.614328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:46.634534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.641051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.641822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:46.642850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:46.646275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:46.648062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:47.081105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:47.108714 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-34ebdcf2-af27-42d9-a797-09ec48d3d1ab tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1673 microversion: 2.1 time: 0.528542 Oct 13 08:59:47.113089 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2949/5535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:46 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1673 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:47.118371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:47.119049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:47.181509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:47.182640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:47.186322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:47.187414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:47.188167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:47.189556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:47.305283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:47.333522 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fbfb0678-505c-447b-a266-b536ad16608e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1245 microversion: 2.1 time: 0.875939 Oct 13 08:59:47.334594 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2587/5536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:46 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1245 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:47.564052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:47.582091 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a231d3f-6be5-4cb1-b59f-4eeeab9a77f5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.467502 Oct 13 08:59:47.582635 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2950/5537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:47 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:48.141071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:48.142123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:48.152845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.153744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.154618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.155948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.156668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.157563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.364978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:48.365760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:48.386729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.387624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.388277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.396501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.403937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.404686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.570442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:48.581183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-573f135c-0831-49ff-9776-3aaf27a54639 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1299 microversion: 2.1 time: 0.220882 Oct 13 08:59:48.581867 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2951/5538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:48 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:48.605146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:48.605923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:48.625567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.630703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.639684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.643912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.647039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.650215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.826327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:48.856977 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-128d2571-84ca-452f-9209-a22dead5ba89 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1653 microversion: 2.1 time: 0.723398 Oct 13 08:59:48.860955 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2588/5539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:48 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1653 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:48.887831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:48.888716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:48.914279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.916183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.918953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:48.924980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:48.926095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:48.926684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:49.095289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:49.108505 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-124271e9-1f1e-4bf8-9b9e-0e6f0b298390 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.506028 Oct 13 08:59:49.129162 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2952/5540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:48 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:49.243636 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6013d90f-0ff3-47a3-8571-ad9f33219513 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.359689 Oct 13 08:59:49.252268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2589/5541] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 08:59:48 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 08:59:49.256282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:49.257137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:49.272241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:49.284787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:49.286122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:49.288328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:49.289488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:49.290478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:49.629695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:49.637113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:49.694611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:49.697810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:49.700166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:49.701143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:49.701751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:49.702434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:49.862029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:49.877497 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52ee4204-e5fc-4102-b10c-875a1ddf7cdf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1660 microversion: 2.1 time: 0.625409 Oct 13 08:59:49.880291 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2953/5542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:49 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1660 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:49.966425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:49.978399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10290e84-3980-4caf-beda-3509bbffeb4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1299 microversion: 2.1 time: 0.362222 Oct 13 08:59:49.998676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2590/5543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:49 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1299 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:50.150357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:50.151818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:50.168879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:50.169387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:50.169827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:50.170573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:50.172940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:50.173955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:50.666861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:50.671598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:50.683279 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8273fd5b-86cf-4cb1-8331-7d1c81d40d1e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.537452 Oct 13 08:59:50.693062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2954/5544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:50 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:50.906960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:50.908146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:50.920599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:50.923083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:50.923673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:50.924742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:50.929185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:50.929845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.013066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:51.013684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:51.059620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.067121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.067944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.069099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.069099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.074455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.350011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:51.360979 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e630947b-14c1-4cc0-903f-e23e96de8550 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.458286 Oct 13 08:59:51.366473 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2591/5545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:51.413645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:51.414353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:51.422586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.425553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.426360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.427454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.428691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.429271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.460886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:51.474219 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22ebfb13-a843-46f2-be68-50a725c5e86e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.466043 Oct 13 08:59:51.478605 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2955/5546] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:51 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:51.720413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:51.723202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:51.743882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.744836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.745647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.746752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.747427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.748209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.777428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:51.802729 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-856a74fb-9ba4-4bfe-9841-8bb77d15f704 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.393330 Oct 13 08:59:51.821240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2592/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:51.842106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:51.843100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:51.861103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.861603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.862044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:51.862790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:51.863250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:51.863681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:52.100755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:52.110906 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d35dbe71-2c21-467a-8554-a00a48d44665 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.396229 Oct 13 08:59:52.119492 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2956/5548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:51 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:52.416414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2", "tag": "19829d7a-794c-469d-8e12-2533d63c6a1b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 08:59:52.436290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:52.437056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:52.437830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:52.462962 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] Creating event network-changed:19829d7a-794c-469d-8e12-2533d63c6a1b for instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 on n-h1-858384-11 Oct 13 08:59:52.479355 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3005b84c-4074-4b40-98f4-bc870f2a28ef req-63f8bff9-8701-4794-abab-331cdc4a620d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069067 Oct 13 08:59:52.483556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2957/5549] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 08:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 08:59:52.517566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:52.518886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:52.529515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:52.530167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:52.530970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:52.531942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:52.532606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:52.533781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:52.991949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:53.000554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9429d158-b9e2-4eed-8694-cb24751e9e4a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.498929 Oct 13 08:59:53.048683 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2958/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:52 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:53.063973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:53.081014 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b5ea960-6b77-4903-b141-0c492fa272f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 1.249616 Oct 13 08:59:53.082136 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2593/5551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:53.111077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:53.111806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:53.114114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:53.126767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.127323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.127880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.128759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.129155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.129560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.143875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:53.144637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:53.163124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.166165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.167383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.169262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.173728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.176054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.242259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:53.792294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:53.800422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc3c1a00-f5c2-479d-b70f-38d89a2b59ea tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.694719 Oct 13 08:59:53.801061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2959/5552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:53 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:53.827973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:53.828842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:53.839077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.841181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.842900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.844786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:53.847032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:53.847757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:53.927893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:53.939768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84a3c419-9671-44d2-8dbb-158390e37464 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.800042 Oct 13 08:59:53.953149 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2594/5553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:53 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:54.040439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:54.041218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:54.052618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:54.053912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:54.054372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:54.060293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:54.060785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:54.061230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:54.115924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:54.125483 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5125604-3e23-48b6-8a32-d6ff0066917e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.302042 Oct 13 08:59:54.126648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2960/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:53 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 08:59:54.156815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:54.157867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:54.168661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:54.169570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:54.170279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:54.171290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:54.173338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:54.174009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:54.412145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:54.436007 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a28746f1-fa92-4fbc-831c-838ec2845f04 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.287012 Oct 13 08:59:54.439732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2961/5555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:54 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:54.520857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:54.532281 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c8ec273-1949-42d2-a7cf-f75326ccde9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.500295 Oct 13 08:59:54.534139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2595/5556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:54 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:54.967996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:54.968613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:54.970544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:54.994267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:54.994842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:54.995287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:55.002455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:55.002455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:55.002791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:55.429187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:55.436982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:55.444607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc39329b-0e22-4702-99da-12774d4e0ad5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.481305 Oct 13 08:59:55.447714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2962/5557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:54 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:55.559578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:55.560758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:55.584989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:55.589744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:55.590525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:55.596412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:55.599738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:55.600497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:55.961229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:55.974081 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8ee1e80-8744-4046-8e80-b08de90b34f5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.421149 Oct 13 08:59:55.974722 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2596/5558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:55 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:56.475269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:56.475992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:56.497349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:56.499667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:56.500213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:56.501766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:56.504309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:56.505858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:56.721912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:56.734455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fcdf5594-1cfc-4180-8a95-09d5e2b1f131 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1531 microversion: 2.1 time: 0.261696 Oct 13 08:59:56.735082 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2963/5559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:56 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1531 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:57.001636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:57.003102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:57.012578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 08:59:57.014468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:57.015254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:57.016182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:57.017260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:57.017865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:57.018619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:57.547170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:57.557185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3961958e-72b1-4545-a5e4-e0b28d415885 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.560292 Oct 13 08:59:57.561768 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2597/5560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:56 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:57.760735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:57.763011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:57.780186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:57.781337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:57.783076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:57.784064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:57.785466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:57.787317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:58.127438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:58.136909 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a75f761f-a1f5-49fa-8cd2-c4bc18ac9aca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1531 microversion: 2.1 time: 0.382272 Oct 13 08:59:58.139477 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2964/5561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:57 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1531 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:58.591652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:58.592844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:58.613629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:58.617535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:58.619557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:58.623266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:58.624880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:58.625755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:59.075153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:59.087621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-705be4fd-598c-49b6-afcb-07a45fbd8121 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.501330 Oct 13 08:59:59.089398 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2598/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:58 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 08:59:59.168417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 08:59:59.171935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 08:59:59.190251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:59.191254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:59.193349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:59.195555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 08:59:59.197877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 08:59:59.202255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 08:59:59.791095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 08:59:59.806029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00368423-5d73-48f8-9a7a-884317d9713b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.641411 Oct 13 08:59:59.808915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2965/5563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 08:59:59 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:00.037091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2", "name": "network-vif-plugged", "status": "completed", "tag": "19829d7a-794c-469d-8e12-2533d63c6a1b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:00.075111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:00.077516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:00.078119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:00.093610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] Creating event network-vif-plugged:19829d7a-794c-469d-8e12-2533d63c6a1b for instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 on n-h1-858384-11 Oct 13 09:00:00.100909 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5dd73540-6f78-4862-9abb-694a4b26e958 req-1b81538f-590f-412b-b9ad-36de6b4ca3cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076227 Oct 13 09:00:00.102212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2599/5564] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:00.115515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:00.116534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:00.141348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:00.141868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:00.145103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:00.148103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:00.148590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:00.151460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:00.835473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:00.836241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:00.848276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:00.848895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:00.849226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:00.849942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:00.873075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:00.873570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:01.217688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:01.229100 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-479a3789-d236-4f16-855c-62cac171edde tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 1.118250 Oct 13 09:00:01.231142 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2966/5565] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:00 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:01.628138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:01.638363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67e53843-fbc1-4b8f-a2a6-f491c5f19f1b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.807241 Oct 13 09:00:01.642807 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2600/5566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:00 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:02.142007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "name": "network-vif-plugged", "status": "completed", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:02.163814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:02.164455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:02.165016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:02.226383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] Creating event network-vif-plugged:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h1-858384-11 Oct 13 09:00:02.248934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4e7299f7-6c8c-4fbb-8967-8dc3b903c2ae req-8d0c98fc-7c1a-4c85-9da2-8be799d682b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107704 Oct 13 09:00:02.251240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2967/5567] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:02.263541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:02.264157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:02.274435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:02.274933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:02.278309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:02.280825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:02.281383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:02.281828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:02.667883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:02.669615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:02.694830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:02.695342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:02.695791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:02.696520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:02.696985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:02.701446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:02.963551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:02.975471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7416ceaa-98cb-4eee-80de-39da41268f26 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1364 microversion: 2.1 time: 0.715633 Oct 13 09:00:02.983285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2601/5568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:02 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1364 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:03.292034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:03.303297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-81fef14f-e08f-4af8-a15e-0fbf861d0c74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.641502 Oct 13 09:00:03.319230 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2968/5569] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:02 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:04.009251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:04.009864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:04.050979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.051490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.051935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.052643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.053098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.053560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.334128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:04.334781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:04.351945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.352672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.353446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.354351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.355076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.355670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.632462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:04.663715 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66bb9d10-69e8-47ed-bbb1-a1eea7e82d5b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1554 microversion: 2.1 time: 0.655295 Oct 13 09:00:04.666568 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2602/5570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:04 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1554 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:04.699420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:04.700288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:04.720322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.721564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.723864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.727322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:04.728121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:04.728989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:04.741066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:04.752455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46d48122-1a5a-42a2-b444-e87d507a9ea2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.424183 Oct 13 09:00:04.771209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2969/5571] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:04 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:04.990628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66038065-9c8c-4032-9a3c-ebf5817e7776 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299928 Oct 13 09:00:04.991419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2603/5572] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:00:04 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:00:05.785755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:05.786446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:05.804721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:05.809754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:05.810398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:05.812177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:05.815499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:05.817703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:06.227322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:06.238717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa042c54-85da-465f-965a-8d1a0f5b2416 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.457250 Oct 13 09:00:06.239346 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2970/5573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:05 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:07.267138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:07.267792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:07.288384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:07.288893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:07.289341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:07.290073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:07.290557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:07.301874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:08.381723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:08.401167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89f4e2cd-ffba-4ae4-83bc-ed8d5f95df9e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 1.143233 Oct 13 09:00:08.404176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2", "tag": "19829d7a-794c-469d-8e12-2533d63c6a1b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:08.437212 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2604/5574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:07 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:08.489885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:08.499020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:08.499957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:08.581325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] Creating event network-changed:19829d7a-794c-469d-8e12-2533d63c6a1b for instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 on n-h1-858384-11 Oct 13 09:00:08.609591 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-78985dd9-023e-47c8-b7bf-4840a7d45658 req-f12db761-c50c-4c03-9831-db62a55ede06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212500 Oct 13 09:00:08.617246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2971/5575] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:09.426235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:09.427591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:09.440617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:09.449257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:09.450279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:09.453535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:09.454195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:09.455715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:10.124502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:10.134739 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3658f234-b5de-4974-b76d-69f5372bb75b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.713881 Oct 13 09:00:10.135343 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2605/5576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:09 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:11.169956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:11.171559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:11.204583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:11.207266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:11.207927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:11.215381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:11.216184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:11.216852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:12.169352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:12.183897 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bb39c2ae-354f-4436-8f98-4f08d62dbdef tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 1.023797 Oct 13 09:00:12.185252 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2972/5577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:11 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:13.213257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:13.214192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:13.228705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:13.229143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:13.229591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:13.230319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:13.236063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:13.236672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:13.649854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:13.661202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80a48bd8-2efe-4956-8bfa-fa52de135346 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.451739 Oct 13 09:00:13.662190 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2606/5578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:13 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:14.696866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:14.697500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:14.715053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:14.722164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:14.722719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:14.723513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:14.723986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:14.724463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:14.789339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:15.162227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:15.173930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dba828d3-ed81-42e3-84ff-bb22045c7d31 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.480992 Oct 13 09:00:15.174955 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2973/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:14 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:16.197257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:16.197873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:16.211097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:16.219323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:16.220946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:16.221857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:16.226752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:16.227392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:16.597599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:16.608945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-be0226c7-93b7-403e-b357-a5f2134ede6c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.415532 Oct 13 09:00:16.610203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2607/5580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:16 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:17.635128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:17.636677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:17.651887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:17.673747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:17.675447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:17.677393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:17.679077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:17.681001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:18.406346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:18.414966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e43bc34-7423-49c9-9100-748086637ff1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.784207 Oct 13 09:00:18.425485 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2974/5581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:17 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:19.454208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:19.454835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:19.476467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:19.477255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:19.477851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:19.478766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:19.479365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:19.482149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:20.113944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:20.154369 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7637a69c-3191-4684-a79e-70f3b48a2c5a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.698504 Oct 13 09:00:20.170433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2608/5582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:19 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:21.180988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:21.181610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:21.202968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:21.203466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:21.203920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:21.212071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:21.212650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:21.213116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:21.545021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:21.570477 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f11109ff-68fc-414a-a1a3-4c44f9323747 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.378161 Oct 13 09:00:21.571368 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2975/5583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:21 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:22.597411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:22.598809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:22.609244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:22.612595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:22.613692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:22.614693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:22.615310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:22.623777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:23.030306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:23.046703 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eea3217b-d3a3-4353-b643-249c4e84da4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.453155 Oct 13 09:00:23.047552 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2609/5584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:22 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:24.078611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:24.079231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:24.091312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=34 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:24.097267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:24.103002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:24.103814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:24.105537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:24.107487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:24.110791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:24.545424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:24.554671 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-242794ee-2c35-429b-9d32-50d7f7767b76 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.480449 Oct 13 09:00:24.560382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2976/5585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:24 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:25.592657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:25.593288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:25.612716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:25.613502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:25.613952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:25.614719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:25.615181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:25.615612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:25.696773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=89 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:26.018467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:26.035455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5e7d2d5-2bf8-45e9-b29b-46ff4d06d300 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.455098 Oct 13 09:00:26.036372 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2610/5586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:27.061060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:27.061674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:27.072676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:27.093738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:27.094985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:27.096465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:27.097121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:27.097695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:27.622159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:27.632108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b7def64-0541-46bb-bc6c-465ab848f87b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.574864 Oct 13 09:00:27.632708 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2977/5587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:27 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:28.658268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:28.659182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:28.662905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=28 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:28.685329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:28.686701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:28.690132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:28.691238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:28.693686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:28.694807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:28.997557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:29.007874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-af494840-7b79-4b58-adfd-2e324290242e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1526 microversion: 2.1 time: 0.354605 Oct 13 09:00:29.011843 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2611/5588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:28 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1526 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:30.039287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:30.040548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:30.069767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:30.070472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:30.071011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:30.071842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:30.073999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:30.074588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:31.396762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:31.404873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04f449d6-9b68-4092-8941-f3d3b3ef3cc1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1508 microversion: 2.1 time: 1.370375 Oct 13 09:00:31.408899 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2978/5589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:30 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1508 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:32.433469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:32.434786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:32.459812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:32.460363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:32.461604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:32.484049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:32.487744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:32.495596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:33.043821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:33.052954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7b3eb79-eebb-4c17-b5dd-3ad2471e8754 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1508 microversion: 2.1 time: 0.624398 Oct 13 09:00:33.060786 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2612/5590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:32 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:34.089920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:34.091750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:34.136431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:34.136431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:34.136431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:34.136431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:34.136431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:34.138463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:34.265012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "name": "network-vif-unplugged", "status": "completed", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:34.299570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:34.300223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:34.302846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:34.342819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_external_events [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] Unable to find a host for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830. Dropping event network-vif-unplugged {{(pid=127030) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 09:00:34.351632 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cfa5dadd-7a16-49d3-a6b2-1e9d2ff5ef89 req-2f95dbc2-a0a0-40dd-a700-adf0330ba01c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.473385 Oct 13 09:00:34.355569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2979/5591] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 478 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 09:00:34.517255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:34.531533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff70f2a5-5a45-44d8-ad32-872ca222095f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1511 microversion: 2.1 time: 0.445823 Oct 13 09:00:34.532220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2613/5592] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:34.567488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:34.568768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:34.589945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:34.590674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:34.595789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:34.596558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:34.597039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:34.597468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:35.078300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:35.091071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b14a3c67-299c-4284-abd0-7586de75c46b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1451 microversion: 2.1 time: 0.536470 Oct 13 09:00:35.093843 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2980/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1451 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:35.150326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:35.151172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:35.164847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:35.167500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:35.168402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:35.171686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:35.172806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:35.174359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:35.236907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lazy-loading 'flavor' on Instance uuid cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:00:35.268881 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'shelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state shelved_offloaded Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 14 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: {"shelve": {}} Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: exception: Cannot 'shelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state shelved_offloaded Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'shelve': {}}} Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 09:00:35.277769 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state shelved_offloaded Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state shelved_offloaded Oct 13 09:00:35.282302 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:00:35.284809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'shelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state shelved_offloaded {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:00:35.287271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bcc96a90-b25f-4253-9be6-02ef15179682 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 155 microversion: 2.1 time: 0.140657 Oct 13 09:00:35.290658 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2614/5594] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:00:35 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 155 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 09:00:35.300281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:35.301123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:35.311828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:35.313882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:35.314462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:35.315282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:35.316498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:35.318563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:35.918965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127030) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 09:00:36.058678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c7a52e6-6066-407d-9cc7-7bf21abb6637 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.763166 Oct 13 09:00:36.060535 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2981/5595] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:00:35 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:00:36.073916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:36.074574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:36.086342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:36.089786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:36.094710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:36.102242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:36.102768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:36.103213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:36.333988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:36.344331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8a29339-608f-43d2-a57d-4c6868561b4f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1459 microversion: 2.1 time: 0.275776 Oct 13 09:00:36.345421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2615/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1459 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:37.371342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:37.372116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:37.387326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:37.389522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:37.390186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:37.392199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:37.393517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:37.394858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:37.870575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:37.887501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6bc420e1-a6ab-480c-b88a-7d86bf2fff89 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1459 microversion: 2.1 time: 0.520315 Oct 13 09:00:37.891924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2982/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:37 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1459 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:38.929711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:38.931468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:38.956497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:38.957103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:38.957644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:38.958254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:38.958941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:38.959157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:39.659656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:39.679809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b354bde-6d0f-423f-961e-791e15038b16 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1461 microversion: 2.1 time: 0.766780 Oct 13 09:00:39.682191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2616/5598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1461 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:40.150233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:40.154760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:40.180829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.187125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.187734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.189813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.191795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.193142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.293612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:40.294192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:40.305179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.305581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.306018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.306756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.307752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.308179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.390550 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7bd888ca-7237-442b-8d68-1449f86fd8d2 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/ips" status: 200 len: 149 microversion: 2.1 time: 0.099548 Oct 13 09:00:40.402399 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2617/5599] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:00:40 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/ips => generated 149 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:40.458395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07b9f2af-9ba7-49c0-b367-c679d0451e6a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.299654 Oct 13 09:00:40.464278 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2983/5600] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:00:40 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:00:40.469565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:40.473818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:40.490775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.491326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.495894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.496795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.497281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.499677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.716733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:40.719985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:40.736481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.737416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.738023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:40.739143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:40.740347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:40.741301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:41.683832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:41.694237 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-97b17c6c-b508-4870-bce4-e0e876826ddf tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1670 microversion: 2.1 time: 1.229462 Oct 13 09:00:41.694875 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2618/5601] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:40 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1670 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:41.944236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:41.954864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40a30af1-42fd-4f68-b507-cb7afe8764d5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 1.249375 Oct 13 09:00:41.961701 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2984/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:40 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:42.425878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:42.453906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:42.453906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:42.454172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:42.476663 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] Creating event network-changed:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h2-858384-11 Oct 13 09:00:42.492357 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e702e1c6-ce79-4269-9609-64fb564c259d req-03b0020a-f68a-4625-a3f1-17c67015b656 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348846 Oct 13 09:00:42.493617 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2619/5603] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:42.721111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:42.721860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:42.732026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:42.733948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:42.737743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:42.738683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:42.739833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:42.741339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:42.988439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:42.989738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:42.996876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:42.997652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:42.998239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:42.999131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:42.999734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:43.000307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:43.456419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:43.474154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86319e0a-7e1a-4c23-b647-1eb752248192 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.489976 Oct 13 09:00:43.474781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2620/5604] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:42 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:43.489926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892d711d-e0ad-49b1-a389-1f6a18bfee28"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:43.492705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:43.506055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:43.511540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:43.513578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:43.515731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:43.516709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:43.519279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:43.764525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:43.800378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d961480e-362e-4036-bbd4-cc0c762d77ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1670 microversion: 2.1 time: 1.083045 Oct 13 09:00:43.817168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2985/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:42 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1670 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:43.967168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d09ecad-484d-42f3-8718-11d4602f0915 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477683 Oct 13 09:00:43.975046 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2621/5606] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:00:43 2022] POST /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:00:44.500185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:44.500818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:44.510689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:44.511339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:44.512820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:44.516240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:44.518459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:44.518945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:44.831242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:44.831950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:44.862518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:44.863401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:44.865853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:44.868586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:44.869424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:44.870124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:45.039270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:45.048894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:45.063522 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb1c4f8f-b924-4147-8fbd-b87e57ed5875 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.564695 Oct 13 09:00:45.063522 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2986/5607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:44 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:46.090967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:46.092619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:46.113747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:46.114649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:46.115726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:46.120052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:46.122607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:46.123265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:46.651367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:46.670812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-429b247e-9085-4692-b7f2-7212add3b0fa tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.585913 Oct 13 09:00:46.678044 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2987/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:46 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:46.860628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:46.888832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7930b53c-9507-4b54-afad-c70a2ad00c42 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 2.064217 Oct 13 09:00:46.897917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2622/5609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:47.703827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:47.705184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:47.726778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:47.729174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:47.730041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:47.733814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:47.736506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:47.737930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:48.536102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1171138762", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "b33aee25-9c56-4417-8053-7ec3f84a729f"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:00:48.617399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:48.634525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ddf9a82b-0f7a-48c3-9622-2bb1ccbc26d3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.935103 Oct 13 09:00:48.640579 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2988/5610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:47 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:48.706147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] validate_networks() for [('b33aee25-9c56-4417-8053-7ec3f84a729f', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:00:49.664271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:49.664920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:49.674065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:49.674577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:49.682392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:49.683591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:49.684223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:49.684920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:50.403959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:00:50.404959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:00:50.405617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:00:50.406197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:00:50.406810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:00:50.433426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:50.434212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:50.434854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:50.437003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:50.440429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:50.441801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:50.491104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Getting quotas for project 1a8bda7a55cd49f6b47239f6bf31640a. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:00:50.510698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Getting quotas for user 58cbddff50834a05bf694e6c813414e0 and project 1a8bda7a55cd49f6b47239f6bf31640a. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:00:50.545743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:00:50.548795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:00:50.603213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:50.613865 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0cfc2d7-81e4-4439-9888-5cecd1a114e0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400700 Oct 13 09:00:50.614088 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d300572e-6f8f-40e3-8014-c5be30425b2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.953639 Oct 13 09:00:50.615400 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2623/5611] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:00:50.640926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab34ddf6-4699-491f-b948-d248d243fe59 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:50.644597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab34ddf6-4699-491f-b948-d248d243fe59 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:50.656192 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2989/5612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:49 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:50.840995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab34ddf6-4699-491f-b948-d248d243fe59 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:50.870370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab34ddf6-4699-491f-b948-d248d243fe59 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1215 microversion: 2.1 time: 0.240383 Oct 13 09:00:50.877583 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2624/5613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:50 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:51.641703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:51.642978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:51.650611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:51.661728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:51.662383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:51.664146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:51.665244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:51.667037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:51.897776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:51.899299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:51.920212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:51.926133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:51.929273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:51.933653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:51.935873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:51.938202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:52.191052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:52.204997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6d71802-71a3-4340-9c52-5ee554e888f3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1219 microversion: 2.1 time: 0.310358 Oct 13 09:00:52.205887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2625/5614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:51 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1219 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:00:52.700313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:52.708543 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8c6cf36-c2ea-45cd-b9b5-291bee5ff462 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 1.070670 Oct 13 09:00:52.734061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2990/5615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:51 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:53.234967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:53.236362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:53.257810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:53.258333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:53.261222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:53.262985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:53.263476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:53.272493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:53.743424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:53.744740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:53.765521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:53.769805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:53.770480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:53.772636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:53.773232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:53.775807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:54.602783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:54.620883 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-298cfff4-5ec4-4abe-899c-25c3893b182c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1267 microversion: 2.1 time: 1.389544 Oct 13 09:00:54.625079 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2626/5616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:53 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1267 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:55.258385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:55.273582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3351f983-c6d2-4d50-8d90-6f585ab8a6d9 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 1.539675 Oct 13 09:00:55.285330 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2991/5617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:53 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:55.659542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:55.661022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:55.688809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:55.689316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:55.689764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:55.690537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:55.690956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:55.691376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:55.768307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:56.243997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:56.263537 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d334a04-737a-4146-ad77-8a78b598840b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1273 microversion: 2.1 time: 0.616968 Oct 13 09:00:56.264177 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2627/5618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:55 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1273 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:56.312324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:56.312983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:56.315948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:00:56.343826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:56.345303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:56.347568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:56.355387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:56.361040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:56.362226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:57.137822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:57.178338 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2b7574cb-68f5-410b-b5a4-008576283342 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.867570 Oct 13 09:00:57.185586 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2992/5619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:56 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:57.294339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:57.295284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:57.314430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:57.319691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:57.321587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:57.323570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:57.324708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:57.325478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:57.571904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:57.587903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-522f5e47-8367-4cf4-a9a3-2d42c14ad247 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1273 microversion: 2.1 time: 0.302960 Oct 13 09:00:57.589698 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2628/5620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:57 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:58.213986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:58.215006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:58.252168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:58.252748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:58.253245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:58.254009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:58.262618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:58.263268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:58.614562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:00:58.615295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:00:58.639499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:58.646261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:58.646752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:58.647517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:00:58.647983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:00:58.648410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:00:59.094467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:59.107119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2b72a02-a21f-40e3-8b8f-4471d3df49b7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.897289 Oct 13 09:00:59.108110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2993/5621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:58 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:00:59.213479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:00:59.222726 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5af6e5c4-a58f-4855-9823-801e0b5b7397 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.612193 Oct 13 09:00:59.228772 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2629/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:00:58 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:00.093453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:00.094000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:00.104235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.104726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.105153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.112663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.113401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.113842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.135648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:00.136332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:00.144074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:00.156934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.157434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.160780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.161623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.162098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.162572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.208363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:01:00.387462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f4e7832c-ac82-425e-9c09-0f106eb046ef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "DELETE /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 204 len: 0 microversion: 2.42 time: 0.635252 Oct 13 09:01:00.404764 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2994/5623] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:00:59 2022] DELETE /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:01:00.422130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:00.424383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:00.435982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.436691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.437360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.438277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.439080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.439828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.465100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:00.734916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:00.745503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23653130-7571-43bc-b7c0-209ea39a8b20 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.338565 Oct 13 09:01:00.746507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2995/5624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:00 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:00.751998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:00.752842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:00.776472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.777786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.778824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.780123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.781210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.782680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.783407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:00.792753 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae2cf128-54ae-4b39-ae29-668c774c6ca8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.661668 Oct 13 09:01:00.814554 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2630/5625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:00 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:00.820575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb36435-9487-4a02-bce2-00eb0bd972f2", "tag": "93392ade-cb5b-4796-913f-7c43b3d494ef"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:00.831877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:00.832610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:00.833270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:00.851853 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] Creating event network-changed:93392ade-cb5b-4796-913f-7c43b3d494ef for instance fdb36435-9487-4a02-bce2-00eb0bd972f2 on n-h2-858384-11 Oct 13 09:01:00.872459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:00.877059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-0fadd134-deb2-425e-91ab-06c8d05e0ad6 req-38f20a90-b02f-43a4-a842-e2a6707e98d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058581 Oct 13 09:01:00.878575 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2631/5626] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:01.093210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:01.105412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:01.107918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:01.109509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-424ec01c-ade1-4995-a8a0-6772711d3c85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2964 microversion: 2.42 time: 0.362043 Oct 13 09:01:01.111118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2996/5627] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:00 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2964 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:01.774205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:01.778284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:01.788854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:01.789411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:01.789921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:01.790785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:01.791256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:01.791689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:01.817764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:01.818916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:01.841876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:01.842639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:01.843423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:01.844321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:01.844808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:01.845197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:02.041492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:02.052060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-784750b3-b7e8-467a-ad3f-d3747c781c8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.239247 Oct 13 09:01:02.052948 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2997/5628] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:01 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:02.059620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9f3f83b-ed09-4bcc-8500-7b91574d189d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: .version_select at 0x7f5376deb3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1600260311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVjmB6clht0BGiM69hMru9zLCiPW9/y07JudSd7Lkz+Y4r2w5P54//BMp7r84p7nICHRbwQ5eV14T/pEVY/n+8uZEuiInFyFUb8IWVwpTQx1ctlWXlqQPxvD1qwYmh5FA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:02.077968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b9f3f83b-ed09-4bcc-8500-7b91574d189d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:01:02.083626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-b9f3f83b-ed09-4bcc-8500-7b91574d189d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:01:02.111244 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9f3f83b-ed09-4bcc-8500-7b91574d189d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.056867 Oct 13 09:01:02.131566 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2998/5629] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:01:02 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:02.144317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:02.145419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:02.161968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:02.162920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:02.163744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:02.165138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:02.166974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:02.169249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:02.230120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:02.251682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e4b03528-c207-43cd-b23b-9d697fc7b9c7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.473101 Oct 13 09:01:02.255267 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2632/5630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:01 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:02.758507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:02.774643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:02.777234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:02.778876 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eb09a9f4-6d73-4242-9e99-077f9ef3ad06 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2964 microversion: 2.42 time: 0.643907 Oct 13 09:01:02.808949 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 2999/5631] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:02 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2964 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:03.076590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:03.078316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:03.101600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.102298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.103865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.104869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.107293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.108306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.278425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:03.279169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:03.294165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.297562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.298470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.304454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.305149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.307217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.510663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:03.521222 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73fec3ac-bd53-4a05-803a-5e2292b587be tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.449322 Oct 13 09:01:03.526546 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2633/5632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:03 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:03.590916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892d711d-e0ad-49b1-a389-1f6a18bfee28"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:03.593772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:03.599727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:03.607649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.609594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.611458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.612131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-851e0da0-a88a-4876-9bc3-f9cae451cbbe tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.337654 Oct 13 09:01:03.613524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.614760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3000/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:03 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:03.615284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.616062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.771741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments HTTP/1.1 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 74 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: {"volumeAttachment": {"volumeId": "892d711d-e0ad-49b1-a389-1f6a18bfee28"}} Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'd7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2', 'body': {'volumeAttachment': {'volumeId': '892d711d-e0ad-49b1-a389-1f6a18bfee28'}}} Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:03.776487 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 Oct 13 09:01:03.780461 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:03.782741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 400 to user: Invalid volume: volume 892d711d-e0ad-49b1-a389-1f6a18bfee28 is already attached to instances: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:03.783921 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-831f1911-2ded-4ada-b246-7b986d912d98 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198670 Oct 13 09:01:03.785661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2634/5634] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:01:03 2022] POST /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 09:01:03.815618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:03.816343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:03.827796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.828703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.829151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.829877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.830332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.835403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.893943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:03.894934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:03.907419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.908413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.909721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:03.912326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:03.912991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:03.913711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.139489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'services' on Instance uuid d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:04.324169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-375d7562-0613-4836-9734-7a3fd335b0b1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments/892d711d-e0ad-49b1-a389-1f6a18bfee28" status: 202 len: 0 microversion: 2.1 time: 0.434807 Oct 13 09:01:04.326160 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2635/5635] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:01:03 2022] DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments/892d711d-e0ad-49b1-a389-1f6a18bfee28 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:01:04.355276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:04.374531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:04.393597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.394601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.395479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.396928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.397609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.398329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.521012 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0068f9fb-a28e-48f2-8dbb-e2da7e357830 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190645 Oct 13 09:01:04.521618 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2636/5636] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:04 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:04.526083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:04.538028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:04.539678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:04.541928 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8504f700-8602-40c7-a5c6-ced1e2e745b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2964 microversion: 2.42 time: 0.730529 Oct 13 09:01:04.545841 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3001/5637] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:03 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2964 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:04.553081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:04.553667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:04.573512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.580054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.580509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.582569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.583231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.583633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.642464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:04.643272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:04.663055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.663662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.664482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:04.665389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:04.666689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:04.667270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:05.405878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:05.416917 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df35f63d-a2e7-4230-a7e4-4e5a90e58650 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.865639 Oct 13 09:01:05.419363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2637/5638] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:04 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:05.428254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-627810136", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "6b7a72b2-e4b4-422c-bb87-0faf0ee8f973"}], "key_name": "tempest-TestNetworkBasicOps-1600260311", "security_groups": [{"name": "tempest-secgroup-smoke-1778734150"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:05.570929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:05.574036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:05.585772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d8e2ed5-ce6c-4da0-a913-04531b72bcba tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.946980 Oct 13 09:01:05.606654 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3002/5639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:04 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:05.616756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:05.619299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:05.644908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:05.645621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:05.646209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:05.647492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:05.648091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:05.650847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:05.685082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] validate_networks() for [('6b7a72b2-e4b4-422c-bb87-0faf0ee8f973', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:01:05.688046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6cbaae99-4488-4939-9313-c2f88acf43cd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080041 Oct 13 09:01:05.688792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3003/5640] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:05 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:05.694495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:05.695422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:05.701982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:05.702827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:05.704161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:05.705025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:05.705621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:05.706198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.000399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:06.019429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:06.035378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:06.037033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0fae17e6-031a-402c-8d17-693deab517b4 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2964 microversion: 2.42 time: 0.347166 Oct 13 09:01:06.048874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3004/5641] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:05 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2964 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:06.444727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:06.445582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:06.455379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.455879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.456457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.469924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.470784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.471246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.756070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:06.772658 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bdd613c0-e8ab-4c51-8d88-ce39df1b9b51 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.331783 Oct 13 09:01:06.776381 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3005/5642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:06 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:06.782971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:06.783601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:06.794017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.794485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.795124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.795964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.796423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.796997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.895279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:01:06.895809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:01:06.896172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:01:06.896588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:01:06.896999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:01:06.911643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.912375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.918857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.920666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:06.921333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:06.921929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:06.974224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:01:06.994087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:01:07.036765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:01:07.041366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:01:07.158638 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d46dc19-2b5d-469a-9dcc-cc74d2f9e41b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.737043 Oct 13 09:01:07.159859 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2638/5643] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:01:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:01:07.178813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:07.182145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:07.214858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.215412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.215882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:07.216595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.219446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.220227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:07.287599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10c6e7dc-6a31-4d79-9c74-c3af6c3241b7 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126065 Oct 13 09:01:07.288451 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2639/5644] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:07 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:07.301989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:07.302899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:07.320606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.321472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.322186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:07.323291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.323929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.324536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:07.466617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:07.475703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-645da428-d023-481b-bbdc-3b8b754f8653 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.697916 Oct 13 09:01:07.476310 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3006/5645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:06 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:07.497963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29be8cee-40b1-4e73-8252-912b78873459 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:07.498635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29be8cee-40b1-4e73-8252-912b78873459 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:07.592891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-29be8cee-40b1-4e73-8252-912b78873459 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:07.601500 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29be8cee-40b1-4e73-8252-912b78873459 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1248 microversion: 2.1 time: 0.122779 Oct 13 09:01:07.602620 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3007/5646] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:07 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1248 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:07.797768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:07.799874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:07.809914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.812039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.813479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:07.816899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:07.817760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:07.818555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.070266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.081134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07754c35-397d-4f89-aba2-8c77e8f81e2b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.287611 Oct 13 09:01:08.084773 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3008/5647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:07 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:08.309676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:08.330608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:08.348640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.354187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.358752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.361847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.363539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.368101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.454389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36a9bc13-440a-4ce0-84c9-d730e7efd7e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156084 Oct 13 09:01:08.459979 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3009/5648] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:08 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:08.509600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.513697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:08.516011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:08.534944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.539555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.540157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.540942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.541425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.542179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.542677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.543122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.545895 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-acdfc52d-1695-4a1e-a45c-6a5c30027eef tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2964 microversion: 2.42 time: 1.253978 Oct 13 09:01:08.548422 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2640/5649] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:07 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2964 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:08.627830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:08.628850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:08.636519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.637570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.638883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.639859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:08.640532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:08.641187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:08.771019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.779923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf184e10-91da-4d39-9118-8c24e3ad65bd tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.279946 Oct 13 09:01:08.780518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3010/5650] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:08 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:08.893595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:08.911625 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98ba69fb-c0b6-40a7-aa02-58c0ce898b04 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1300 microversion: 2.1 time: 0.289837 Oct 13 09:01:08.926438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2641/5651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:08 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:09.110888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:09.113809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:09.124068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.125077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.125987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.127295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.127947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.128528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.398542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:09.410513 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-deb262b0-43f7-42cf-9dff-1cf00d18e728 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.304496 Oct 13 09:01:09.412741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3011/5652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:09 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:09.470616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:09.473182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:09.501274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.506661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.507319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.508232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.508958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.509611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.576654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:09.577749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:09.593603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.594707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f3a1ac0-4f79-49b8-bf76-1cfb8ffb564f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130139 Oct 13 09:01:09.595291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.597444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.597578 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2642/5653] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:09 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:09.598892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.599925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.601674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.809420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:09.810160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:09.823454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.826202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.826799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.828302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:09.828846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:09.831262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:09.977812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:09.999654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:10.001442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:10.002963 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eae57e9e-4a36-4cf9-b8b2-67761cfa9d7d tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2943 microversion: 2.42 time: 0.430949 Oct 13 09:01:10.003710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3012/5654] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:09 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2943 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:01:10.008723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:10.009655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:10.035324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.036117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.036777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.037667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.038490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.039239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.168748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:10.185069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e844700-3b13-4204-81ee-d3a7b803de75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1306 microversion: 2.1 time: 0.180074 Oct 13 09:01:10.189676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3013/5655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:10 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1306 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:10.204335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-unplugged", "status": "completed", "tag": "19000e35-57c3-405f-89d5-1b2f93667c01"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:10.227837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.228402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.229227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.254670 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] Creating event network-vif-unplugged:19000e35-57c3-405f-89d5-1b2f93667c01 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:10.264762 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3559b45a-3991-4228-830d-a16098eba5d8 req-759feb3c-62e1-4369-b762-141bdc346aa9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073664 Oct 13 09:01:10.265775 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3014/5656] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:10.335736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:10.355837 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eeb10ece-b4e9-414b-b2d2-97fdf65dab3b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.552562 Oct 13 09:01:10.356524 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2643/5657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:09 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:10.438245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:10.439119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:10.449768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.450438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.450887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.457700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.458280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.458770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.611114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:10.613997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:10.635156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.635686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.637148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.637913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:10.641275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:10.641784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:10.714701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:10.738649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0cb2bad2-c8ef-4f29-98a7-b8b117c1a817 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132461 Oct 13 09:01:10.739931 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2644/5658] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:10 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:10.936648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:10.950365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e6c5933-3cbd-4af9-b651-c09ba84b6e8c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.518342 Oct 13 09:01:10.951417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3015/5659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:10 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:11.037004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:11.037650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:11.054034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.055018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.055654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.057695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.058327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.061059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.219766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:11.220383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:11.233944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.234984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.237244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.239614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.242911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.243801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.601626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:11.615440 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f73cad06-a2cb-4a4d-b5a3-95856826e987 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.399705 Oct 13 09:01:11.616989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3016/5660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:11 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:11.628488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:11.629419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:11.644927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.646681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.648168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.649203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.650669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.651384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.854521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:11.922833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:11.927980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:11.930030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a6ef3e0-f683-4a6b-882a-034b5dfcaa10 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2943 microversion: 2.42 time: 0.897766 Oct 13 09:01:11.946439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2645/5661] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:11 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2943 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:11.950884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:11.960988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:11.975371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.975933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.978538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:11.979838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:11.980470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:11.981064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.025659 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9b3bbac-456a-488a-b2bc-5de71d4f072c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086702 Oct 13 09:01:12.033646 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2646/5662] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:01:11 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:01:12.041990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:12.043639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:12.053729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.055190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.057823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.059307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.060834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.061446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.353273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:12.369652 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61032ee8-7661-49a8-9abb-5f8a52a00d32 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.750644 Oct 13 09:01:12.371853 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3017/5663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:11 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:12.394118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:12.394905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:12.403032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.403761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.404409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.406596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.407290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.407894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.473179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:01:12.476267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:12.485855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95ab6c7c-31a6-479d-adca-5c01ce695893 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.449021 Oct 13 09:01:12.486470 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2647/5664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:12 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:12.512522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-unplugged", "status": "completed", "tag": "afb29497-31a2-4019-b86d-20fc1d02f81e"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-unplugged", "status": "completed", "tag": "a1303ad6-f0c5-46da-8664-cbc040d72825"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-unplugged", "status": "completed", "tag": "a00270e9-c028-4ccb-830f-06b0da6b95bc"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-unplugged", "status": "completed", "tag": "603d44c4-9c9d-4c91-a69d-281b2bfcc655"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:12.558100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.567879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.570880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.617203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Creating event network-vif-unplugged:afb29497-31a2-4019-b86d-20fc1d02f81e for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:12.619200 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Creating event network-vif-unplugged:a1303ad6-f0c5-46da-8664-cbc040d72825 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:12.621336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Creating event network-vif-unplugged:a00270e9-c028-4ccb-830f-06b0da6b95bc for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:12.622075 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] Creating event network-vif-unplugged:603d44c4-9c9d-4c91-a69d-281b2bfcc655 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:12.629534 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ec5fd638-6290-4dbe-9d82-448cbd47d2f3 req-f9ff5ede-ba6d-453d-aebe-7e04871a7476 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.141871 Oct 13 09:01:12.630829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2648/5665] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:12.638577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8281c503-26d4-42fc-89a2-417e5084de79", "tag": "1b4c3bf8-2e12-44cb-8769-0a2b621c18fa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:12.650529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.651361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.652047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.673767 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] Creating event network-changed:1b4c3bf8-2e12-44cb-8769-0a2b621c18fa for instance 8281c503-26d4-42fc-89a2-417e5084de79 on n-h1-858384-11 Oct 13 09:01:12.684596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5c0ae2c1-cdc3-42c6-8983-ba3faa96281f req-6a45b3cc-bbd7-4818-8aa2-97a0b10e283b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051229 Oct 13 09:01:12.685986 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2649/5666] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:12.694017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:12.696495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:12.722015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.724461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.725661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.730630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.731398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.732255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.737482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c3fb558f-b20f-41db-8151-da446666293d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 204 len: 0 microversion: 2.1 time: 0.347326 Oct 13 09:01:12.744716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3018/5667] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:01:12 2022] DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:01:12.760180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:12.762720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:12.786076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.788722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.789313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.791906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:12.792055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:12.795200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:12.838087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:13.201931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.213738 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-60a00c06-f121-4110-b1a3-f7351278228b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1678 microversion: 2.1 time: 0.466932 Oct 13 09:01:13.219158 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3019/5668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:12 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1678 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:13.232850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:13.234916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:13.249531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.258289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.259043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.260720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.261693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.262357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.277449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.303225 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3330c20e-d45a-4aaf-8f45-1f71c340f2eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.604395 Oct 13 09:01:13.303917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2650/5669] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:12 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:13.394378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:13.395193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:13.402149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.402805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.403350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.404394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.404961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.405497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.758905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.770901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d9617ff-7f81-4055-a1ed-ce5b0d652055 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.380816 Oct 13 09:01:13.783586 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2651/5670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:13 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:13.794326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:13.795181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:13.806736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.808738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.809529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.810443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:13.811060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:13.812277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:13.870788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.901078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.904806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:13.907158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e75509e-d090-4728-94e0-2708c690f61b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2922 microversion: 2.42 time: 0.686179 Oct 13 09:01:13.908880 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3020/5671] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:13 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2922 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:14.053154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-deleted", "tag": "afb29497-31a2-4019-b86d-20fc1d02f81e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:14.070553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.071288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.072033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.102192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] Creating event network-vif-deleted:afb29497-31a2-4019-b86d-20fc1d02f81e for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:14.115733 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2543930f-7149-4074-b574-b67ae03aa9f5 req-49fd989f-0dc1-495a-a26a-6a933f0f5e28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205003 Oct 13 09:01:14.118732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3021/5672] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:14.240028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:14.240987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:14.257815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.258502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.258950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.260225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.260683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.261111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.405149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:14.419169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3259cba7-fd6e-4bd7-90cd-b9372574c439 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.633355 Oct 13 09:01:14.419773 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2652/5673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:13 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:14.440744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:14.441369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:14.448038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.448528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.449139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.450020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.450649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.451235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.624929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:14.633221 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28a22999-a8c2-4797-ab2c-77ff79caaa73 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1678 microversion: 2.1 time: 0.398326 Oct 13 09:01:14.634523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3022/5674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:14 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1678 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:14.672532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "name": "network-vif-plugged", "status": "completed", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}, {"server_uuid": "fdb36435-9487-4a02-bce2-00eb0bd972f2", "name": "network-vif-plugged", "status": "completed", "tag": "93392ade-cb5b-4796-913f-7c43b3d494ef"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:14.683687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.684356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.684788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.698162 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Creating event network-vif-plugged:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h2-858384-11 Oct 13 09:01:14.698697 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] Creating event network-vif-plugged:93392ade-cb5b-4796-913f-7c43b3d494ef for instance fdb36435-9487-4a02-bce2-00eb0bd972f2 on n-h2-858384-11 Oct 13 09:01:14.707308 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5c85c5d7-2c68-4287-bf76-5c424a43ff62 req-600a5ca4-3b4c-4836-a20c-bf320083a113 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038443 Oct 13 09:01:14.708459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3023/5675] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:01:14.797641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:14.798362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:14.806821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.807317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.807753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:14.808466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:14.808915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:14.809337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.187604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:15.196348 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfb2f0b2-8c55-4b65-8e14-ab6412c7ba24 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.404744 Oct 13 09:01:15.197605 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3024/5676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:14 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:15.203311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:15.204028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:15.210101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.210956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.211469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.212425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.213097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.213741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.349360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:15.358842 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-954af429-25f5-4935-ae06-09628d52cd4b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.926826 Oct 13 09:01:15.359425 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2653/5677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:14 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:15.444149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:15.444970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:15.445491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:15.451671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.452463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.453140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.454066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.454773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.455436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.457288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:15.458784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:15.460037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-534daa8b-fe5d-49ca-bfc4-619e75877080 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2761 microversion: 2.42 time: 0.261072 Oct 13 09:01:15.460850 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3025/5678] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:15 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2761 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:15.660316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:15.661225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:15.671436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.672438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.673063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:15.674846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:15.675487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:15.676069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.005271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:16.014919 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0d6e5fb-6748-4603-8f8c-eb9a2ded3a97 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.574428 Oct 13 09:01:16.016326 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2654/5679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:15 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:16.064146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:16.074347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ae0f7a1-eb20-4b54-bfc8-600fbacb1968 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1678 microversion: 2.1 time: 0.421038 Oct 13 09:01:16.075704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3026/5680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:15 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1678 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:16.223431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:16.224335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:16.232420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.233269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.234118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.235033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.235573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.236077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.383473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:16.384326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:16.392780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.394178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.394932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.395826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.396289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.397008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.690941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:16.704168 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70bc36ce-ba40-4478-8afe-c73586aa0dd9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.325085 Oct 13 09:01:16.713342 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3027/5681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:16 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:16.732780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:16.733992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:16.742982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.743974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.744657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.745611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:16.746345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:16.747049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:16.935741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:16.944521 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fdda1da8-d923-4ebe-9211-537e58b2d409 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1315 microversion: 2.1 time: 0.726515 Oct 13 09:01:16.945381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2655/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:16 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:17.032344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:17.041205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:17.043900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:17.055494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:17.058717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:17.059554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:17.060012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:17.061434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80367836-f495-45b3-8763-fd2788daa55f tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2714 microversion: 2.42 time: 0.343920 Oct 13 09:01:17.062372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.063094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.063838 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3028/5683] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:16 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2714 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:17.079627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.080876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.081534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.082162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.098681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:17.099460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:17.113788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.115371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.116124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.117527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.118241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.119037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.254690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:17.278083 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8522a5e8-031e-4895-bd47-832dc1c7264e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 200 len: 1613 microversion: 2.1 time: 0.183197 Oct 13 09:01:17.279814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3029/5684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:17 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 1613 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:17.401189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-deleted", "tag": "a1303ad6-f0c5-46da-8664-cbc040d72825"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:17.418193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:17.424357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.425145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.426933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.459692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] Creating event network-vif-deleted:a1303ad6-f0c5-46da-8664-cbc040d72825 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:17.468647 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a6fb376a-6ffb-430b-8796-fb105cd6b4fd req-e0a37114-b604-4a03-8fa2-b036511537c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073860 Oct 13 09:01:17.469863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3030/5685] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:01:17.643400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:17.682541 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd9898dd-d609-402e-a9c8-548edcaad31c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.634393 Oct 13 09:01:17.686117 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2656/5686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:17 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:17.734729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:17.735539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:17.751655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:17.760751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.762909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.763558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.765754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:17.782246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:17.783923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:17.976028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:17.976743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:18.010005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.012834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.014183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.018592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.021736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.024344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.792090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:18.807847 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-901d7d81-763d-486d-868c-112ade2f36d8 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1501 microversion: 2.1 time: 0.839191 Oct 13 09:01:18.808800 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2657/5687] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:17 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1501 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:18.819373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:18.822438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:18.841542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.842464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.846007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:18.847268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.848279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.848992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.849638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.858582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16983aa9-ab50-4db2-a891-54e09317e63d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 1.131783 Oct 13 09:01:18.859594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3031/5688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:17 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:18.865446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:18.866075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:18.881761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.887084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.887740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.888971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.891424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.892078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.927003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 HTTP/1.1 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2'} Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:18.929114 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b601b5e7-d041-4e0f-af58-276622885266 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 404 len: 111 microversion: 2.1 time: 0.069877 Oct 13 09:01:18.936807 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3032/5689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:18 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:18.944921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:18.945622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:18.967801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.970711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.971356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:18.972355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:18.973043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:18.973913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:19.242274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:19.254818 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fadf193-9753-407e-b4e7-05e60ef93085 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1517 microversion: 2.1 time: 0.320280 Oct 13 09:01:19.266691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3033/5690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:18 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:19.266691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:19.266691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:19.271394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:19.271394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:19.271394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:19.271394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:19.278797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:19.281779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:19.771808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:19.787488 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d73a223-ab6d-4362-8caa-329259a27ea5 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1501 microversion: 2.1 time: 0.529322 Oct 13 09:01:19.802863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3034/5691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:19 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:19.819007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-121ae99f-be0f-4c01-a25f-229be63855b3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '.version_select at 0x7f53755ecd30>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:19.867685 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-121ae99f-be0f-4c01-a25f-229be63855b3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849097910" status: 202 len: 0 microversion: 2.1 time: 0.055043 Oct 13 09:01:19.869327 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3035/5692] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 09:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849097910 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:19.873998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2", "name": "network-vif-deleted", "tag": "19829d7a-794c-469d-8e12-2533d63c6a1b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:19.896218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:19.896705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:19.897141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:19.927437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] Creating event network-vif-deleted:19829d7a-794c-469d-8e12-2533d63c6a1b for instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 on n-h1-858384-11 Oct 13 09:01:19.943450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-73e2c00f-e5cb-4eaa-ad4d-55d96570fcda req-bd6f2a21-76a8-4e87-9334-d6192105e870 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072786 Oct 13 09:01:19.944742 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3036/5693] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:19.951886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:19.960404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:19.975642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:19.976141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:19.976743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:19.978373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:19.979005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:19.979437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.008891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lazy-loading 'flavor' on Instance uuid fdb36435-9487-4a02-bce2-00eb0bd972f2 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:20.081432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.094783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.097865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.099635 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a9a3a330-8dc0-427b-ba58-5345e44bedbc tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2422 microversion: 2.42 time: 1.289608 Oct 13 09:01:20.100493 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2658/5694] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:18 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2422 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:20.106888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:20.107803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:20.114876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.115862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.116813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.117796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.118654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.119635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.136716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a33ff4ef-ff8c-416d-a180-9060c37b958a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action" status: 202 len: 0 microversion: 2.1 time: 0.190206 Oct 13 09:01:20.137370 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3037/5695] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:19 2022] POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:20.150007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:20.150611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:20.170642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.171122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.171729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.172585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.173203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.173790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.567878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.572547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:20.617251 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c728aee-8d7f-47fa-845f-243983db1c88 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1509 microversion: 2.1 time: 0.474980 Oct 13 09:01:20.618143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3038/5696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:20 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:20.624331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:20.625154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:20.631735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.632409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.633036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.633967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.634645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.635275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.662192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.675094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb7f0ef8-e9d0-49df-9930-1cf6b719e52c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.571550 Oct 13 09:01:20.676113 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2659/5697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:20 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:20.909838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:20.917525 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-799f6c9c-2ac3-4163-bdd6-20d40cd93fc3 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.297319 Oct 13 09:01:20.918713 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3039/5698] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:20 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:20.941609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:20.942225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:20.955372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.958314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.959761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:20.963840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:20.965633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:20.966393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.132042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:21.133096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:21.147556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.148067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.148516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.149249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.149777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.150215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.492092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:21.508109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:21.514581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:21.518256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1c527889-bbe0-4c65-bb06-6427113f3cdf tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2375 microversion: 2.42 time: 0.389791 Oct 13 09:01:21.520706 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3040/5699] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:21 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2375 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:21.641860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:21.642514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:21.652877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.653393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.656089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.657035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.658293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.660985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.728827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:21.738984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b54b25c-f55e-4088-b374-aab67d33132b tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.801939 Oct 13 09:01:21.751020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2660/5700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:20 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:21.765315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:21.766242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:21.772949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.773614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.774202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:21.775181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:21.775786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:21.776484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.100292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:22.122101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b597cc14-e8c8-4ffe-96ac-d5c9d8be97ef tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1492 microversion: 2.1 time: 0.484474 Oct 13 09:01:22.123371 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3041/5701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:21 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1492 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:22.128149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:22.128755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:22.145949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.146761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.147657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.148585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.150152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.151023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.606374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:22.624629 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74901314-c197-41e1-a3df-d2a6e9891573 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.499982 Oct 13 09:01:22.629039 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3042/5702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:22 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:22.639909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-deleted", "tag": "19000e35-57c3-405f-89d5-1b2f93667c01"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:22.665533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.668194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.671599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.700194 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] Creating event network-vif-deleted:19000e35-57c3-405f-89d5-1b2f93667c01 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:22.707610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-004d37e5-e296-492d-bb6c-b14085fcef52 req-17b09743-5006-43ee-9a30-992742c874bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076716 Oct 13 09:01:22.709036 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3043/5703] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:22.727072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:22.728876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:22.744268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.744779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.745215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.745943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.750794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.751420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.882467 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74f4f381-bf54-49a9-a5a5-bfde979cf2e9 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action" status: 202 len: 0 microversion: 2.1 time: 0.171753 Oct 13 09:01:22.886518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3044/5704] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:22 2022] POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:22.887049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:22.889514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8281c503-26d4-42fc-89a2-417e5084de79", "name": "network-vif-plugged", "status": "completed", "tag": "1b4c3bf8-2e12-44cb-8769-0a2b621c18fa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:22.893928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14990bea-a2bf-4b12-a544-8190a596df8d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 1.132524 Oct 13 09:01:22.906655 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2661/5705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:21 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:22.907276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.907276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.907276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.907474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:22.907474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:22.923306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.923825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.924272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.924988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:22.927006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:22.927484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:22.938707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] Creating event network-vif-plugged:1b4c3bf8-2e12-44cb-8769-0a2b621c18fa for instance 8281c503-26d4-42fc-89a2-417e5084de79 on n-h1-858384-11 Oct 13 09:01:22.946506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4139f266-3c8f-4641-8032-6667fd64ad1f req-815016f1-db4b-4450-a6c7-a88987280a53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061560 Oct 13 09:01:22.947549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3045/5706] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:22.952843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70fdedb6-33e8-4c2f-937c-5f0172dfb7cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:22.992174 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-70fdedb6-33e8-4c2f-937c-5f0172dfb7cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70fdedb6-33e8-4c2f-937c-5f0172dfb7cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/70470b1d-6a38-4218-a798-3e161872c399/action HTTP/1.1 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: {"os-stop": {}} Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '70470b1d-6a38-4218-a798-3e161872c399', 'body': {'os-stop': {}}} Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:23.000954 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. Oct 13 09:01:23.004565 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:23.006982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70fdedb6-33e8-4c2f-937c-5f0172dfb7cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 70470b1d-6a38-4218-a798-3e161872c399 has no mapping to a cell. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:23.008090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70fdedb6-33e8-4c2f-937c-5f0172dfb7cc tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/70470b1d-6a38-4218-a798-3e161872c399/action" status: 404 len: 117 microversion: 2.1 time: 0.059428 Oct 13 09:01:23.010776 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3046/5707] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:22 2022] POST /compute/v2.1/servers/70470b1d-6a38-4218-a798-3e161872c399/action => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:23.019171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e31198ee-c138-4b04-94bd-e72eb454d8eb tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: .version_select at 0x7f53769d4e50>, body: {"keypair": {"name": "tempest-keypair-1785084350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz8qdV62ShAzlAsHB2X8kILXna+ZdXKM2DNT8Dix0dv9o8OrfBxInmeW+NfvBDtPRRkcIxF2CfJAdajeby4AnRIWmH5JPYarmyyVVPHutHuPs2qX2iV2GZOrxHpdG9nfg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:23.044498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e31198ee-c138-4b04-94bd-e72eb454d8eb tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:01:23.057698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e31198ee-c138-4b04-94bd-e72eb454d8eb tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:01:23.109084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e31198ee-c138-4b04-94bd-e72eb454d8eb tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096788 Oct 13 09:01:23.111156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3047/5708] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:01:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:23.131052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:23.132225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:23.142144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.142859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.143489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:23.144419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.144919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.145455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:23.702914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:23.724163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:23.736069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:23.742384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:23.745441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:23.748449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20314512-008d-4cba-b523-3fb9095916d8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 2328 microversion: 2.42 time: 0.847341 Oct 13 09:01:23.750071 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2662/5709] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:22 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 2328 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:23.755627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:23.756646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:23.766228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-698b6a59-87ce-4b08-b50c-f47a8ab908d3 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1498 microversion: 2.1 time: 0.649670 Oct 13 09:01:23.767081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.767898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.768546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:23.769621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.770456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.771335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:23.780518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3048/5710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:23 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1498 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:23.923317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:23.924305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:23.930708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.931991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.932309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:23.933092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:23.933614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:23.934445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.275879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:24.286859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:24.292536 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dec74535-4484-49d9-8748-fa4a919cb4c2 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.539850 Oct 13 09:01:24.298399 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2663/5711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:23 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:24.308812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03859b64-b8a8-441b-b63e-4894af4a494b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1374 microversion: 2.1 time: 0.389530 Oct 13 09:01:24.322821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3049/5712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:23 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1374 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:24.323672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:24.324575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:24.354979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.356172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.356527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.357608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.358235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.361281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.767743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:24.780640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:24.781525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:24.781825 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b256a2b1-f51f-4e07-8d34-99bcf0916738 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.464722 Oct 13 09:01:24.782823 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2664/5713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:24 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:24.796762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:24.797385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:24.801803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.802378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.804607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.805372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.805902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.811367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.812130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.812731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.813521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:24.813803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:24.815487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:24.816109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.121965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.151574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66ba3a6b-dae9-44c3-97b1-c1035aeaf8db tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1498 microversion: 2.1 time: 0.341283 Oct 13 09:01:25.151574 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2665/5714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:24 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:25.151574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:25.151574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 538e312e-5288-4bac-b906-4b65f1ea4a56] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:25.155496 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/538e312e-5288-4bac-b906-4b65f1ea4a56/action HTTP/1.1 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 15 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: {"suspend": {}} Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '538e312e-5288-4bac-b906-4b65f1ea4a56', 'body': {'suspend': {}}} Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:25.158133 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 538e312e-5288-4bac-b906-4b65f1ea4a56 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93330783-51b4-4b9e-8594-ea61c0a2d6fe tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/538e312e-5288-4bac-b906-4b65f1ea4a56/action" status: 404 len: 111 microversion: 2.1 time: 0.024714 Oct 13 09:01:25.163666 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2666/5715] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:25 2022] POST /compute/v2.1/servers/538e312e-5288-4bac-b906-4b65f1ea4a56/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:25.165343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-deleted", "tag": "603d44c4-9c9d-4c91-a69d-281b2bfcc655"}, {"server_uuid": "370ac9af-105c-4dab-93f7-86b6ac92209f", "name": "network-vif-deleted", "tag": "a00270e9-c028-4ccb-830f-06b0da6b95bc"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:25.177293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.177624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.178067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.182867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.193648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.193881 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Creating event network-vif-deleted:603d44c4-9c9d-4c91-a69d-281b2bfcc655 for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:25.194230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] Creating event network-vif-deleted:a00270e9-c028-4ccb-830f-06b0da6b95bc for instance 370ac9af-105c-4dab-93f7-86b6ac92209f on n-h2-858384-11 Oct 13 09:01:25.195997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.197634 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac92766c-394b-4009-ae36-630dda9cf957 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.421823 Oct 13 09:01:25.198737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3050/5716] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:24 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:25.204227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:25.205033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:25.212817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.213583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.214194 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bd195359-1052-4eb6-99ca-9672e9bf98d7 req-8451e153-829d-489c-99a8-c7056db1282e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052541 Oct 13 09:01:25.214871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.215161 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2667/5717] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:25.215957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.216610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.218817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.341201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:25.341900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:25.348624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.349119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.349552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.350256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.350734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.351857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.494232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.507669 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8da5b19c-28d2-447d-a948-3dafef9414eb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1547 microversion: 2.1 time: 0.171604 Oct 13 09:01:25.508270 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2668/5718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:25 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:25.547042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:25.548029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:25.564008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.564656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.566509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.567384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.568167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.568674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.766326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.770869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:25.777710 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-95d4c22f-d4c4-40ae-9646-0da0844848e6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1547 microversion: 2.1 time: 0.249686 Oct 13 09:01:25.778536 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2669/5719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:25 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:25.786893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c1bed61-412c-4d9e-a79c-29dfa92cacf1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.586751 Oct 13 09:01:25.787604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3051/5720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:25.819993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:25.821661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:25.835125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.837481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.838009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:25.838708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:25.839186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:25.842928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.076224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:26.085173 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-087f5a47-c6f5-473e-90eb-ddbf2ac7b7d7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.272227 Oct 13 09:01:26.088644 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2670/5721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:25 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:26.117473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:26.118286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.133288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.136661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.139786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.140737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.141500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.151206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.169083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:26.170897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.199599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.202035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.203269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.203879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.203879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.204212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.244787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lazy-loading 'flavor' on Instance uuid cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:26.406904 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4d9bc5c2-3c0e-4d7b-b1d9-9fd02d3f128a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.293585 Oct 13 09:01:26.408158 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3052/5722] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:26 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:26.433313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:26.434037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.450279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.453491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.454765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.455673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.461241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.462034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.548856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:26.559632 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6cce8af0-a638-46b4-84c8-ed9ec3635561 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1501 microversion: 2.1 time: 0.398347 Oct 13 09:01:26.561012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2671/5723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:26 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1501 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:26.565922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:26.566812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.570117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:26.574093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.574877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.587600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.590432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.591508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.597086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.732196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:26.751542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:26.754160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:26.756314 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5e6ef38-5a17-44a9-8570-c04f2a2ae436 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.346038 Oct 13 09:01:26.757266 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3053/5724] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:26 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:26.772545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:26.774208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.783692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.784542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.786238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.787280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.788218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.788723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.830213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lazy-loading 'flavor' on Instance uuid fdb36435-9487-4a02-bce2-00eb0bd972f2 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:26.905678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:26.955738 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3eb4b1d-99c1-46a5-aa75-eb65f9845533 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action" status: 202 len: 0 microversion: 2.1 time: 0.196667 Oct 13 09:01:26.958101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3054/5725] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:26 2022] POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:26.972358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:26.974798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:26.986330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.987221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.988105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:26.989116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:26.990012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:26.990895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:27.088679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:27.097972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57f70e05-7889-4a45-8cc8-30e1f8cfe13f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1512 microversion: 2.1 time: 0.535635 Oct 13 09:01:27.104595 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2672/5726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:26 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:27.419344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:27.434073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e17efce6-c785-4146-8f63-96cfab38e2cf tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1509 microversion: 2.1 time: 0.470935 Oct 13 09:01:27.442947 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3055/5727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:26 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:27.791690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:27.794091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:27.810876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:27.812001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:27.812768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:27.814248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:27.814989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:27.815586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:27.983461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:28.006815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:28.008943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:28.010604 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6017093f-ec6a-455d-b990-a9d8b1655d54 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.226411 Oct 13 09:01:28.030606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2673/5728] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:27 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:28.132753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:28.134102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:28.146495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.150539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.151058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.152100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.152672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.155096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.457155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:28.458165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:28.467966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.487259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.489713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.490833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.492435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.495038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.556526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:28.569388 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8eba7f36-0ee5-421c-97e2-4d5b94b0d57a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1495 microversion: 2.1 time: 0.440228 Oct 13 09:01:28.591843 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3056/5729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:28 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1495 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:28.601962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:28.602741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:28.619532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.620261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.620843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.621711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.622667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.623118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.673648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lazy-loading 'flavor' on Instance uuid cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:28.697473 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'suspend' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state suspended Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: {"suspend": {}} Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'suspend' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state suspended Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'suspend': {}}} Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 13 09:01:28.699290 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state suspended Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state suspended Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'suspend' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state suspended {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c121b4b-ae0c-4153-8cf9-ce4d8008f91d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 148 microversion: 2.1 time: 0.107505 Oct 13 09:01:28.702843 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3057/5730] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:28 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 148 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 09:01:28.720159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:28.720692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:28.732679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.733171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.733671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.748265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:28.748889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:28.749345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:28.926278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fd310d8-a484-46df-965c-a0b8f0435cd4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 202 len: 0 microversion: 2.1 time: 0.207960 Oct 13 09:01:28.928714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3058/5731] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:28 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:28.942786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-381408564", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d510c72-59c1-4539-8bec-64f07cb7d4c4"}], "security_groups": [{"name": "tempest-securitygroup--577533192"}], "key_name": "tempest-keypair-1785084350", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:29.305421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:29.313738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] validate_networks() for [('6d510c72-59c1-4539-8bec-64f07cb7d4c4', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:01:29.314223 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-491843cd-c85b-4114-9f08-52390619fda7 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1492 microversion: 2.1 time: 0.860510 Oct 13 09:01:29.331537 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2674/5732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:28 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1492 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:29.340311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:29.341384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:29.348155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:29.349004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:29.349650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:29.350608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:29.351297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:29.351930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:29.803022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:29.825226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f42993e-b8e6-4a89-94ac-251839658d65 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1501 microversion: 2.1 time: 0.492236 Oct 13 09:01:29.838807 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2675/5733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:29 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1501 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:29.848598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:29.849403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:29.858240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:29.859203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:29.859808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:29.860677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:29.861367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:29.861958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:29.971864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:29.986004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:29.991320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:29.993870 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a77a750c-de41-48a3-b7ad-80b7f0e91f62 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.152648 Oct 13 09:01:29.996016 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2676/5734] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:29 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:30.005431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:30.006574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:30.016817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.019627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.021297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.022810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.024390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.025115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.145354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2379a7d-7067-4910-ba49-087d0e21108c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action" status: 202 len: 0 microversion: 2.1 time: 0.146965 Oct 13 09:01:30.146566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2677/5735] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:29 2022] POST /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:01:30.186222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:30.187160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:30.209617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.210394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.211232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.212578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.213576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.214691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.479555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:01:30.482460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:01:30.483627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:01:30.485194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:01:30.486200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:01:30.510873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.512039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.512757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.515275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.517774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.519330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.542856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:01:30.550176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Getting quotas for user 5c5e262ee0214fe09fc0e5f6cc4d4db9 and project 64823e22cdad4cc0b008987d235a7794. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:01:30.571855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:01:30.575933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:01:30.684430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:30.689755 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9665b23-5494-4b00-8e71-9787a676e31d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.756360 Oct 13 09:01:30.690924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3059/5736] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:01:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:01:30.707576 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae650092-6a38-4e60-80ca-b36a6a4e3e38 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1498 microversion: 2.1 time: 0.550979 Oct 13 09:01:30.707961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3b142b0-f367-4174-afb2-315f03708e77 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:30.708835 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2678/5737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:30 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:30.724746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3b142b0-f367-4174-afb2-315f03708e77 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:30.855648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:30.856303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:30.875819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.876186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.876615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:30.881989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:30.885072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:30.885793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.360658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3b142b0-f367-4174-afb2-315f03708e77 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:31.372844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3b142b0-f367-4174-afb2-315f03708e77 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1241 microversion: 2.1 time: 0.673225 Oct 13 09:01:31.388993 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3060/5738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:30 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1241 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:31.400520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:31.401471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:31.412965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:31.413758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:31.414374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.415945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:31.422399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:31.423782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.513767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:31.526060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:31.527549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:31.528748 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40e23d17-da63-46ed-bd8e-f29691a94661 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.138638 Oct 13 09:01:31.553606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3061/5739] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:31 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:31.558776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8281c503-26d4-42fc-89a2-417e5084de79", "tag": "1b4c3bf8-2e12-44cb-8769-0a2b621c18fa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:31.568088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:31.578891 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd572e2b-592e-4b2e-887b-1b97da4ebd91 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1501 microversion: 2.1 time: 0.729472 Oct 13 09:01:31.584296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:31.585421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2679/5740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:30 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1501 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:31.591034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:31.591725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.616939 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] Creating event network-changed:1b4c3bf8-2e12-44cb-8769-0a2b621c18fa for instance 8281c503-26d4-42fc-89a2-417e5084de79 on n-h1-858384-11 Oct 13 09:01:31.626460 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-497adc7e-83f7-438e-83f2-a0461227f35a req-6fbda7a0-4828-4afb-adba-b3ce41fea603 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071224 Oct 13 09:01:31.627643 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3062/5741] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:31.737696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:31.738769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:31.751246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:31.751974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:31.753270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.754189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:31.754751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:31.755640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:31.763040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:32.290944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:32.304920 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55ae714c-b0bf-461d-88f7-eaa4d9c45bdc tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1498 microversion: 2.1 time: 0.570713 Oct 13 09:01:32.305736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2680/5742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:31 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1498 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:32.404080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:32.404797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:32.418246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.418800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.419275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.420018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.420487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.420937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.560808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:32.561556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:32.575667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:32.583919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.589108 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-137b25ca-56cb-4e16-986c-06d3c3f8bb95 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1293 microversion: 2.1 time: 0.190433 Oct 13 09:01:32.607671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3063/5743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:32 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1293 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:32.609972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.610646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.614378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:32.615435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.616075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.616671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.621785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:32.635911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.638986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.639707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.640682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:32.644634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:32.645654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:32.763691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:32.777144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:32.779147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:32.781149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61e225ca-113e-4c6d-972a-95367f3dbcb5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.225172 Oct 13 09:01:32.782289 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2681/5744] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:32 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:33.017644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:33.036667 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3b001f6-fe09-4dab-8274-daa92bdba9af tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.426797 Oct 13 09:01:33.037603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3064/5745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:32 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:33.067929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:33.072033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:33.088061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.091779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.092840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.093815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.095122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.096155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.329500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:33.331391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:33.340828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:33.345534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.346379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.347995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.348961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.362609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.363381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.589193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:33.599391 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c0f1081-9b57-45fe-961c-932560e27581 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.536282 Oct 13 09:01:33.603400 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2682/5746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:33 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:33.623193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:33.623881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:33.639007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.639527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.639985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.640713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.642209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.642708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.741262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:33.749548 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-824accc2-b70c-4ce2-a05d-2d8992bc0b32 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1299 microversion: 2.1 time: 0.133240 Oct 13 09:01:33.755180 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2683/5747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:33 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:33.763229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:33.774242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 38c2640d-ef68-4fd6-b474-2f074369a926] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:33.788142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/38c2640d-ef68-4fd6-b474-2f074369a926/action HTTP/1.1 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 15 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: {"unpause": {}} Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '38c2640d-ef68-4fd6-b474-2f074369a926', 'body': {'unpause': {}}} Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:33.790680 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:33.795347 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:33.795347 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:33.795347 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. Oct 13 09:01:33.795347 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:33.796586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 38c2640d-ef68-4fd6-b474-2f074369a926 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:33.797619 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1efd82dc-779d-4517-86b8-b6d05dfb4e2f tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/38c2640d-ef68-4fd6-b474-2f074369a926/action" status: 404 len: 111 microversion: 2.1 time: 0.041280 Oct 13 09:01:33.803302 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2684/5748] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:33 2022] POST /compute/v2.1/servers/38c2640d-ef68-4fd6-b474-2f074369a926/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:33.815932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:33.816774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:33.834686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.835326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.835905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.836842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:33.837402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:33.838902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:33.983817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:33.991110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:33.994817 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e3b28c5-775e-4c90-ad0c-82e99d3ff21a tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1498 microversion: 2.1 time: 0.670499 Oct 13 09:01:34.007297 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3065/5749] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:33 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1498 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:34.008361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:34.012244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:34.014173 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f111892e-e7af-4153-a1ce-913997d60fd9 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.209257 Oct 13 09:01:34.015330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2685/5750] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:33 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:34.025481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:34.025481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:34.030190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.031402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.047149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.048015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.049005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.049462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.285723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:34.297682 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2fa48da8-9e52-43ce-b9e7-ba54104dcf8a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.288959 Oct 13 09:01:34.299369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3066/5751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:34.325650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:34.328201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:34.337913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.339303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.340714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.341763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.342465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.343389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.673833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:34.691348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec87896c-b545-47db-9f64-bd74b240b2e7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.371895 Oct 13 09:01:34.701066 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2686/5752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:34.714839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:34.721445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:34.731193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.731692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.732143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.732844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.733296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.733726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.766824 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'unpause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 15 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: {"unpause": {}} Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'unpause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'unpause': {}}} Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state active. Cannot unpause while the instance is in this state. Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:34.768799 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:34.773051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:34.773051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:34.773051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:34.773051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:34.773051 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:34.775156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'unpause' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:34.776377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fea5caf-b357-45c2-b1db-40b9a6c90841 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 145 microversion: 2.1 time: 0.066412 Oct 13 09:01:34.777360 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3067/5753] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:34 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 145 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 13 09:01:34.780499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:34.781091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:34.787988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:34.788860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:34.791637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.792811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.793462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.799164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.799857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.800491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.801085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.803023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.803874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:34.810243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:34.811071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:34.811811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.060627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.074804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-827dfb9d-8f02-4d0e-8acc-cab4ff4ab39e tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.292275 Oct 13 09:01:35.076090 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3068/5754] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:34 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:35.108992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:35.111100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:35.134089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.134872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.135464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.142229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.143364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.143961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.233105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.246131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-510f386f-d71c-4e75-9ed4-d2e75ccbc58f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.469788 Oct 13 09:01:35.251477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2687/5755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:34 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:35.271334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:35.272235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:35.280566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.281278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.284147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.285352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.285974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.286597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.403537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.428790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.431490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.432746 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9738c44-b4b3-4757-924e-fee988802460 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.180133 Oct 13 09:01:35.450444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2688/5756] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:35 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:35.450444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:35.450444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:35.453133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.453761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.454096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.458617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.459158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.459633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.612677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:35.622752 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f3fd00a-1dc4-4bc3-bb61-3478c1f13c1b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1501 microversion: 2.1 time: 0.545328 Oct 13 09:01:35.623960 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3069/5757] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:35 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1501 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:35.645146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:35.645936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:35.668727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.669522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.670190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.671145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.671811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.672468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.708452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:01:35.837696 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-408b8e32-fb57-409f-ae5a-bbd5607f0e76 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 204 len: 0 microversion: 2.1 time: 0.195502 Oct 13 09:01:35.838360 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3070/5758] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:01:35 2022] DELETE /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:01:35.848041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:35.848756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:35.855291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.855777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.856214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.856945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:35.857401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:35.857914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:35.860818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:36.046427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.056089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60918ec3-73bf-40fa-bba5-77481428d2ac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.620192 Oct 13 09:01:36.056683 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2689/5759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:35 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:36.081501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:36.084925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: 6ac30740-8295-492d-8557-748b2bed786d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.103008 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/6ac30740-8295-492d-8557-748b2bed786d/action HTTP/1.1 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 18 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: {"unshelve": null} Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6ac30740-8295-492d-8557-748b2bed786d', 'body': {'unshelve': None}} Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.108226 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance 6ac30740-8295-492d-8557-748b2bed786d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:36.112342 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e66236e-c4b6-4392-a0a3-be57faf06596 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/6ac30740-8295-492d-8557-748b2bed786d/action" status: 404 len: 111 microversion: 2.1 time: 0.036022 Oct 13 09:01:36.119119 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2690/5760] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:36 2022] POST /compute/v2.1/servers/6ac30740-8295-492d-8557-748b2bed786d/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:01:36.119265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.124521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:36.126335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-926244ec-be03-45f3-acc8-727f6ceec98b tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1507 microversion: 2.1 time: 0.282901 Oct 13 09:01:36.127206 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3071/5761] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:35 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:36.127915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.147874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.148378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.148819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.149645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.150102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.150560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.279827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:36.280358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.288412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.292673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.293151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.295815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.296902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.298792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.330012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.348098 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8790cc4-8d94-4cbb-94c0-de8a31c7fff7 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.224782 Oct 13 09:01:36.348839 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2691/5762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:36.377700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:36.378813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.387095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.388336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.402843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.403609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.406388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.407139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.517982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.529946 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e3739e3-ba1a-4bae-ab40-f1023e60e70b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.254597 Oct 13 09:01:36.546746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3072/5763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:36 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:36.552477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:36.553320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.561122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.561866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.562538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.563452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.564104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.564747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.648345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.658665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.661736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.663103 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3d5fb210-8c84-46fe-9c02-2b4cf85c12b8 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.115227 Oct 13 09:01:36.664326 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3073/5764] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:36 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:36.736924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:36.755566 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f732359-e5a6-45af-baba-a0fb7ac45691 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.378128 Oct 13 09:01:36.756384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2692/5765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:36.784292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:36.785255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.795770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.797008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.797686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.799062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.799996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.801155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.846773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Cannot 'unshelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action HTTP/1.1 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 18 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: {"unshelve": null} Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: exception: Cannot 'unshelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'unshelve': None}} Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 in vm_state active. Cannot unshelve while the instance is in this state. Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 13 09:01:36.850235 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active Oct 13 09:01:36.855332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:36.858564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 409 to user: Cannot 'unshelve' instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 while it is in vm_state active {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:36.859969 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4303ebd-eac9-4311-9568-fc1334bbdaec tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action" status: 409 len: 146 microversion: 2.1 time: 0.079616 Oct 13 09:01:36.861105 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3074/5766] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:36 2022] POST /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830/action => generated 146 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 13 09:01:36.869579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:36.870281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:36.876688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.877453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.878166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:36.879196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:36.879946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:36.880589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.153157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:37.154240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.162888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.163483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.164156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.165033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.165568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.166105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.330265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.341924 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e896d2c6-7cac-470a-a8d8-fc24fe4facb6 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1507 microversion: 2.1 time: 0.193255 Oct 13 09:01:37.341924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3075/5767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:37 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:37.423669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.434259 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-163d9889-2531-48d5-aa76-c1efa7210eac tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.568595 Oct 13 09:01:37.435924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2693/5768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:36 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:37.458735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:37.459410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.467515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.468277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.469108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.469999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.470702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.472387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.477045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab4f3a1-bf5c-4be0-bab7-99e35ae26e13", "tag": "9c60f1ef-116d-4433-ab6f-a46531b8777c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:37.497166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.497655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.498089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.511104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] Creating event network-changed:9c60f1ef-116d-4433-ab6f-a46531b8777c for instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 on n-h2-858384-11 Oct 13 09:01:37.517927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-796f04e1-25b0-4764-8722-49de268665c1 req-e0ef6add-eda9-446b-afbe-0cf6992d0da0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047826 Oct 13 09:01:37.519039 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2694/5769] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:01:37.555636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:37.556589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.565917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.566602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.567173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.567997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.568629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.569123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.705412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.716040 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7eb2e45e-1ea3-4f5b-93b8-c95618347ae4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.261412 Oct 13 09:01:37.716637 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3076/5770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:37 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:37.723747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:37.728197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.738284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.740998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.746382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.750507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.751088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.751638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.853179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.869568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.871380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.872790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb24934e-bbd1-4a34-8b3f-d2cf742be877 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.152809 Oct 13 09:01:37.876191 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3077/5771] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:37 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:37.881077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-92689572_updated"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:37.883719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.903327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:37.909052 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. Oct 13 09:01:37.913592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa5271a5-64cf-4d57-98c1-9ca9f193fa08 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.364052 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/servers/d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 HTTP/1.1 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 79 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-92689572_updated"}} Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd6a8e6e9-38d0-42a1-81a1-c8d9cb600d43', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-92689572_updated'}}} Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 13 09:01:37.918681 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. Oct 13 09:01:37.922377 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:37.928685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:37.929804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29ce0d3c-ec2c-4ab4-8398-8d8a2c8ddeeb tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "PUT /compute/v2.1/servers/d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43" status: 404 len: 111 microversion: 2.1 time: 0.052621 Oct 13 09:01:37.931152 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2695/5772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:37 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:37.931636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3078/5773] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 09:01:37 2022] PUT /compute/v2.1/servers/d6a8e6e9-38d0-42a1-81a1-c8d9cb600d43 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:37.945893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:37.946578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:37.965005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.965800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.966665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:37.967958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:37.968614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:37.969236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.224299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:38.233005 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-535bedb3-934e-4db6-847b-26dd001671bf tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.293058 Oct 13 09:01:38.247628 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2696/5774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:37 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:38.259989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:38.260714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:38.268620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.269238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.269776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.270895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.271617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.272253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.365131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:38.366305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:38.374658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.375481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.376202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.378367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.379318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.379960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.496786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:38.507666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a98b3e4-dd1e-45b0-8453-35a6b3de6cb1 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.252095 Oct 13 09:01:38.509169 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3079/5775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:38.534252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a382846-fecb-4292-b224-a65ebb79b99d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a382846-fecb-4292-b224-a65ebb79b99d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 HTTP/1.1 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 280 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.538392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 13 09:01:38.541486 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:38.544644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a382846-fecb-4292-b224-a65ebb79b99d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:38.545865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a382846-fecb-4292-b224-a65ebb79b99d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 400 len: 619 microversion: 2.1 time: 0.016654 Oct 13 09:01:38.550284 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3080/5776] 10.222.0.23 () {60 vars in 1257 bytes} [Thu Oct 13 09:01:38 2022] PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 09:01:38.556102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:38.557070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:38.564682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.565311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.566452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.566913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.567641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.568161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.770617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:38.786982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b5e7142-f34c-4a07-a63a-9609a91c53e8 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.235366 Oct 13 09:01:38.804123 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3081/5777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:38.814593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:38.815218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:38.824796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.825291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.825961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.827730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.829184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.830203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.894443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:38.907114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab07471b-9b33-4a07-a60e-ee504f73b108 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1507 microversion: 2.1 time: 0.547468 Oct 13 09:01:38.911371 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2697/5778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:38 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:38.918860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:38.920003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:38.927770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.928604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.932206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:38.937464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:38.938304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:38.938989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.109465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.113101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.129459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.131626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.133193 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3e57537a-d1f9-43b2-b224-c144a66f48c5 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.220623 Oct 13 09:01:39.134803 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2698/5779] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:38 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:39.142374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:39.143282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:39.151218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.151934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.152666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.153779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.154344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.155045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.164043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2634c3c3-821a-4aa8-8e06-feb78744d9a4 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.353861 Oct 13 09:01:39.166618 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3082/5780] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:38 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:39.178505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:39.193734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba937572-603c-4498-90a0-aa8484d0f567 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba937572-603c-4498-90a0-aa8484d0f567 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: request: PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 HTTP/1.1 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 24 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: {"server": {"name": ""}} Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830', 'body': {'server': {'name': ''}}} Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi '' Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:01:39.200091 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba937572-603c-4498-90a0-aa8484d0f567 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba937572-603c-4498-90a0-aa8484d0f567 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 400 len: 108 microversion: 2.1 time: 0.013488 Oct 13 09:01:39.204711 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3083/5781] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 09:01:39 2022] PUT /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 09:01:39.211453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:39.212276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:39.223085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.223786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.225008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.225938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.226625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.227815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.472696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.491922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c40f5dd1-f366-4304-ab18-dad89ffbfd74 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1504 microversion: 2.1 time: 0.280749 Oct 13 09:01:39.493611 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3084/5782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:39 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:39.768561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:39.782176 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b314e44-9549-4374-baa1-3c818a95fcdf tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.645121 Oct 13 09:01:39.797120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2699/5783] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:39 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:39.934256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:39.935957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:39.946459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.947276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.947895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:39.949408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:39.950721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:39.951333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:40.040011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb36435-9487-4a02-bce2-00eb0bd972f2", "name": "network-vif-deleted", "tag": "93392ade-cb5b-4796-913f-7c43b3d494ef"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:40.056438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:40.071230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:40.074744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:40.076064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:40.079265 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17d6b7f0-fcb2-4c0d-81e4-9bca94443f01 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1465 microversion: 2.1 time: 0.148957 Oct 13 09:01:40.080536 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3085/5784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:39 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:40.093980 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] Creating event network-vif-deleted:93392ade-cb5b-4796-913f-7c43b3d494ef for instance fdb36435-9487-4a02-bce2-00eb0bd972f2 on n-h2-858384-11 Oct 13 09:01:40.115508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c207b649-7fac-4736-99ae-0ac1ad443a27 req-c21d0813-d14a-4263-b8f5-a18dec06fc3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088730 Oct 13 09:01:40.116746 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2700/5785] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:40.165229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:40.166248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:40.174192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:40.175158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:40.189970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:40.192589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:40.193848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:40.194691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:40.534339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:40.734384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:40.748930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:40.750779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:40.752139 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-69caef8b-75f0-4bfa-b5e2-29233e9a4abe tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.591786 Oct 13 09:01:40.753218 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3086/5786] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:40 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:41.111807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:41.112745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:41.138267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.138825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.139275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.143259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.144627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.147136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.267648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.268415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.269105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.269790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lazy-loading 'fault' on Instance uuid fdb36435-9487-4a02-bce2-00eb0bd972f2 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:41.325424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:41.326231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:41.332826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.335562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.337003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.337951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.339946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.340697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.366355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:41.409493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:41.423365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70868419-3d5b-4614-bf7a-c726f9b969a0 tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1305 microversion: 2.1 time: 0.318683 Oct 13 09:01:41.427399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3087/5787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:41 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1305 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:41.575269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:41.585125 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c005dbb-38ab-4efe-8d86-9cdc5417a015 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.778876 Oct 13 09:01:41.591196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2701/5788] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:40 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:41.779985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:41.780602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:41.791820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.793815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.795304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.797582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:41.798560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:41.799810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:41.924046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:41.937865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:41.939503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:41.940998 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cbeb5b9-2f93-448e-9fe8-b31194e354d1 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.164973 Oct 13 09:01:41.942152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3088/5789] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:41 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:42.449644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:42.450643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:42.463820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.465669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.467201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.469561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.470045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.470600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.511396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.512286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.512891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.513503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lazy-loading 'fault' on Instance uuid fdb36435-9487-4a02-bce2-00eb0bd972f2 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:42.588190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cbddff50834a05bf694e6c813414e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8bda7a55cd49f6b47239f6bf31640a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:42.599194 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-171ec5e5-4106-433b-93ed-674e148973ad tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 200 len: 1305 microversion: 2.1 time: 0.151687 Oct 13 09:01:42.601703 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2702/5790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:42 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:42.610303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:42.611280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:42.635130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.639835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.640310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.641060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.645783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.649437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.942807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:42.955735 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-976bb15d-da2d-4403-8073-0c4e2e7d819c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.350535 Oct 13 09:01:42.957104 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3089/5791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:42 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:42.979847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:42.980511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:42.992488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:42.993067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:42.993519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:42.994274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:43.012850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:43.013863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:43.119334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:43.129772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:43.132154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:43.133734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6a58324-72fd-4434-9ff1-5ed7cfb58d00 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1605 microversion: 2.42 time: 0.160593 Oct 13 09:01:43.135176 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2703/5792] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:42 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:43.631783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:43.632724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] [instance: fdb36435-9487-4a02-bce2-00eb0bd972f2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:43.649245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:43.660866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:43.662823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:43.665948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:43.666849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:43.668720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:43.706122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] HTTP exception thrown: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Request method failure captured: Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 HTTP/1.1 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9O8LntkmJmv87bjvRjIfan3A4Tc_K0dUmS97ZmG2KgwO4RNquhDND1ZJwdUYlPKbJlhc73PwPTU7TqalxCNDD0LFiQ9KUdzI3uKnIR9c5i6hqj2JTH9Gd_M-FWqBZaQ-MQFJjmRP5sJijPThQYNUIYfv7VOBEgFw_TlJGJrF7HhF1o Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 1a8bda7a55cd49f6b47239f6bf31640a Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestServerAdvancedOps-1365580331 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a8bda7a55cd49f6b47239f6bf31640a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1a8bda7a55cd49f6b47239f6bf31640a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1a8bda7a55cd49f6b47239f6bf31640a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1a8bda7a55cd49f6b47239f6bf31640a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestServerAdvancedOps-1365580331 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 1a8bda7a55cd49f6b47239f6bf31640a Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestServerAdvancedOps-1365580331 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestServerAdvancedOps-1365580331-project Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 58cbddff50834a05bf694e6c813414e0 Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestServerAdvancedOps-1365580331-project Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fdb36435-9487-4a02-bce2-00eb0bd972f2'} Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:43.711710 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. Oct 13 09:01:43.718769 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:43.722027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] Returning 404 to user: Instance fdb36435-9487-4a02-bce2-00eb0bd972f2 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:43.725470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-547aa161-06f0-4ca1-a236-5502c1785c6c tempest-TestServerAdvancedOps-1365580331 tempest-TestServerAdvancedOps-1365580331-project] 10.222.0.23 "GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2" status: 404 len: 111 microversion: 2.1 time: 0.098187 Oct 13 09:01:43.730093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3090/5793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:43 2022] GET /compute/v2.1/servers/fdb36435-9487-4a02-bce2-00eb0bd972f2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:43.979401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:43.980752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:43.988266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:43.990923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:43.992282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:43.994975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:43.996427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:43.997674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:44.169337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:44.170584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:44.189581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:44.190432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:44.191304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:44.199704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:44.201317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:44.202340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:44.263980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:44.309673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:44.318522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:44.319231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:44.319934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lazy-loading 'fault' on Instance uuid 370ac9af-105c-4dab-93f7-86b6ac92209f {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:01:44.413119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:44.424648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f1a95ef-eaaa-4072-bd3b-20433d727f86 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.449590 Oct 13 09:01:44.440630 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2704/5794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:43 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:44.544993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:44.555240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:44.571662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4966ceab0ec143938dadab574388ab2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a5cba0679244b9a6319d2c56a09092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:44.573014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62d235be-d6c2-4839-ac5f-98c2d395ff85 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 200 len: 1610 microversion: 2.42 time: 0.410378 Oct 13 09:01:44.595307 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3091/5795] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:44 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 1610 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:01:45.451613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:45.453677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:45.461151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:45.462382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:45.463112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:45.467647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:45.468280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:45.468863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:45.603299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:45.604663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:45.612263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:45.613044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:45.613828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:45.615081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:45.615782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:45.616406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:45.634322 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] HTTP exception thrown: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Request method failure captured: Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f HTTP/1.1 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9JZeAS33NMYE83-PdS9e97Cdkeuv_0nJJy12lhbmkmhx0nWhU0gxZQrk2ZjF25yjlCMPTAaUkJjJ6AC28mSaoU7CSLpnquIIRdG9tTmaCKIeqKSKc-9s-8UBc1HuQO7cSPhvkWz9ienvXsIku39Givy3RDJwJ6bEFNotkpnlpXjRnk Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.42 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4966ceab0ec143938dadab574388ab2f Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '370ac9af-105c-4dab-93f7-86b6ac92209f'} Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:45.636699 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:45.642524 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:45.644930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Returning 404 to user: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:45.646644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e919f296-05b0-46c2-ba68-12c96cad0589 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 404 len: 111 microversion: 2.42 time: 0.048810 Oct 13 09:01:45.647478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3092/5796] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:45 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:01:45.656676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e021e210-bb0e-4789-a240-7bef0652d432 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '.version_select at 0x7f5375d584c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:45.683911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e021e210-bb0e-4789-a240-7bef0652d432 tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650510233" status: 204 len: 0 microversion: 2.42 time: 0.031564 Oct 13 09:01:45.689148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3093/5797] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 09:01:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650510233 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 09:01:45.832958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:45.850703 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04d6ed18-3a9d-4470-9710-c1a375edccef tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.403318 Oct 13 09:01:45.853936 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2705/5798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:45 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:46.402369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab4f3a1-bf5c-4be0-bab7-99e35ae26e13", "name": "network-vif-plugged", "status": "completed", "tag": "9c60f1ef-116d-4433-ab6f-a46531b8777c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:46.416321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.417010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.417592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.439112 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] Creating event network-vif-plugged:9c60f1ef-116d-4433-ab6f-a46531b8777c for instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 on n-h2-858384-11 Oct 13 09:01:46.453664 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8d81fda6-75e5-41bd-bfc7-c0aeb2a08ddf req-3f2b123b-bb04-4d4b-890e-4357c1c6bf92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054879 Oct 13 09:01:46.454697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3094/5799] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:46.484050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:46.485207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:46.496376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.496878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.500317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.501101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.501579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.502037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.543861 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 HTTP/1.1 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'bed19514-32cb-4108-948f-877680adbcb1'} Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:46.545588 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.549841 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.554531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:46.556187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40f2b334-b060-4a65-bd8c-e0d6ca14f7c5 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 404 len: 111 microversion: 2.1 time: 0.076703 Oct 13 09:01:46.557256 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2706/5800] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:01:46 2022] DELETE /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:46.567595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:46.568912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: bed19514-32cb-4108-948f-877680adbcb1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:46.576671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.577532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.578130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.580219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.580842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.581432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.601547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 HTTP/1.1 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'bed19514-32cb-4108-948f-877680adbcb1'} Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:46.604533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. Oct 13 09:01:46.609479 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:46.611466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance bed19514-32cb-4108-948f-877680adbcb1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:46.612845 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8024785-fc57-4d4a-ba4a-40b8b3cb333a tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1" status: 404 len: 111 microversion: 2.1 time: 0.051491 Oct 13 09:01:46.614048 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3095/5801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:46 2022] GET /compute/v2.1/servers/bed19514-32cb-4108-948f-877680adbcb1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:46.621946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:46.622370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:46.632203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.632827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.634231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.635101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.635694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.636575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.687709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:01:46.814014 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0736a47-2b0b-4651-a65d-2dcda920327c tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 204 len: 0 microversion: 2.1 time: 0.195029 Oct 13 09:01:46.819721 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2707/5802] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:01:46 2022] DELETE /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:01:46.823753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:46.824389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:46.834105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.839341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.842252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.843636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.844178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.844676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.885223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:46.885972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:46.898643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.900629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.901312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:46.902280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:46.904069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:46.904772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:47.226519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:47.254759 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56aabbd3-7192-4844-9231-d3b4390c386c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.381140 Oct 13 09:01:47.255762 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2708/5803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:46 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:47.348531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:47.364069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cbba10c-8c51-49ec-95f1-c7aab14bceca tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.538351 Oct 13 09:01:47.365217 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3096/5804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:46 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:48.279759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:48.280371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:48.299220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:48.299721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:48.302664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:48.305608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:48.309105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:48.311886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:48.389499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:48.390119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:48.401781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:48.402305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:48.402799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:48.403539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:48.404041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:48.404500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:48.637690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:48.648366 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1552943c-3dd7-4703-b184-c76f277c7ace tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.373094 Oct 13 09:01:48.655529 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2709/5805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:48 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:48.848892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:48.857598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df58b7f3-e6f1-40de-9d7c-3611dae964ad tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.472318 Oct 13 09:01:48.861336 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3097/5806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:48 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:49.682166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:49.682815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:49.716853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:49.717364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:49.717807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:49.718575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:49.719032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:49.719458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:49.885842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:49.886581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:49.911778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:49.912336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:49.912836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:49.913628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:49.917942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:49.920063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.037211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:50.053692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab7a6528-3d16-481f-8222-987e56632e25 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1366 microversion: 2.1 time: 0.376758 Oct 13 09:01:50.067889 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2710/5807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:49 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:50.076386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:50.088010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:50.088010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.088010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.088010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.089402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.090287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.090891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.179181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8a774e2-41b2-487e-a06d-01b69f653ba0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79/action" status: 200 len: 24568 microversion: 2.1 time: 0.109725 Oct 13 09:01:50.180241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2711/5808] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:01:50 2022] POST /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79/action => generated 24568 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:01:50.189813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:50.190833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:50.201874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.202691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.203781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.205254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.205849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.206457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.601279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f7b7beca1944019b70932ebc6f553c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d7b7aa7f7d4f6c84189db0a530a1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:50.643475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d55688fb-3a70-4d6c-bd08-370198f0193d tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 200 len: 1510 microversion: 2.1 time: 0.761632 Oct 13 09:01:50.645026 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3098/5809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:49 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 1510 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:50.673890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2c1cc-390b-4f4f-a9fc-bcdc261b2830", "name": "network-vif-deleted", "tag": "220f12d0-25b7-4155-8745-b5a61cb603bc"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:50.693395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:50.699557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.700051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.700493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.706461 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-726c2313-3b77-4871-b802-a394ec589211 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.523350 Oct 13 09:01:50.707486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2712/5810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:50.741257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:50.742226 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] Creating event network-vif-deleted:220f12d0-25b7-4155-8745-b5a61cb603bc for instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 on n-h2-858384-11 Oct 13 09:01:50.743045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:50.757830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.759229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.760250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c0a1289e-6081-447d-81fd-c5b02dfb846f req-235c4ae3-df3a-4828-9eba-0fea15cf1a55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113787 Oct 13 09:01:50.760402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:50.761136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:50.761756 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3099/5811] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:50.764470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:50.765175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.062483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:51.079308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db993272-ffbb-45e7-a59c-d1f31b519aae tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.343724 Oct 13 09:01:51.080589 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2713/5812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:51.101213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:51.106380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:51.106755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:51.107374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:51.114589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.115457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.116219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.117387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.118848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.119606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.119723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.120861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.121321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.123340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.125118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.129069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.410169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:51.426731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-847e7f57-2e3a-405e-894f-1c8dc663e38c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.324373 Oct 13 09:01:51.438439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2714/5813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:51.457713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:51.459317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:51.477524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.479237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.479928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.480901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.481575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.483813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.610039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:51.620900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd3d674f-1db9-42db-84d2-8220002ee93b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1556 microversion: 2.1 time: 0.543421 Oct 13 09:01:51.621498 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3100/5814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:51 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1556 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:01:51.654116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:51.654648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:51.661457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.661896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.662634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.663424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.663964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.665068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.703961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:51.706972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:51.716279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f21578e9-faef-4c9b-ad6a-56bb01ec2b56 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.264889 Oct 13 09:01:51.716986 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2715/5815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:51.723079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:51.724568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] [instance: cea2c1cc-390b-4f4f-a9fc-bcdc261b2830] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:51.734167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.735003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.736021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.737455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:51.738238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:51.739132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:51.761290 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] HTTP exception thrown: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Request method failure captured: Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 HTTP/1.1 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9MhJKGxfUaxeC5q0mmZcn6UfGUUfVKATIVZuHNSspqAQyGkGzcVSRF9UCVq4X0uSFwiqKhiR0rUs_RbIaW8xBUvvHW6mJhmPhrUH7pY0axsBB6KHrN230GQdEc_0ShGTQODZY_-8_rjdiim0ssHnCZ749UiFc7tk2vXdps7SNFxPf4 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5d7b7aa7f7d4f6c84189db0a530a1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a5d7b7aa7f7d4f6c84189db0a530a1f8 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1483763705 Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c4f7b7beca1944019b70932ebc6f553c Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1483763705-project Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'cea2c1cc-390b-4f4f-a9fc-bcdc261b2830'} Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:51.763885 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:01:51.767594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] Returning 404 to user: Instance cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:51.768445 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43249637-2572-4806-9c47-6c3b583cb431 tempest-ServersNegativeTestJSON-1483763705 tempest-ServersNegativeTestJSON-1483763705-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830" status: 404 len: 111 microversion: 2.1 time: 0.050296 Oct 13 09:01:51.769508 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2716/5816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:51 2022] GET /compute/v2.1/servers/cea2c1cc-390b-4f4f-a9fc-bcdc261b2830 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:01:51.845345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1027928078", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "b7a3a358-8f5e-4e38-984b-35dd1ec4122e"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:51.871450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae0b518d-ed3b-44fc-ada5-dd3642a2dabe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223906 Oct 13 09:01:51.871946 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3101/5817] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:01:51 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:01:51.907582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] validate_networks() for [('b7a3a358-8f5e-4e38-984b-35dd1ec4122e', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:01:52.354046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:52.354649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:52.368224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:52.369582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:52.370191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:52.371162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:52.371785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:52.372545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:52.416864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] HTTP exception thrown: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Request method failure captured: Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f HTTP/1.1 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9JZeAS33NMYE83-PdS9e97Cdkeuv_0nJJy12lhbmkmhx0nWhU0gxZQrk2ZjF25yjlCMPTAaUkJjJ6AC28mSaoU7CSLpnquIIRdG9tTmaCKIeqKSKc-9s-8UBc1HuQO7cSPhvkWz9ienvXsIku39Givy3RDJwJ6bEFNotkpnlpXjRnk Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.42 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4966ceab0ec143938dadab574388ab2f Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '370ac9af-105c-4dab-93f7-86b6ac92209f'} Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:52.419786 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.423707 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.431805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Returning 404 to user: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:52.433738 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-916615cd-44ee-4575-91f5-877574c4565b tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "DELETE /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 404 len: 111 microversion: 2.42 time: 0.094978 Oct 13 09:01:52.435103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3102/5818] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:01:52 2022] DELETE /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:01:52.443998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:52.444887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] [instance: 370ac9af-105c-4dab-93f7-86b6ac92209f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:52.453955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:52.454993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:52.455767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:52.456887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:52.457936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:52.458567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:52.477384 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] HTTP exception thrown: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Request method failure captured: Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f HTTP/1.1 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9JZeAS33NMYE83-PdS9e97Cdkeuv_0nJJy12lhbmkmhx0nWhU0gxZQrk2ZjF25yjlCMPTAaUkJjJ6AC28mSaoU7CSLpnquIIRdG9tTmaCKIeqKSKc-9s-8UBc1HuQO7cSPhvkWz9ienvXsIku39Givy3RDJwJ6bEFNotkpnlpXjRnk Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.42 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a5cba0679244b9a6319d2c56a09092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 65a5cba0679244b9a6319d2c56a09092 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-530399197 Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4966ceab0ec143938dadab574388ab2f Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TaggedBootDevicesTest_v242-530399197-project Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '370ac9af-105c-4dab-93f7-86b6ac92209f'} Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.480021 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. Oct 13 09:01:52.483882 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:01:52.486168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] Returning 404 to user: Instance 370ac9af-105c-4dab-93f7-86b6ac92209f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:01:52.487879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-967f0980-c239-4818-8f1e-febc607cd3bb tempest-TaggedBootDevicesTest_v242-530399197 tempest-TaggedBootDevicesTest_v242-530399197-project] 10.222.0.23 "GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f" status: 404 len: 111 microversion: 2.42 time: 0.048919 Oct 13 09:01:52.489389 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3103/5819] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:01:52 2022] GET /compute/v2.1/servers/370ac9af-105c-4dab-93f7-86b6ac92209f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:01:53.663531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:01:53.666385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:01:53.667069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:01:53.670493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:01:53.671680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:01:53.697012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:01:53.746966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:53.747376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:53.747824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:53.748562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:53.749020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:53.749457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:53.838076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:01:53.846003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:01:53.872372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:01:53.875329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:01:53.983277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b412873-945c-4738-8ce0-3780620ad691 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142316 Oct 13 09:01:53.986095 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2717/5820] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:01:53.998041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb9c4e5d-e6de-480d-b231-199d71463368 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:53.998782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb9c4e5d-e6de-480d-b231-199d71463368 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:54.139502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb9c4e5d-e6de-480d-b231-199d71463368 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:54.149442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb9c4e5d-e6de-480d-b231-199d71463368 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1215 microversion: 2.1 time: 0.155156 Oct 13 09:01:54.163167 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3104/5821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:53 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:55.176595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:55.177444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:55.185697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:55.186199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:55.186677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:55.187414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:55.187879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:55.188346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:55.576878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab4f3a1-bf5c-4be0-bab7-99e35ae26e13", "tag": "9c60f1ef-116d-4433-ab6f-a46531b8777c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:01:55.595848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:55.596345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:55.596784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:55.633941 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] Creating event network-changed:9c60f1ef-116d-4433-ab6f-a46531b8777c for instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 on n-h2-858384-11 Oct 13 09:01:55.646644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e49e5fd4-326a-45f3-aea2-dcb4541b0c44 req-359f1559-a2a4-4b91-a2ea-5ff047a132ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073446 Oct 13 09:01:55.650019 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3105/5822] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:01:55.757874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:55.778025 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-860f8783-0266-4920-b0f5-4efc4d7ca657 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1211 microversion: 2.1 time: 0.605753 Oct 13 09:01:55.781368 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2718/5823] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:55 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1211 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:56.808039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:56.809708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:56.824898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:56.825976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:56.826930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:56.829227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:56.835136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:56.836704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:57.023257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:57.031805 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-669cdf2d-3723-4321-be08-18d09e461caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1273 microversion: 2.1 time: 0.228934 Oct 13 09:01:57.035072 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3106/5824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:56 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:58.060762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:58.061482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:58.080524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:58.083575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:58.084547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:58.086761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:58.091550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:58.099166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:58.318576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:58.327254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22008403-fb7f-4d24-b8d7-e9b69adb2a88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1273 microversion: 2.1 time: 0.271041 Oct 13 09:01:58.346974 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2719/5825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:58 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:01:59.358629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:01:59.359255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:01:59.370134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:59.379021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:59.379495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:59.380256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:01:59.386002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:01:59.386839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:01:59.560929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:01:59.569512 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a928b18-47ef-40ad-971e-e4384b7304b1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1273 microversion: 2.1 time: 0.214675 Oct 13 09:01:59.570130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3107/5826] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:01:59 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:00.594163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:00.595693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:00.606512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:00.609280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:00.609907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:00.610884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:00.613524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:00.628477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:02.354386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:02.375459 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4da068c-15b0-4e16-adc6-93bcf609ee16 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 1.783846 Oct 13 09:02:02.378017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2720/5827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:00 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:03.405924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:03.406918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:03.421753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:03.422247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:03.422836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:03.423405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:03.423859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:03.424284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:03.623214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:03.633072 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba8e4b38-1447-4f69-9199-0136a1043f99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.234261 Oct 13 09:02:03.635194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3108/5828] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:03 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:04.665220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:04.666386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:04.673832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:04.674580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:04.688429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:04.691907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:04.693650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:04.697932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:04.698998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:04.700941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:05.554731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c2871d-1b61-4367-b6bc-f634b93ac218", "tag": "0eecd2ec-454d-4837-bf00-d5271a9ebff2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:05.576918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:05.599182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:05.605970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:05.634545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:05.635252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:05.666114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] Creating event network-changed:0eecd2ec-454d-4837-bf00-d5271a9ebff2 for instance c1c2871d-1b61-4367-b6bc-f634b93ac218 on n-h1-858384-11 Oct 13 09:02:05.674653 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9dae0639-a7de-42e6-990e-cc4bfc236f91 req-b006c373-ff08-492c-ac02-8ce4cc1c5713 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132896 Oct 13 09:02:05.676095 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3109/5829] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:02:06.549163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:06.592624 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae617c56-5adc-4af8-ba88-5b26a3a107f2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 1.932741 Oct 13 09:02:06.614297 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2721/5830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:04 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:07.621586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:07.622289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:07.637075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:07.637576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:07.638003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:07.641339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:07.645789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:07.646616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:08.191971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:08.201790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ed2f85f-4e59-4b85-af68-219673420251 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.584257 Oct 13 09:02:08.205692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3110/5831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:07 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:08.355783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-945b98de-56e8-4f81-8f40-59b294839ef3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: .version_select at 0x7f53753e54c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-465937073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqemaKKJR01KP/kXQLNAWX05I0DTBU32Wn1r4YvOfaDNjEjLWgJJx1II7fZ2ufl95+51DrLPkYU0MgaZ7cvU9FyO5pBDsDDi+NWDA0LKeAHMXA35s8WIPM1RYTuoFU+0Q=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:08.419379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-945b98de-56e8-4f81-8f40-59b294839ef3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:08.440908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-945b98de-56e8-4f81-8f40-59b294839ef3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:08.543109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-945b98de-56e8-4f81-8f40-59b294839ef3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.191695 Oct 13 09:02:08.551278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2722/5832] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:02:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:02:09.229856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:09.230696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:09.267958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:09.272127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:09.275865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:09.280527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:09.281190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:09.283321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:10.276204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:10.290681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7dff4f43-adfd-486e-b4f2-aacf012fc1eb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 1.064512 Oct 13 09:02:10.290681 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3111/5833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:09 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:11.329191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:11.330556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:11.341520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:11.344781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:11.345520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:11.346552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:11.348174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:11.350114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:11.771010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:11.783046 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.459349 Oct 13 09:02:11.799609 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2723/5834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:11 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:12.817459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:12.818083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:12.834602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:12.835103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:12.835620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:12.836348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:12.836811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:12.850169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:13.617926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:13.648339 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb3fea3e-2a87-4cf5-bb0d-61365c099ed9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.823122 Oct 13 09:02:13.654557 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3112/5835] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:12 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:13.915716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:13.917804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c63cadf7-4cca-4e68-aecb-d73f83d861e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002505 Oct 13 09:02:13.918539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2724/5836] 10.222.0.23 () {56 vars in 886 bytes} [Thu Oct 13 09:02:13 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 13 09:02:14.683505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:14.686029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:14.732822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:14.740055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:14.740808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:14.744636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:14.747491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:14.752322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:14.786347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=86 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:15.320928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:15.347113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-631d559b-fa1b-4139-b51a-25cf6c4a7217 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.667662 Oct 13 09:02:15.347905 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3113/5837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:14 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:15.438607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-397385032", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "2c01334c-3950-4a86-a2c8-1b9acc230b6b"}], "key_name": "tempest-TestNetworkBasicOps-465937073", "security_groups": [{"name": "tempest-secgroup-smoke-1651666407"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:15.636516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] validate_networks() for [('2c01334c-3950-4a86-a2c8-1b9acc230b6b', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:02:16.376208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:16.376802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:16.394576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:16.398022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:16.398660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:16.402108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:16.402820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:16.403471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:16.999489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:17.039267 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17b5c57f-28f0-49c7-a157-82abf938b793 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.664049 Oct 13 09:02:17.061343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3114/5838] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:16 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:17.434219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:02:17.435629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:02:17.437020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:02:17.437716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:02:17.438446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:02:17.452263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:17.453456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:17.454151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:17.455686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:17.456573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:17.457546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:17.502238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:17.510841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:17.519376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c2871d-1b61-4367-b6bc-f634b93ac218", "name": "network-vif-plugged", "status": "completed", "tag": "0eecd2ec-454d-4837-bf00-d5271a9ebff2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:17.535555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:02:17.541166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:02:17.581778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:17.583694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:17.589419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:17.632243 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] Creating event network-vif-plugged:0eecd2ec-454d-4837-bf00-d5271a9ebff2 for instance c1c2871d-1b61-4367-b6bc-f634b93ac218 on n-h1-858384-11 Oct 13 09:02:17.653901 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-77cbdbc3-43b5-4deb-a080-b0df537c8fb8 req-fef3baaa-5856-4c2c-be8c-8d7d61a0d1dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138204 Oct 13 09:02:17.661328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3115/5839] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:17.744602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d03da8e-b2fe-4737-81fc-686292162204 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.296150 Oct 13 09:02:17.748558 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2725/5840] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:02:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:02:17.760545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4045f5c6-e205-41b8-a343-65c86f8c331d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:17.761264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4045f5c6-e205-41b8-a343-65c86f8c331d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:18.070823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:18.071705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:18.091692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:18.098317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:18.102574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:18.104288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:18.108451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:18.110350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:18.796167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:18.814631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3118f59a-a8d8-4ab3-969d-2a96c8e8a69a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1315 microversion: 2.1 time: 0.745808 Oct 13 09:02:18.830043 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2726/5841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:18 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:18.982590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4045f5c6-e205-41b8-a343-65c86f8c331d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:18.995562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4045f5c6-e205-41b8-a343-65c86f8c331d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1247 microversion: 2.1 time: 1.239771 Oct 13 09:02:18.996170 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3116/5842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:17 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1247 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:19.838951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:19.839568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:19.869281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:19.870138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:19.875087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:19.878984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:19.882095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:19.884224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:20.024530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:20.025954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:20.044356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:20.045718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:20.046359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:20.047864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:20.048516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:20.049790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:20.230690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:20.241201 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38888b0e-31d1-4236-b9f2-ffdb7e017d17 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1299 microversion: 2.1 time: 0.222329 Oct 13 09:02:20.243457 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3117/5843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:20 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:21.268835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:21.269502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:21.284683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:21.285222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:21.285680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:21.286449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:21.291001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:21.291699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:21.353235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:21.373611 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ace19410-4dc9-4879-b0fd-ca61f7289621 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1503 microversion: 2.1 time: 1.539798 Oct 13 09:02:21.378365 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2727/5844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:19 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1503 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:21.408820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:21.409640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:21.432389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:21.433620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:21.436209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:21.438550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:21.448394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:21.449254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:21.548732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:21.559482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebc58e21-dbb7-43a7-a39d-9bda9c62577a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1305 microversion: 2.1 time: 0.297580 Oct 13 09:02:21.560688 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3118/5845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:21 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1305 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:22.217177 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Removing security group dcaf6790-84ed-4f20-b940-525354a97093 from port 0eecd2ec-454d-4837-bf00-d5271a9ebff2 Oct 13 09:02:22.586157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:22.587644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:22.614222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:22.615978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:22.616953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:22.618812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:22.620238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:22.621876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:22.774859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:22.790694 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62a65d18-0e9f-442b-81b6-ff5edb2eec4f tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1305 microversion: 2.1 time: 0.210850 Oct 13 09:02:22.793876 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3119/5846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:22 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1305 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:23.817013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:23.817671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:23.831085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:23.837808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:23.838352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:23.848826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:23.850203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:23.853316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.000855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:24.074563 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c4193e6-4ec8-4016-9561-5c2b90148c36 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1305 microversion: 2.1 time: 0.202691 Oct 13 09:02:24.075547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3120/5847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:23 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:24.347442 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-33463b63-9acf-4d9a-8179-87f7eb5cf1b5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218/action" status: 202 len: 0 microversion: 2.1 time: 2.941934 Oct 13 09:02:24.348273 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2728/5848] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:02:21 2022] POST /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218/action => generated 0 bytes in 2944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:02:24.357516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:24.358208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:24.378137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:24.378933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:24.379533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.380445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:24.381066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:24.381660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.561084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:24.569209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8141386f-8596-405c-a02f-885d5460a98a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1461 microversion: 2.1 time: 0.216682 Oct 13 09:02:24.569855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3121/5849] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:24 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1461 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:24.600202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:24.600899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:24.615311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:24.617267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:24.617733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:24.623399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.635225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:24.637466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c2871d-1b61-4367-b6bc-f634b93ac218", "tag": "0eecd2ec-454d-4837-bf00-d5271a9ebff2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:24.653773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:24.654828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.670241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:24.671249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:24.679666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:24.706192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] Creating event network-changed:0eecd2ec-454d-4837-bf00-d5271a9ebff2 for instance c1c2871d-1b61-4367-b6bc-f634b93ac218 on n-h1-858384-11 Oct 13 09:02:24.719901 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-270b126c-7e32-4814-bac0-49ff71004444 req-e2be3bdb-7777-4d82-a615-60eba86909fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097137 Oct 13 09:02:24.721014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3122/5850] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:24.774547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=54 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:25.122120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:25.123686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:25.138751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:25.139810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:25.140497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:25.141449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:25.143487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:25.144144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:26.141318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:26.152832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dbfe249-b9e6-4e5b-9182-96f405a883cb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 1.556703 Oct 13 09:02:26.155035 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2729/5851] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:24 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:26.187444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:26.188423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:26.201496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:26.202558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:26.203218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:26.204149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:26.204817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:26.205454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:26.417542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:26.436147 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74134164-3004-4de7-82bf-140b8add1ea3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 1.337353 Oct 13 09:02:26.437132 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3123/5852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:25 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:26.591586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:26.607841 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-13facbeb-7eed-4ec2-b3f2-98fa6b5a729a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.424054 Oct 13 09:02:26.613206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2730/5853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:26 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:26.655688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:26.657143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:26.684378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:26.685486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:26.692017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:26.695070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:26.696669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:26.697846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:27.356358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:27.366150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c0ddd291-f265-45d6-899d-1288992fb098 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.726154 Oct 13 09:02:27.367397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3124/5854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:26 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:27.396944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:27.398174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:27.429548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:27.430246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:27.435083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:27.435938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:27.444547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:27.445156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:27.465907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:27.466567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:27.473291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:27.474710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:27.475170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:27.476503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:27.478374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:27.480223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:27.520635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:27.525528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:28.001816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:28.013322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-008fc622-1794-4bfa-8ece-f3f44f79c112 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.621541 Oct 13 09:02:28.033784 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2731/5855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:27 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:28.221710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:28.230288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e389796-4bbb-45cd-a90f-9cb3e57b20cf tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 0.773769 Oct 13 09:02:28.246669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3125/5856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:27 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:28.247071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c85368-86dd-49e9-8463-677dbf762375", "tag": "e7d8ae9d-1374-4bad-9258-266b91039ffa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:28.247071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:28.247071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:28.247303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:28.249954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-972969398", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "b7a3a358-8f5e-4e38-984b-35dd1ec4122e"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:28.266145 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] Creating event network-changed:e7d8ae9d-1374-4bad-9258-266b91039ffa for instance b2c85368-86dd-49e9-8463-677dbf762375 on n-h1-858384-11 Oct 13 09:02:28.276697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3cacc86d-b4a4-44fd-8a4f-756aa13205eb req-2f57b4b7-ccaa-4a05-80cb-fc5de5c1334d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048218 Oct 13 09:02:28.280653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2732/5857] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:28.346448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] validate_networks() for [('b7a3a358-8f5e-4e38-984b-35dd1ec4122e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:02:28.987487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:29.259300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:29.260013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:29.269596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:29.270035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:29.270942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:29.274177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:29.276975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:29.279218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:29.897513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:29.907199 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c37c194-5f37-4ff2-ab3a-118332ae2cad tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 0.654060 Oct 13 09:02:29.915519 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2733/5858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:29 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:30.669573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:02:30.670809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:02:30.671319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:02:30.671735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:02:30.674269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:02:30.711421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:30.713264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:30.714600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:30.719775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:30.721290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:30.722756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:30.796082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:30.821955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Getting quotas for user 8522c58b81114d1093416ad6c6336f29 and project b464b1905aee4008898ae12948f5b741. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:30.863165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:02:30.873161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:02:30.939400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:30.940149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:30.955020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:30.965525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:30.969060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:30.971506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:30.972454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:30.973074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:31.047291 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f1ce6a8-83fc-47e1-afd7-18b09bca25e4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.808173 Oct 13 09:02:31.050246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3126/5859] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:02:31.063450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7883e043-b64b-4cae-8745-32e6870cfd7b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:31.067988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7883e043-b64b-4cae-8745-32e6870cfd7b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:31.415001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7883e043-b64b-4cae-8745-32e6870cfd7b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:31.428318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7883e043-b64b-4cae-8745-32e6870cfd7b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1214 microversion: 2.1 time: 0.371294 Oct 13 09:02:31.443464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3127/5860] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:31 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:31.574398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:31.582757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f00d570-e426-4b1d-86d4-c73fefc471ba tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 0.647918 Oct 13 09:02:31.591477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2734/5861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:30 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:32.457952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:32.459156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:32.487130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:32.495288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:32.497606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:32.502395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:32.504381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:32.510014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:32.623942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:32.624576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:32.663776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:32.664345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:32.664820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:32.665573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:32.666035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:32.683180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:32.720041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:32.736803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3efc372a-a68f-4bcd-a367-142a6f0e76e5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1210 microversion: 2.1 time: 0.283556 Oct 13 09:02:32.737417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3128/5862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:32 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:33.165809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:33.182749 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1bb4da5-d4fe-4c60-a015-a68d82ec3b3d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 0.569314 Oct 13 09:02:33.187689 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2735/5863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:32 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:33.764167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:33.764783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:33.780117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:33.780612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:33.781079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:33.781881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:33.782500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:33.794635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:34.000544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:34.009031 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fa350095-6e9c-4a5b-be95-679cbd3379f8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1284 microversion: 2.1 time: 0.248730 Oct 13 09:02:34.018468 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3129/5864] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:33 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:34.209336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:34.211452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:34.224324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:34.226991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:34.227646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:34.229754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:34.230970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:34.232884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:35.028848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c85368-86dd-49e9-8463-677dbf762375", "name": "network-vif-plugged", "status": "completed", "tag": "e7d8ae9d-1374-4bad-9258-266b91039ffa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:35.049186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:35.049871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:35.052529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:35.083347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] Creating event network-vif-plugged:e7d8ae9d-1374-4bad-9258-266b91039ffa for instance b2c85368-86dd-49e9-8463-677dbf762375 on n-h1-858384-11 Oct 13 09:02:35.099358 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f22b5ed2-a8ad-4c85-b8ff-2b49260fa9f3 req-17cdd49d-968b-4696-9ce6-357309f38f47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074213 Oct 13 09:02:35.101107 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3130/5865] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:35.114899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:35.115722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:35.130709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:35.131363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:35.131855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:35.132797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:35.133367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:35.133831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:35.202610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:35.217817 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6fc7d0f-1022-478d-a91a-29b901fe042c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 1.012528 Oct 13 09:02:35.218528 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2736/5866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:34 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:35.349711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:35.370610 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0375a161-f33d-4262-8d7b-fca1902239c2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1272 microversion: 2.1 time: 0.268046 Oct 13 09:02:35.382431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3131/5867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:35 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:36.265041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:36.265926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:36.295995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:36.300472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:36.317239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:36.318601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:36.330180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:36.330676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:36.406062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:36.415027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:36.451088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:36.453229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:36.455977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:36.457714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:36.458519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:36.459154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:36.992571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:37.001486 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07f04207-7e94-474e-ab81-d0b45f5388db tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.606338 Oct 13 09:02:37.006397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3132/5868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:36 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:37.798458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:37.816257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae322c41-cf8f-4e40-975b-ebbd084882ca tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1373 microversion: 2.1 time: 1.564424 Oct 13 09:02:37.819218 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2737/5869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:36 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1373 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:38.030254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:38.030900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:38.043705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:38.050861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:38.053320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:38.055258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:38.056510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:38.059836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:38.060523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:38.498636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:38.507612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9137f4bc-19f0-4d0e-a911-de597e8cc36d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.482315 Oct 13 09:02:38.535465 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3133/5870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:38 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:38.843233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:38.843958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:38.868855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:38.871846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:38.872802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:38.873127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:38.873595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:38.882818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:39.491076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:39.508282 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3bb1411-9357-4465-b480-ac36497f98f2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1546 microversion: 2.1 time: 0.669800 Oct 13 09:02:39.512326 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2738/5871] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:38 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1546 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:39.543227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:39.544427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:39.548401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:39.550807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:39.558103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:39.560626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:39.561042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:39.564289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:39.566212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:39.566712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:39.567294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:39.570332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:39.572489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:39.573150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:39.575427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:39.596093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:39.621820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:40.076577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:40.088164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-459b4155-4dec-48a5-bcec-b43827267939 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1546 microversion: 2.1 time: 0.553925 Oct 13 09:02:40.090577 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3134/5872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:39 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1546 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:40.566023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:40.583446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e10c1c00-b96d-44e2-a2d6-f7315da67c32 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 1.042813 Oct 13 09:02:40.584159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2739/5873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:39 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:41.425794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faae4070-66bc-4d7c-9f09-6d42a21d46fa", "tag": "16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:41.441886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:41.446451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:41.457478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:41.457847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:41.462751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:41.516943 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] Creating event network-changed:16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3 for instance faae4070-66bc-4d7c-9f09-6d42a21d46fa on n-h2-858384-11 Oct 13 09:02:41.536271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-61dd6cf7-794f-4813-932f-3e4e4d22576c req-8911fa66-fdb6-4f78-94d2-5331535b6fc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116761 Oct 13 09:02:41.540059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3135/5874] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:02:41.614734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:41.616616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:41.633295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:41.635164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:41.635947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:41.636932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:41.637496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:41.638432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:42.352310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:42.363103 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ff8ba05-9043-462e-9837-b790a1f8d976 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.750543 Oct 13 09:02:42.364198 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2740/5875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:41 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:43.389193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:43.389895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:43.402695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:43.403194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:43.403643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:43.405766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:43.413269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:43.415763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:43.485967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4aa81def-8fa7-426f-90b5-51b56a7f4246 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: .version_select at 0x7f5375c4c550>, body: {"keypair": {"name": "tempest-keypair-1611159982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrCGWjcY2ykVPGfW0+Xz07KqOR3BFozvyu1LQFVElbyrAstX4CnYqulEWuVZHqt+0ml/SkWyc1INp9QNMv4+mMViUbC4pF2ZINUkSj7DN6ifjsPiDaf3pESGD/vIFkyyw=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:43.510849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4aa81def-8fa7-426f-90b5-51b56a7f4246 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for project 86809284aea846728abda8b2e94f2717. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:43.517405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4aa81def-8fa7-426f-90b5-51b56a7f4246 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for user b165892374c048329f8d7cb1c29aa395 and project 86809284aea846728abda8b2e94f2717. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:43.550415 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4aa81def-8fa7-426f-90b5-51b56a7f4246 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.700470 Oct 13 09:02:43.551734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3136/5876] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 09:02:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 705 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 09:02:43.844494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1876519632", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "ec8c3cd8-4382-447b-9c08-6df54a5c47a4"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:43.927858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:43.952575 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc1bfc02-2a80-43c1-ae2f-edbfb019e715 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.567007 Oct 13 09:02:43.980780 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2741/5877] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:43 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:43.982019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] validate_networks() for [('ec8c3cd8-4382-447b-9c08-6df54a5c47a4', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:02:44.991102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:44.991763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:45.015096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:45.015749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:45.016504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:45.022257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:45.024320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:45.028191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:45.729438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:02:45.730799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:02:45.731509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:02:45.732173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:02:45.732826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:02:45.763499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:45.764393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:45.767518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:45.768963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:45.769646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:45.771600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:45.802610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:45.817015 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7def442e-5f91-4acb-9a74-9aed52263a61 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.836239 Oct 13 09:02:45.827526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Getting quotas for project 98f84787ee0143699be35cfc2c50499b. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:45.831230 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2742/5878] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:44 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:45.840361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Getting quotas for user 8037e6501a7945baa71b03566646a071 and project 98f84787ee0143699be35cfc2c50499b. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:45.872962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:02:45.880060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:02:46.001002 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c0bf1cc5-2467-4970-8f8c-13b21fe693dd tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.319444 Oct 13 09:02:46.003067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3137/5879] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:02:46.013737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a50b314-1d10-4491-94c2-69932f57fcd4 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:46.014366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a50b314-1d10-4491-94c2-69932f57fcd4 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:46.199218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a50b314-1d10-4491-94c2-69932f57fcd4 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:46.211544 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a50b314-1d10-4491-94c2-69932f57fcd4 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1214 microversion: 2.1 time: 0.202309 Oct 13 09:02:46.212151 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2743/5880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:46 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:46.860904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:46.860904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:46.879013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:46.880351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:46.883701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:46.885458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:46.888538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:46.889299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:47.245349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:47.246691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:47.269636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:47.270479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:47.273793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:47.275033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:47.275699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:47.279480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:47.533799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:47.543013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-599a2d6f-1d94-462e-bc35-4ac54a295d49 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.703773 Oct 13 09:02:47.550734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3138/5881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:46 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:47.771411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:47.784577 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-441b55f3-edd7-490c-97f8-1206cfd6cb88 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1210 microversion: 2.1 time: 0.552207 Oct 13 09:02:47.787002 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2744/5882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:47 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1210 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:48.573655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:48.575031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:48.590887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:48.591678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:48.593111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:48.594001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:48.594627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:48.601292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:48.816816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:48.818066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:48.828616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:48.829564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:48.830204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:48.831738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:48.832406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:48.833059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:48.913726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:48.922896 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d471580e-faf3-452e-9907-25a25066aaee tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.353156 Oct 13 09:02:48.935237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3139/5883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:48 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:49.040442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:49.065070 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4c90682-ff22-434c-9005-a7b696489bca tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1272 microversion: 2.1 time: 0.247308 Oct 13 09:02:49.068626 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2745/5884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:48 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:49.423912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faae4070-66bc-4d7c-9f09-6d42a21d46fa", "name": "network-vif-plugged", "status": "completed", "tag": "16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:49.450235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:49.451004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:49.451635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:49.470335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] Creating event network-vif-plugged:16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3 for instance faae4070-66bc-4d7c-9f09-6d42a21d46fa on n-h2-858384-11 Oct 13 09:02:49.485929 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-77c94745-cb0f-4290-88cd-cfc12b7951ea req-88bd143b-9dee-4775-a7b0-7e5c7635377f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066843 Oct 13 09:02:49.486807 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3140/5885] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:02:49.741803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1264446716", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbd6f304-e78b-4f1a-a640-89431fc24386"}], "security_groups": [{"name": "tempest-securitygroup--827501546"}], "key_name": "tempest-keypair-1611159982", "user_data": "}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:49.959613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:49.961315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:49.979362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:49.979873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:49.980712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:49.981448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:49.981918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:49.985584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:50.068115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] validate_networks() for [('cbd6f304-e78b-4f1a-a640-89431fc24386', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:02:50.429931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:50.438995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2b29863-f8ac-4724-a56b-8eb48da2e04c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1314 microversion: 2.1 time: 0.484191 Oct 13 09:02:50.439604 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3141/5886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:49 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:50.444642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:50.455309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:50.478694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:50.479666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:50.480338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:50.481682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:50.482354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:50.483040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:50.797098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:50.815681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f6b835e3-6de3-4482-8c59-ddab04ae4922 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.374845 Oct 13 09:02:50.816142 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3142/5887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:50 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:50.901943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:02:50.902882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:02:50.903572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:02:50.905015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:02:50.905688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:02:50.924337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:50.925434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:50.927319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:50.930188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:50.930940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:50.931592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:50.989244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for project 86809284aea846728abda8b2e94f2717. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:02:51.009482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for user b165892374c048329f8d7cb1c29aa395 and project 86809284aea846728abda8b2e94f2717. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:02:51.041121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:02:51.050830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:02:51.154094 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea8ff471-37d3-4a0f-9efc-3fc85b0a1e1c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.417135 Oct 13 09:02:51.166959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2746/5888] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 09:02:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 09:02:51.178360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:51.179593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:51.327569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:51.337681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:51.341405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:51.346175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea06734d-68fa-47d1-b738-2bc9458a819c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1282 microversion: 2.20 time: 0.171973 Oct 13 09:02:51.351615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3143/5889] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:51 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:02:51.464546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:51.465637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:51.480905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:51.481408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:51.492937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:51.494303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:51.499919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:51.500788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:51.848594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:51.849411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:51.858613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:51.859312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:51.859912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:51.860795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:51.870280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:51.871201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:51.997153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:52.009695 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b746209-1072-4663-9517-289188a083ff tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1501 microversion: 2.1 time: 0.550191 Oct 13 09:02:52.011871 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2747/5890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:51 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1501 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:52.038538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:52.048582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:52.061944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.062733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.063483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.069316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.070103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.070912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.149780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:52.276367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a58d8438-d805-486c-b6c2-a055bb4f7b3d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa/action" status: 202 len: 0 microversion: 2.1 time: 0.242021 Oct 13 09:02:52.299462 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2748/5891] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:02:52 2022] POST /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:02:52.368897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:52.373597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:52.388901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:52.405049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.406719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f4bea82f-5d1d-4a0a-8a36-38d8d1a84294 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.561624 Oct 13 09:02:52.407103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.408089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.409375 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3144/5892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:51 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:52.411057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.411526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.416367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.423812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:52.424903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:52.438726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.439227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.439667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.440387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:52.440866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:52.441271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:52.999163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:53.034535 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-936573d4-26c1-445c-89dd-4c36b1c8091d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1506 microversion: 2.1 time: 0.728451 Oct 13 09:02:53.040967 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2749/5893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:52 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:53.390911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27175421-ca31-4acd-aec6-faf1b20d354d", "tag": "daf4a47d-54c7-41a8-b1fb-8449859bdc2b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:53.421713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:53.422441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:53.424211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:53.459255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:53.479705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] Creating event network-changed:daf4a47d-54c7-41a8-b1fb-8449859bdc2b for instance 27175421-ca31-4acd-aec6-faf1b20d354d on n-h2-858384-11 Oct 13 09:02:53.491141 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4ce95bc6-7b4a-4851-a562-036deea19127 req-d9d667f6-45af-44b1-90df-913f5ca623ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105762 Oct 13 09:02:53.496103 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2750/5894] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:53.510513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:53.511477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:53.512066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:53.516233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:53.520363 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22d6997a-7846-40b2-b52a-5c52ec307042 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1278 microversion: 2.20 time: 1.109702 Oct 13 09:02:53.524407 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3145/5895] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:52 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1278 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:02:53.532176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:53.532660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:53.533096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:53.533801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:53.534254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:53.540962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.065482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:54.066109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:54.083403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.083910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.084428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.085200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.085666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.086101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.107973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:54.116743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7df351a5-eb25-45f7-8bb6-5e3dc168f0eb tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.618752 Oct 13 09:02:54.122205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2751/5896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:53 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:54.545643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:54.552684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:54.553846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:54.556510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35f17ff2-4a1c-4aed-9517-a594036663fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1486 microversion: 2.1 time: 0.495048 Oct 13 09:02:54.560917 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3146/5897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:54 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1486 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:54.563320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.563807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.566954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.569041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.573367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.573987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.599542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:54.600554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:54.612982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.615487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.616390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.617949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:54.620752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:54.621266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:54.684131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lazy-loading 'flavor' on Instance uuid faae4070-66bc-4d7c-9f09-6d42a21d46fa {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:02:54.917416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:54.931823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:54.933431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:54.934722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b76fd8d-2b4a-4779-86a3-86378af79efa tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1340 microversion: 2.20 time: 0.385957 Oct 13 09:02:54.941229 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2752/5898] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:54 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1340 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:02:55.150514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:55.151209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:55.153518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:55.161865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0dea3ef3-d118-4e10-b612-e327ca37285d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa/action" status: 202 len: 0 microversion: 2.1 time: 0.577859 Oct 13 09:02:55.162597 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3147/5899] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:02:54 2022] POST /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:02:55.175962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:55.177000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:55.177755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:55.178847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:55.187151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:55.187959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:55.188508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:55.189008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:55.195681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:55.196947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:55.200600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:55.201616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:55.202445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:55.203059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:55.493372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:55.508067 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90adf64d-bc36-4d02-8abd-5dbb6b9cdd88 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1492 microversion: 2.1 time: 0.340322 Oct 13 09:02:55.520873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3148/5900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:55 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1492 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:55.903400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:55.915420 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81843007-0ef9-477e-bafb-edfe794b2ce2 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.769826 Oct 13 09:02:55.916120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2753/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:55 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:02:55.975577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:55.976531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:55.988296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:02:55.994390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:55.997016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:55.999314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.001771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:56.004377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:56.009489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.213135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:56.241472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:56.246079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:56.247549 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-604c076a-74fe-46f6-a08f-b4e6c2bde970 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1340 microversion: 2.20 time: 0.280254 Oct 13 09:02:56.251943 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3149/5902] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:55 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1340 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:02:56.535193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:56.535806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:56.556009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:56.556510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:56.556952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.557672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:56.558125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:56.558589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.873519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:56.874022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:56.883845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:56.884344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:56.884791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.896278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:56.897209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:56.897896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:56.982731 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2709c9ab-e8f3-4100-957e-da95ff1efa71 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/ips" status: 200 len: 149 microversion: 2.1 time: 0.112754 Oct 13 09:02:56.985373 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3150/5903] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:02:56 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:02:56.991267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:56.992464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:57.020376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:57.020875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:57.021315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:57.022094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:57.022593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:57.023021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:57.617561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:57.630782 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19a03272-6505-4bc1-8d7f-6a9c04e7643a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1492 microversion: 2.1 time: 1.097533 Oct 13 09:02:57.634900 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2754/5904] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:56 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1492 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:57.650653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:57.651738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:57.663389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:57.664368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:57.666117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:57.667197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:57.675783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:57.676612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:57.747535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:57.763666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49c8c9e4-314d-46c4-bf08-15765e5fdd73 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.771709 Oct 13 09:02:57.775293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3151/5905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:56 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:58.664817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:58.682593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:58.687341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:58.696988 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-689da954-329c-4e5e-b0d7-8124be9f38c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 1.056145 Oct 13 09:02:58.698332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2755/5906] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:57 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:02:58.719191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:58.721855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:58.755504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:58.756145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:58.756793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:58.757553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:58.758024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:58.758480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:59.295517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1320328817", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "782972c2-1f59-4984-8351-ea676ae1c177"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:02:59.404598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] validate_networks() for [('782972c2-1f59-4984-8351-ea676ae1c177', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:02:59.454555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:59.484962 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5163293f-c88b-4e44-b4ab-a6eba94db6e1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1513 microversion: 2.1 time: 0.781514 Oct 13 09:02:59.488755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2756/5907] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:58 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1513 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:59.524767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:02:59.528282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:02:59.550747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:59.551258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:59.555154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:59.555944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:02:59.556414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:02:59.556855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:02:59.978549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:02:59.990461 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19086fb2-f354-4439-8745-1984826d99b6 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.500019 Oct 13 09:02:59.992447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2757/5908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:02:59 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:02:59.999240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:00.000064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:00.033180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.036972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.037473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.038280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.043063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.043593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.173598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:03:00.174025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:03:00.174544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:03:00.174962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:03:00.175374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:03:00.201118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.201869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.202498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.203457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.204300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.204909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.226931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Getting quotas for project 702f207bfe5f4fb0980d099f4801a205. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:03:00.233086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Getting quotas for user 55da4b6f7be74a9db95fe7e52442972e and project 702f207bfe5f4fb0980d099f4801a205. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:03:00.250129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Going to run 2 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:03:00.252798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:03:00.294194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=700df525-2400-4eff-a6cc-8fb31a69ed22,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:03:00.387517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:00.404249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe5a45d1-e196-4d70-862b-8fe8475c5a1a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764469 Oct 13 09:03:00.405339 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3152/5909] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:03:00.408048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:00.409501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:00.410676 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7356b95c-4765-4347-85ff-a6d4099e31cf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 0.417056 Oct 13 09:03:00.411234 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2758/5910] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:02:59 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:00.415414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c115bba7-4592-426f-bb59-c6278f4e9111"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:00.424800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:00.434348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.435144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.435747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.436631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.437277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.437867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.440824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:00.486474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.486965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.487392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.519434 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] Creating event network-changed:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:03:00.525254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-076f832f-5acb-4734-b1f9-5b45e3621ff4 req-0095a32c-88ed-4759-889f-9c24e07d554d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101526 Oct 13 09:03:00.526206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2759/5911] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:00.532952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:00.540544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:00.542383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Searching by: {'deleted': False, 'project_id': '702f207bfe5f4fb0980d099f4801a205'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 09:03:00.561119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.561710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.562725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.576622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.579118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.579751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.608217 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4bb16ba-a4d6-4d7d-81c3-42a34acf90a9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.080289 Oct 13 09:03:00.609349 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2760/5912] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 09:03:00 2022] GET /compute/v2.1/servers => generated 677 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:00.616871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:00.618074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:00.623618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:00.625921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.627718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.628385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.630698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:00.634149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:00.635531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:00.912922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4c82295-721c-4933-8907-dd5ab12655e9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "POST /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505202 Oct 13 09:03:00.924464 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3153/5913] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:03:00 2022] POST /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:00.931836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2eaabc4d-636b-4501-af43-74142acf4ed1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:00.932835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2eaabc4d-636b-4501-af43-74142acf4ed1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:01.024036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:01.074336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2eaabc4d-636b-4501-af43-74142acf4ed1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:01.083023 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2eaabc4d-636b-4501-af43-74142acf4ed1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1220 microversion: 2.1 time: 0.157208 Oct 13 09:03:01.084254 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3154/5914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:00 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:01.094447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:01.099879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:01.104310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:01.120790 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45369704-fc67-4641-a016-0f39d890651f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1513 microversion: 2.1 time: 0.506658 Oct 13 09:03:01.122696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2761/5915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:00 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1513 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:01.142710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:01.143858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:01.145250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:01.147697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:01.149052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:01.150421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:01.437167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:01.438052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:01.446636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:01.447352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:01.447961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:01.449179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:01.450882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:01.451236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:01.451994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:01.477044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c434e90-6007-40cb-b724-8062c88f87fe tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.388264 Oct 13 09:03:01.477918 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3155/5916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:01 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:02.108600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:02.111743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:02.114043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:02.133019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:02.142533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.142687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:02.144387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-952704e6-6a51-4622-ad0d-38f3210ce4c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 0.712136 Oct 13 09:03:02.144972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2762/5917] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:01 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:03:02.158523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.158523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:02.158523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.158523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.158523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:02.173210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:02.174831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:02.202584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.203257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.206163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:02.207440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.209518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.210829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:02.323923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:02.334976 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c1e4f22-7f4a-42a7-b450-ed0d1fcf3612 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1224 microversion: 2.1 time: 0.230304 Oct 13 09:03:02.336183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3156/5918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:02 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1224 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:02.500930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:02.501556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:02.515525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.517457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.518109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:02.520625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:02.524619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:02.525958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.067956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:03.078374 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc39c69f-3f86-46d1-bb7e-d0fa4b17fa99 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1513 microversion: 2.1 time: 0.926304 Oct 13 09:03:03.083145 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2763/5919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:02 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1513 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:03.102822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:03.116207 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bcf17bf6-9410-4796-9079-6e7acf0ea0ba tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.619260 Oct 13 09:03:03.121243 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3157/5920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:02 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:03.175811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:03.179099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:03.207763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:03.217560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:03.223094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.224365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:03.230419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:03.233365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.359582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:03.360358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:03.380536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:03.382068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:03.382876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.385188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:03.386329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:03.395234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.633550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:03.648044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-30f0b350-3933-46e3-acd9-23cdf7901ba9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1272 microversion: 2.1 time: 0.292603 Oct 13 09:03:03.651629 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3158/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:03 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:03.673522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27175421-ca31-4acd-aec6-faf1b20d354d", "name": "network-vif-plugged", "status": "completed", "tag": "daf4a47d-54c7-41a8-b1fb-8449859bdc2b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:03.734338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:03.735219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:03.736996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:03.786009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] Creating event network-vif-plugged:daf4a47d-54c7-41a8-b1fb-8449859bdc2b for instance 27175421-ca31-4acd-aec6-faf1b20d354d on n-h2-858384-11 Oct 13 09:03:03.795710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2e092366-de02-49e4-89b5-9094d68d911f req-4c26cf78-7385-4433-b7f5-60a08ddbca48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140483 Oct 13 09:03:03.797809 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3159/5922] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:04.109940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:04.111115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:04.113433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:04.122164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:04.123082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:04.123774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:04.124758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:04.125457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:04.126201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:04.570370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:04.585409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:04.589803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:04.595170 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e437b03-a640-4c0d-98af-182e4aeecccc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 1.423808 Oct 13 09:03:04.596397 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2764/5923] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:03 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:04.609909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:04.610918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:04.628016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:04.629012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:04.629888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:04.631894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:04.632614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:04.633786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:05.202592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:05.204858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:05.215821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da055af4-8565-4767-b0b5-8624470504db tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 0.617774 Oct 13 09:03:05.216417 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2765/5924] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:04 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:05.241422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:05.242662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:05.272601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:05.273528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:05.274130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:05.275068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:05.275741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:05.276201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:05.624547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:05.651832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6565812a-1fa0-4088-8381-0352a800d926 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1278 microversion: 2.1 time: 0.424961 Oct 13 09:03:05.654624 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2766/5925] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:05 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:05.662394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:05.663403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:05.696638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:05.702074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:05.703752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:05.706075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:05.708405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:05.721644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:05.836590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:05.849443 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-500c50f3-8148-4c90-bb56-a380efbfcde7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 1.743845 Oct 13 09:03:05.868293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3160/5926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:04 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:06.191342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faae4070-66bc-4d7c-9f09-6d42a21d46fa", "name": "network-vif-plugged", "status": "completed", "tag": "16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:06.224128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:06.227324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:06.227798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:06.255690 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] Creating event network-vif-plugged:16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3 for instance faae4070-66bc-4d7c-9f09-6d42a21d46fa on n-h2-858384-11 Oct 13 09:03:06.261182 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-95d06f1a-69f2-4b7b-82cd-7e01b8a2146c req-750e6851-88a8-4320-b262-fdcad8c35c40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074069 Oct 13 09:03:06.262365 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3161/5927] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:06.270851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:06.273469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:06.280504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:06.283749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:06.285587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:06.287850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:06.288642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:06.289253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:07.182681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:07.192500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:07.204776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:07.205985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-87ae68c9-e5e1-487b-96ea-056692547804 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 1.549534 Oct 13 09:03:07.206896 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2767/5928] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:05 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:07.211756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:07.213336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:07.227855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:07.231941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:07.236415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:07.237383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:07.238970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:07.239754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:07.278364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:07.289430 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a65fa4d-a072-4f48-949e-8d5f867bbe47 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1314 microversion: 2.1 time: 1.024948 Oct 13 09:03:07.306558 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3162/5929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:06 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:07.311490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:07.312479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:07.326131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:07.328241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:07.329272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:07.331992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:07.332689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:07.336485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:07.506290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:07.518230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-daad099e-0206-403a-be30-9d031dae1753 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1278 microversion: 2.1 time: 0.309972 Oct 13 09:03:07.518870 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2768/5930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:07 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:08.237918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:08.238692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:08.256381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:08.256889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:08.257333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:08.266963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:08.267702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:08.270723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:08.896323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:08.906325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:08.909873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:08.913697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08bedbec-8d31-46f2-aa2b-55e79f0b94d7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 0.680434 Oct 13 09:03:08.915413 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2769/5931] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:08 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:03:08.920834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "name": "network-vif-plugged", "status": "completed", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:08.950660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:08.951492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:08.952124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:08.977579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] Creating event network-vif-plugged:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:03:09.009004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-11ccfe5e-7cc6-4d7d-9689-5d6e913a3491 req-59468f78-ff58-4334-b356-728702386413 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091619 Oct 13 09:03:09.013454 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2770/5932] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:09.047872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:09.052868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:09.076652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.077478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.078146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:09.079098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.079781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.080415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:09.301348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:09.330644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-788f148b-a5d6-4355-9e83-36615a6a281d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 2.020776 Oct 13 09:03:09.330644 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3163/5933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:07 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:09.347588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:09.348222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:09.385069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.398792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.399255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:09.400018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.400480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.400913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:09.546971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:09.556545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8013a5f-cad8-4a84-83e6-f4841db96142 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1497 microversion: 2.1 time: 0.541220 Oct 13 09:03:09.564207 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2771/5934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:09 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1497 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:09.944273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:09.945931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:09.956773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.961289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.962008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:09.963126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:09.963750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:09.967013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.184426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:10.232955 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99cda00c-aee4-4592-bd7f-87c8710f4ab9 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.903382 Oct 13 09:03:10.233573 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3164/5935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:09 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:10.291330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:10.297467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:10.322246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:10.367312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:10.367849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:10.371787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.374919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:10.390694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:10.390694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.492727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:10.502303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:10.509447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:10.511931 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-701170fc-79e7-435c-a1ac-7425a805e82a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1407 microversion: 2.20 time: 0.571342 Oct 13 09:03:10.512543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2772/5936] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:09 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:10.531157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:10.552732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:10.558310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:10.577309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:10.581720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:10.584939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.585932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:10.590731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:10.595709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.596534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:10.867501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c28b63f-abfa-4d2d-b3f5-42b19a426ed3 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 204 len: 0 microversion: 2.1 time: 0.619782 Oct 13 09:03:10.870621 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3165/5937] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:10 2022] DELETE /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:10.878942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700df525-2400-4eff-a6cc-8fb31a69ed22", "tag": "62010c9f-ac3b-44eb-983e-51a86704823d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:10.899585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:10.900274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:10.900730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:10.929029 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] Creating event network-changed:62010c9f-ac3b-44eb-983e-51a86704823d for instance 700df525-2400-4eff-a6cc-8fb31a69ed22 on n-h2-858384-11 Oct 13 09:03:10.951581 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cfa9f62f-1a21-4763-a21a-abc9e1e6a8df req-890e34a3-2d5f-46be-bcb0-25eb440e7466 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079187 Oct 13 09:03:10.961490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3166/5938] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:10.976333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:10.981565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:11.009576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.013946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.014802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:11.015735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.020410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.021102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:11.089687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=20 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:11.319984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:11.328411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bde4161-9731-49eb-90ed-96fd9d27f3c9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.791920 Oct 13 09:03:11.334754 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2773/5939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:10 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:11.348017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:11.348649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:11.382189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.382718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.383163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:11.385626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.386114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.386591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:11.751654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:11.764202 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3599158-58f2-41fa-973f-c47c6d7bd86a tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1552 microversion: 2.1 time: 0.799067 Oct 13 09:03:11.766521 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3167/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:10 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1552 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:11.773178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:11.773988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:11.796351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.797066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.797688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:11.801636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:11.803468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:11.804086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:12.174973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:12.186389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61116a5b-0a57-446f-a795-cde011780cfc tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.850383 Oct 13 09:03:12.187004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2774/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:11 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:12.203743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032061a5-8dec-4673-811b-943deb1cfb1d", "tag": "a3b89943-520a-4776-a67e-acb5a7ed20b1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:12.246885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:12.247387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:12.247835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:12.281382 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] Creating event network-changed:a3b89943-520a-4776-a67e-acb5a7ed20b1 for instance 032061a5-8dec-4673-811b-943deb1cfb1d on n-h1-858384-11 Oct 13 09:03:12.295147 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cbae6727-3596-4d99-a748-607895104bb3 req-945f0e49-19a5-442a-9171-736d489cb138 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099334 Oct 13 09:03:12.303832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2775/5942] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:12.356730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:12.357679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:12.375212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:12.376048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:12.376816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:12.377756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:12.378376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:12.379006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:12.644834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:12.657802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:12.664827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:12.671122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebf385ad-cbc7-4a4a-bd21-ab8c92dc39f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1599 microversion: 2.20 time: 0.900555 Oct 13 09:03:12.673611 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3168/5943] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:11 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1599 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:12.707693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:12.708186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:12.771316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:12.772163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:12.772730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:12.777652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:12.778280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:12.778833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.154513 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79027c31-542d-42e2-b9e3-f4da0a1d205b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.450935 Oct 13 09:03:13.155778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3169/5944] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 09:03:12 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-interface => generated 284 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 09:03:13.167255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:13.168116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:13.186687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:13.190345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:13.191018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.193109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:13.194778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:13.195800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.520775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:13.535153 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57dc698c-c88c-4d1e-9ff9-10f9682e754e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 1.182886 Oct 13 09:03:13.562447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2776/5945] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:12 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:13.575304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:13.576261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:13.589440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:13.590483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:13.591110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.592036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:13.592847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:13.593460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.644268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:13.667810 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f39f66de-2c50-4cab-90fa-2cabe4e64302 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1552 microversion: 2.1 time: 0.510324 Oct 13 09:03:13.669108 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3170/5946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:13 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1552 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:13.674632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c85368-86dd-49e9-8463-677dbf762375", "name": "network-vif-deleted", "tag": "e7d8ae9d-1374-4bad-9258-266b91039ffa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:13.692795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:13.694086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:13.694714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:13.710676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:13.713243 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] Creating event network-vif-deleted:e7d8ae9d-1374-4bad-9258-266b91039ffa for instance b2c85368-86dd-49e9-8463-677dbf762375 on n-h1-858384-11 Oct 13 09:03:13.719400 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bdce2697-a049-472d-8a8b-6393f69eb35e req-ee435447-cfd5-4d69-b4c2-7af54bd3bf58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048855 Oct 13 09:03:13.720673 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3171/5947] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:13.954192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:13.963895 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a529239-1287-4f0c-80b3-d6147cdb99b0 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.413129 Oct 13 09:03:13.976954 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2777/5948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:13 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:14.572469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:14.576423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:14.597578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:14.598342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:14.601332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:14.602328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:14.604559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:14.614638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:14.699809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:14.700437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:14.729701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:14.732421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:14.733059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:14.735831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:14.741152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:14.741834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:14.835207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:14.835721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:14.837083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:14.837619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lazy-loading 'fault' on Instance uuid b2c85368-86dd-49e9-8463-677dbf762375 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:14.969606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:14.993971 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e6d349d-8770-403b-aad6-0ddeb687f4b8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.426643 Oct 13 09:03:15.001855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3172/5949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:14 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:15.018643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:15.022925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:15.050386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:15.055306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:15.056038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:15.057037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:15.059430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:15.063532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:15.501698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:15.510067 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b77bca4a-279c-4b6a-b568-84e8d8f0eed6 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.506237 Oct 13 09:03:15.510706 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3173/5950] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:15 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:15.606995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:15.619478 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5a7554fc-c196-4c15-8359-c94a14587d05 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 200 len: 1337 microversion: 2.1 time: 0.927187 Oct 13 09:03:15.638860 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2778/5951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:14 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 1337 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:16.030646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:16.030646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:16.050871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.051229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.051867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.061932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.062611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.063231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.279223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:16.318378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.319432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.320057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.376089 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] Creating event network-changed:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:03:16.397248 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c5b5800c-d193-4777-b351-2b9e426d5ee0 req-64f67e0d-eed4-4ebd-bfce-0814c6297c31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121719 Oct 13 09:03:16.402864 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2779/5952] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:16.561331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:16.562631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:16.575461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:16.589898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.591148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.591600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.594671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.595330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.595931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.597985 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26d7139d-dab6-4ebc-8421-088f830f6677 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.574238 Oct 13 09:03:16.621144 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3174/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:16 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:16.628229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:16.628731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:16.662938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.665020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.665479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.668952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.669431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.669867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.751443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:16.874216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:16.883319 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8e9e470-437e-4ff8-8b87-479f9be6af3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.342075 Oct 13 09:03:16.890097 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2780/5954] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:16 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:16.895430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:16.899894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: b2c85368-86dd-49e9-8463-677dbf762375] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:16.921084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.921955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.922862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.923965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:16.924689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:16.925525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:16.957278 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] HTTP exception thrown: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Request method failure captured: Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 HTTP/1.1 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9O0bUNKsKefHACVGhJD80fKNfpPzZFBxneceacQEOtqjDEEzC34ZEv3_Qh5KiPpMN3btQcwZqPdVmRD2uFekWjiwq8-HXnRnAmZCgtdTGbUNkNC0lYUGtQWW0JRGgpzpeleRvWKE49uF3QR0wQ-T7mMEqZOAUi5qv0Pi7X6trzZe74 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: d21e2f3b05c244c49a19dcbb7bb2fa5e Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b2c85368-86dd-49e9-8463-677dbf762375'} Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:16.968486 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. Oct 13 09:03:16.972952 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:16.976864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Returning 404 to user: Instance b2c85368-86dd-49e9-8463-677dbf762375 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:03:16.978267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a49cf111-545e-45ce-adbc-5b78846bb3e7 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375" status: 404 len: 111 microversion: 2.1 time: 0.086637 Oct 13 09:03:16.984268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2781/5955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:16 2022] GET /compute/v2.1/servers/b2c85368-86dd-49e9-8463-677dbf762375 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:03:16.989490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-775f184d-ca6e-4fdd-b4ae-b493b9f022ae tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "DELETE /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 204 len: 0 microversion: 2.1 time: 0.366740 Oct 13 09:03:16.997530 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3175/5956] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:16 2022] DELETE /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:17.000351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:17.001517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:17.013418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.025105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.025891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:17.026917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.027628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.028325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:17.535898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed1e21f4-adaf-4f8d-91e9-fc5dda766df1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '.version_select at 0x7f5375c6d940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:17.586349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed1e21f4-adaf-4f8d-91e9-fc5dda766df1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-465937073" status: 202 len: 0 microversion: 2.1 time: 0.055008 Oct 13 09:03:17.590661 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3176/5957] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 13 09:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-465937073 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:03:17.607137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:17.616159 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-26583370-cf81-481f-9ecc-74853dc37815 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1503 microversion: 2.1 time: 0.620420 Oct 13 09:03:17.616744 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2782/5958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:16 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1503 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:17.625981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:17.627125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:17.641529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.642699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.644206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:17.645244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.648448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.649236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:17.890662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:17.900706 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-702a7336-2a89-413a-b2bb-728a9f408e01 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.278972 Oct 13 09:03:17.908527 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3177/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:17 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:17.917574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:17.918971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:17.935499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.936552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.937258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:17.939430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:17.947027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:17.949357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:18.285434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:18.300970 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f7bce60-da11-4a09-80ee-ebacaa13088d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.382707 Oct 13 09:03:18.302797 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2783/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:17 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:18.642360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:18.643706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:18.691456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:18.692171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:18.692716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:18.694102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:18.694671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:18.695177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:18.941139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:18.942588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:18.966904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:18.978656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:18.980433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:18.988510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:18.989379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:18.990910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:19.368110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:19.385092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-75ec8a39-12b1-4697-8ea1-bd8e785ad04f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1503 microversion: 2.1 time: 0.747465 Oct 13 09:03:19.402950 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3178/5961] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:18 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1503 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:19.412301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:19.412927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:19.440978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:19.441487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:19.441928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:19.442690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:19.443674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:19.444103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:19.912489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:19.915673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:19.934080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:19.944615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd8b0cfb-4ddf-44a4-a336-565fac773fe2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 1.007562 Oct 13 09:03:19.946003 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82cc20e4-bbbc-486c-bff5-5ec7683eee9f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.539172 Oct 13 09:03:19.962423 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2784/5962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:18 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:19.962834 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3179/5963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:19 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:20.409538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:20.410062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:20.427438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:20.427942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:20.428393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:20.429117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:20.429574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:20.430002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:20.866539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:20.893609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b368734-f025-4570-89a8-f262f891943f tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1503 microversion: 2.1 time: 0.486643 Oct 13 09:03:20.907144 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2785/5964] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:20 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:20.978040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:20.979267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:20.980981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:20.984180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:20.992418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.003957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.004660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.007027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.008427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.011158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.011888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.012651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.025275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.026192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.026764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.027274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.376944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:21.391579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:21.393765 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b84968c8-39fb-4397-80b1-71cee932d718 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.423867 Oct 13 09:03:21.394942 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2786/5965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:20 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:21.404649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27175421-ca31-4acd-aec6-faf1b20d354d", "name": "network-vif-deleted", "tag": "daf4a47d-54c7-41a8-b1fb-8449859bdc2b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:21.416713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46d8be60-90b2-4b11-abf4-4c0b6dfebf9d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.451171 Oct 13 09:03:21.431103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3180/5966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:20 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:21.437680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032061a5-8dec-4673-811b-943deb1cfb1d", "name": "network-vif-plugged", "status": "completed", "tag": "a3b89943-520a-4776-a67e-acb5a7ed20b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:21.449180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.449983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.450656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.452532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.454218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.454721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.465743 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] Creating event network-vif-plugged:a3b89943-520a-4776-a67e-acb5a7ed20b1 for instance 032061a5-8dec-4673-811b-943deb1cfb1d on n-h1-858384-11 Oct 13 09:03:21.480194 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] Creating event network-vif-deleted:daf4a47d-54c7-41a8-b1fb-8449859bdc2b for instance 27175421-ca31-4acd-aec6-faf1b20d354d on n-h2-858384-11 Oct 13 09:03:21.482650 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-db10923f-b9da-49b2-aed4-679f53e65130 req-7f1cbee5-72bc-42f9-a039-521d9dcc28ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049872 Oct 13 09:03:21.483826 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3181/5967] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:21.537142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ddbb487e-9df3-4f03-8e83-207b35071c67 req-6f8e95f1-87f3-414a-97df-05ba24fc3e4b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135990 Oct 13 09:03:21.548156 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2787/5968] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:21.924548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:21.925138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:21.937641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.938131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.938599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:21.939307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:21.939758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:21.940184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.029893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:22.035112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:22.035953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.036745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lazy-loading 'fault' on Instance uuid 27175421-ca31-4acd-aec6-faf1b20d354d {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:22.133606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8037e6501a7945baa71b03566646a071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f84787ee0143699be35cfc2c50499b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:22.142061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab5da3e8-b196-4c77-a5ed-b627b2ccac18 tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 200 len: 1304 microversion: 2.1 time: 0.221896 Oct 13 09:03:22.148948 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3182/5969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:21 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 1304 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:22.418321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:22.419818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:22.433979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:22.442079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:22.444472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:22.450153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:22.452250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.456501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:22.457418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:22.458149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:22.459669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.460291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:22.464487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.465826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:22.470669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:22.471512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:22.670628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:22.680685 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f30da93c-218a-4a4a-a4ff-65d984d87969 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1320 microversion: 2.1 time: 0.242920 Oct 13 09:03:22.683219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3183/5970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:22 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:22.785624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:22.797741 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e06cdcd5-c27b-4e6f-9eb4-24ef3126879a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.383765 Oct 13 09:03:22.798803 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2788/5971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:22 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:23.048924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:23.049309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:23.066381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.067168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.067724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.068614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.069148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.069644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.171018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:23.171938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] [instance: 27175421-ca31-4acd-aec6-faf1b20d354d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:23.180138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:23.202051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.211555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.212587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.218350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.220698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.230830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.289361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] HTTP exception thrown: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Request method failure captured: Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d HTTP/1.1 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Qt-OzM-PPtxFXOuwMy3tAzJ2PClT2HJQmni8uJZLQarSgKy6Lwx8nDcADd302BxZWqJ_YzqfNfeAAXAseV1wOtS9K_UUVYXQHF34PwXdNY3Dz_J31YV0XQgYQ7gAf7ifWx8BvSDY-V68O40VTuuVX8AIiMUhwW9eCLinFNRxQnjt8 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 98f84787ee0143699be35cfc2c50499b Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesActionsTest-904602635 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98f84787ee0143699be35cfc2c50499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98f84787ee0143699be35cfc2c50499b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98f84787ee0143699be35cfc2c50499b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98f84787ee0143699be35cfc2c50499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesActionsTest-904602635 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 98f84787ee0143699be35cfc2c50499b Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesActionsTest-904602635 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesActionsTest-904602635-project Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8037e6501a7945baa71b03566646a071 Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesActionsTest-904602635-project Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '27175421-ca31-4acd-aec6-faf1b20d354d'} Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:23.298567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. Oct 13 09:03:23.306390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:23.323426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] Returning 404 to user: Instance 27175421-ca31-4acd-aec6-faf1b20d354d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:03:23.324595 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-57f5c737-1dd4-4cd2-b85e-d3b8c636623e tempest-VolumesActionsTest-904602635 tempest-VolumesActionsTest-904602635-project] 10.222.0.23 "GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d" status: 404 len: 111 microversion: 2.1 time: 0.157783 Oct 13 09:03:23.325244 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2789/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:23 2022] GET /compute/v2.1/servers/27175421-ca31-4acd-aec6-faf1b20d354d => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:03:23.516065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700df525-2400-4eff-a6cc-8fb31a69ed22", "name": "network-vif-plugged", "status": "completed", "tag": "62010c9f-ac3b-44eb-983e-51a86704823d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:23.565608 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9682c777-2204-487c-98d1-416fa2a03d37 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 204 len: 0 microversion: 2.1 time: 0.511488 Oct 13 09:03:23.567078 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3184/5973] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:23 2022] DELETE /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:03:23.569738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.570530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.573406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8281c503-26d4-42fc-89a2-417e5084de79", "tag": "1b4c3bf8-2e12-44cb-8769-0a2b621c18fa"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:23.574112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.586728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.587601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.588185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.611245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] Creating event network-changed:1b4c3bf8-2e12-44cb-8769-0a2b621c18fa for instance 8281c503-26d4-42fc-89a2-417e5084de79 on n-h1-858384-11 Oct 13 09:03:23.612589 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] Creating event network-vif-plugged:62010c9f-ac3b-44eb-983e-51a86704823d for instance 700df525-2400-4eff-a6cc-8fb31a69ed22 on n-h2-858384-11 Oct 13 09:03:23.622164 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-782381b2-19d8-448f-93d1-9f1bb034f09e req-e24bbb0d-846f-4b2b-95b7-49d9dca3b091 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051797 Oct 13 09:03:23.628066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3185/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:23.642178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-02e559e6-953e-4b7d-97a6-08b8a1fa384f req-9cf916a3-5666-406b-b4d2-f370c8b6864a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131178 Oct 13 09:03:23.644748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2790/5975] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:23.656110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:23.657469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:23.697537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.700366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.702421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.715433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:23.716621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:23.723204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.727722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.728857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.740249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.741110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.742307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:23.743771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:23.746676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:23.749425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:24.059388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:24.076954 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d4c1d885-799d-4ead-8463-9b20fce9b85b tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1672 microversion: 2.1 time: 0.447078 Oct 13 09:03:24.077553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3186/5976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:23 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1672 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:24.083519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:24.085578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:24.102657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:24.103153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:24.103590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:24.104298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:24.104750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:24.105175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:24.108146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:24.280124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:24.288865 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1a2741a-d8b4-45b2-9d6e-2715bd7b13dd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 200 len: 1507 microversion: 2.1 time: 0.584160 Oct 13 09:03:24.300446 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2791/5977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:23 2022] GET /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 1507 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:24.317116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:24.317868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:24.325584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:24.326144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:24.326554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:24.327300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:24.327760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:24.329805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:24.451300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:24.463280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d83995e7-a176-4795-8240-349b5f2af774 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.383346 Oct 13 09:03:24.470213 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3187/5978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:24 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:24.625537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:24.638077 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa6bee3f-a6d9-4a49-ac76-f7fdd99e7819 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22" status: 200 len: 1320 microversion: 2.1 time: 0.324987 Oct 13 09:03:24.640686 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2792/5979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:24 2022] GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:25.105538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:25.107069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:25.125331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.129415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.130364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.134582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.135381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.136531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.491337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:25.492296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:25.502476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=82 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:25.530919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.531441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.538799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.539729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.540233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.540683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.715584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:25.744044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb0890d9-7b73-4b13-9ced-7177aa82d509 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1672 microversion: 2.1 time: 0.643056 Oct 13 09:03:25.747933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3188/5980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:25 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1672 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:25.760055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:25.765732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:25.779375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.781844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.782491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.783393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:25.789010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:25.789693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:25.949256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:25.966267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0a6712c-8fba-43da-bdf1-343f46ec77a9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.476350 Oct 13 09:03:25.968970 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2793/5981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:25 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:26.162857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:26.188511 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c55ea42-aca8-4748-9a9a-d3ffe0626285 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22" status: 200 len: 1320 microversion: 2.1 time: 0.435704 Oct 13 09:03:26.189565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3189/5982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:25 2022] GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:26.409953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8281c503-26d4-42fc-89a2-417e5084de79", "name": "network-vif-deleted", "tag": "1b4c3bf8-2e12-44cb-8769-0a2b621c18fa"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:26.429741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:26.431006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:26.431762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:26.447941 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] Creating event network-vif-deleted:1b4c3bf8-2e12-44cb-8769-0a2b621c18fa for instance 8281c503-26d4-42fc-89a2-417e5084de79 on n-h1-858384-11 Oct 13 09:03:26.456221 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-68a5dbc5-2674-42e2-a572-1a589aa9399d req-4f973215-a015-4640-a369-14db6afcdd64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056086 Oct 13 09:03:26.457481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2794/5983] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:26.772960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:26.773776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:26.813657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:26.814551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:26.815187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:26.816095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:26.828002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:26.838553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:26.943757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:26.944590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:26.945598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:26.946623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lazy-loading 'fault' on Instance uuid 8281c503-26d4-42fc-89a2-417e5084de79 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:26.997504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:26.998392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:27.032032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.043858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.044721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.047614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.048797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.051626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.061752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:27.105337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b34c3367-5e19-41db-8196-c3461cd2851d tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 200 len: 1338 microversion: 2.1 time: 0.337919 Oct 13 09:03:27.128627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3190/5984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:26 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:27.203669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:27.212601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:27.234500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.235303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.236640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.238317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.238949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.244269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.472862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:27.481139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'services' on Instance uuid eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:27.490024 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a1dc2fe-1c19-4c41-b6fe-d9aa3048aff2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.497818 Oct 13 09:03:27.502588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2795/5985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:26 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:27.514413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:27.520205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:27.546897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.547858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.552856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.553919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.554659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.555777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.634556 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e9ec6c3-3152-4a0f-a1a4-5b008e4dc52e tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments/c115bba7-4592-426f-bb59-c6278f4e9111" status: 202 len: 0 microversion: 2.1 time: 0.434893 Oct 13 09:03:27.635749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3191/5986] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:03:27 2022] DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments/c115bba7-4592-426f-bb59-c6278f4e9111 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:03:27.678251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:27.686990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:27.717517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.720740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.723154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.725610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.728850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.729885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.826843 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e0271c45-a090-4f67-9937-0457c029dc0c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175717 Oct 13 09:03:27.831316 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3192/5987] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:27 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:27.867467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:27.882130 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51f5de8a-a8da-4a2e-bdc3-00740872bd88 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22" status: 200 len: 1508 microversion: 2.1 time: 0.376614 Oct 13 09:03:27.884711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2796/5988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:27 2022] GET /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:27.906375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:27.909256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:27.921758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.923665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.924351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.925367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:27.926069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:27.926773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:27.959683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 700df525-2400-4eff-a6cc-8fb31a69ed22] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:28.140191 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad335440-ac77-4a25-9cc7-1f551872bd3d tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22" status: 204 len: 0 microversion: 2.1 time: 0.237146 Oct 13 09:03:28.144676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3193/5989] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:27 2022] DELETE /compute/v2.1/servers/700df525-2400-4eff-a6cc-8fb31a69ed22 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:28.151044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:28.151591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:28.156157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:28.157936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: 8281c503-26d4-42fc-89a2-417e5084de79] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:28.165590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.165794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.166301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.166444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.166772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.167321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.167537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.168503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.169140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.169712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.183289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.183846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.209372 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] HTTP exception thrown: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Request method failure captured: Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 HTTP/1.1 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9O0bUNKsKefHACVGhJD80fKNfpPzZFBxneceacQEOtqjDEEzC34ZEv3_Qh5KiPpMN3btQcwZqPdVmRD2uFekWjiwq8-HXnRnAmZCgtdTGbUNkNC0lYUGtQWW0JRGgpzpeleRvWKE49uF3QR0wQ-T7mMEqZOAUi5qv0Pi7X6trzZe74 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: d21e2f3b05c244c49a19dcbb7bb2fa5e Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8281c503-26d4-42fc-89a2-417e5084de79'} Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:28.211823 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. Oct 13 09:03:28.216578 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:03:28.218326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Returning 404 to user: Instance 8281c503-26d4-42fc-89a2-417e5084de79 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:03:28.219380 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a86df32a-6c11-4dfc-bc07-65484f2e695c tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79" status: 404 len: 111 microversion: 2.1 time: 0.068684 Oct 13 09:03:28.220130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3194/5990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:28 2022] GET /compute/v2.1/servers/8281c503-26d4-42fc-89a2-417e5084de79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:03:28.238616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 032061a5-8dec-4673-811b-943deb1cfb1d] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:28.478365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d293d5e-06e6-4c32-a197-986e60b8cbea tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d" status: 204 len: 0 microversion: 2.1 time: 0.331789 Oct 13 09:03:28.479620 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2797/5991] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:28 2022] DELETE /compute/v2.1/servers/032061a5-8dec-4673-811b-943deb1cfb1d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:28.527602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:28.528415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:28.531898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:28.558775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.559814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.560418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.561270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.561997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.566908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.636199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbe84487-ef61-4097-88f8-63be7c401e75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '.version_select at 0x7f5376094d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:28.697697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbe84487-ef61-4097-88f8-63be7c401e75 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1600260311" status: 202 len: 0 microversion: 2.1 time: 0.065657 Oct 13 09:03:28.702874 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2798/5992] 10.222.0.23 () {58 vars in 1257 bytes} [Thu Oct 13 09:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1600260311 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:03:28.717998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1725114643", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "782972c2-1f59-4984-8351-ea676ae1c177"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:28.819092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] validate_networks() for [('782972c2-1f59-4984-8351-ea676ae1c177', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:03:28.941486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:28.953981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe81121a-5ace-421b-8109-9c0dc4a2a4e8 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.430878 Oct 13 09:03:28.954856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3195/5993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:28 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:28.975251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:28.977637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:28.987285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.987995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.988589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:28.989990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:28.990672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:28.991397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:29.056555 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8cbac7b-c257-4916-81f1-773c22c51e83 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100592 Oct 13 09:03:29.057470 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3196/5994] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:28 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:29.987821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:29.989183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:30.011800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.012494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.013106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.014140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.014795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.015381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.362508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:30.372214 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-319a2bd4-71dd-452a-bc37-1d0690d7ed78 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.390957 Oct 13 09:03:30.389675 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3197/5995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:29 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:30.395039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:30.398080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:30.405407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.406280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.406987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.407984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.408668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.409325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.465651 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3543fa2d-fd23-445f-b44b-20793ce62730 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074133 Oct 13 09:03:30.466602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3198/5996] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:30 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:30.499995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:03:30.499995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:03:30.500454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:03:30.500708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:03:30.501304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:03:30.519853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.520353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.521347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.522070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.522757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.523952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.565970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Getting quotas for project 702f207bfe5f4fb0980d099f4801a205. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:03:30.590559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Getting quotas for user 55da4b6f7be74a9db95fe7e52442972e and project 702f207bfe5f4fb0980d099f4801a205. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:03:30.635157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Going to run 2 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:03:30.637588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:03:30.725940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=c67958b8-d5d0-4924-afea-8284b5fb35a3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:03:30.871801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bd3fb24-df10-4ac9-825a-9f8a4c94f0fd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.158725 Oct 13 09:03:30.877117 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2799/5997] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:03:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 2165 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 13 09:03:30.881174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:30.886761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:30.891251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Searching by: {'deleted': False, 'project_id': '702f207bfe5f4fb0980d099f4801a205'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 09:03:30.941976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.949529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.950146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:30.951941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:30.953697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:30.955073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:31.037815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 09:03:31.130209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f8e7642-f386-4d26-9a1e-53cad105d38f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.253511 Oct 13 09:03:31.143440 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3199/5998] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 09:03:30 2022] GET /compute/v2.1/servers => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:31.159293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bb85cbb2-6127-464d-86d7-3e89b7b2c9e2 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:31.161483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bb85cbb2-6127-464d-86d7-3e89b7b2c9e2 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:31.398614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:31.399436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:31.416726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:31.417286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:31.419800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:31.420578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:31.421062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:31.421512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:31.531486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bb85cbb2-6127-464d-86d7-3e89b7b2c9e2 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:31.543536 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bb85cbb2-6127-464d-86d7-3e89b7b2c9e2 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1218 microversion: 2.1 time: 0.389973 Oct 13 09:03:31.544274 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2800/5999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:31 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1218 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:31.576281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:31.587821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:31.610992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:31.612891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:31.614956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:31.616010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:31.619047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:31.619725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:31.742203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40f7be2e-8cff-41c5-a073-d4db253aef2a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178091 Oct 13 09:03:31.746278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2801/6000] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:31 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:31.822991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:31.834281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-758f107d-dddc-411e-bd77-abb90463f0e9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.438278 Oct 13 09:03:31.835025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3200/6001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:31 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:32.567221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73e909b6-6fc1-4079-9906-063318e22099 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:32.568656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73e909b6-6fc1-4079-9906-063318e22099 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:32.756981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:32.760401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:32.791115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:32.799822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:32.800866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:32.806479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:32.807490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:32.813584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:32.881611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:32.949996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-015c32b7-23bd-43ae-8b87-08ee96516025 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197126 Oct 13 09:03:32.952555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3201/6002] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:32 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:03:32.976247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:32.977317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:32.996149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:32.997037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:32.999599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:33.000827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:33.002665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:33.003483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:33.218222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73e909b6-6fc1-4079-9906-063318e22099 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:33.237528 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73e909b6-6fc1-4079-9906-063318e22099 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1218 microversion: 2.1 time: 0.665757 Oct 13 09:03:33.238222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2802/6003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:32 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1218 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:33.384256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:33.399002 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44783143-5bae-4eef-9a59-0fde4c8b09a6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 0.438977 Oct 13 09:03:33.401362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3202/6004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:32 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:33.965007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:33.968088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:33.990560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:33.991121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:33.991575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:33.992311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:33.992772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:33.993205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:34.094044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f216295d-c3f8-4c99-ade6-be4ef43ebe18 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133587 Oct 13 09:03:34.099138 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2803/6005] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:33 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:34.265612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:34.266283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:34.293614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:34.298231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:34.303372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:34.309065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:34.310776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:34.315244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:34.429066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:34.430293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:34.443114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:34.444525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:34.447421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:34.448404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:34.450130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:34.451870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:34.641318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:34.654960 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4bffc8d-69b5-4e22-8978-363f8950b266 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1278 microversion: 2.1 time: 0.391503 Oct 13 09:03:34.661562 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3203/6006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:34 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1278 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:35.107541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:35.111053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:35.137556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.138689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.139179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:35.141444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.141924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.142363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:35.286165 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e1a9ea6-d690-4539-af04-e4e4d05b698d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184086 Oct 13 09:03:35.293030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3204/6007] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:35 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:35.303959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032061a5-8dec-4673-811b-943deb1cfb1d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3b89943-520a-4776-a67e-acb5a7ed20b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:35.331061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.332074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.335555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:35.415676 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] Creating event network-vif-unplugged:a3b89943-520a-4776-a67e-acb5a7ed20b1 for instance 032061a5-8dec-4673-811b-943deb1cfb1d on n-h1-858384-11 Oct 13 09:03:35.437863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0f6b6041-0f49-4dd0-a529-46e03f067b8c req-47b43772-7ee9-4cc9-b0f6-a84450929936 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141271 Oct 13 09:03:35.439875 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3205/6008] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:35.482904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700df525-2400-4eff-a6cc-8fb31a69ed22", "name": "network-vif-deleted", "tag": "62010c9f-ac3b-44eb-983e-51a86704823d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:35.494623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.495387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.496251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:35.512982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] Creating event network-vif-deleted:62010c9f-ac3b-44eb-983e-51a86704823d for instance 700df525-2400-4eff-a6cc-8fb31a69ed22 on n-h2-858384-11 Oct 13 09:03:35.536035 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4f93876a-f0ae-4058-bae1-18f8a53e009f req-b4b04558-2f7e-479d-b3fd-9beb568428b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047220 Oct 13 09:03:35.540396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3206/6009] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:35.691361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:35.692073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:35.708897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.709888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.710331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:35.711097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:35.712796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:35.713230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:36.228433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:36.284643 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f04209e0-4464-4c57-8a22-6839e150796d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 1.834289 Oct 13 09:03:36.285501 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2804/6010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:34 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:36.311866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:36.318819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:36.367093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:36.370378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:36.370378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:36.370378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:36.370378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:36.385743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:36.541214 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b635102-68de-4527-a306-14cc320488e1 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235322 Oct 13 09:03:36.568679 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2805/6011] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:36 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:36.711731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:36.721513 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bef431a-448d-459d-8659-badd9b325e79 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 1.036067 Oct 13 09:03:36.746286 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3207/6012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:35 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:37.313413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:37.319642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:37.336790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.337325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.337781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:37.338602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.339160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.339598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:37.360445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:37.561123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:37.563438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:37.587214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.589999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.593347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:37.599182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.600121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.600724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:37.719269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8ef55809-887f-4cda-98e1-f184ec603dfa tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169812 Oct 13 09:03:37.721699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3208/6013] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:37 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:37.749283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:37.750275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:37.767677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.768726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.771488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:37.772431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:37.773120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:37.774749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:38.281024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:38.291249 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61078aaa-26e7-4387-974b-7a78fc079083 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.545767 Oct 13 09:03:38.301991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3209/6014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:37 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:38.327482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032061a5-8dec-4673-811b-943deb1cfb1d", "name": "network-vif-deleted", "tag": "a3b89943-520a-4776-a67e-acb5a7ed20b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:38.374437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:38.374437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:38.374437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:38.396690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:38.410337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cdf8daf5-8e1b-479d-b96c-8053a17ae296 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1505 microversion: 2.1 time: 1.100826 Oct 13 09:03:38.419299 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2806/6015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:37 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1505 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:38.429454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] Creating event network-vif-deleted:a3b89943-520a-4776-a67e-acb5a7ed20b1 for instance 032061a5-8dec-4673-811b-943deb1cfb1d on n-h1-858384-11 Oct 13 09:03:38.458591 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ac7215fc-4d78-4f06-909c-5f7535a6c36f req-c0e9f4dc-0ca2-4c45-b9f6-9769c1815f85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142124 Oct 13 09:03:38.462530 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3210/6016] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:38.611508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faae4070-66bc-4d7c-9f09-6d42a21d46fa", "name": "network-vif-unplugged", "status": "completed", "tag": "16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:38.681045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:38.681558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:38.682014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:38.720776 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] Creating event network-vif-unplugged:16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3 for instance faae4070-66bc-4d7c-9f09-6d42a21d46fa on n-h2-858384-11 Oct 13 09:03:38.746216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:38.751069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:38.754866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4a2f8ca2-e7d3-49f7-b468-4d47500eddde req-d5c4ab08-759a-43b2-8b0c-79cc33e48722 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126510 Oct 13 09:03:38.756792 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2807/6017] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:38.773207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:38.775942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:38.779154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:38.781149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:38.782092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:38.785967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:38.875789 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-095bb0c6-5893-4867-964e-11548f468b1d tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145473 Oct 13 09:03:38.881081 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3211/6018] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:38 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:03:39.141102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0c4aba-3545-4c17-8f7b-a0ed5be522a8", "tag": "777fa145-8e35-4a78-8198-47f03516db5f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:39.190372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:39.191926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:39.207234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:39.239249 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] Creating event network-changed:777fa145-8e35-4a78-8198-47f03516db5f for instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 on n-h1-858384-11 Oct 13 09:03:39.246803 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4ee4f150-ede6-4ef5-94ea-9b493fba446b req-a2c6eebd-841f-4859-8f03-c1a5f710010c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113253 Oct 13 09:03:39.247702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2808/6019] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:39.331458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:39.333310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:39.362875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:39.363783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:39.367004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:39.367961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:39.368595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:39.369615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:39.435066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:39.435905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:39.461368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:39.464656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:39.468858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:39.472753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:39.473234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:39.474866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:40.234823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:40.253495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5dc5e474-cafe-4b4a-9ec1-462fa17ceef1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1505 microversion: 2.1 time: 0.820947 Oct 13 09:03:40.254112 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2809/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:39 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1505 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:40.264279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:40.272875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:40.287563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:40.290062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:40.290751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:40.291889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:40.293267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:40.296354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:40.373626 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4d57bcaf-386a-41f8-b4a0-a12cb91b67fe tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115984 Oct 13 09:03:40.383514 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2810/6021] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:40 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:40.808662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:40.823248 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4df4c069-2e6b-4ba9-b3cb-f346a0e40fcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 1.495726 Oct 13 09:03:40.826034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3212/6022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:39 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:41.287089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:41.292749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:41.310230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:41.313176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.314560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.318545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.319533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.320477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.321265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.393092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:41.396177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:41.435998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:41.453693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.454272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.457855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.460302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.465492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.466020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.584564 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0338d1ef-0457-4f22-8ede-74725d23e54f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.197652 Oct 13 09:03:41.596973 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3213/6023] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:03:41 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13/os-volume_attachments => generated 25 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:03:41.785960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:41.786504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:41.805546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.806060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.806539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.807265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:41.807725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:41.808158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:41.888159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:42.044250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7003028-2a56-44d6-b212-8ced29db55bd tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 204 len: 0 microversion: 2.1 time: 0.262137 Oct 13 09:03:42.045147 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3214/6024] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:41 2022] DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:42.063366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:42.064108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:42.070479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:42.070967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:42.074231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:42.075285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:42.075936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:42.076544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:42.426044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:42.442281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9161fb6-5750-4147-937d-baa3b1c04f62 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.395347 Oct 13 09:03:42.460081 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3215/6025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:42 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:42.482439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:42.483446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:42.515670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:42.517699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:42.518350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:42.519881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:42.521781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:42.522879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:42.911362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:42.919792 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9781c6db-c11b-4f4e-aa2e-3560e6505829 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1680 microversion: 2.1 time: 0.456691 Oct 13 09:03:42.923519 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3216/6026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:42 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1680 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:43.119819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:43.132602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-76749bda-e670-43d2-82d7-507a68e7b0fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 200 len: 1508 microversion: 2.1 time: 1.854673 Oct 13 09:03:43.133753 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2811/6027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:41 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 1508 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:43.158230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:43.159083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:43.169855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.183138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.183825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.184717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.185325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.185905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.476953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:43.478236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:43.495762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:43.500049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.502054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.502772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.503697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.514251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.514737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.680078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:43.688760 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c29d9f8-5bd2-4315-8f37-a5054eb6acc9 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.534619 Oct 13 09:03:43.691492 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3217/6028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:43 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:43.728525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:43.729068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:43.753118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.753638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.754089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.754867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.755329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.755754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.789291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:43.877482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:43.914947 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ac5c445-72aa-4684-bb90-255d1ddafdff tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.450149 Oct 13 09:03:43.915822 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2812/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:43 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:43.928323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c67958b8-d5d0-4924-afea-8284b5fb35a3", "tag": "e481e957-6e01-488e-89b8-b020caaedcd0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:43.950202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:43.951187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:43.951963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:43.967680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] Creating event network-changed:e481e957-6e01-488e-89b8-b020caaedcd0 for instance c67958b8-d5d0-4924-afea-8284b5fb35a3 on n-h2-858384-11 Oct 13 09:03:43.973690 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-db26d46f-5837-4bed-94f5-760e27bb9572 req-55d4b1a4-a2b2-4bc3-9a86-5a94d74452da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056401 Oct 13 09:03:43.974581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2813/6030] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:43.999727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:44.000682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:44.006590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:44.015834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.016566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.017179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.018080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.018721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.022436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0489a4b-cca9-43c9-aed8-af2e43c9878d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.302395 Oct 13 09:03:44.022621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.056156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3218/6031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:43 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:44.076937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:44.077836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:44.086017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.086806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.087415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.088437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.089254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.089854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.312160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:44.323947 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-713341f0-6e07-41d0-9e39-a51bc2962221 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.250777 Oct 13 09:03:44.335330 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3219/6032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:44.347822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:44.348992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:44.355645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.356138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.356576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.357277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.357730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.358155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.636801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:44.658498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-916feec7-6cda-4096-9505-e6a0995fedbe tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.303984 Oct 13 09:03:44.674555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3220/6033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:44.684393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:44.691681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.692961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.693585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.744059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 09:03:44.828485 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-088e2081-e07e-40c5-811f-ecc4f628ebe7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.148057 Oct 13 09:03:44.835696 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3221/6034] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:03:44 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:03:44.857970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:44.859707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:44.874813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.876667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.877177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:44.880862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:44.881395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:44.881936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:45.209687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:45.227427 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a4da438e-24d2-4f19-8879-b6b23673f68b tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1680 microversion: 2.1 time: 1.239986 Oct 13 09:03:45.234986 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2814/6035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:43 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1680 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:45.274426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:45.283604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:45.293426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:45.300326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:45.300838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:45.301284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:45.302553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:45.303016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:45.303451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:45.304550 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6e29836-68e0-42c1-91e4-a9551516a4d4 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.462344 Oct 13 09:03:45.310486 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3222/6036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:44 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:46.023882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:46.049054 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-334ecab4-22bd-4085-91cf-ac3ce7a499b1 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.812472 Oct 13 09:03:46.062969 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2815/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:45 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:46.265043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:46.265659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:46.289446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.290988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.291624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.295625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.296753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.298253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.337044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:46.339150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:46.348483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.351227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.351956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.352942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.353596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.354266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.403908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:46.420464 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afc71ac5-a38d-48dc-80f2-3d1c44247b9c tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1613 microversion: 2.1 time: 0.158388 Oct 13 09:03:46.424619 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3223/6038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:46 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:46.822292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:46.823070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:46.833252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.836515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.837131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.838057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:46.839232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:46.840847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:46.890535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e833bca3-fdc7-4b6b-bf70-05928329e4d5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/ips" status: 200 len: 152 microversion: 2.20 time: 0.071975 Oct 13 09:03:46.901166 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3224/6039] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 13 09:03:46 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/ips => generated 152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 09:03:46.956537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:46.973919 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-179ae3c6-bf69-444d-b84c-05e8b452c087 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.642149 Oct 13 09:03:46.975179 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2816/6040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:46 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:47.073712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab4f3a1-bf5c-4be0-bab7-99e35ae26e13", "name": "network-vif-deleted", "tag": "9c60f1ef-116d-4433-ab6f-a46531b8777c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:47.077280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:47.078013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:47.088554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.093404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.093561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.094078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.094286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.094556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.095245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.095839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.096533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.127238 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] Creating event network-vif-deleted:9c60f1ef-116d-4433-ab6f-a46531b8777c for instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 on n-h2-858384-11 Oct 13 09:03:47.155291 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5952f0bb-d2f9-4929-9321-7841927c5a47 req-870c54f8-ac3e-40d7-a65e-f7fe3aa8fe21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082767 Oct 13 09:03:47.157939 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3225/6041] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:47.319582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c4aba-3545-4c17-8f7b-a0ed5be522a8", "name": "network-vif-plugged", "status": "completed", "tag": "777fa145-8e35-4a78-8198-47f03516db5f"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:47.351645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.352444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.352891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.390661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] Creating event network-vif-plugged:777fa145-8e35-4a78-8198-47f03516db5f for instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 on n-h1-858384-11 Oct 13 09:03:47.408891 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0fde9529-1f31-47be-b15c-f9287dc83a01 req-f390f65d-9b8f-4bcb-8eff-10d6f9ae4e9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094022 Oct 13 09:03:47.427392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3226/6042] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:03:47.454193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:47.454941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:47.476467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.481643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.482136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.484099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:47.487341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:47.487803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:47.519642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:47.534222 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a15564ed-ede5-4ba3-943f-e9387c85de10 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.459081 Oct 13 09:03:47.563357 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2817/6043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:47 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:47.682020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:47.696633 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ecbc508f-d68c-4e4e-8b18-aad881247ee3 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1613 microversion: 2.1 time: 0.248571 Oct 13 09:03:47.718431 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3227/6044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:47 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1613 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:48.004105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:48.005421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:48.020951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.021456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.021906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:48.022664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.023130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.023562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:48.563208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:48.563825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:48.577445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.577949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.584874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:48.585723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.586205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.586663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:48.906790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:48.919958 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ebcb2d4-c4a9-4c09-b32d-f7a089493dcf tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1318 microversion: 2.1 time: 0.360536 Oct 13 09:03:48.921225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3228/6045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:48 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:48.931537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:48.938868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:48.955934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.957278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.957940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:48.958847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:48.959456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:48.960228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:49.034314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:49.036663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:49.038466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:49.039115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lazy-loading 'fault' on Instance uuid eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:49.158221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5e262ee0214fe09fc0e5f6cc4d4db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64823e22cdad4cc0b008987d235a7794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:49.187131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-122c1c6c-7a1c-4fe3-b8c3-cdaf885d3953 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 200 len: 1331 microversion: 2.1 time: 0.264637 Oct 13 09:03:49.192454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3229/6046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:48 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 1331 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:49.792438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:49.804469 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6b3f623-e13c-4ee0-94ce-23f12ce4dde5 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 1.802093 Oct 13 09:03:49.805236 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2818/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:47 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:49.949564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:49.950994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:49.964488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:49.967245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:49.967923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:49.969874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:49.970384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:49.973692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.222137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:50.222948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:50.249509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.250468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.251200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.252288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.252913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.253446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.313841 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 HTTP/1.1 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'eab4f3a1-bf5c-4be0-bab7-99e35ae26e13'} Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:03:50.315606 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:03:50.321796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:03:50.330888 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-50dbbd62-ec3e-49bb-ad15-7ce995a4a419 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 404 len: 111 microversion: 2.1 time: 0.101435 Oct 13 09:03:50.338639 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2819/6048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:50 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:03:50.353341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f5a1c975-e0fa-4704-890a-9313c80f7a51 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '.version_select at 0x7f5375fb2d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:50.414640 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f5a1c975-e0fa-4704-890a-9313c80f7a51 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785084350" status: 202 len: 0 microversion: 2.1 time: 0.066433 Oct 13 09:03:50.418935 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2820/6049] 10.222.0.23 () {58 vars in 1221 bytes} [Thu Oct 13 09:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785084350 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:03:50.424227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:50.424777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:50.462601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.463131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.463607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.464357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.464837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.465764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.487122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:50.506304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ccb61593-634e-4a12-99cf-a7f85249c77a tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 200 len: 1506 microversion: 2.1 time: 0.557240 Oct 13 09:03:50.507662 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3230/6050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:49 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:50.535378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:50.536148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:50.552577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.562859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.564173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:50.564305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lazy-loading 'flavor' on Instance uuid 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:03:50.565439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:50.566121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:50.569507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:51.046355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:51.064396 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c701a19b-bfbd-4fba-b0fd-0cd8d84a3504 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1318 microversion: 2.1 time: 0.533582 Oct 13 09:03:51.067422 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3231/6051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:50 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:03:51.075151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:51.079402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:51.096679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:51.097624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:51.099745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:51.102586 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1faeea72-89df-4a8d-b178-05459c76430a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/action" status: 202 len: 0 microversion: 2.20 time: 0.682170 Oct 13 09:03:51.103692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:51.104354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:51.104986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:51.107239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2821/6052] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 09:03:50 2022] POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:51.119870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:51.121339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:51.156541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:51.157816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:51.161996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:51.163077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:51.164359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:51.164983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:51.345216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:51.356894 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3987ebe-4b57-4b58-aa70-ad7fe2eafc69 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.288120 Oct 13 09:03:51.358270 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3232/6053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:51.800613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:51.820851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:51.823055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:51.832286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e78c808d-a1f5-4df6-82a0-8bd9403118a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.723440 Oct 13 09:03:51.846935 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2822/6054] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:51 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:52.090195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:52.091579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:52.104832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.106663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.107185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.109134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.109761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.110816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.323981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c67958b8-d5d0-4924-afea-8284b5fb35a3", "name": "network-vif-plugged", "status": "completed", "tag": "e481e957-6e01-488e-89b8-b020caaedcd0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:52.345706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.346650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.349194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.360597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:52.368196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] Creating event network-vif-plugged:e481e957-6e01-488e-89b8-b020caaedcd0 for instance c67958b8-d5d0-4924-afea-8284b5fb35a3 on n-h2-858384-11 Oct 13 09:03:52.371485 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8db5ea44-50ac-42b7-a9e7-723562c13d3f tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1318 microversion: 2.1 time: 0.285989 Oct 13 09:03:52.378873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3233/6055] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:52 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:52.383477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1dbb5616-ca23-4c12-832a-930fe7f7e251 req-2127eb5b-9f1d-411c-bf85-79379a2397f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061937 Oct 13 09:03:52.386828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:52.387636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:52.388657 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2823/6056] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:03:52.405439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.406132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.406620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.407344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.424699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.425484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.713231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:52.746630 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64b25133-e415-423a-be8e-7bc0a0eeea58 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.365112 Oct 13 09:03:52.759397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3234/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:52 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:52.865599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:52.866874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:52.886927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.887490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.899486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:52.900268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:52.901448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:52.906741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:53.305046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:53.321583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:53.323453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:53.324939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5235e2e-72f0-43f8-b275-bafd32080351 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.467554 Oct 13 09:03:53.338715 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2824/6058] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:52 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:53.395621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:53.407494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:53.422051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:53.426560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:53.427286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:53.428355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:53.428974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:53.429573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:53.468625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:53.776672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:53.777458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:53.782172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:53.788149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:53.790266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:53.791084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:53.794832 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9377cfc-9372-4d8c-8bbe-2809d981b163 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1318 microversion: 2.1 time: 0.399097 Oct 13 09:03:53.795935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:53.796531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:53.797015 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3235/6059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:53 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:53.797669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:53.844764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:54.194129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:54.213852 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66c15c82-4a1d-4198-ae87-527c3e6e5733 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.433995 Oct 13 09:03:54.215603 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2825/6060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:53 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:54.352396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:54.353342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:54.375036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:54.377706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:54.381577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:54.384010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:54.387036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:54.388940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:54.690689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:54.708713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:54.713714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:54.717123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f16df03a-caf4-4d37-a0d2-88d25a8eee26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.369022 Oct 13 09:03:54.735903 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3236/6061] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:54 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:54.828082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:54.830257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:54.858188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:54.863180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:54.864592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:54.865725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:54.866357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:54.869483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.242166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:55.242874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:55.259793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.261488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.261945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.268291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.270953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.271415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.354046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:55.367964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e1ca24e-c2fd-4f16-af73-e705975eaa59 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1505 microversion: 2.1 time: 0.547277 Oct 13 09:03:55.368761 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2826/6062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:54 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:55.407505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:55.411644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:55.414016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:55.439410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.439963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.440410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.441148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.441601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.442594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.523976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:55.745800 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a20cb876-0b2c-42af-9732-acf8c5f43a5c tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 204 len: 0 microversion: 2.1 time: 0.344987 Oct 13 09:03:55.746362 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2827/6063] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:55 2022] DELETE /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:55.778099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:55.779783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:55.785112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:55.789083 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c46ac88a-9660-4bd4-9747-af039ee00013 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.551337 Oct 13 09:03:55.791145 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3237/6064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:55 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:55.798274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:55.802789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:55.818089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.818615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.819613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.822290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.822961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.823186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.823822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.828016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.828252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.828975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:55.835927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:55.837225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:55.921171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:03:56.117425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef2e5d64-1be0-4cd7-b1cf-c514960d3146 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 204 len: 0 microversion: 2.1 time: 0.351142 Oct 13 09:03:56.122008 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2828/6065] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:03:55 2022] DELETE /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:03:56.137747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:56.139313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:56.154925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:56.158313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:56.159985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:56.163311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:56.164100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:56.167099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:56.264177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:56.276980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:56.284447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:56.288436 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b901b665-4be3-4dbe-aa5c-b68db514f599 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.495842 Oct 13 09:03:56.310321 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3238/6066] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:55 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:56.721137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:56.730967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa698c02-9dcf-4d76-82b1-557c5817d262 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1511 microversion: 2.1 time: 0.606858 Oct 13 09:03:56.747805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2829/6067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:56 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1511 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:56.850160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:56.852236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:56.885580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:56.887728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:56.888348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:56.889577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:56.890240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:56.890914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:57.128226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:57.142292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e50f97bc-0740-4840-9c04-0858dfb37d45 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 0.327773 Oct 13 09:03:57.142919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3239/6068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:56 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:57.317250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:57.318624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:57.348107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:57.348787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:57.349578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:57.350887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:57.351608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:57.352200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:57.753447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:57.754700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:57.763622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:57.770317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:57.771106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:57.775449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:57.777363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:57.785854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:59.277350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:59.296156 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2c3d430b-7652-43f5-9183-2d54232232de tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1511 microversion: 2.1 time: 1.539422 Oct 13 09:03:59.306869 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3240/6069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:57 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1511 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:03:59.336715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:03:59.337777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:03:59.396119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:03:59.407881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:59.408311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:59.408762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:59.409494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:59.409956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:59.424949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:59.850230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:59.863104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:59.872831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:03:59.881168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8ecf2b1-226b-4955-a62e-63d84f88b1f1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 2.566474 Oct 13 09:03:59.883719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2830/6070] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:03:57 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:03:59.894017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c4aba-3545-4c17-8f7b-a0ed5be522a8", "name": "network-vif-deleted", "tag": "777fa145-8e35-4a78-8198-47f03516db5f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:03:59.948397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:03:59.953469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:03:59.954050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:03:59.997629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] Creating event network-vif-deleted:777fa145-8e35-4a78-8198-47f03516db5f for instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 on n-h1-858384-11 Oct 13 09:04:00.015160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8d4f4ab6-17ca-4486-b30e-8cc129f18745 req-dcb4bef3-4204-4ebf-b1b8-a620992bf41b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129755 Oct 13 09:04:00.017923 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2831/6071] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:00.321563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:00.322695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:00.355023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:00.357359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:00.360090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:00.363943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:00.367016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:00.369435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:01.172565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:01.187093 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa96f79a-046d-4c8c-b833-3763ad54ad76 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1678 microversion: 2.1 time: 1.878627 Oct 13 09:04:01.191732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3241/6072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:03:59 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1678 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:01.199098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c67958b8-d5d0-4924-afea-8284b5fb35a3", "name": "network-vif-deleted", "tag": "e481e957-6e01-488e-89b8-b020caaedcd0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:01.224001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:01.224562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:01.226725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:01.253772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] Creating event network-vif-deleted:e481e957-6e01-488e-89b8-b020caaedcd0 for instance c67958b8-d5d0-4924-afea-8284b5fb35a3 on n-h2-858384-11 Oct 13 09:04:01.266786 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-81f66d0c-c799-46a6-9ef0-d0712e416d45 req-327d11e3-96b0-4355-b17a-472ff6a4e281 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072414 Oct 13 09:04:01.268210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3242/6073] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:01.305652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:01.306380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:01.317868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:01.319285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:01.319949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:01.321021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:01.321691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:01.322308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:01.643820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da4b6f7be74a9db95fe7e52442972e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702f207bfe5f4fb0980d099f4801a205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:01.644361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:01.655836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:01.658286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:01.659577 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae9b7770-d308-4b3a-89fd-68501b7d43cd tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 200 len: 1469 microversion: 2.1 time: 1.342738 Oct 13 09:04:01.659740 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf3c608c-c5db-49f0-896e-e7b93b4b78a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.386264 Oct 13 09:04:01.661167 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3243/6074] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:01 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:01.661477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2832/6075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:00 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 1469 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:02.066084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:02.066941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:02.085570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.088154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.088860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.090302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.091776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.092405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.136350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 HTTP/1.1 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'eab4f3a1-bf5c-4be0-bab7-99e35ae26e13'} Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:02.141639 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.145644 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.151157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:02.152290 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f93f27b0-dc78-4f8b-8cb1-ab412ba0af10 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 404 len: 111 microversion: 2.1 time: 0.091244 Oct 13 09:04:02.159695 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3244/6076] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:02 2022] DELETE /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:02.168665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:02.169679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: eab4f3a1-bf5c-4be0-bab7-99e35ae26e13] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:02.184223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.184735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.185176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.202356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.203534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.204004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.213384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:02.214004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:02.226813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.227754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.230028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.233335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.235300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.238039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.262804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 HTTP/1.1 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'eab4f3a1-bf5c-4be0-bab7-99e35ae26e13'} Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.265122 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. Oct 13 09:04:02.270063 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.272437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:02.274073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1dba6425-eb28-4f87-a64b-1c74f1e3aea5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13" status: 404 len: 111 microversion: 2.1 time: 0.109507 Oct 13 09:04:02.275248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2833/6077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:02 2022] GET /compute/v2.1/servers/eab4f3a1-bf5c-4be0-bab7-99e35ae26e13 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:02.684720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:02.686963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: c67958b8-d5d0-4924-afea-8284b5fb35a3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:02.694779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:02.709204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.710913 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b857cc2-7949-4b0f-b5ec-3ab2bb915caa tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1655 microversion: 2.1 time: 0.500918 Oct 13 09:04:02.713463 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3245/6078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:02 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1655 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:02.717965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.718873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.723310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.724327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:02.724957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:02.725280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.728319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.740403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.740903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.741340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.742047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.742523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.746431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.766915 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] HTTP exception thrown: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Request method failure captured: Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 HTTP/1.1 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9RCUip2kVtsq22NgERKUr582rB5WESkkII83jZuuT_8TJ8h3jhHfgmin-j1joqMHlBWcdRE1O4xa4nRn7e6-DNRi0Y-jKfSCUOmvGZoVzJcgYwCElKL_REedaySHIJOkWBoQTRrkbnS6-cAC4lOsHA2RrwBaObYYF5tCqEflWv9xsg Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 702f207bfe5f4fb0980d099f4801a205 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 702f207bfe5f4fb0980d099f4801a205 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateTestJSON-1335580618-project Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 55da4b6f7be74a9db95fe7e52442972e Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateTestJSON-1335580618-project Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c67958b8-d5d0-4924-afea-8284b5fb35a3'} Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:02.771572 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. Oct 13 09:04:02.775612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:02.782012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Returning 404 to user: Instance c67958b8-d5d0-4924-afea-8284b5fb35a3 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:02.785704 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d93e0991-63d4-4980-81f6-b3d29360d6f7 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3" status: 404 len: 111 microversion: 2.1 time: 0.103776 Oct 13 09:04:02.788590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2834/6079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:02 2022] GET /compute/v2.1/servers/c67958b8-d5d0-4924-afea-8284b5fb35a3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:04:02.806224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:02.813728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:02.814635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:02.815511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:02.855167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Going to try to start instance {{(pid=127031) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 09:04:02.985388 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32d9a0e5-de8f-4da4-95e3-2e621b3c4389 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.192820 Oct 13 09:04:02.987710 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2835/6080] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:04:02 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:04:03.007209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:03.010346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] [instance: 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:03.049088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:03.049871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:03.050589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:03.051854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:03.054148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:03.055795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:03.124186 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] HTTP exception thrown: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Request method failure captured: Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 HTTP/1.1 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9RCUip2kVtsq22NgERKUr582rB5WESkkII83jZuuT_8TJ8h3jhHfgmin-j1joqMHlBWcdRE1O4xa4nRn7e6-DNRi0Y-jKfSCUOmvGZoVzJcgYwCElKL_REedaySHIJOkWBoQTRrkbnS6-cAC4lOsHA2RrwBaObYYF5tCqEflWv9xsg Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 702f207bfe5f4fb0980d099f4801a205 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/702f207bfe5f4fb0980d099f4801a205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 702f207bfe5f4fb0980d099f4801a205 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1335580618 Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-MultipleCreateTestJSON-1335580618-project Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 55da4b6f7be74a9db95fe7e52442972e Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-MultipleCreateTestJSON-1335580618-project Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '9e0c4aba-3545-4c17-8f7b-a0ed5be522a8'} Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:03.126048 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] Returning 404 to user: Instance 9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:03.131484 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79bcced5-27c5-4bc4-9ac1-e3549a702a76 tempest-MultipleCreateTestJSON-1335580618 tempest-MultipleCreateTestJSON-1335580618-project] 10.222.0.23 "GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8" status: 404 len: 111 microversion: 2.1 time: 0.140436 Oct 13 09:04:03.146815 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2836/6081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:02 2022] GET /compute/v2.1/servers/9e0c4aba-3545-4c17-8f7b-a0ed5be522a8 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:03.159038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:03.166771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:03.178080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:03.178600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:03.179046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:03.192452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:03.193057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:03.193513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:03.283969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:03.313062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:03.314526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:03.331570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3aa9dae2-05d1-486a-a872-7083cf7d3638 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.616789 Oct 13 09:04:03.342784 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3246/6082] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:02 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:03.492264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e9cb0d6-2967-4362-a512-0a2b193e73df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: .version_select at 0x7f5376868430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-317388973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzeFhAN/XMHZ3cjxO7ufV6V+eoMuKLv+4A87ZMSY8PnXLUjXYtYhhTLf/lXNRajsEkV5MzEI5DUCz05Tm/P0hP36o/V/qrBRXeIeLLeytl1UsS2/fdAx5f3I0LuesrcTg=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:03.532985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3e9cb0d6-2967-4362-a512-0a2b193e73df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:04:03.545989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-3e9cb0d6-2967-4362-a512-0a2b193e73df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:04:03.622888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e9cb0d6-2967-4362-a512-0a2b193e73df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.134399 Oct 13 09:04:03.623760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3247/6083] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:04:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:04:04.164048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:04.181991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3261ff0-1c50-4975-b608-51d68289ac6f tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1664 microversion: 2.1 time: 1.033960 Oct 13 09:04:04.183356 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2837/6084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:03 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1664 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:04.362060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:04.362950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:04.386608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:04.393432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:04.394125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:04.395700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:04.399451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:04.400065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:04.982010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:05.000194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:05.001639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:05.027460 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d0cbc57-f9af-4cbc-8fbf-f3fb07577c03 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.669923 Oct 13 09:04:05.041940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3248/6085] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:04 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:05.208749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:05.209927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:05.233872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:05.234758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:05.239188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:05.240268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:05.240943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:05.241572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:06.060580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:06.061412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:06.062137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:06.076905 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ccc9cec-5013-46a6-a308-a187171b4ab1 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1664 microversion: 2.1 time: 0.872347 Oct 13 09:04:06.078704 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2838/6086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:05 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1664 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:06.085095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:06.094217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:06.095983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:06.097050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:06.098975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:06.099959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:06.533908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:06.545752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:06.562059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:06.586907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35dd4c41-eb3f-4d9f-bd59-29fe60ac98f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.516346 Oct 13 09:04:06.593237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3249/6087] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:06 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:06.949918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1444244223", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "c1228cf0-54b3-4021-81a0-e9e95f23041c"}], "key_name": "tempest-TestNetworkBasicOps-317388973", "security_groups": [{"name": "tempest-secgroup-smoke-295245513"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:07.109993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:07.110670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:07.127139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:07.147952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:07.148487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:07.164661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:07.168122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:07.168947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:07.484974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] validate_networks() for [('c1228cf0-54b3-4021-81a0-e9e95f23041c', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:04:07.589761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:07.604548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c086bcb8-f860-4f6c-945e-68924f1271ad tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.494910 Oct 13 09:04:07.605556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3250/6088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:07 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:07.617087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:07.618954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:07.633666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:07.636945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:07.637941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:07.639127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:07.639795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:07.640840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:08.379482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:08.388773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:08.413047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:08.414365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-efe42a18-9fc2-4a2d-b6bc-bb4331148ce2 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1745 microversion: 2.20 time: 0.801157 Oct 13 09:04:08.425885 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3251/6089] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:07 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1745 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:08.436133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:08.436792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:08.465809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:08.466324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:08.466795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:08.467533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:08.469844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:08.475123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.081063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:10.090703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da5e11c3-f49b-45f3-aa66-25e161c3827e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 1.663305 Oct 13 09:04:10.091314 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3252/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:08 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:10.151436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:10.152260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:10.166377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.167641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.177106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.178246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.179017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.179616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.709821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:10.718108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:04:10.718719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:04:10.719209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:04:10.719627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:04:10.720047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:04:10.725075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:10.727135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:10.728507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afdc58af-ed5d-4889-a878-65234987390a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.624924 Oct 13 09:04:10.747014 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3253/6091] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:10 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:10.755310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:10.756899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.757120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:10.757321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.757778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.758549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.759014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.759484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.765327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.766091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.766856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.768205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:10.768871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:10.770637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:10.877882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:04:10.887124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:10.913128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Getting quotas for user d21e2f3b05c244c49a19dcbb7bb2fa5e and project 8d3cc724833843f2b8feedac21a297e0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:04:10.987677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:04:10.991936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:04:11.224619 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4169229-3f36-4584-82dc-704e628273f9 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.274943 Oct 13 09:04:11.226010 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2839/6092] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:04:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 4280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:04:11.237179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.242726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.278748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.279376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.279842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.283462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.284360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.284360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.376234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 HTTP/1.1 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'd7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2'} Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:11.386031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e4b31a6-b1d6-4754-92b8-dad750a98ca0 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 404 len: 111 microversion: 2.1 time: 0.160347 Oct 13 09:04:11.393651 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2840/6093] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:11 2022] DELETE /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:11.414768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f661a36-e352-4c8d-b28b-feeecd2f5837 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.418255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f661a36-e352-4c8d-b28b-feeecd2f5837 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.599268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f661a36-e352-4c8d-b28b-feeecd2f5837 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:11.608237 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f661a36-e352-4c8d-b28b-feeecd2f5837 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1248 microversion: 2.1 time: 0.218719 Oct 13 09:04:11.612096 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2841/6094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:11 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1248 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:11.625369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:11.643911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.645007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.651453 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6bafe9d-44ea-4c62-b6cf-7f597e6fb770 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.902966 Oct 13 09:04:11.652227 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3254/6095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:10 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:11.669406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.671033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.672711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.675083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.676302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.677403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.679398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.700481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.704747 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 HTTP/1.1 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'd7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2'} Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.709439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. Oct 13 09:04:11.716043 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.718047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:11.719356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ece57e3-d6ea-48da-823f-bae56425331a tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2" status: 404 len: 111 microversion: 2.1 time: 0.091768 Oct 13 09:04:11.720753 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2842/6096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:11 2022] GET /compute/v2.1/servers/d7c5dc1c-2d74-4c52-9c5a-799de5f3a5e2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:11.730088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.730636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.737853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.746602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.747114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.747884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.748365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.748852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.774583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.785816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.786299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.790673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.793401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.796161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.813075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:11.842987 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e HTTP/1.1 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8c1b1c92-30da-4eca-afa5-9cf97d50c61e'} Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:11.852274 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:11.856232 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:11.858904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:11.861439 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63f58cf6-3014-4e33-a2e5-c2bf14d457c5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 404 len: 111 microversion: 2.1 time: 0.136119 Oct 13 09:04:11.865435 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2843/6097] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:11 2022] DELETE /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:11.870901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:11.871628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:11.882799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.883696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.888951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:11.890207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:11.890955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:11.893242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:12.352631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:12.372859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:12.382814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:12.391315 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f51b66d-3211-4dd9-bd8c-349190f534d6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.518018 Oct 13 09:04:12.392845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2844/6098] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:11 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:12.412539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:12.423055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:12.424508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: 8c1b1c92-30da-4eca-afa5-9cf97d50c61e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:12.443212 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-276b7395-0bdf-49ec-a873-1ffbad04def2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.764247 Oct 13 09:04:12.458122 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3255/6099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:11 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:12.474699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:12.476357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:12.477852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:12.480742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:12.482860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:12.492948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:12.493581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:12.502977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:12.540918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:12.548291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:12.551821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:12.558799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:12.559619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:12.560076 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:12.560586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e HTTP/1.1 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8c1b1c92-30da-4eca-afa5-9cf97d50c61e'} Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:12.563827 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. Oct 13 09:04:12.569191 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:12.574021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance 8c1b1c92-30da-4eca-afa5-9cf97d50c61e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:12.579885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c9bd682a-92f7-47d5-9dcc-f895772467c9 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e" status: 404 len: 111 microversion: 2.1 time: 0.184253 Oct 13 09:04:12.589378 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2845/6100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:12 2022] GET /compute/v2.1/servers/8c1b1c92-30da-4eca-afa5-9cf97d50c61e => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:12.639612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6714e35a-de07-49af-bbe6-6dd26e11d0c0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:12.640755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6714e35a-de07-49af-bbe6-6dd26e11d0c0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:12.852621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6714e35a-de07-49af-bbe6-6dd26e11d0c0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:12.868322 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6714e35a-de07-49af-bbe6-6dd26e11d0c0 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1248 microversion: 2.1 time: 0.232743 Oct 13 09:04:12.872814 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2846/6101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:12 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1248 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:13.250074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:13.266418 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-616fe59e-163a-4d8d-b143-513c01e423fb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.792064 Oct 13 09:04:13.267037 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3256/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:12 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:13.293501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:13.294045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:13.313577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.320126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.322419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:13.323359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.330278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.330995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:13.428320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:13.431775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:13.476432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lazy-loading 'flavor' on Instance uuid 2ee2cdd6-5903-4004-b00c-56cfe6448598 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:04:13.478703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.481772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.491019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:13.497696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.499359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.499506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:13.614731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:13.727928 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f5d346c-5152-47c2-ae0c-859ff3419635 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.438778 Oct 13 09:04:13.730499 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2847/6103] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:04:13 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:04:13.770755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:13.771576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:13.789000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.789501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.789949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:13.796311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:13.796871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:13.797330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:14.191054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:14.217002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:14.224259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:14.230359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d35597d-e809-4edf-825f-53290b4825f6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.809732 Oct 13 09:04:14.234370 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3257/6104] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:13 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:14.262606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:14.268241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:14.316962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:14.331668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:14.336711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:14.354980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:14.365609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:14.371587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:14.603635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:14.615798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-65fddf06-5c61-45ba-9cbf-ace4d7e155a3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1676 microversion: 2.1 time: 0.869287 Oct 13 09:04:14.634324 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2848/6105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:13 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1676 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:14.668009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "name": "network-vif-plugged", "status": "completed", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:14.733254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:14.754312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:14.757750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a890c95f-bef6-4f1b-9bdc-8c8cb81240c2 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1308 microversion: 2.1 time: 0.518073 Oct 13 09:04:14.758602 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3258/6106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:14 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:14.764007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:14.767046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:14.817729 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] Creating event network-vif-plugged:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:04:14.859798 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-aefc6fb4-dae8-4e30-a073-cc8a767309bc req-cfd0e6e5-57d2-4a6a-8c2f-d61cd89f9645 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223723 Oct 13 09:04:14.865800 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2849/6107] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:15.262867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:15.264212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:15.296424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:15.307444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:15.308597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:15.309539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:15.310180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:15.310989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:15.663211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:15.664705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:15.696385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:15.696904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:15.697531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:15.698980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:15.699454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:15.699896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.421175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:16.431808 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e44dbe97-2ef4-44ac-9010-10db84263b73 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1659 microversion: 2.1 time: 0.773919 Oct 13 09:04:16.437759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2850/6108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:15 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1659 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:16.444323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:16.453302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:16.481609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:16.492830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.493977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.497066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.498796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.501720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.504902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:16.508035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.513407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:16.518934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94be56a0-8aad-4379-bb5a-8534678d365e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 1.261681 Oct 13 09:04:16.542987 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3259/6109] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:15 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:16.564133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:16.568305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:16.601379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.604732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.606958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.608875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.612980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.613765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.890033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdc6b979-fdd6-45e2-8247-b2a22d636d83 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action" status: 202 len: 0 microversion: 2.1 time: 0.345196 Oct 13 09:04:16.891874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3260/6110] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:04:16 2022] POST /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:04:16.900695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:16.905911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:16.919716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.921660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.922956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:16.926393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:16.927279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:16.931020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:17.671440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:17.679585 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44d7c94e-1633-4806-a37e-865a21f7431b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1665 microversion: 2.1 time: 0.783543 Oct 13 09:04:17.686918 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3261/6111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:16 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1665 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:17.713526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:17.727487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:17.761845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:17.762356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:17.762825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:17.763550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:17.764003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:17.764436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:18.177734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:18.224666 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8931551-d8b5-48f6-af2e-d535d09a74c1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 1.779009 Oct 13 09:04:18.225764 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2851/6112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:16 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:18.698243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:18.714462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:18.716500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:18.719492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:18.720246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:18.723503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-049a9de6-d6ee-407e-be14-391fd2e4fd48 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 1.035318 Oct 13 09:04:18.732388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3262/6113] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:17 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:18.759184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:18.760208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:18.761009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:18.761970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:18.762701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:18.763381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:19.255080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:19.255978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:19.267106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:19.267919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:19.275117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:19.276051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:19.278874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:19.279489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:19.785981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:19.794919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8dd1b9b-8535-49ab-81de-fb20f5b30016 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.543905 Oct 13 09:04:19.802520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3263/6114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:19 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:19.810306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:19.817718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:19.860153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:19.860648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:19.861087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:19.861805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:19.862254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:19.862710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:20.392939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:20.428447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:20.441937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:20.455935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d179ca5b-8d68-45fe-bd68-14917d1ae231 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.651987 Oct 13 09:04:20.463261 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3264/6115] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:19 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:20.817174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:20.825329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:20.825944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:20.839986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:20.840478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:20.841181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:20.841886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:20.842547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:20.843133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:20.904228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:20.915375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c110bc9-5bff-4472-8911-badcdbcad5dd tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1665 microversion: 2.1 time: 2.200011 Oct 13 09:04:20.917554 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2852/6116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:18 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1665 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:21.113050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:21.113749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:21.122951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.125308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.125880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.127208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.131984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.132585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.164689 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 HTTP/1.1 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fb83b0a4-076d-43e8-937b-34c4c8663bb5'} Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:21.168270 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.172558 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.179253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:21.180527 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbd03b23-c223-411f-b09c-4f41bf98618f tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 404 len: 111 microversion: 2.1 time: 0.080327 Oct 13 09:04:21.184608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2853/6117] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:21 2022] DELETE /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:21.194858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:21.196778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] [instance: fb83b0a4-076d-43e8-937b-34c4c8663bb5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:21.214601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.215445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.218537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.219615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.220315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.223227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.258964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] HTTP exception thrown: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Request method failure captured: Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 HTTP/1.1 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9LGZUjhRwi3VcIszPY9WuBzgWkgd1T0XDdMXmhulZyAHc0WLP49cMmrwh64fCtKjrFRQ-8-4DKlG-ld3jP40-QzHeLi_roJrn1kNe-cpchC3Ibk38OWraiPSNnbAPlaEd_OnHNq9gu9KThNve2vLNtmFPI199MSYnnf-1LGUYaC5fU Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64823e22cdad4cc0b008987d235a7794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64823e22cdad4cc0b008987d235a7794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 64823e22cdad4cc0b008987d235a7794 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-592231706 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 5c5e262ee0214fe09fc0e5f6cc4d4db9 Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeNegativeTest-592231706-project Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fb83b0a4-076d-43e8-937b-34c4c8663bb5'} Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:21.264250 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. Oct 13 09:04:21.268458 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:21.275153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] Returning 404 to user: Instance fb83b0a4-076d-43e8-937b-34c4c8663bb5 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:21.277850 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2d122c0-6fb4-4535-8d83-84862a129fc5 tempest-AttachVolumeNegativeTest-592231706 tempest-AttachVolumeNegativeTest-592231706-project] 10.222.0.23 "GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5" status: 404 len: 111 microversion: 2.1 time: 0.090548 Oct 13 09:04:21.280421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2854/6118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:21 2022] GET /compute/v2.1/servers/fb83b0a4-076d-43e8-937b-34c4c8663bb5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:21.500476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:21.501097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:21.517965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.521298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.521753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.522524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.522997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.523432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.679503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:21.699011 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0fe61d5-1cda-4030-b16a-d3df0ca77162 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.877603 Oct 13 09:04:21.700118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3265/6119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:20 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:21.951514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:21.952197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:21.968140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.975148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.975839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:21.978299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:21.978996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:21.981010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:22.377285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:22.387274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-317bbe0a-e21e-43d3-8d45-04d8ec2dff46 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 0.439979 Oct 13 09:04:22.388525 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3266/6120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:21 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:22.393377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fb18e5-30b4-4678-8938-a98c3e76926c", "tag": "c870c6e9-8823-4701-a988-2b3681feb008"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:22.403799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:22.404653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:22.405341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:22.442394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] Creating event network-changed:c870c6e9-8823-4701-a988-2b3681feb008 for instance f5fb18e5-30b4-4678-8938-a98c3e76926c on n-h2-858384-11 Oct 13 09:04:22.594889 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f0619e4b-01a0-4736-99a5-f43152d0c787 req-ed1aeda6-a563-4e6b-9ab1-d78e5b90245b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204818 Oct 13 09:04:22.599391 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3267/6121] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:22.701524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:22.724348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:22.732031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:22.739182 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d41af910-be51-4b8e-8a7f-83733170fef4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 1.242428 Oct 13 09:04:22.756056 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2855/6122] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:21 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:22.778213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:22.778989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:22.790217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:22.790984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:22.792215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:22.793241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:22.794715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:22.795321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:22.864166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:22.931268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1103019607", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:23.059528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:04:23.060132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:04:23.069465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:04:23.075612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:04:23.077964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:04:23.108963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:23.111879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:23.112334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:23.115411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:23.118850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:23.119554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:23.165470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Getting quotas for project 3b7a991df0bd404cb96521d3df4fd615. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:04:23.182467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Getting quotas for user 60056df7dc9a4356942c71992ba527f6 and project 3b7a991df0bd404cb96521d3df4fd615. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:04:23.242829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:04:23.251439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:04:23.363652 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62a95b2c-d0e4-4d61-a74a-d6a43904ba19 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.762576 Oct 13 09:04:23.368347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3268/6123] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 09:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 09:04:23.381236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:23.382447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:23.401907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:23.403087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:23.404629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:23.405619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:23.406560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:23.407244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:23.969203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:23.984856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-117ff641-31be-40f6-a53c-e868ab83b725 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.614796 Oct 13 09:04:24.009361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3269/6124] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:23 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:24.036282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:24.037366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:24.137211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.144955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.146419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.147583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87f6d747-e78d-4061-9df9-e6762314a21d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 200 len: 1278 microversion: 2.47 time: 0.135871 Oct 13 09:04:24.196254 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3270/6125] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:24 2022] GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:24.201230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:24.201852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:24.234717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.235272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.235769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.236569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.237027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.237505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.522504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.539413 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef5286f3-7be9-4b72-a1d6-b33b5953865b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1668 microversion: 2.1 time: 1.768816 Oct 13 09:04:24.550912 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2856/6126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:22 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1668 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:24.583891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-702409599", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": "none"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:24.592635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.622212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.635613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:24.642857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce0c5f20-4dec-42e9-85bb-73e48fe5d8bc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.444134 Oct 13 09:04:24.650013 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3271/6127] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:24 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:24.725096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:24.725768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:24.729211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:04:24.729774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:04:24.732147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:04:24.733084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:04:24.733622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:04:24.749513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.752145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.755901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.756198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.757579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.757802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.758391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.760708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:24.761444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.763023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:24.763750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.767720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:24.807887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Getting quotas for project 3b7a991df0bd404cb96521d3df4fd615. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:04:24.828466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Getting quotas for user 60056df7dc9a4356942c71992ba527f6 and project 3b7a991df0bd404cb96521d3df4fd615. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:04:24.854964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:24.867675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:24.912110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:04:24.913735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:04:24.921316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:04:24.939501 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Working on deleting snapshot 909ccf36-dec7-41c4-98a9-758efbe8f6d3 from shelved instance... Oct 13 09:04:25.139517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-938cc7e8-9065-4024-88cd-e62baa3b3bd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.585804 Oct 13 09:04:25.141783 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2857/6128] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 09:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 13 09:04:25.156082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:25.171780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:25.195653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:25.197625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:25.198752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:25.202364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:25.203289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:25.204650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:25.765335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:25.787433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad47d2b7-6593-4a72-98a8-307b181d4026 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.642050 Oct 13 09:04:25.791100 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2858/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:25 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:25.805075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d55aad3-f2fa-49cb-a320-82b1761f9c3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:25.809041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d55aad3-f2fa-49cb-a320-82b1761f9c3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:25.968415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d55aad3-f2fa-49cb-a320-82b1761f9c3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "PUT /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 991 microversion: 2.47 time: 0.160479 Oct 13 09:04:25.972510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2859/6130] 10.222.0.23 () {62 vars in 1297 bytes} [Thu Oct 13 09:04:25 2022] PUT /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 991 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:04:25.991367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:25.993334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:26.020967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.021488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.021945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:26.023304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.026441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.027062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:26.567890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.581331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.592158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.599151 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a9e836af-0feb-4863-8322-d823c74a719a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.620368 Oct 13 09:04:26.600499 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2860/6131] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:25 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:26.614991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:26.619422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:26.639675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.645198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.645670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:26.647084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.647553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.650256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:26.937470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.943572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Doing local delete in cell da9ed4ed-f649-4a64-9171-7dcc9de0d307(cell1) {{(pid=127030) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 13 09:04:26.946920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.948480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.950003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:26.951084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.951235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a0b0153-2fac-46af-8aed-b24b3ee7a57a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1281 microversion: 2.47 time: 0.347619 Oct 13 09:04:26.951867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:26.952019 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2861/6132] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:26 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1281 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:26.956114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 13 09:04:26.958853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:26.959633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:26.986684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] deallocate_for_instance() {{(pid=127030) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 13 09:04:26.996530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:26.998061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:26.998603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:27.019537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:27.024560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:27.025284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:27.485862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:27.497795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c544a7df-1212-4fcb-8f4c-3b93616822df tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.544769 Oct 13 09:04:27.502952 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2862/6133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:26 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:27.631258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:27.632470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:27.645444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:27.653624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:27.657243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:27.658279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:27.662160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:27.665963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:28.414045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Updating instance_info_cache with network_info: [] {{(pid=127030) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 13 09:04:28.745665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:28.755205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:28.761894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:28.812316 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8b526ad-eea5-433a-80ec-1c1fb6997caf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 1.177120 Oct 13 09:04:28.862433 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2863/6134] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:27 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:28.864992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:28.877399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:28.905074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:28.906262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:28.908277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:28.915847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:28.927898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:28.935442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:28.946931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:29.171933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:29.189076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:29.198720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:29.204666 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22335cb8-d8ab-459a-ba5e-13669014b77e tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1329 microversion: 2.47 time: 0.354954 Oct 13 09:04:29.214367 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2864/6135] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:28 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1329 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:29.247261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faae4070-66bc-4d7c-9f09-6d42a21d46fa", "name": "network-vif-deleted", "tag": "16f9df6b-95e4-4d4c-800a-c7edb1ecc3a3"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:29.261646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ae87b2e-b800-4f60-8bae-31038f9703ac tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 204 len: 0 microversion: 2.1 time: 4.608212 Oct 13 09:04:29.271337 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3272/6136] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:24 2022] DELETE /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 0 bytes in 4620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:04:29.284514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:29.291123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:29.291876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.294336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.296669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.312181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.314709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.316821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.318310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.320231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.322566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.358165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_external_events [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] Unable to find a host for instance faae4070-66bc-4d7c-9f09-6d42a21d46fa. Dropping event network-vif-deleted {{(pid=127031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 09:04:29.359111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2fe29723-7f78-4984-ac2a-db9b5f65430d req-f37e9cfa-89df-4f33-bd8f-0021ba3fc20e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.141762 Oct 13 09:04:29.359730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2865/6137] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 145 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 09:04:29.385000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:29.389132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: faae4070-66bc-4d7c-9f09-6d42a21d46fa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:29.403915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.405681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.408357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.410200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.413547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.414233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.470367 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa HTTP/1.1 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'faae4070-66bc-4d7c-9f09-6d42a21d46fa'} Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:29.474238 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. Oct 13 09:04:29.478601 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:29.510582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 404 to user: Instance faae4070-66bc-4d7c-9f09-6d42a21d46fa could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:29.511768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75c7de3f-2b12-4aa9-804b-1de9957fb729 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa" status: 404 len: 111 microversion: 2.1 time: 0.138215 Oct 13 09:04:29.514113 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2866/6138] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:29 2022] GET /compute/v2.1/servers/faae4070-66bc-4d7c-9f09-6d42a21d46fa => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:29.528945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:29.529823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:29.580232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.580923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.585247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.588396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.602815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.604742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.765217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:29.779098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:04:29.786524 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45978fd2-e1e7-467e-a655-01de284dcf52 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.513748 Oct 13 09:04:29.813056 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3273/6139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:29 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:29.876820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:29.878088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:29.886576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:29.890955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.895360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.896127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:29.897127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:29.898877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:29.899529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.040528 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bbd1bcf9-026a-400d-91df-b4b918f698d7 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 204 len: 0 microversion: 2.1 time: 0.520070 Oct 13 09:04:30.043278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2867/6140] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:29 2022] DELETE /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:04:30.057451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:30.060815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:30.086608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.088102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.088581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.091508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.092018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.092498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.243641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.262372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.264820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.268092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b5c2d136-4b07-418f-882b-0a79efa686a4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.395123 Oct 13 09:04:30.271252 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3274/6141] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:29 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:30.287494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:30.288495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:30.299542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.301708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.302158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.302976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.303444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.303858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.442705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.454907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.457305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.460042 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d06b390f-a35e-4ec7-a95b-14cd4fd8a1c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1335 microversion: 2.47 time: 0.186278 Oct 13 09:04:30.460665 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3275/6142] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:30 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1335 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:30.635372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:30.643641 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37be353e-3d52-4094-bf75-adfa2e58a84e tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1467 microversion: 2.1 time: 0.596021 Oct 13 09:04:30.646341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2868/6143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:30 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1467 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:30.825131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:30.827144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:30.837219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.840552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.842925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:30.847413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:30.848164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:30.848813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.155459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:31.178119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a17eea93-6631-41a8-b848-96f4e5e6e831 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.353777 Oct 13 09:04:31.181640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3276/6144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:30 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:31.298724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:31.299342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:31.341897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.349233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.351147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.357216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.366455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.367271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.495882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:31.496945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:31.526856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.527401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.527851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.528633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.529057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.544180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.843622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:31.873333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:31.879588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:31.886564 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7626d94a-d1fd-4bbb-843a-29bf9e495ad9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1335 microversion: 2.47 time: 0.391207 Oct 13 09:04:31.889041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3277/6145] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:31 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1335 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:31.907086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:31.914201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:31.947756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.948262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.948824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:31.949562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:31.950022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:31.950544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:32.205695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:32.216501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:32.229443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:32.233747 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d930c18c-ba4b-4f48-8f1f-0c7c664189f9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.938982 Oct 13 09:04:32.235369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2869/6146] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:31 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:32.254464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:32.257643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:32.276393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:32.279294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:32.280071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:32.282115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:32.283692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:32.285925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.028084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.044351 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-928ec286-e9e7-418e-8378-d895d26ca4e2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1467 microversion: 2.1 time: 1.153908 Oct 13 09:04:33.067797 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3278/6147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:31 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1467 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:33.079441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:33.080257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:33.113451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:33.115522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:33.122201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.123236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:33.125760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:33.128905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.227269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:33.364778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.370468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.381750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.388074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.388945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8384d58d-2d12-4ee8-9dbf-fec4dc0c5d62 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 1.151650 Oct 13 09:04:33.389561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2870/6148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:32 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:33.391325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9732c1e5-7a56-4655-81a0-10408bce96c4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1335 microversion: 2.47 time: 0.322160 Oct 13 09:04:33.398106 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3279/6149] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:33 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1335 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:33.403280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:33.426176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:33.445957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c2871d-1b61-4367-b6bc-f634b93ac218", "name": "network-vif-deleted", "tag": "0eecd2ec-454d-4837-bf00-d5271a9ebff2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:33.455699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:33.459290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:33.460125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.461645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:33.462812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:33.464597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.474347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:33.494456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:33.495048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:33.535210 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] Creating event network-vif-deleted:0eecd2ec-454d-4837-bf00-d5271a9ebff2 for instance c1c2871d-1b61-4367-b6bc-f634b93ac218 on n-h1-858384-11 Oct 13 09:04:33.548356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2c145f76-0909-4052-832c-c13cd61c7cb5 req-b398bde5-12d2-4455-baf6-f0e929a031f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117744 Oct 13 09:04:33.550579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2871/6150] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:33.882048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.892359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.894442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:33.895766 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-099cacf5-4523-4689-9173-69215a27c5ee tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.496288 Oct 13 09:04:33.896433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3280/6151] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:33 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:34.077295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:34.078171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:34.093551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.095964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.097432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.099321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.100386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.107317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.160417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.161092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.161724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.162372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lazy-loading 'fault' on Instance uuid c1c2871d-1b61-4367-b6bc-f634b93ac218 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:04:34.230658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:34.283584 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec6256dd-f8b0-4120-87d4-0492b96c0f8a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 200 len: 1305 microversion: 2.1 time: 0.191900 Oct 13 09:04:34.291150 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2872/6152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:34 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 1305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:34.439667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:34.441521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:34.453072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:34.453697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:34.467382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.467894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.468347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.469080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.469543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.469987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.474119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:34.487959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.489959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.490852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.492752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.493221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.497930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.783250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:34.879133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:34.927409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:34.936378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:34.949280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:34.951387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67973544-3693-4cef-a200-130cb0d9efe9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1335 microversion: 2.47 time: 0.516954 Oct 13 09:04:34.952155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3281/6153] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:34 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1335 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:34.978304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:34.979126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:34.985926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.986654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.987255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.988693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:34.989309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:34.989917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:34.992464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:35.001266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cb1df39-b47f-4796-be5d-71e6f5e2bfc8 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.566498 Oct 13 09:04:35.002945 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2873/6154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:34 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:35.094453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fb18e5-30b4-4678-8938-a98c3e76926c", "name": "network-vif-plugged", "status": "completed", "tag": "c870c6e9-8823-4701-a988-2b3681feb008"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:35.119771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.121525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.122336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.137961 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] Creating event network-vif-plugged:c870c6e9-8823-4701-a988-2b3681feb008 for instance f5fb18e5-30b4-4678-8938-a98c3e76926c on n-h2-858384-11 Oct 13 09:04:35.165652 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-109c9819-a004-4282-8bf3-c3be892a1d3e req-5ca60dbc-6f75-428c-8d8a-8cc66b8f5c14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079815 Oct 13 09:04:35.166840 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2874/6155] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:35.317744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:35.318812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: c1c2871d-1b61-4367-b6bc-f634b93ac218] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:35.331885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.335780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.336604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.337674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.338340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.339020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.372575 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 HTTP/1.1 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c1c2871d-1b61-4367-b6bc-f634b93ac218'} Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:35.376897 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. Oct 13 09:04:35.381629 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:35.387035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 404 to user: Instance c1c2871d-1b61-4367-b6bc-f634b93ac218 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:35.388213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-616952c1-b164-40f9-b822-b9b01b392ab2 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218" status: 404 len: 111 microversion: 2.1 time: 0.076298 Oct 13 09:04:35.393548 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2875/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:35 2022] GET /compute/v2.1/servers/c1c2871d-1b61-4367-b6bc-f634b93ac218 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:35.405989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:35.407341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:35.420901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.424389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.425160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.425991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.429815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.430353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.468786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:04:35.679254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-989809ab-26a6-4a59-9257-f7041af22109 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 204 len: 0 microversion: 2.1 time: 0.284063 Oct 13 09:04:35.680303 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2876/6157] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:35 2022] DELETE /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:04:35.696110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:35.697143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:35.722396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.723110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.723564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:35.725740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:35.726230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:35.726779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.105984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.109320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.112344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:36.123739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.127661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.135814 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f08c0889-83bb-4924-8f5a-b5fa37888aef tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 1.169044 Oct 13 09:04:36.136860 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-917329d6-d540-4934-ae7d-6646132c2ba3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1507 microversion: 2.1 time: 0.444865 Oct 13 09:04:36.137909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2877/6158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:35 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:36.138737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3282/6159] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:34 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:36.154611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:36.154611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:36.164786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:36.167356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:36.187304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.189104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.194030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.194611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.195169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.195311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.195685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.196333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.196620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.197325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.197756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.199414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.405281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.421942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.423520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.424743 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da84d0c2-c136-4216-a83b-6a894b86696c tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1356 microversion: 2.47 time: 0.283569 Oct 13 09:04:36.431378 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2878/6160] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:36 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1356 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:36.462043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:36.468408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:36.486937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.489658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.490481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.492897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:36.493995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:36.495786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:36.625881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:36.682266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3cda1671-f351-4684-b7f2-16c6e360d5c4 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1373 microversion: 2.1 time: 0.534564 Oct 13 09:04:36.688785 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3283/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:36 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1373 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:36.711995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:04:36.717583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:04:36.719677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:04:36.720364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:04:36.720968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:04:36.812589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:37.048723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:37.059667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.061902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.062546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.070025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.071136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.071882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.137768 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd2ca927-2c14-4264-aa69-ac6af725e83d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "POST /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30/action" status: 202 len: 1078 microversion: 2.47 time: 0.681607 Oct 13 09:04:37.146785 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2879/6162] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 09:04:36 2022] POST /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30/action => generated 1078 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 13 09:04:37.164192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:37.165013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:37.167574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:37.168200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:37.175796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.176295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.176739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.177453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.177910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.178345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.197798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.203292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.203828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.204653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.212100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.212945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.265609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:37.279736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:37.286239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:37.287823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e0b8793-eff9-451b-b390-a9df99de56b9 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.124571 Oct 13 09:04:37.307327 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2880/6163] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:37 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:37.312703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:37.313439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:37.335857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.336374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.336815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.339820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.340447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.342318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.820602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:37.835835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fe11d63-16f2-47e2-a6c6-97ed0c1d03d6 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1507 microversion: 2.1 time: 0.677997 Oct 13 09:04:37.879528 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3284/6164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:37 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1507 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:37.912618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:37.915268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:37.938227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.944904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.948776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.950988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:37.951654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:37.952523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:37.984353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.008868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.012817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.021751 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5898112c-8e0f-4350-ac8c-9ac4add4e03d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.713199 Oct 13 09:04:38.039862 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2881/6165] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:37 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:38.313274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:38.313893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:38.327503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.327942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.328420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.329230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.329691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.330133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.372725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.393008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ebcc12f-182e-43c1-8ecb-0cf83705b8c6 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1544 microversion: 2.1 time: 0.502083 Oct 13 09:04:38.394181 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3285/6166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:37 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1544 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:38.426072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:38.427084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:38.436503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.442074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.442885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.443864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.444524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.445298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.500608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.511534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.516369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.517680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f703ddf5-92f0-4fc6-9ce0-a57692618cd4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.208436 Oct 13 09:04:38.521110 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2882/6167] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:38 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:38.752600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72", "name": "network-vif-deleted", "tag": "755db9b2-1ba0-4a55-8d23-b72a365b4408"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:38.765856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.766856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.768268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.788523 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] Creating event network-vif-deleted:755db9b2-1ba0-4a55-8d23-b72a365b4408 for instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 on n-h2-858384-11 Oct 13 09:04:38.795362 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-afa94136-f424-4930-8ac4-f6dd85d74040 req-a355727d-17ff-4fa7-8248-5d7ddcf5c2c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047876 Oct 13 09:04:38.810810 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2883/6168] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:38.870385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:38.883440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:38.886801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:38.898374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b88d67d6-20d8-4301-8e26-488bdc8daa50 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1544 microversion: 2.1 time: 0.475617 Oct 13 09:04:38.900707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3286/6169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:38 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1544 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:38.904455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.905639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.906925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:38.908209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:38.909080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:38.910522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:39.055394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:39.056244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:39.081556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:39.086624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:39.087821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:39.094142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:39.097740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:39.102227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:39.223593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.244446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14864e71-48f0-4dba-86e3-3d76963c950a tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 200 len: 1299 microversion: 2.1 time: 0.360581 Oct 13 09:04:39.248716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2884/6170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:38 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 1299 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:39.547583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:39.548609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:39.566326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:39.568451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:39.569680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:39.570692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:39.571723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:39.579033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:39.693884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.704205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.716059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.719544 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2216a8c8-f93e-4a67-a5b8-adf5d7b60961 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.176931 Oct 13 09:04:39.726302 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2885/6171] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:39 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:39.756402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.806681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.813011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:39.818813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1646220d-fbfb-4316-b10a-8ddb980e2624 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.763417 Oct 13 09:04:39.821565 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3287/6172] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:39 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:40.276948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:40.279320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:40.322288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.325923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.328407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.334773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.341461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.344527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.399331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 HTTP/1.1 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72'} Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:40.406481 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. Oct 13 09:04:40.411419 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.416728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 404 to user: Instance 57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:40.417948 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20ad7f25-cf9b-4733-9603-c9501376eb2c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72" status: 404 len: 111 microversion: 2.1 time: 0.146354 Oct 13 09:04:40.420588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2886/6173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:40 2022] GET /compute/v2.1/servers/57b5a9b6-8ee1-4ed1-8f8f-4b2609a9cf72 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:40.428627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:40.429427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:40.451878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.452452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.452900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.453641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.454102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.456066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.515033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:04:40.682548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-690b028d-7449-433b-9253-6c2997adf5c3 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 204 len: 0 microversion: 2.1 time: 0.257710 Oct 13 09:04:40.685414 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3288/6174] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:40 2022] DELETE /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:04:40.697428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:40.704771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:40.729648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.730237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.730780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.739544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.740042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.741330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.963163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a533de99-5417-46af-ac80-11128ba174a2 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Action: 'create', calling method: .version_select at 0x7f5375f56670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1152439063", "metadata": {"Type": "work"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a533de99-5417-46af-ac80-11128ba174a2 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 122 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1152439063", "metadata": {"Type": "work"}}} Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1152439063', 'metadata': {'Type': 'work'}}}} Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '#$%' Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:04:40.967405 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a533de99-5417-46af-ac80-11128ba174a2 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:40.972566 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a533de99-5417-46af-ac80-11128ba174a2 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.300287 Oct 13 09:04:40.973723 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2887/6175] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 09:04:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 305 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:04:40.980853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:40.984308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:40.997031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:40.997533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:40.997991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:40.999353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:41.001288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:41.001738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:41.109992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.119903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.133653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.137506 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8402b46-9f61-4618-8e13-1361690fb71f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.161117 Oct 13 09:04:41.142471 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2888/6176] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:40 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:41.167522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:41.168223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:41.198878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:41.199336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:41.199787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:41.200529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:41.201032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:41.201404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:41.462438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.475888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.477499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.491885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30fde7e2-9a62-418b-b2cc-0d701da37be5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.348292 Oct 13 09:04:41.493163 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2889/6177] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:41 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:41.498328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f450cb4b-e96d-4e85-a352-beff07f039d5 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Action: 'create', calling method: .version_select at 0x7f5375f56280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1257665295", "metadata": {"Type": "work"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f450cb4b-e96d-4e85-a352-beff07f039d5 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 120 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1257665295", "metadata": {"Type": "work"}}} Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1257665295', 'metadata': {'Type': 'work'}}}} Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '0' Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:04:41.502516 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 13 09:04:41.506743 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.508645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f450cb4b-e96d-4e85-a352-beff07f039d5 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:41.509803 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f450cb4b-e96d-4e85-a352-beff07f039d5 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015316 Oct 13 09:04:41.514807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:41.515904 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2890/6178] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 09:04:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:04:41.525613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3d4ce94-f6fa-4262-8bb9-54b5f05aa91c tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Action: 'create', calling method: .version_select at 0x7f5375e5aa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-338935935", "metadata": {"Type": "work"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:41.528179 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9beb9de-8447-4a8a-aad7-506986f390bb tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1494 microversion: 2.1 time: 0.836150 Oct 13 09:04:41.531236 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3289/6179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:40 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1494 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3d4ce94-f6fa-4262-8bb9-54b5f05aa91c tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 118 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-338935935", "metadata": {"Type": "work"}}} Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-338935935', 'metadata': {'Type': 'work'}}}} Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '' Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:04:41.533973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 13 09:04:41.538217 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.561206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3d4ce94-f6fa-4262-8bb9-54b5f05aa91c tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:41.563662 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3d4ce94-f6fa-4262-8bb9-54b5f05aa91c tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041926 Oct 13 09:04:41.572992 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2891/6180] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 09:04:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 13 09:04:41.582737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a55ad19-f41d-4dd4-8776-72efb736bb82 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Calling method '.version_select at 0x7f53754cef70>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:41.631061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2a55ad19-f41d-4dd4-8776-72efb736bb82 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] HTTP exception thrown: Volume tempest-invalid-622339656 could not be found. Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a55ad19-f41d-4dd4-8776-72efb736bb82 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-622339656 HTTP/1.1 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: exception: Volume tempest-invalid-622339656 could not be found. Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'tempest-invalid-622339656'} Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-622339656 could not be found. (HTTP 404) (Request-ID: req-3f6f4278-74ba-4e8c-89dc-2c31d13d19ba) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.640090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-622339656 could not be found. Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-622339656 could not be found. Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-622339656 could not be found. Oct 13 09:04:41.646077 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.653532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a55ad19-f41d-4dd4-8776-72efb736bb82 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 404 to user: Volume tempest-invalid-622339656 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:41.653532 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a55ad19-f41d-4dd4-8776-72efb736bb82 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-622339656" status: 404 len: 98 microversion: 2.1 time: 0.071921 Oct 13 09:04:41.653532 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3290/6181] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 09:04:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-622339656 => generated 98 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 13 09:04:41.669226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a69394a-46a0-443a-836b-57817ebfc8dc tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005418 Oct 13 09:04:41.669737 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2892/6182] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 09:04:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 13 09:04:41.679767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ba32eabb-aec6-41fd-a523-a5339f24f7a1 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003935 Oct 13 09:04:41.684319 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3291/6183] 10.222.0.23 () {58 vars in 1137 bytes} [Thu Oct 13 09:04:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 13 09:04:41.689961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c39e60e4-8eb5-4f88-aa87-25e959554188 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Calling method '.version_select at 0x7f537aa8c790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:41.734293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c39e60e4-8eb5-4f88-aa87-25e959554188 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] HTTP exception thrown: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c39e60e4-8eb5-4f88-aa87-25e959554188 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-volumes/e029aaad-b70a-4365-b7ea-11d75bbb22d2 HTTP/1.1 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: exception: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e029aaad-b70a-4365-b7ea-11d75bbb22d2'} Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. (HTTP 404) (Request-ID: req-c3a0abcd-97b4-4330-9f01-c81a1e13befa) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:04:41.736741 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. Oct 13 09:04:41.742394 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.751996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c39e60e4-8eb5-4f88-aa87-25e959554188 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 404 to user: Volume e029aaad-b70a-4365-b7ea-11d75bbb22d2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:41.755957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c39e60e4-8eb5-4f88-aa87-25e959554188 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e029aaad-b70a-4365-b7ea-11d75bbb22d2" status: 404 len: 109 microversion: 2.1 time: 0.068123 Oct 13 09:04:41.757053 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2893/6184] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:04:41 2022] DELETE /compute/v2.1/os-volumes/e029aaad-b70a-4365-b7ea-11d75bbb22d2 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:41.766704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-187d7aca-309d-40c0-8c2c-c5b05a469d59 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Calling method '.version_select at 0x7f53754783a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:41.814976 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-187d7aca-309d-40c0-8c2c-c5b05a469d59 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] HTTP exception thrown: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-187d7aca-309d-40c0-8c2c-c5b05a469d59 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Request method failure captured: Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-volumes/a84dc46e-7f30-4c71-8185-07f0859df567 HTTP/1.1 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9SowQGJm_pUDcb9jtIL1cbsKkBaSQojhXpyPOHGjKhxodnocnDqLHarbNnnb0qBLqvZtjzi5hJgmOgSej5JuHrPyY19q8uDXjpSt9YStxlu1Cw_GLMeo-w4INaniodYaHDnm9-Gf0WlBeX7LJ86eeOQFdd5G0s-pNCRrAvyO9hFaEQ Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c5c83f40b28b4f0bb5c3c790f693ae5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c5c83f40b28b4f0bb5c3c790f693ae5e Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesNegativeTest-180509522 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 3ca0f0b3e5ee45f2abe1cac802addeb3 Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesNegativeTest-180509522-project Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: exception: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a84dc46e-7f30-4c71-8185-07f0859df567'} Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. (HTTP 404) (Request-ID: req-e229509e-3b89-4b82-9857-5be84f31ed75) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:04:41.817158 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-187d7aca-309d-40c0-8c2c-c5b05a469d59 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] Returning 404 to user: Volume a84dc46e-7f30-4c71-8185-07f0859df567 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-187d7aca-309d-40c0-8c2c-c5b05a469d59 tempest-VolumesNegativeTest-180509522 tempest-VolumesNegativeTest-180509522-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a84dc46e-7f30-4c71-8185-07f0859df567" status: 404 len: 109 microversion: 2.1 time: 0.056602 Oct 13 09:04:41.821176 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3292/6185] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:04:41 2022] GET /compute/v2.1/os-volumes/a84dc46e-7f30-4c71-8185-07f0859df567 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:42.175406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:42.176333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:42.194718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.195433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.197672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:42.198485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.198919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.199356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:42.334298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:42.349857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:42.351389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:42.352614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-03943767-0900-4341-9636-cb81159110e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.183264 Oct 13 09:04:42.359431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2894/6186] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:42 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:42.523749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:42.524866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:42.539300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.539793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.540230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:42.540943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.541396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.541838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:42.555617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:42.556853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:42.571006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.583309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.584013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:42.588180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:42.588935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:42.591721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:43.006977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.017231 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d01c07f-3996-419c-8d0d-b422a7dec92c tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1494 microversion: 2.1 time: 0.465792 Oct 13 09:04:43.017567 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2895/6187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:42 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1494 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:43.369808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.383519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:43.384136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:43.393551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:43.410589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:43.411177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.411177 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0dd6c8d-b800-40dd-9e78-0e1c0f565911 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.886867 Oct 13 09:04:43.411177 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3293/6188] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:42 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:43.680935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.695203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.696679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:43.697967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3481a490-76fe-4c74-ad9c-3c1db5f7b116 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.318358 Oct 13 09:04:43.727234 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2896/6189] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:43 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:44.042100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:44.043016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:44.058853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.062494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175e2d98-d9aa-46f7-adf1-2ce368904597", "name": "network-vif-deleted", "tag": "42eae411-1007-40e2-975a-42934cc8a57d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:44.071870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:44.098888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.101248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.107043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.110227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.113932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.120296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.126439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.134369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.177786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] Creating event network-vif-deleted:42eae411-1007-40e2-975a-42934cc8a57d for instance 175e2d98-d9aa-46f7-adf1-2ce368904597 on n-h1-858384-11 Oct 13 09:04:44.236807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6948c9ed-f65e-4577-b9b6-0b04ee86931e req-0229b89d-1bb0-4d6a-b413-a6bd3dc57d78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178866 Oct 13 09:04:44.245239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2897/6190] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:44.334971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:44.347944 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd6b2612-3f0b-442e-aa6d-6e81f13b8371 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 200 len: 1286 microversion: 2.1 time: 0.308473 Oct 13 09:04:44.349048 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3294/6191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:44 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 1286 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:44.444302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:44.448027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:44.490470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.491100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.491561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.494677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.495167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.502316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.743915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:44.744639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:44.751369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.761449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.764452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.776048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:44.778283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:44.780493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:44.888913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:44.906743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:44.914847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:44.919002 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bdddff07-0641-4181-97af-4145742bfd2a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.479139 Oct 13 09:04:44.920330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2898/6192] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:44 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:45.376174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:45.377086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 175e2d98-d9aa-46f7-adf1-2ce368904597] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:45.397040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.397485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.401085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.404557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.405566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.407651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.492827 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 HTTP/1.1 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '175e2d98-d9aa-46f7-adf1-2ce368904597'} Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:45.506801 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:45.511707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 404 to user: Instance 175e2d98-d9aa-46f7-adf1-2ce368904597 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:45.515568 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f593555-1e2a-4fe7-a234-06b95f03460d tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597" status: 404 len: 111 microversion: 2.1 time: 0.143234 Oct 13 09:04:45.516426 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2899/6193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:45 2022] GET /compute/v2.1/servers/175e2d98-d9aa-46f7-adf1-2ce368904597 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:04:45.528946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:45.536494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:45.550920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.551725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.555645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.557289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.558070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.558695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.638887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:04:45.885983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:45.906318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-417415cd-6093-4e39-9ae2-6371ac188f36 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 204 len: 0 microversion: 2.1 time: 0.378937 Oct 13 09:04:45.907637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:45.909484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2900/6194] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:04:45 2022] DELETE /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:04:45.909730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:45.910982 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3418caae-7b37-4e5b-8f6e-5ce4f4ac3087 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 1.172070 Oct 13 09:04:45.911541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3295/6195] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:44 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:45.930597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:45.931423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:45.950734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.956718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.957279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.960601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:45.961506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:45.966185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:45.973521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:45.976970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:45.983259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:45.995320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:46.000279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:46.001678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:46.003375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:46.005242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:46.007684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:46.286892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:46.303680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-682c5d7a-c4e1-4f49-b16a-42c1ef7335e0 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1674 microversion: 2.1 time: 0.377244 Oct 13 09:04:46.304747 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2901/6196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:45 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1674 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:46.311018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fb18e5-30b4-4678-8938-a98c3e76926c", "tag": "c870c6e9-8823-4701-a988-2b3681feb008"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:46.324578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:46.325161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:46.325664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:46.328860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:46.341449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] Creating event network-changed:c870c6e9-8823-4701-a988-2b3681feb008 for instance f5fb18e5-30b4-4678-8938-a98c3e76926c on n-h2-858384-11 Oct 13 09:04:46.343026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:46.347209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:46.349836 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5d0bc702-e484-4577-8c0e-7431210e8e25 req-0525288b-4869-4314-bc4a-8b2aeef7f48a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043604 Oct 13 09:04:46.351215 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2902/6197] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:04:46.353090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-78a6fcac-c9c3-455b-b5f8-2e1ec2202577 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1740 microversion: 2.20 time: 0.407866 Oct 13 09:04:46.353671 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3296/6198] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:45 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:46.938091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:46.939610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:46.953912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:46.955212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:46.957087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:46.958791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:46.961000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:46.962614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:47.261759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.300231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.305977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.307274 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61fcfc45-235e-4763-92ec-12c33af1db9a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.374166 Oct 13 09:04:47.307861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2903/6199] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:46 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:47.330174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:47.331595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:47.343233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:47.343933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:47.351183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:47.352145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:47.354257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:47.354901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:47.381860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:47.382495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:47.390984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:47.392696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:47.397711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:47.398524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:47.399553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:47.399553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:47.789885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.805104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.806812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.812164 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d9692acc-3679-4d1f-9838-124048b8a806 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1722 microversion: 2.20 time: 0.434644 Oct 13 09:04:47.813282 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2904/6200] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:47 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:47.941141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:47.955390 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d374a79-2f29-4456-8384-1ab860096121 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1674 microversion: 2.1 time: 0.630138 Oct 13 09:04:47.961194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3297/6201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:47 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1674 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:48.339768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:48.341337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:48.354385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.359220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.360006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:48.360979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.366548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.367249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:48.629869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:48.641529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:48.643045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:48.644384 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-58ae1ff5-687e-43be-bb9e-2afc87955ddf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.308761 Oct 13 09:04:48.644984 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2905/6202] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:48 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:48.843485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:48.848961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:48.861172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.863059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.863838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:48.871834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.874472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.876141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:48.979903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:48.980785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:48.993575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.994310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.994967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:48.995872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:48.996520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:48.998951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:49.128938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.139359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba7be666-f317-47f7-ae7a-0f2d5b58b364 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1607 microversion: 2.1 time: 0.163346 Oct 13 09:04:49.139956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2906/6203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:48 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1607 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:04:49.492717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.505141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.509392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.518861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff65e377-68c2-44ce-a046-904c39730de4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1722 microversion: 2.20 time: 0.677833 Oct 13 09:04:49.520809 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3298/6204] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:48 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1722 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:49.673262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:49.673887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:49.700927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:49.701431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:49.701881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:49.702638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:49.712747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:49.715300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:49.793443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee2cdd6-5903-4004-b00c-56cfe6448598", "name": "network-vif-deleted", "tag": "ebd55345-c9a3-4d27-b191-524ef70b2678"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:49.817296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:49.819161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:49.820858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:49.857627 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] Creating event network-vif-deleted:ebd55345-c9a3-4d27-b191-524ef70b2678 for instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 on n-h2-858384-11 Oct 13 09:04:49.873776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2948b33a-6e3e-40ae-9edf-735009bdef94 req-59b6862b-a388-4a19-abc1-92ad5fe3c991 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083855 Oct 13 09:04:49.874825 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3299/6205] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:04:49.883077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.938716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.942288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:49.946960 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20a98ebf-0f66-4a5b-b3dd-c7bafec2c3b4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.276397 Oct 13 09:04:49.947788 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2907/6206] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:49 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:50.166232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:50.167714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:50.182263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:50.183018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:50.183898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:50.198811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:50.199968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:50.201311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:50.263762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:50.264775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:50.265733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:50.267346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lazy-loading 'fault' on Instance uuid 2ee2cdd6-5903-4004-b00c-56cfe6448598 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:04:50.324432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8522c58b81114d1093416ad6c6336f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b464b1905aee4008898ae12948f5b741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:50.336347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61c98327-e95a-43dd-8a1f-7982874ffdcc tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 200 len: 1326 microversion: 2.1 time: 0.174545 Oct 13 09:04:50.342997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3300/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:50 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 1326 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:04:50.555679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:50.556288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:50.567564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:50.568085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:50.568569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:50.569279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:50.569741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:50.573681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:50.919200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:50.928775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:50.930522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:50.931923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7950a9b-cb79-493e-a6bf-96ec64782184 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1725 microversion: 2.20 time: 0.380233 Oct 13 09:04:50.932878 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2908/6208] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:50 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:50.964364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c500ce-9026-4bbf-8a60-1c6ed2eb8808"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:50.974305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:50.974967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:50.985030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:50.999691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.000232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.000708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.001495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.008116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.010541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.011554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.012082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.012630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.015925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.016488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.016976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.032097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:04:51.184122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:51.201012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:51.204240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:51.207533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d731e948-5d1a-4efe-8f29-edbe7b6eebcf tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.238314 Oct 13 09:04:51.216910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2909/6209] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:50 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:51.369502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:51.370285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] [instance: 2ee2cdd6-5903-4004-b00c-56cfe6448598] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:51.383441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.386627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.387239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.388938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:51.390619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:51.391586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:51.416420 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] HTTP exception thrown: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Request method failure captured: Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 HTTP/1.1 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9IoSt0vAJX18kmvCgih9mK0Ni9V9XbOUyyogCDZDxw6x9jQ_w2KsSqPmyQrezxTqd__MhnBNaAn87C8fkHP-EpSlpBc2SIqsN9GjgMFpiHTCVWwKxpZ5FMqp2qjDtBuyEHRA81JlPl6KGow50Te3Ui4xite_dq7Eae_LXNZtNR13gU Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b464b1905aee4008898ae12948f5b741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b464b1905aee4008898ae12948f5b741"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: b464b1905aee4008898ae12948f5b741 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-457107961 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 8522c58b81114d1093416ad6c6336f29 Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-457107961-project Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '2ee2cdd6-5903-4004-b00c-56cfe6448598'} Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:04:51.418439 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. Oct 13 09:04:51.422447 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:04:51.425140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Returning 404 to user: Instance 2ee2cdd6-5903-4004-b00c-56cfe6448598 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:04:51.426502 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f17d451-f928-47a7-b0c8-52618902ba1b tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598" status: 404 len: 111 microversion: 2.1 time: 0.064542 Oct 13 09:04:51.431471 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2910/6210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:04:51 2022] GET /compute/v2.1/servers/2ee2cdd6-5903-4004-b00c-56cfe6448598 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:04:51.437686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d044f470-c2b6-465d-a073-c6d780423b54 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] Calling method '.version_select at 0x7f5375fb2670>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:51.469053 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d044f470-c2b6-465d-a073-c6d780423b54 tempest-ServerActionsTestJSON-457107961 tempest-ServerActionsTestJSON-457107961-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51424753" status: 202 len: 0 microversion: 2.1 time: 0.031799 Oct 13 09:04:51.473283 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2911/6211] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 09:04:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51424753 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:04:51.666278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d40ad9eb-471b-4d2a-9fcd-582143121ba0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.695628 Oct 13 09:04:51.666984 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3301/6212] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 13 09:04:50 2022] POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 188 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:04:51.962978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "name": "network-vif-unplugged", "status": "completed", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:51.968528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:04:51.970388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:51.998206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.000019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.000708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.002786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.003630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.005193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.005837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.007328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.008090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.061185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_external_events [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] Unable to find a host for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6. Dropping event network-vif-unplugged {{(pid=127030) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 09:04:52.075649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-78ce9953-57c8-4a34-a87f-9069107e1aaf req-7f3fbdcf-7fe7-4c0b-9f89-852cd9109cd1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.124044 Oct 13 09:04:52.080543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3302/6213] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 130 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 09:04:52.121978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127031) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 09:04:52.243104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:52.243878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:52.265437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.267061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.269642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.270610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.275025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.275780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.335127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-384ad8cd-5597-46a2-8c73-f05093b72f41 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/action" status: 202 len: 0 microversion: 2.20 time: 0.382663 Oct 13 09:04:52.336386 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2912/6214] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 09:04:51 2022] POST /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:04:52.347073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:52.348236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:52.366923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.367815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.368420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.369404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:52.370239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:52.370936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:52.453894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.469437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.470941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.472721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-52146e82-66b5-428c-8135-1fb6ef9ae9e7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.234746 Oct 13 09:04:52.491689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3303/6215] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:52 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:52.661747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.671368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.692171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:52.694161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a248704b-ea68-4fc5-b545-8f331d4bf9eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1751 microversion: 2.20 time: 0.353968 Oct 13 09:04:52.710787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2913/6216] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:52 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1751 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:53.505468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:53.506782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:53.536090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:53.536922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:53.537567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:53.538368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:53.539677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:53.540499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:53.650826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:53.668964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:53.671208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:53.672717 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56591d46-6046-43f5-aa7b-a3e7a865377b tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.171242 Oct 13 09:04:53.673612 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3304/6217] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:53 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:53.733260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:53.734598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:53.745210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:53.746300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:53.747009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:53.747972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:53.748673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:53.749340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:54.116108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.125563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.128474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.133574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a57a827-fa07-4114-9cf9-b5c1d4317203 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1751 microversion: 2.20 time: 0.404528 Oct 13 09:04:54.134798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2914/6218] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:53 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1751 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:54.703705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:54.704798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:54.718588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:54.719209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:54.719661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:54.720599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:54.727360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:54.728701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:54.907316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.919217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.921366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:54.923750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84cc6d41-77d8-464d-83bb-9b61fc07ac04 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.225379 Oct 13 09:04:54.924981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3305/6219] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:54 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:55.164911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:55.165526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:55.190202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:55.190913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:55.192027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:55.192958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:55.193587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:55.195158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:55.953235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:55.953852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:55.966834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:55.974816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:55.976891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:55.980240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:55.983101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:55.987934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:56.176279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.188806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.191253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.193297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad5c6843-0db3-4ed7-a95b-55b3561cae33 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.244308 Oct 13 09:04:56.222334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3306/6220] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:55 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:56.254682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.271987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.275133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:56.277954 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-106dd506-609a-4386-88ae-e78d3b4a46ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 1.118189 Oct 13 09:04:56.281557 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2915/6221] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:55 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:57.223466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:57.224089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:57.238947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:57.239445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:57.239886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:57.240611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:57.241067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:57.241495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:57.309609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:57.310223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:57.322324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:57.323724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:57.328890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:57.329974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:57.331210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:57.331818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:57.448016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.457568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.459052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.476520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a6ac0f0d-c0b2-4a31-b618-3c282fd9afe7 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.241485 Oct 13 09:04:57.477219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3307/6222] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:57 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:57.842178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.854560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.856030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:57.857239 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e8b66b5-0d9e-496e-addd-defe0813a1af tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.552010 Oct 13 09:04:57.870439 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2916/6223] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:57 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:04:58.511969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:58.513447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:58.525508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:58.526213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:58.526849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:58.527744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:58.528367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:58.528956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:58.688015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:58.700584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:58.702094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:58.703270 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-daef4691-cd61-4bce-9c33-77f62b8e3f97 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.195373 Oct 13 09:04:58.703836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3308/6224] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:58 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:58.885545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:58.886277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:58.897539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:58.911093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:58.911700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:58.912596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:58.913167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:58.913711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:59.274734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.311107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.318475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.322540 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3624508-2d1c-4861-9939-224387b3ce22 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.440878 Oct 13 09:04:59.344854 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2917/6225] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:58 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:04:59.737217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:04:59.738480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:04:59.754038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:59.754723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:59.756750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:59.766188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:04:59.769622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:04:59.773633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:04:59.930998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.941115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.944045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:04:59.945510 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c35adae-4fb0-4bd1-91e4-9bd99b6d44fe tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.212783 Oct 13 09:04:59.946301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3309/6226] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:04:59 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:00.378629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:00.380002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:00.430047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:00.434115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:00.436776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:00.440410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:00.441164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:00.441862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:00.762949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:00.788461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:00.795423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:00.797538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0abacd6c-8734-429f-ba7e-3f7800f61d20 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.432953 Oct 13 09:05:00.798146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2918/6227] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:00 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:00.978722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:00.980628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:01.004049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:01.008437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:01.012194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:01.013736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:01.017338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:01.018316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:01.020651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:01.154635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:01.172689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:01.184493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:01.186355 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ffd132e-1427-4118-ab77-6c5f09b568eb tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.214302 Oct 13 09:05:01.188311 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3310/6228] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:00 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:01.826255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:01.827801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:01.849132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:01.849132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:01.849132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:01.863543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:01.864250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:01.865292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:01.903655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:02.194839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.210064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.217132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:02.217847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:02.227464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.230106 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-798cf8cb-86fc-4b36-990b-717212e4d434 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.408881 Oct 13 09:05:02.232704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:02.233442 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2919/6229] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:01 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:02.234254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:02.235385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:02.236647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:02.237318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:02.238202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:02.375669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.386265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.387745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:02.388933 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a1c57066-a531-40cf-8276-66493993a0b5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.177081 Oct 13 09:05:02.390666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3311/6230] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:02 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:05:03.258975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:03.259734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:03.282849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:03.283826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:03.285470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:03.287933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:03.290895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:03.292430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:03.422921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:03.425629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:03.444823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:03.446508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:03.447445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:03.451225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:03.453833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:03.459107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:03.614311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.623832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.628390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.631918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b117a4d-66c9-474e-b6cd-42979855ffc0 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1365 microversion: 2.47 time: 0.215188 Oct 13 09:05:03.646494 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3312/6231] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:03 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:03.743752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.761304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.762886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:03.764221 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-baa563c0-8594-48da-8807-dee2eaef7dc8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.509160 Oct 13 09:05:03.777757 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2920/6232] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:03 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:04.661975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:04.663388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:04.675941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:04.676433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:04.681569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:04.682630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:04.683101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:04.685372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:04.796446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:04.797683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:04.808952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:04.809646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:04.810277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:04.811285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:04.812784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:04.813446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:04.913213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:04.926532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:04.930847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:04.936233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ec89644-cbae-4aab-b8ab-99c313dbaac3 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1371 microversion: 2.47 time: 0.278042 Oct 13 09:05:04.937944 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3313/6233] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:04 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:05.189064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:05.222082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:05.226996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:05.231919 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a62695c-e7f9-4d3e-8233-b95848063938 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.442123 Oct 13 09:05:05.237481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2921/6234] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:04 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:05.965540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:05.966425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:05.979898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:05.981355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:05.983336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:06.007042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:06.009172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:06.012371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:06.172965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.186305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.190109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.193773 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e2653b1-d938-4652-88b0-799796a3f35a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1371 microversion: 2.47 time: 0.230222 Oct 13 09:05:06.202750 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3314/6235] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:05 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:06.289925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:06.292598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:06.321987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:06.321987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:06.321987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:06.321987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:06.322848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:06.324194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:06.669305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.684991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.693554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:06.704468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-847a5014-a1a6-4ae2-9130-05ba3184046a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.418573 Oct 13 09:05:06.706028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2922/6236] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:06 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:07.233164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:07.234017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:07.251564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:07.253219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:07.254616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:07.256022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:07.265316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:07.266790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:07.527462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:07.534312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:07.548426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:07.548426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:07.557518 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f3b5c06-5a10-4b6d-a255-d89430655e5a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1371 microversion: 2.47 time: 0.326822 Oct 13 09:05:07.558142 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3315/6237] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:07 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:07.742799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:07.744180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:07.763701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:07.764126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:07.769329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:07.772379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:07.772859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:07.773727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:08.241407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.261807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.264280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.268307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5fe1a397-eea5-408d-8d06-dffa1e624f1e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.529549 Oct 13 09:05:08.277653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2923/6238] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:07 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:08.591949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:08.592738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:08.645602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:08.647284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:08.652982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:08.655367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:08.657394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:08.660612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:08.909717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.923727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.930121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:08.934761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2b4a15e6-0204-4d1c-96d0-17b22d5dbcf4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1371 microversion: 2.47 time: 0.350738 Oct 13 09:05:08.938248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3316/6239] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:08 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:09.310825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:09.312133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:09.381650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:09.382176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:09.386844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:09.387770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:09.393700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:09.393813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:09.794341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:09.809431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:09.813773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:09.817760 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-10930c0c-ec0f-43f3-8667-29947860946a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1753 microversion: 2.20 time: 0.509554 Oct 13 09:05:09.834693 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2924/6240] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:09 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1753 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:09.969221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:09.969944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:09.989785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:09.993521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:09.994941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:09.999063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:09.999836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.000512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.241572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.253425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.262740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.264888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e86b0646-4fd7-4def-99f3-a3c5568e42dd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1356 microversion: 2.47 time: 0.300633 Oct 13 09:05:10.279401 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3317/6241] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:09 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1356 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:10.300444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:10.305772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.316952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Searching by: {'deleted': False, 'project_id': '3b7a991df0bd404cb96521d3df4fd615'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 09:05:10.380611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:10.381108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.396553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.402194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:10.402749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.409936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.808908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 09:05:10.850652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:10.851520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:10.876049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:10.876049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.876049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.880116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:10.889675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.890226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.950454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.965222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:10.965717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:10.967442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:10.989709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:10.993180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:11.138793 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab0424b4-e776-44dd-986b-bfb03298ec89 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.844148 Oct 13 09:05:11.139408 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2925/6242] 10.222.0.23 () {60 vars in 1187 bytes} [Thu Oct 13 09:05:10 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:11.175109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:11.175604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:11.186057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:11.194741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:11.195446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:11.196389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:11.197022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:11.198936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:11.315214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:05:11.568565 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aa3167ce-2209-4cdd-b163-7d8f937fa1cd tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 204 len: 0 microversion: 2.47 time: 0.394134 Oct 13 09:05:11.574232 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2926/6243] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:05:11 2022] DELETE /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 09:05:11.601777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:11.603385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:11.626212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:11.650718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:11.653114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:11.658637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:11.659376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:11.661403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:11.704624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:11.730196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:11.743024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:11.748795 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-954a6779-590d-470c-af9c-5239bca70ffc tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.902642 Oct 13 09:05:11.762489 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3318/6244] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:10 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:05:12.279223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:12.296708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:12.298240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:12.300178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fab8334-6f02-4a77-b594-b81e6ccd7da4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1362 microversion: 2.47 time: 0.720608 Oct 13 09:05:12.318903 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2927/6245] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:11 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1362 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:12.777411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:12.778030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:12.795438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:12.795940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:12.796376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:12.797091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:12.797555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:12.797985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:13.332673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:13.334657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:13.360916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:13.361495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:13.361938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:13.371171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:13.372053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:13.374303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:13.645011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.647240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.660636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.663269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.665187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18d30eb6-12ea-4e04-aad8-29705ebaee3d tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1362 microversion: 2.47 time: 0.337658 Oct 13 09:05:13.671417 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2928/6246] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:13 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:13.733688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.739158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:13.740708 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8dd8bbc8-0432-4ae1-a3bf-0ea16b8e79e9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.967430 Oct 13 09:05:13.742957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3319/6247] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:12 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:14.369604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Action: 'create', calling method: .version_select at 0x7f5375eb2550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:14.404983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:14.443880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Getting quotas for project 0fef1fbea1e84eb9ab76716125c2d0e6. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:05:14.462644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Getting quotas for user 4199c089e9a2485cb72eebe39ca4ece8 and project 0fef1fbea1e84eb9ab76716125c2d0e6. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:05:14.574232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Getting quotas for project 0fef1fbea1e84eb9ab76716125c2d0e6. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:05:14.591528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Getting quotas for user 4199c089e9a2485cb72eebe39ca4ece8 and project 0fef1fbea1e84eb9ab76716125c2d0e6. Resources: {'server_groups'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:05:14.657387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6769acbe-da9a-4e6f-9d4e-e5f8489b7ed0 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.984461 Oct 13 09:05:14.664447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2929/6248] 10.222.0.23 () {62 vars in 1214 bytes} [Thu Oct 13 09:05:13 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:05:14.677305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65e82ecf-3e98-415b-9e9f-7cc1abe5df14 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:14.704318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:14.705717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:14.713650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:14.714399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:14.715523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:14.717134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:14.717669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:14.718300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:14.765892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65e82ecf-3e98-415b-9e9f-7cc1abe5df14 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.099626 Oct 13 09:05:14.768312 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3320/6249] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Oct 13 09:05:14 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:05:14.778443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:14.779387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:14.780045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:14.780769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lazy-loading 'fault' on Instance uuid c8017464-8948-49ce-b3d3-9c2b69fd1d30 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:05:14.791352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:14.800708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:14.823464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:14.824375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:14.825880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:14.829222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:14.833397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:14.834754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:14.897124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:14.910312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:14.927490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:14.933386 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8ba28ae-8865-4784-af86-f656da98365f tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 200 len: 1367 microversion: 2.47 time: 0.240006 Oct 13 09:05:14.935718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2930/6250] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:14 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:14.980438 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46f2459d-67dc-45dd-9651-6ef09c1470fc tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c/action" status: 200 len: 24575 microversion: 2.1 time: 0.205635 Oct 13 09:05:14.981104 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3321/6251] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:05:14 2022] POST /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c/action => generated 24575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:05:14.984233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:14.988965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-248c9293-6c0e-43c4-b2b8-3d06b26f1b82 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:14.990915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:15.011396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:15.015184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:15.017434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-248c9293-6c0e-43c4-b2b8-3d06b26f1b82 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d" status: 200 len: 235 microversion: 2.64 time: 0.035102 Oct 13 09:05:15.018459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:15.019457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:15.023074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:15.024467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:15.026804 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3322/6252] 10.222.0.23 () {60 vars in 1304 bytes} [Thu Oct 13 09:05:14 2022] GET /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d => generated 235 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:05:15.049870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-882131ea-3147-415e-a14f-94f979f77fad tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:15.145273 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-882131ea-3147-415e-a14f-94f979f77fad tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d" status: 204 len: 0 microversion: 2.64 time: 0.114321 Oct 13 09:05:15.147829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3323/6253] 10.222.0.23 () {60 vars in 1307 bytes} [Thu Oct 13 09:05:15 2022] DELETE /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:05:15.163611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db25c559-7ac3-4f96-ae8d-f2f23fe66992 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:15.183383 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-db25c559-7ac3-4f96-ae8d-f2f23fe66992 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] HTTP exception thrown: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db25c559-7ac3-4f96-ae8d-f2f23fe66992 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Request method failure captured: Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d HTTP/1.1 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9TJY4ItVV12dOxZKtfe8yvaQcWcbQLx-CcCP9oO7NsdOpq_W-7qseJu9NwJDHqfnEt1oynXjtcYhNkw77dopRxCQ8MDFJRc8A2_hkh41iBz29tGBqfTr-qg86gr7Tk9GlL-gg3La_2yVp9pCKNy3F7BpH1Br4aQhyt9Nx12ZObomUI Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.64 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 0fef1fbea1e84eb9ab76716125c2d0e6 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerGroup264TestJSON-12787866 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fef1fbea1e84eb9ab76716125c2d0e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fef1fbea1e84eb9ab76716125c2d0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fef1fbea1e84eb9ab76716125c2d0e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fef1fbea1e84eb9ab76716125c2d0e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerGroup264TestJSON-12787866 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 0fef1fbea1e84eb9ab76716125c2d0e6 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerGroup264TestJSON-12787866 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerGroup264TestJSON-12787866-project Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 4199c089e9a2485cb72eebe39ca4ece8 Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerGroup264TestJSON-12787866-project Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '09eb9abe-a86d-4953-81f4-c07a3d53f44d'} Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:15.188750 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. Oct 13 09:05:15.194656 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:15.196917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db25c559-7ac3-4f96-ae8d-f2f23fe66992 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] Returning 404 to user: Instance group 09eb9abe-a86d-4953-81f4-c07a3d53f44d could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:05:15.199346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db25c559-7ac3-4f96-ae8d-f2f23fe66992 tempest-ServerGroup264TestJSON-12787866 tempest-ServerGroup264TestJSON-12787866-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d" status: 404 len: 117 microversion: 2.64 time: 0.045090 Oct 13 09:05:15.200856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3324/6254] 10.222.0.23 () {60 vars in 1307 bytes} [Thu Oct 13 09:05:15 2022] DELETE /compute/v2.1/os-server-groups/09eb9abe-a86d-4953-81f4-c07a3d53f44d => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:05:15.575755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:15.595707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:15.600866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:15.605711 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cf357f1f-8cee-4725-a20a-deb5b02110cd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.656474 Oct 13 09:05:15.624758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2931/6255] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:14 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:15.967006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:15.967803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: c8017464-8948-49ce-b3d3-9c2b69fd1d30] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:16.002241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.002816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.003266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.004080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.004546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.005063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.065822 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] HTTP exception thrown: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Request method failure captured: Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 HTTP/1.1 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9SVHt3PohSvRSRagXJG5fR9c_V2SvRGij3Cs231r1MsyU3sDFjS8AEUJV_hPNTDP2gX2TUT8irXrt1ep8CsVkULdTNlozFlL6mfBz-u_Hl2v4jMRsW4X5-zNdL_5dSY4nF6fPYE0NvAraKSV5QmTkfrteUpkMvr4oautPYJL6Pz_Cg Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.47 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3b7a991df0bd404cb96521d3df4fd615 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerShowV247Test-611054136 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerShowV247Test-611054136 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3b7a991df0bd404cb96521d3df4fd615 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerShowV247Test-611054136 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerShowV247Test-611054136-project Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 60056df7dc9a4356942c71992ba527f6 Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerShowV247Test-611054136-project Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c8017464-8948-49ce-b3d3-9c2b69fd1d30'} Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:16.067616 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:16.073537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Returning 404 to user: Instance c8017464-8948-49ce-b3d3-9c2b69fd1d30 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:05:16.079071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1832010c-401c-41f7-9c1a-aea66b1ee142 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30" status: 404 len: 111 microversion: 2.47 time: 0.109250 Oct 13 09:05:16.083293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3325/6256] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:15 2022] GET /compute/v2.1/servers/c8017464-8948-49ce-b3d3-9c2b69fd1d30 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:05:16.088755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:16.089318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:16.115616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.116129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.116588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.117320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.117838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.118321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.177795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:05:16.320852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:16.429442 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08c9764e-0773-4090-b548-a9e44cd8ea06 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 204 len: 0 microversion: 2.47 time: 0.344511 Oct 13 09:05:16.430345 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2932/6257] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:05:16 2022] DELETE /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 13 09:05:16.440172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:16.440933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:16.453394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.456130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.458604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.460173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.461798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.463811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.655604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:16.656483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:16.669452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.670046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.670562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.683971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:16.684916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:16.685524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:16.895552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:16.916358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:16.921084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:16.926330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65597c1d-558e-4a5a-bfce-863391bb4278 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 200 len: 1363 microversion: 2.47 time: 0.488887 Oct 13 09:05:16.929550 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3326/6258] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:16 2022] GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:17.176591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:17.186069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:17.193254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:17.199157 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-68dfa5b7-e6c8-4a94-a4db-827dac6857e3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.547863 Oct 13 09:05:17.201561 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2933/6259] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:16 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:05:17.959072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:17.960758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:17.990807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:17.995726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:17.996475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:17.999514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:18.002752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:18.003381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:18.235406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:18.236024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:18.255644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:18.258732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.264762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:18.265434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:18.266838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:18.268473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:18.269360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:18.273174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.279864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.281117 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb94b04a-9b79-41c0-b08d-bb30c184783a tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 200 len: 1363 microversion: 2.47 time: 0.327822 Oct 13 09:05:18.281683 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3327/6260] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:17 2022] GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:18.669357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.700138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.703876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:18.709726 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6fd08959-2968-4dc1-a7e1-0daeb5675479 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.478959 Oct 13 09:05:18.713305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2934/6261] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:18 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:19.331546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:19.332373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:19.352519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:19.352934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:19.375615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:19.376576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:19.380733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:19.381180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:19.696911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:19.706182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:19.707666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60056df7dc9a4356942c71992ba527f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7a991df0bd404cb96521d3df4fd615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:19.708842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56fd37bc-ead9-4d68-8d01-43fade9938e4 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 200 len: 1363 microversion: 2.47 time: 0.383550 Oct 13 09:05:19.732588 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3328/6262] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:19 2022] GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:19.747135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:19.747750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:19.768978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:19.769477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:19.769914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:19.783254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:19.783762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:19.784209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:20.240166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:20.258777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:20.261625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:20.263624 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6507f520-f385-46da-8ed0-aadb521b0375 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.521812 Oct 13 09:05:20.265389 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2935/6263] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:19 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:20.739492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:20.740382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] [instance: d16c5b95-47d8-474e-965e-0862b12bc4bf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:20.771526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:20.772127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:20.772646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:20.783681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:20.784458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:20.785287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:20.832959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] HTTP exception thrown: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Request method failure captured: Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf HTTP/1.1 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9SVHt3PohSvRSRagXJG5fR9c_V2SvRGij3Cs231r1MsyU3sDFjS8AEUJV_hPNTDP2gX2TUT8irXrt1ep8CsVkULdTNlozFlL6mfBz-u_Hl2v4jMRsW4X5-zNdL_5dSY4nF6fPYE0NvAraKSV5QmTkfrteUpkMvr4oautPYJL6Pz_Cg Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.47 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 3b7a991df0bd404cb96521d3df4fd615 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerShowV247Test-611054136 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3b7a991df0bd404cb96521d3df4fd615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerShowV247Test-611054136 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 3b7a991df0bd404cb96521d3df4fd615 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerShowV247Test-611054136 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerShowV247Test-611054136-project Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 60056df7dc9a4356942c71992ba527f6 Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerShowV247Test-611054136-project Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd16c5b95-47d8-474e-965e-0862b12bc4bf'} Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:20.834600 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. Oct 13 09:05:20.840072 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:20.843394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] Returning 404 to user: Instance d16c5b95-47d8-474e-965e-0862b12bc4bf could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:05:20.845296 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d969edd1-6301-4581-964b-7ae2efca23c5 tempest-ServerShowV247Test-611054136 tempest-ServerShowV247Test-611054136-project] 10.222.0.23 "GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf" status: 404 len: 111 microversion: 2.47 time: 0.112612 Oct 13 09:05:20.850240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3329/6264] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:20 2022] GET /compute/v2.1/servers/d16c5b95-47d8-474e-965e-0862b12bc4bf => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:05:21.295106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:21.295903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:21.299855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:21.317347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:21.318244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:21.321526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:21.323217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:21.323915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:21.324567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:21.704199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:21.733833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:21.739214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:21.741596 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea65b0ea-e814-4d09-9f68-f8beb29ec76f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.450899 Oct 13 09:05:21.753022 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2936/6265] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:21 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:22.777523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:22.779078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:22.805636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:22.817094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:22.818520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:22.820888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:22.821509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:22.822277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:24.297838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:24.311857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:24.330445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:24.345477 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac5c8263-9b6d-404a-86ef-72f3c09eb341 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 1.565842 Oct 13 09:05:24.366920 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3330/6266] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:22 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:25.383975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:25.388819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:25.393847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:25.417920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:25.421703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:25.426075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:25.433058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:25.437575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:25.441869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:27.067884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:27.082661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:27.098354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:27.107737 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0619b42-05e3-4645-aac5-b38d27eb7c1d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 1.729121 Oct 13 09:05:27.108351 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2937/6267] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:25 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:28.144535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:28.145351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:28.174656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:28.176887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:28.182536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:28.186885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:28.187443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:28.187963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:29.110636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:29.129050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:29.130525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:29.131720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97b37166-ddcc-4d02-89a8-af6445637556 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.992046 Oct 13 09:05:29.132304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3331/6268] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:28 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:29.938439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ccdaac4-f45a-4734-ba92-05950219bd39 tempest-ComputeTenantNetworksTest-2010044971 tempest-ComputeTenantNetworksTest-2010044971-project] Calling method '.version_select at 0x7f5375c03310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:30.160370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:30.160985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:30.176109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:30.179414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:30.182468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:30.183475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:30.184147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:30.184779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:30.641114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:30.656682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:30.660532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:30.664701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ed092828-a8a4-4cab-822a-6f2ee459ef26 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.508796 Oct 13 09:05:30.665445 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3332/6269] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:30 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:30.816197 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ccdaac4-f45a-4734-ba92-05950219bd39 tempest-ComputeTenantNetworksTest-2010044971 tempest-ComputeTenantNetworksTest-2010044971-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.511579 Oct 13 09:05:30.818296 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2938/6270] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 09:05:29 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:30.830825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d45c22f-49b5-4fba-a577-bb159b211ad6 tempest-ComputeTenantNetworksTest-2010044971 tempest-ComputeTenantNetworksTest-2010044971-project] Calling method '.version_select at 0x7f537543d790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:31.058669 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d45c22f-49b5-4fba-a577-bb159b211ad6 tempest-ComputeTenantNetworksTest-2010044971 tempest-ComputeTenantNetworksTest-2010044971-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/09f82bae-6f21-4d7a-9d20-dbad01cc27a0" status: 200 len: 140 microversion: 2.1 time: 0.233863 Oct 13 09:05:31.065534 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3333/6271] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 09:05:30 2022] GET /compute/v2.1/os-tenant-networks/09f82bae-6f21-4d7a-9d20-dbad01cc27a0 => generated 140 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:31.697977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:31.698588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:31.722936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:31.723503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:31.723952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:31.724679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:31.725242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:31.725780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:32.803856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:32.824827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:32.831180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:32.838102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-527bd04e-e82a-499c-be1f-4d5d2e2dd7f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 1.140766 Oct 13 09:05:32.841955 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2939/6272] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:31 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:33.877209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:33.878212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:33.890641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:33.893329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:33.894169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:33.894842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:33.895725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:33.896546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:33.907020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:34.579531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:34.607802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:34.609496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:34.611770 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f8c84a8-01e1-46fa-ab61-b1be68ea9036 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.750876 Oct 13 09:05:34.620396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3334/6273] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:33 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:34.931741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c8f5e09-d846-49f9-99d0-693842503846 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Action: 'create', calling method: .version_select at 0x7f5375d39550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-855828267", "metadata": {"Type": "work"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:35.652906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:35.655662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:35.686769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:35.694488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:35.697055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:35.698477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:35.702604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:35.704832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:35.756878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c8f5e09-d846-49f9-99d0-693842503846 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.119799 Oct 13 09:05:35.765697 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2940/6274] 10.222.0.23 () {60 vars in 1156 bytes} [Thu Oct 13 09:05:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1145 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 09:05:35.772037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61e79415-b153-4b61-85da-a74eb3c30f22 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375f44550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:35.944336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61e79415-b153-4b61-85da-a74eb3c30f22 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.176918 Oct 13 09:05:35.944909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2941/6275] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:35 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:36.163107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:36.193462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:36.199479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:36.206462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9a90f63-4242-460d-b2ab-ed381485c527 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.564724 Oct 13 09:05:36.212208 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3335/6276] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:35 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:36.965356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6e0bf85-7b14-4c80-83e0-9797c7168fc9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375c03310>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:37.216742 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6e0bf85-7b14-4c80-83e0-9797c7168fc9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.260766 Oct 13 09:05:37.217589 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2942/6277] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:36 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:37.259478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:37.265722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:37.373771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:37.375138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:37.378220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:37.379444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:37.383177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:37.391321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:38.097557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:38.122348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:38.131646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:38.136512 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44c90d2e-918c-4937-8859-ceb66b909408 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.903078 Oct 13 09:05:38.140091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3336/6278] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:37 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:38.245467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98cfe6a4-3d2e-4557-ab4e-e71d104238b1 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375d16b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:38.371673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98cfe6a4-3d2e-4557-ab4e-e71d104238b1 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 353 microversion: 2.1 time: 0.141015 Oct 13 09:05:38.372436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2943/6279] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:38 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:38.386715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6010bd9e-fa15-4d67-97a9-6b06fd42951d tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375537040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:38.489259 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6010bd9e-fa15-4d67-97a9-6b06fd42951d tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 353 microversion: 2.1 time: 0.106727 Oct 13 09:05:38.490204 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3337/6280] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:38 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:38.505565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c43bd576-a055-4da3-a1bd-8be28d88f2ef tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375d16160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:38.656780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c43bd576-a055-4da3-a1bd-8be28d88f2ef tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 202 len: 0 microversion: 2.1 time: 0.156096 Oct 13 09:05:38.658729 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2944/6281] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:05:38 2022] DELETE /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:05:38.666014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1217bd6-d36e-42bb-8bdc-22098eb2b9ca tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5376fad9d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:38.816266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1217bd6-d36e-42bb-8bdc-22098eb2b9ca tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.154252 Oct 13 09:05:38.817243 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3338/6282] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:38 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:39.169638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:39.170379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:39.183601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:39.185297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:39.187361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:39.189456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:39.190156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:39.191760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:39.832408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-13919a6e-ef7d-46e7-beec-4d7b508944b9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f53754ce670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:39.987070 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-13919a6e-ef7d-46e7-beec-4d7b508944b9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.153148 Oct 13 09:05:39.988209 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3339/6283] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:39 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:05:39.997124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:40.023633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:40.027194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:40.028660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3a5fc277-8230-4c03-b8a0-ec6e84b759d4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.863377 Oct 13 09:05:40.044688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2945/6284] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:39 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:41.006588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f834f3e-5d36-48d7-be1d-809d76904368 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f53754950d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:41.059846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:41.060461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:41.074345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:41.074877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:41.075323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:41.083159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:41.083656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:41.084107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:41.218784 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f834f3e-5d36-48d7-be1d-809d76904368 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.219899 Oct 13 09:05:41.220822 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3340/6285] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:40 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:41.587836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:41.601888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:41.632122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:41.633946 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f075c8fd-2b88-44c2-90bc-2695f152bd68 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.578912 Oct 13 09:05:41.636922 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2946/6286] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:41 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:42.237639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-efc68e55-b3eb-43e0-8164-557b1d0716d9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f53754bd670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:42.419316 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-efc68e55-b3eb-43e0-8164-557b1d0716d9 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.189705 Oct 13 09:05:42.419902 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3341/6287] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:42 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:42.667878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:42.669292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:42.698912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:42.700549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:42.700983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:42.701761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:42.702233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:42.707481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:43.168165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:43.199443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:43.206465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:43.213102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-feecd7c5-8a28-4403-98de-9ffe59a5eef0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.551591 Oct 13 09:05:43.224590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2947/6288] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:42 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:43.434634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-677ce682-b77a-47ba-9c97-43e570012f76 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375478ca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:43.526023 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-677ce682-b77a-47ba-9c97-43e570012f76 tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 200 len: 352 microversion: 2.1 time: 0.095593 Oct 13 09:05:43.527045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3342/6289] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:43 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:44.252483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:44.253485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:44.269219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:44.271674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:44.272356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:44.275468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:44.277166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:44.277862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:44.932903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "name": "network-vif-plugged", "status": "completed", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:44.971454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:44.972059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:44.973495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:45.018991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=88 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:45.033678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] Creating event network-vif-plugged:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:05:45.066987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-fc9e211e-9fed-438d-b9d0-d1f7eb7c38c1 req-d1dfab99-ac8f-41ad-a4a9-b8d24f53a37b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.588026 Oct 13 09:05:45.077814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3343/6290] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:05:45.105562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d9a5012-5d6c-4938-be41-e733663194be tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Calling method '.version_select at 0x7f5375478c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:45.320570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-2d9a5012-5d6c-4938-be41-e733663194be tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] HTTP exception thrown: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d9a5012-5d6c-4938-be41-e733663194be tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Request method failure captured: Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 HTTP/1.1 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Tem22BRWnEnUp3luSJexP3X69mltES9decHTS63M74dxX_m-L0WZ8ZddXLWzLNg8N809boYThFAHnCpXFRFswxM_qTR9SPnZJr4nPlhGfL2m46c_akrMc6Ozm3DqW9DX8IqZXBuKxDzEAjaaG10FjzpJhuUcuRwi7Jou9_QS6aXVg Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4570694cbc4e498ca90c2f476e68e6f9 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesGetTestJSON-2100273891 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4570694cbc4e498ca90c2f476e68e6f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4570694cbc4e498ca90c2f476e68e6f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4570694cbc4e498ca90c2f476e68e6f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4570694cbc4e498ca90c2f476e68e6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesGetTestJSON-2100273891 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4570694cbc4e498ca90c2f476e68e6f9 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesGetTestJSON-2100273891 Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesGetTestJSON-2100273891-project Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c2d8906ec1f84554a7c73293bbfe5fcc Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesGetTestJSON-2100273891-project Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: method: Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: exception: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4fa41fac-0c16-430d-ab54-32f7edf9bb26'} Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. (HTTP 404) (Request-ID: req-7bcc8e1b-8beb-4cd0-90d6-4d58ce6a80b5) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:05:45.326011 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d9a5012-5d6c-4938-be41-e733663194be tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] Returning 404 to user: Volume 4fa41fac-0c16-430d-ab54-32f7edf9bb26 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d9a5012-5d6c-4938-be41-e733663194be tempest-VolumesGetTestJSON-2100273891 tempest-VolumesGetTestJSON-2100273891-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26" status: 404 len: 109 microversion: 2.1 time: 0.248294 Oct 13 09:05:45.333309 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3344/6291] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:05:45 2022] GET /compute/v2.1/os-volumes/4fa41fac-0c16-430d-ab54-32f7edf9bb26 => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:05:45.392730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:45.410987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:45.424470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:45.431584 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40284fea-57a1-4691-9dfc-b578ea4b259d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 1.184666 Oct 13 09:05:45.446846 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2948/6292] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:44 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:45.495548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Calling method '.version_select at 0x7f53754ce700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:45.497667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:45.498489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:45.499117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:45.553275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:45.554037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:45.554748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:45.584761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:45.589865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:45.591073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:45.608516 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22f5fbc3-a3b3-4bab-b089-56ab00df9cd0 tempest-PortsAdminExtendedAttrsTestJSON-2132553076 tempest-PortsAdminExtendedAttrsTestJSON-2132553076-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.273580 Oct 13 09:05:45.624836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3345/6293] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 09:05:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:46.262891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:46.265329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:46.288575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:46.299166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:46.299698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:46.302357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:46.303138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:46.303616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:46.304061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:46.381980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:46.450435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a9391c9a-f9f0-40d6-957d-ac7bb46b58a1 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "POST /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c/action" status: 200 len: 32650 microversion: 2.1 time: 0.191783 Oct 13 09:05:46.464664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:46.465292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:46.467734 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2949/6294] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:05:46 2022] POST /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c/action => generated 32650 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:05:46.491227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:46.491725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:46.492187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:46.492931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:46.493410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:46.493831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:47.168989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:47.181295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:47.187936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:47.192094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6cae0b41-b4c1-40de-8831-7d9add0fcb83 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.731460 Oct 13 09:05:47.195244 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3346/6295] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:46 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:05:47.252305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-848311383", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "d0c2c970-478e-4561-9798-f8e87bd864c8"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:47.385356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] validate_networks() for [('d0c2c970-478e-4561-9798-f8e87bd864c8', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:05:48.223823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:48.224836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:48.236495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:48.240152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:48.242244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:48.251010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:48.251010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:48.251010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:48.792245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:05:48.794042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:05:48.794905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:05:48.795564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:05:48.796345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:05:48.815511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:48.816856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:48.818615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:48.822345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:48.823034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:48.824473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:48.881132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:48.890914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:48.897863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Getting quotas for project 1771341959c64b48a5cafb4b93b268c2. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:05:48.907489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:48.913681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61d2a2cd-009e-4f35-b3f9-47c539f177c7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1809 microversion: 2.20 time: 0.692536 Oct 13 09:05:48.917543 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3347/6296] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:48 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1809 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:05:48.920620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Getting quotas for user a40af118e8814cdfb47b29cfb6be09ef and project 1771341959c64b48a5cafb4b93b268c2. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:05:48.958360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:05:48.963626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:05:49.097977 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3722877e-fc98-4f3f-8c28-be1155f59f63 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.191868 Oct 13 09:05:49.118268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1fcdfafb-2bef-4337-b65a-7827c856a4ed tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:49.118932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1fcdfafb-2bef-4337-b65a-7827c856a4ed tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:49.132606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2950/6297] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:05:49.234815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:49.235625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:49.247836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.248347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.248798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.259884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.260307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.260758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.289085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1fcdfafb-2bef-4337-b65a-7827c856a4ed tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:49.298843 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1fcdfafb-2bef-4337-b65a-7827c856a4ed tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1215 microversion: 2.1 time: 0.184144 Oct 13 09:05:49.303862 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3348/6298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:49 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:49.414861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:05:49.760723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fb18e5-30b4-4678-8938-a98c3e76926c", "tag": "c870c6e9-8823-4701-a988-2b3681feb008"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:49.769693 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5473ea2-2a5f-4ec1-9cca-766cd2a961aa tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 204 len: 0 microversion: 2.1 time: 0.538784 Oct 13 09:05:49.777037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.777663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.778677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.780192 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2951/6299] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:05:49 2022] DELETE /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:05:49.796754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] Creating event network-changed:c870c6e9-8823-4701-a988-2b3681feb008 for instance f5fb18e5-30b4-4678-8938-a98c3e76926c on n-h2-858384-11 Oct 13 09:05:49.800793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:49.801534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:49.805560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7b933f7b-b7f6-45c5-a002-bd7f473889e6 req-604280c1-e158-4820-8903-d1dafd5ca35d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502933 Oct 13 09:05:49.806760 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3349/6300] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:49.831929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.832748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.836208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.840463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.841504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.843465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.952630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:49.953382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:49.975664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.976901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.979969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:49.982989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:49.986154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:49.987940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:50.275027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:50.289589 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84175784-217d-4504-abed-fa5712980022 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1668 microversion: 2.1 time: 0.504293 Oct 13 09:05:50.292702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2952/6301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:49 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1668 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:50.331127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:50.331867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:50.356798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:50.361634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:50.362555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:50.367160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:50.368062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:50.369611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:50.371801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:50.397745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:50.399973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:50.405339 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e490a61-a08b-44ee-8844-b2bbb5036e37 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1796 microversion: 2.20 time: 0.456090 Oct 13 09:05:50.436074 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3350/6302] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:05:49 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1796 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:05:50.576583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:50.586473 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e39f355-111e-482d-8fc3-deb2ba757c73 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1219 microversion: 2.1 time: 0.265042 Oct 13 09:05:50.599387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2953/6303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:50 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1219 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:51.322719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:51.323887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:51.340644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:51.342264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:51.343387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:51.345877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:51.347477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:51.348151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:51.611233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:51.611925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:51.623961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:51.626851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:51.628487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:51.632340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:51.633043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:51.635089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:52.120359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:52.129357 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e0357188-6ac8-437a-b78c-073d4b484030 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1285 microversion: 2.1 time: 0.522697 Oct 13 09:05:52.129952 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2954/6304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:51 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1285 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:52.364489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:52.373033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a062fd6-f595-4eb1-896a-896e19950c73 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1668 microversion: 2.1 time: 1.054546 Oct 13 09:05:52.374008 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3351/6305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:51 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1668 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:52.804940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fb18e5-30b4-4678-8938-a98c3e76926c", "name": "network-vif-deleted", "tag": "c870c6e9-8823-4701-a988-2b3681feb008"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:52.868539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:52.869101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:52.869743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:52.898090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] Creating event network-vif-deleted:c870c6e9-8823-4701-a988-2b3681feb008 for instance f5fb18e5-30b4-4678-8938-a98c3e76926c on n-h2-858384-11 Oct 13 09:05:52.903779 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-06785963-55d5-4857-9d2c-615404d25780 req-d248c572-5f93-46e3-80fd-48e83ba1d9d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102395 Oct 13 09:05:52.905702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2955/6306] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:05:53.189329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:53.190332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:53.234166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:53.248169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:53.249117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:53.264155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:53.265575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:53.269371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:53.402075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:53.406132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:53.425438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:53.426193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:53.434381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:53.435559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:53.436289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:53.437163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:53.515546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:53.525287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4108b9a5-9433-4108-9a8d-ffc2be11231c tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1273 microversion: 2.1 time: 0.372885 Oct 13 09:05:53.534304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3352/6307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:53 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:53.574362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:53.576245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:53.584079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:53.592974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lazy-loading 'fault' on Instance uuid f5fb18e5-30b4-4678-8938-a98c3e76926c {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:05:53.759608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd21e2f3b05c244c49a19dcbb7bb2fa5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3cc724833843f2b8feedac21a297e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:53.813294 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4417cc27-3ac1-41ee-8af9-8dda7ca064ab tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 200 len: 1338 microversion: 2.1 time: 0.417325 Oct 13 09:05:53.814070 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2956/6308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:53 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:54.575779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:54.585657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:54.610092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:54.611192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:54.613646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:54.615455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:54.620480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:54.621712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:54.838837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:54.840290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] [instance: f5fb18e5-30b4-4678-8938-a98c3e76926c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:54.865951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:54.868629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:54.869637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:54.869637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:54.869953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:54.873904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:54.932221 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] HTTP exception thrown: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Request method failure captured: Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c HTTP/1.1 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9O0bUNKsKefHACVGhJD80fKNfpPzZFBxneceacQEOtqjDEEzC34ZEv3_Qh5KiPpMN3btQcwZqPdVmRD2uFekWjiwq8-HXnRnAmZCgtdTGbUNkNC0lYUGtQWW0JRGgpzpeleRvWKE49uF3QR0wQ-T7mMEqZOAUi5qv0Pi7X6trzZe74 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8d3cc724833843f2b8feedac21a297e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 8d3cc724833843f2b8feedac21a297e0 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkBasicOps-1386725237 Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: d21e2f3b05c244c49a19dcbb7bb2fa5e Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkBasicOps-1386725237-project Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f5fb18e5-30b4-4678-8938-a98c3e76926c'} Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:05:54.939548 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. Oct 13 09:05:54.946333 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:05:54.950171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Returning 404 to user: Instance f5fb18e5-30b4-4678-8938-a98c3e76926c could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:05:54.953297 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2668d0bf-3a2b-4a36-9d54-ea3984298d44 tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c" status: 404 len: 111 microversion: 2.1 time: 0.119157 Oct 13 09:05:54.960419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2957/6309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:54 2022] GET /compute/v2.1/servers/f5fb18e5-30b4-4678-8938-a98c3e76926c => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:05:55.316478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:55.337227 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de8ef4b9-3cf4-4691-a244-5971ec9e1074 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.772842 Oct 13 09:05:55.338931 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3353/6310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:54 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:55.531898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-674e654c-f64e-46c9-a47c-d8b1adccb5cb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] Calling method '.version_select at 0x7f5375f04550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:55.579709 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-674e654c-f64e-46c9-a47c-d8b1adccb5cb tempest-TestNetworkBasicOps-1386725237 tempest-TestNetworkBasicOps-1386725237-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-317388973" status: 202 len: 0 microversion: 2.1 time: 0.049976 Oct 13 09:05:55.580654 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2958/6311] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 13 09:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-317388973 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:05:56.368434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:56.374249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:56.389648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:56.390338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:56.390933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:56.393543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:56.394741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:56.395311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:56.929188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:56.952721 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-256afff9-39af-4108-9487-225f960c8774 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.589458 Oct 13 09:05:56.961917 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3354/6312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:56 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:05:57.994771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:57.996390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:57.997219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db774dc6-02e9-471a-9b55-571c74762de4", "tag": "a63f93f7-e711-4d41-8a6e-f2ba19d9636e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:05:58.056828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:58.064445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:58.069190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:58.072866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:58.079103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:58.079821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:58.087710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:58.088301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:58.088754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:58.135055 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] Creating event network-changed:a63f93f7-e711-4d41-8a6e-f2ba19d9636e for instance db774dc6-02e9-471a-9b55-571c74762de4 on n-h1-858384-11 Oct 13 09:05:58.149270 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bc83b7fe-83d0-4aed-bb15-ccaa21dc57dc req-17829a37-4ac1-48ad-b276-f4a09689a7bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166574 Oct 13 09:05:58.156249 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2959/6313] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:05:58.900407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:05:58.911711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20c2a480-9d74-4d48-9ccb-5217dbd9104b tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.926051 Oct 13 09:05:58.923427 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3355/6314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:57 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:05:59.937410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:59.939228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:05:59.945994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:05:59.946983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:05:59.992970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:59.993849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:59.994565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:05:59.996902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:05:59.997802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:05:59.998942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:00.795438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:00.822890 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-97360bc5-90e3-4922-bddf-4e4cf86dfca2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.886289 Oct 13 09:06:00.841549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2960/6315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:05:59 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:01.850929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:01.852147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:01.855595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:01.869792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:01.871741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:01.872321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:01.873302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:01.873990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:01.874822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:02.167741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:02.180406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e736588-a0d7-4e06-a61a-fb4943992137 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.336690 Oct 13 09:06:02.181718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3356/6316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:01 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:03.211484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:03.212978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:03.228351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:03.228851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:03.229296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:03.235286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:03.235803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:03.236328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:03.549171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:03.562561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45292db5-2636-4102-a246-c5c4af5951be tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.357158 Oct 13 09:06:03.563274 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2961/6317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:03 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:04.594885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:04.596406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:04.613366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:04.618132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:04.620366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:04.622644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:04.625062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:04.626088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:04.626553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:05.199603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:05.221748 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3661b04b-5453-4158-b168-2d1f5b846fa9 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.631287 Oct 13 09:06:05.224852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3357/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:04 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:06.253970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:06.254956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:06.270758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:06.271709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:06.272463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:06.275498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:06.276274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:06.278577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:06.568386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db774dc6-02e9-471a-9b55-571c74762de4", "name": "network-vif-plugged", "status": "completed", "tag": "a63f93f7-e711-4d41-8a6e-f2ba19d9636e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:06.587285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:06.590267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:06.591151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:06.620190 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] Creating event network-vif-plugged:a63f93f7-e711-4d41-8a6e-f2ba19d9636e for instance db774dc6-02e9-471a-9b55-571c74762de4 on n-h1-858384-11 Oct 13 09:06:06.644614 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cf65b1f7-6b18-4f78-9010-e4121144f2c5 req-60abf73c-539f-4c58-afd4-c135233a3156 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079617 Oct 13 09:06:06.645239 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3358/6319] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:06:07.169919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:07.169919 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e43ac46-1313-4f49-afe3-e0ab45e04cf2 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1315 microversion: 2.1 time: 0.884300 Oct 13 09:06:07.169919 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2962/6320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:06 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:08.166686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:08.168529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:08.213805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:08.217878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:08.219995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:08.222499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:08.229989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:08.232837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.038126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:09.046638 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0734e4c6-81ea-4fc4-b8fc-3458a4fce541 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1503 microversion: 2.1 time: 0.885887 Oct 13 09:06:09.047349 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3359/6321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:08 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1503 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:09.073420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:09.073975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:09.089963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.090493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.091006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.091923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.092382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.092844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.272533 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-35da7878-bf98-479d-8171-c92ff13f8139 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.201834 Oct 13 09:06:09.274311 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2963/6322] 10.222.0.23 () {58 vars in 1296 bytes} [Thu Oct 13 09:06:09 2022] DELETE /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4/os-server-password => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:06:09.284391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:09.284881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:09.298097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.302703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.303261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.304038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.304680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.304945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.362378 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5aa5c930-23e2-48c9-80d4-eaeb67186d75 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.079720 Oct 13 09:06:09.363448 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3360/6323] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Oct 13 09:06:09 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4/os-server-password => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:06:09.385884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:09.385884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:09.420837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.421704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.427060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.432201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.434681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.439444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.595367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:06:09.728225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:09.790760 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a969215-e0de-4822-a804-5c905d141f23 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 204 len: 0 microversion: 2.1 time: 0.421120 Oct 13 09:06:09.794833 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2964/6324] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:06:09 2022] DELETE /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:06:09.803499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:09.804647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:09.815821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.824681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.825449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:09.827087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:09.827748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:09.828751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:10.299828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:10.311388 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5650b2e-9ce2-4972-8be4-e82ccaf63ec5 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1509 microversion: 2.1 time: 0.510920 Oct 13 09:06:10.315711 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3361/6325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:09 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:11.350577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:11.351372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:11.375804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:11.386463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:11.388589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:11.395344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:11.400446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:11.401658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:11.892086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:11.900623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5024c7cf-3f25-4677-9acf-af2f65ab6590 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1509 microversion: 2.1 time: 0.563010 Oct 13 09:06:11.909419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2965/6326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:11 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1509 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:12.935948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:12.937288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:12.960081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:12.960575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:12.961067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:12.961734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:12.962197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:12.962709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:13.419250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a40af118e8814cdfb47b29cfb6be09ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1771341959c64b48a5cafb4b93b268c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:13.423163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db774dc6-02e9-471a-9b55-571c74762de4", "name": "network-vif-deleted", "tag": "a63f93f7-e711-4d41-8a6e-f2ba19d9636e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:13.439346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a89f26dc-8497-4f57-917d-90a6c56f4552 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 200 len: 1467 microversion: 2.1 time: 0.509120 Oct 13 09:06:13.458485 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3362/6327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:12 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 1467 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:13.462056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:13.469620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:13.470303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:13.505615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] Creating event network-vif-deleted:a63f93f7-e711-4d41-8a6e-f2ba19d9636e for instance db774dc6-02e9-471a-9b55-571c74762de4 on n-h1-858384-11 Oct 13 09:06:13.529003 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f0376e18-6409-4acf-906e-a333fd6bb31a req-5827989b-87df-4afe-8c3c-5cddd338ccb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116410 Oct 13 09:06:13.529938 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2966/6328] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:06:14.476760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:14.477388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] [instance: db774dc6-02e9-471a-9b55-571c74762de4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:14.493382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:14.493892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:14.494342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:14.495136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:14.495625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:14.496080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:14.589450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] HTTP exception thrown: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Request method failure captured: Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 HTTP/1.1 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Tq19C_Mykg7-C1O3LTRSleoPeX3DTf7OlJ6AITNnzrRRnwrgj_CtLujZ9dyqRkjGEBLepJZmwQKNE7NJqTCQ2pQkEfmyBttQwiWFompKjYS4yO6dbhHqcJ3Dc8F9pFeIKZwBDEKPqMUCvTjK5sw0xceVdp0hHwFQezh4aLwCmcjVg Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 1771341959c64b48a5cafb4b93b268c2 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerPasswordTestJSON-559331847 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1771341959c64b48a5cafb4b93b268c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1771341959c64b48a5cafb4b93b268c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1771341959c64b48a5cafb4b93b268c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1771341959c64b48a5cafb4b93b268c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerPasswordTestJSON-559331847 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 1771341959c64b48a5cafb4b93b268c2 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerPasswordTestJSON-559331847 Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerPasswordTestJSON-559331847-project Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: a40af118e8814cdfb47b29cfb6be09ef Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerPasswordTestJSON-559331847-project Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'db774dc6-02e9-471a-9b55-571c74762de4'} Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:06:14.600527 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. Oct 13 09:06:14.605597 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:14.608912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] Returning 404 to user: Instance db774dc6-02e9-471a-9b55-571c74762de4 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:06:14.623887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f514265-4d2f-475f-867e-21f2f1f34dd8 tempest-ServerPasswordTestJSON-559331847 tempest-ServerPasswordTestJSON-559331847-project] 10.222.0.23 "GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4" status: 404 len: 111 microversion: 2.1 time: 0.151304 Oct 13 09:06:14.626125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3363/6329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:14 2022] GET /compute/v2.1/servers/db774dc6-02e9-471a-9b55-571c74762de4 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:06:22.665497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:22.671824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:22.680160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:22.700025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:22.701326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:22.705460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:22.706668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:22.711722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:22.712499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:22.814169 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a55c01ca-10f3-49b2-813a-0e0ad3e9766f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments/35c500ce-9026-4bbf-8a60-1c6ed2eb8808" status: 200 len: 194 microversion: 2.20 time: 0.164926 Oct 13 09:06:22.817159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2967/6330] 10.222.0.23 () {60 vars in 1454 bytes} [Thu Oct 13 09:06:22 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments/35c500ce-9026-4bbf-8a60-1c6ed2eb8808 => generated 194 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:23.054564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:23.056568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:23.080082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:23.085004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:23.085841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:23.087654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:23.092242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:23.092986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:23.166929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:23.366783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lazy-loading 'services' on Instance uuid 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:06:23.663035 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9173a5bb-8921-42d2-a71e-0853e7f1daae tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments/35c500ce-9026-4bbf-8a60-1c6ed2eb8808" status: 202 len: 0 microversion: 2.20 time: 0.616360 Oct 13 09:06:23.666940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3364/6331] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 13 09:06:23 2022] DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments/35c500ce-9026-4bbf-8a60-1c6ed2eb8808 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:06:23.675381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:23.679767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:23.702574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:23.711795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:23.711795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:23.712557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:23.713272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:23.718118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:23.835415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7312541-81a0-49da-8659-461436f9db17 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164625 Oct 13 09:06:23.839071 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2968/6332] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:23 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:24.889760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:24.895718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:24.905834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:24.907408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:24.908016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:24.908909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:24.909485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:24.910031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:24.952650 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db89a7e7-9831-4418-85d4-d5b10a87d8e1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094640 Oct 13 09:06:24.958178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3365/6333] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:24 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:25.968329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:25.970683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:26.002589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:26.019174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:26.021537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:26.026908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:26.030237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:26.047784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:26.246966 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59412fe6-c6e1-4c4e-ac99-5b4ed3c372eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.262036 Oct 13 09:06:26.249408 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2969/6334] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:25 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:27.265156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:27.268386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:27.289528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:27.310722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:27.311873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:27.312926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:27.317677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:27.319691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:27.450297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c462e61-3b91-4411-add1-74fc834306a8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189381 Oct 13 09:06:27.472702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3366/6335] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:27 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:28.478613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:28.483229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:28.519843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:28.520871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:28.521526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:28.522477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:28.524022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:28.526084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:28.630361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43d5885c-56b4-456f-9101-2b54e61f2cd1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157879 Oct 13 09:06:28.637787 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2970/6336] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:28 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:29.645923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:29.648725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:29.679204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:29.683827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:29.684241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:29.685000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:29.689412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:29.689878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:29.821967 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23aa15f6-8624-42ba-9b5a-e5a84be5e651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179198 Oct 13 09:06:29.830922 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3367/6337] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:29 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 09:06:30.838448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:30.841401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:30.899688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:30.900515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:30.902052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:30.905432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:30.909804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:30.910686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:31.034932 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60532eb2-7684-4b81-96f8-bad988a68f34 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196534 Oct 13 09:06:31.044054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2971/6338] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:30 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:32.052738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:32.056473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:32.092252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:32.094428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:32.095407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:32.097686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:32.100228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:32.104994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:32.318935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18a436a6-07bc-41a2-94b7-1cf51dffaab8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.270909 Oct 13 09:06:32.327989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3368/6339] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:32 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:33.351646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:33.354887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:33.388037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:33.396048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:33.398724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:33.402434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:33.403614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:33.405366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:33.615334 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84870e60-8e0d-49cf-b155-e08a710abbd6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.275567 Oct 13 09:06:33.618961 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2972/6340] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:33 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:34.631516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:34.634770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:34.647657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=24 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:34.655238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:34.656622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:34.659090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:34.660163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:34.663033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:34.663700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:34.774395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-12163e92-e2d6-4d89-9990-d6fe426f2288 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145721 Oct 13 09:06:34.776024 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3369/6341] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:34 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:35.789162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:35.792302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:35.808123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:35.808642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:35.809095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:35.809838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:35.810296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:35.810766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:35.917477 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5a2a95a3-204a-46f7-ac01-994155d20da7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133810 Oct 13 09:06:35.931047 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2973/6342] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:35 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:36.929486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:36.932032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:36.951189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:36.953772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:36.954240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:36.964097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:36.966829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:36.972519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:37.105575 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ffa9d13-de05-4a7d-bc7d-481c40711767 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180031 Oct 13 09:06:37.110656 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3370/6343] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:36 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:38.123383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:38.126786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:38.146854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:38.149588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:38.153966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:38.156246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:38.159680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:38.169226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:38.324612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc093694-3467-48a3-815f-430adff759db tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.203888 Oct 13 09:06:38.327979 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2974/6344] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:38 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:39.365115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:39.375893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:39.408060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:39.415888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:39.417124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:39.420536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:39.421736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:39.422355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:39.467560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2bf95689-aa90-4cfa-bf47-c89c47257ddf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.131580 Oct 13 09:06:39.469024 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3371/6345] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:39 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:40.486547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:40.486547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:40.545115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:40.549350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:40.549960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:40.553814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:40.555121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:40.559220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:40.684567 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-86e96463-59ec-4764-8c1f-d97242ef6257 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207474 Oct 13 09:06:40.690543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2975/6346] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:40 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:06:41.699558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:41.702237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:41.722590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:41.723087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:41.723529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:41.724257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:41.724709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:41.725135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:41.869481 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e81b5249-cb8c-4cf2-805d-9cea6a72ebcd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.174234 Oct 13 09:06:41.875220 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3372/6347] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:06:41 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:42.063866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:42.064514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:42.081677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:42.082330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:42.082923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:42.096883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:42.097633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:42.103138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:42.111120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=63 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:42.188314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:06:42.516712 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b83aa5ff-1fe1-4132-a9ed-8046ca53898c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 204 len: 0 microversion: 2.20 time: 0.457047 Oct 13 09:06:42.525314 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2976/6348] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:06:42 2022] DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:06:42.544040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:42.545039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:42.593172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:42.594387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:42.595049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:42.595961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:42.596609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:42.597211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:43.706335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:43.742220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:43.752500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:43.753778 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0eb4c14-22ec-4a85-8607-071a86d42be4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 1.227225 Oct 13 09:06:43.754382 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3373/6349] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:42 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:06:44.788381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:44.789857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:44.803617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:44.804497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:44.805708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:44.806742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:44.807452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:44.808171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:45.616415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:45.683229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:45.688814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:45.690878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-579e7415-4e2d-4215-8acf-ea8b94ea0a12 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1724 microversion: 2.20 time: 0.906758 Oct 13 09:06:45.692445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2977/6350] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:44 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1724 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:06:46.725814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:46.730119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:46.746101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:46.746643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:46.758606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:46.759596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:46.764501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:46.765537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:47.059148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:47.072555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:47.074243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:47.081347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d28f6d80-b281-441b-908a-43776a80da8a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1657 microversion: 2.20 time: 0.360965 Oct 13 09:06:47.084212 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3374/6351] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:46 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1657 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:06:48.113772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:48.115362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:48.139954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:48.147030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:48.147751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:48.148699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:48.149994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:48.150663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:48.480800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:48.497284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:48.498610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:48.499918 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ce65984-08d5-449e-a1c0-cef687b79003 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1657 microversion: 2.20 time: 0.390119 Oct 13 09:06:48.500497 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2978/6352] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:48 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1657 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:06:48.558698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6", "name": "network-vif-deleted", "tag": "0070f6c9-1e82-4422-8cb2-5014cb4c0f19"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:48.597880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:48.598647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:48.599391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:48.635403 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] Creating event network-vif-deleted:0070f6c9-1e82-4422-8cb2-5014cb4c0f19 for instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 on n-h1-858384-11 Oct 13 09:06:48.649542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b1ab665a-4faf-4802-9f53-5b4e74c97626 req-b564ebfa-ece0-4869-b95e-a6323e6b258a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095241 Oct 13 09:06:48.650168 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3375/6353] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:06:49.532407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:49.534232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:49.536452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:49.537178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:49.538909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:49.539396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:49.540208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:49.540683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:49.541118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:49.558836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:49.565122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:49.567138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:49.571486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:49.574229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:49.575525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:49.688904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:49.689928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:49.693476 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e0edf7e8-27c5-4ac1-a7b6-503731e7360a tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.965587 Oct 13 09:06:49.694092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2979/6354] 10.222.0.23 () {58 vars in 1185 bytes} [Thu Oct 13 09:06:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:06:49.707298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:49.707975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lazy-loading 'fault' on Instance uuid 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:06:49.987579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:50.017177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:50.026361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:06:50.032340 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f83a8da7-a51b-4b89-aa85-c82376f8cc80 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 200 len: 1372 microversion: 2.20 time: 0.500998 Oct 13 09:06:50.033476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3376/6355] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:49 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 1372 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:06:50.037191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-650444259", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "availability_zone": "nova:n-h1-858384-11", "networks": [{"uuid": "c08fd27d-8c4e-4929-a544-6ca399ecc7fe"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:50.202786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] validate_networks() for [('c08fd27d-8c4e-4929-a544-6ca399ecc7fe', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:06:51.061340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:51.062554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:51.085158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:51.085673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:51.086120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:51.087290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:51.087290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:51.087736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:51.150327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 HTTP/1.1 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6'} Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:51.166454 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1bdd47fe-8fef-4850-9033-edeb67d9c097 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 404 len: 111 microversion: 2.20 time: 0.110606 Oct 13 09:06:51.172345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3377/6356] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:06:51 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 13 09:06:51.185605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4319ef94-c0d0-405e-a92f-ac4e017af385 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '.version_select at 0x7f53756ee940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:51.256607 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4319ef94-c0d0-405e-a92f-ac4e017af385 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611159982" status: 204 len: 0 microversion: 2.20 time: 0.072223 Oct 13 09:06:51.258598 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3378/6357] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 09:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611159982 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:06:52.034059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:06:52.034676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:06:52.035258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:06:52.035789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:06:52.036317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:06:52.059587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:52.068489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:52.069120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:52.070085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:52.073446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:52.075200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:52.199393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Getting quotas for project edc54dcb9f404b8b9dcab06e1d6d72b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:06:52.226062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Getting quotas for user f1154eec3c474ab8a1f61f9c49a0643d and project edc54dcb9f404b8b9dcab06e1d6d72b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:06:52.283416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:06:52.290191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:06:52.403086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe91ed55-d0e5-4002-94c2-914a3819b02c tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369464 Oct 13 09:06:52.414606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2980/6358] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:06:52.422623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c735a312-5188-4218-82d1-9de0a259e1cc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:52.423249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c735a312-5188-4218-82d1-9de0a259e1cc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:52.993092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c735a312-5188-4218-82d1-9de0a259e1cc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1328 microversion: 2.1 time: 0.578591 Oct 13 09:06:52.994668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3379/6359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:52 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1328 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:54.011813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7cb6b40a-ef42-4d68-a967-857c6ceb9f9d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: .version_select at 0x7f5375f04af0>, body: {"keypair": {"name": "tempest-keypair-1494202853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFapXbugP0nNrsRE0jfE0wKMRWdDyI73N8QhEZ/4cA2Ded6Vkdj5Zn7a0dzst1nL03k9A+eoC6lyDd/CS0M1bGVp4laCLZBl30J/rhuu4LKxEMBv9ojLT/UN9TTlqYqWQ=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:54.021355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:54.022774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:54.029408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:54.030897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:54.031760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:54.033153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:54.033835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:54.034504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:54.040646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:54.048821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:06:54.105755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7cb6b40a-ef42-4d68-a967-857c6ceb9f9d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for project 86809284aea846728abda8b2e94f2717. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:06:54.120879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7cb6b40a-ef42-4d68-a967-857c6ceb9f9d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for user b165892374c048329f8d7cb1c29aa395 and project 86809284aea846728abda8b2e94f2717. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:06:54.168307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7cb6b40a-ef42-4d68-a967-857c6ceb9f9d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161630 Oct 13 09:06:54.169781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2981/6360] 10.222.0.23 () {62 vars in 1200 bytes} [Thu Oct 13 09:06:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 13 09:06:54.448743 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b668dfca-6ec4-46fd-a5a6-24b63e688702 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1417 microversion: 2.1 time: 0.432354 Oct 13 09:06:54.456004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3380/6361] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:54 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1417 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:54.711162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b963abc0-6d7c-4d80-845f-27150782a164 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Action: 'create', calling method: .version_select at 0x7f5375646b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1948739658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWy/2d1qLpV/JWWWiI/j/j1y9FfIIcpoqcVRgv5Ug+tEKNFz73nDHfAas/RPUlyaYWOWW7tREKezzsu1HfXddNBRMD8b9kgBw8zESSmZOU7z5lmylaY09hg0sWg9/GJpA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:54.747706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b963abc0-6d7c-4d80-845f-27150782a164 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Getting quotas for project 0ab0ebf030c941a1879de9b2c1c94b69. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:06:54.761444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-b963abc0-6d7c-4d80-845f-27150782a164 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Getting quotas for user 8372012a17394b5e9e90d7475f749675 and project 0ab0ebf030c941a1879de9b2c1c94b69. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:06:54.812686 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b963abc0-6d7c-4d80-845f-27150782a164 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110973 Oct 13 09:06:54.815750 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2982/6362] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:06:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:06:55.473426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:55.480281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:55.500767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:55.503070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:55.505999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:55.507915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:55.509548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:55.510214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:55.928592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1423 microversion: 2.1 time: 0.459166 Oct 13 09:06:55.930451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3381/6363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:55 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1423 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:56.958384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:56.959224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:56.967102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:56.967647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:56.968093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:56.979999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:56.980625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:56.981083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:57.760376 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0a3ef45-d778-43ba-ac85-4f32777df897 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.806459 Oct 13 09:06:57.776712 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2983/6364] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:56 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:57.904749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:57.906302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38c0f53e-a3f3-4a33-88dd-bfb86bced965 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001883 Oct 13 09:06:57.906661 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3382/6365] 10.222.0.23 () {56 vars in 886 bytes} [Thu Oct 13 09:06:57 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 13 09:06:58.786093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:06:58.793065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:06:58.827269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:58.835326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:58.843014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:58.844037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:06:58.844943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:06:58.845510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:06:58.895677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-942831389", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbd6f304-e78b-4f1a-a640-89431fc24386"}], "security_groups": [{"name": "tempest-securitygroup--1709277718"}], "key_name": "tempest-keypair-1494202853", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:06:59.349601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbf1e6d2-1199-414b-9db3-ed0c14e0478f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.567209 Oct 13 09:06:59.350220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2984/6366] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:06:58 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:06:59.724399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] validate_networks() for [('cbd6f304-e78b-4f1a-a640-89431fc24386', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:07:00.375402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:00.375996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:00.385559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:00.388861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:00.388861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:00.390192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:00.396103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:00.396942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:00.923606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b847bb5a-8d29-406e-b3ae-710abfcee6c9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.550772 Oct 13 09:07:00.926856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2985/6367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:00 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:00.979504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-276043696", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "57e8b072-e0e4-458f-a429-eee27c00f6e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1948739658", "security_groups": [{"name": "tempest-secgroup-smoke-1304228101"}], "networks": [{"uuid": "e687f5cb-730c-435b-8a5c-44dc7ce7ddbd"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:01.401819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] validate_networks() for [('e687f5cb-730c-435b-8a5c-44dc7ce7ddbd', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:07:02.111049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:02.309522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:07:02.310294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:07:02.312071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:07:02.313099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:07:02.320615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:07:02.349225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:02.351376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:02.352498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:02.355554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:02.357113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:02.357934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:02.416084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Getting quotas for project 0ab0ebf030c941a1879de9b2c1c94b69. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:07:02.431116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Getting quotas for user 8372012a17394b5e9e90d7475f749675 and project 0ab0ebf030c941a1879de9b2c1c94b69. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:07:02.579020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:07:02.581589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57e8b072-e0e4-458f-a429-eee27c00f6e2',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:07:02.875656 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cda0e72e-9152-4463-850b-8e04148bbcf5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.946807 Oct 13 09:07:02.884544 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2986/6368] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:07:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:07:02.893015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:02.897194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:02.909103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:02.909603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:02.910232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:02.911790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:02.912624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:02.913442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:02.989242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:04.305680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-432db424-11dd-4b1c-a886-1473aee4b993 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 1.416680 Oct 13 09:07:04.321860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:07:04.322424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:07:04.331033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:07:04.331481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:07:04.331912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:07:04.354673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2987/6369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:02 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:04.357490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:04.358041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:04.358530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:04.365889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:04.366904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:04.367432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:04.369686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:04.372001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:04.392134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:04.399228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:04.401022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:04.403793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:04.409438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:04.413725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:04.421335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for project 86809284aea846728abda8b2e94f2717. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:07:04.438849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Getting quotas for user b165892374c048329f8d7cb1c29aa395 and project 86809284aea846728abda8b2e94f2717. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:07:04.474503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:07:04.491885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:07:04.582840 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:07:04.697782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:04.709537 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f55677da-56a4-43fd-95cb-7ef3aee74304 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1196 microversion: 2.1 time: 0.352835 Oct 13 09:07:04.719481 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2988/6370] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:04 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1196 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:04.730517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272161a4-e290-480a-b98f-e5482cb65afa", "tag": "a6243f5e-7607-4bdb-8ab4-74ff528cd450"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:04.743486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:04.744228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:04.745039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:04.759216 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] Creating event network-changed:a6243f5e-7607-4bdb-8ab4-74ff528cd450 for instance 272161a4-e290-480a-b98f-e5482cb65afa on n-h1-858384-11 Oct 13 09:07:04.766290 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-af42f16e-4b06-4d9a-87e4-8d0c4eddefe0 req-b93fb5e6-92c2-48e1-b391-711fa4955b30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045861 Oct 13 09:07:04.767444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2989/6371] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:05.333803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:05.335359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:05.348125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:05.354216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:05.355016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:05.355674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:05.356132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:05.356560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:05.591248 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36336. Oct 13 09:07:05.599304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eeecad3f-2c71-46f5-8178-a26265f4dbe6 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.707396 Oct 13 09:07:05.606334 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3383/6372] 10.222.0.23 () {62 vars in 1188 bytes} [Thu Oct 13 09:06:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 6710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 13 09:07:05.628604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:05.629293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:05.637041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:05.773339 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a3197b6-493b-4aa4-b748-e205b3c6126d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.443584 Oct 13 09:07:05.773941 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2990/6373] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:05 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:05.805919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:05.806623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:05.836657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:05.837174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:05.838502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:05.840475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:05.846140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:05.846724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:06.213649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:06.222239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:06.229546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:06.236579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a4c582b-9b74-4318-a8a9-fdc70bcac4ea tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1281 microversion: 2.20 time: 0.623960 Oct 13 09:07:06.240967 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3384/6374] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:05 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1281 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:06.258223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1527594915", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:06.356858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:07:06.404825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:06.419748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f2e4e57-51d3-4145-b5cf-f46856c77e1e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1214 microversion: 2.1 time: 0.626325 Oct 13 09:07:06.420940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2991/6375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:05 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1214 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:06.805820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:06.809238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:06.862340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:06.863239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:06.863846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:06.864732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:06.865350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:06.866014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:07.307558 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b1b3b451-d40c-4e6c-b524-1504595902cd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.510886 Oct 13 09:07:07.315898 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2992/6376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:06 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:07.321316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:07.324662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:07.339139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:07.339925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:07.346706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:07.355297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:07.356238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:07.356936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:07.510430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:07.520265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:07.521742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:07.537133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0b3c392-a162-4cb5-be21-cdf4137d60b4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1333 microversion: 2.20 time: 0.219567 Oct 13 09:07:07.541906 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2993/6377] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:07 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1333 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:07.560691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:07.561627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:07.585395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:07.586002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:07.586612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:07.590580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:07.591518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:07.607317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:07.945875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:07.965176 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-821172fc-8f1c-4b9d-95a6-399f8a80c751 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1214 microversion: 2.1 time: 0.421678 Oct 13 09:07:07.968504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2994/6378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:07 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1214 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:08.344153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:08.344968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:08.359633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:08.360310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:08.360878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:08.361740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:08.362315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:08.362890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:08.994287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:07:08.994816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:07:08.995238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:07:08.995653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:07:08.996069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:07:09.016827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.017600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.018246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.019222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.020332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.022953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.080931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Getting quotas for project edd9a338f2be4df89c4309d1c561816c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:07:09.112528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Getting quotas for user 79ec0b04e9a648d8a938ce8c1a16cdfa and project edd9a338f2be4df89c4309d1c561816c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:07:09.152165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:07:09.164873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:07:09.173794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:09.176481 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-383f65ab-68d8-4914-83ef-29215d51ec80 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.837119 Oct 13 09:07:09.182699 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2995/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:08 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:09.196625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:09.197709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:09.218618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.222136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.222824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.223970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.224322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.224784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.246446 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5fc28c5c-0481-4120-96e3-60f431280bb0 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.002721 Oct 13 09:07:09.253791 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3385/6380] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:07:09.261677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:09.262624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:09.271198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.272145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.272838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.273842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:09.274746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:09.275420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:09.417346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:09.426736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:09.428220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:09.433063 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7ea1867-5b70-4b05-ba78-a21525f6b354 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1339 microversion: 2.20 time: 0.248956 Oct 13 09:07:09.433684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2996/6381] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:09 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:09.447074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0c2f35a-da71-4474-b0d0-453ea5c6232b tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:09.447700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0c2f35a-da71-4474-b0d0-453ea5c6232b tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:09.498202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:09.510328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-235e4c2a-f80b-4e1d-ac44-41b96bfbec36 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1214 microversion: 2.1 time: 0.254867 Oct 13 09:07:09.524009 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3386/6382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:09 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:09.827205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0c2f35a-da71-4474-b0d0-453ea5c6232b tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:09.837792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0c2f35a-da71-4474-b0d0-453ea5c6232b tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1215 microversion: 2.1 time: 0.394605 Oct 13 09:07:09.843243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2997/6383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:09 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:10.204718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:10.205333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:10.218130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.222841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.223579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.224541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.226883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.229372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.463354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:10.464745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:10.472846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.473621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.474274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.475282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.476005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.476972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.632886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:10.642191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:10.655312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:10.657095 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91880310-f08c-4911-aa2b-9d7cdf366bb7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1339 microversion: 2.20 time: 0.198441 Oct 13 09:07:10.658328 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2998/6384] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:10 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:10.666891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:10.669706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:10.685165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.687520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.698200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.700251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:10.703071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:10.703789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:10.956719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:10.965072 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c0b4614-219c-4d62-a59a-27dc9cc0955a tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1214 microversion: 2.1 time: 0.305236 Oct 13 09:07:10.975194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 2999/6385] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:10 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:10.982380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:10.983725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:11.006377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:11.007021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:11.009764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:11.010823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:11.013116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:11.015671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:11.398055 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9106df22-58c7-4867-a6d2-9d55033d8f9d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 1.197821 Oct 13 09:07:11.406225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3387/6386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:10 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:11.546008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:11.564642 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7bad717-e9c6-4092-8768-c1c350cf47e6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1267 microversion: 2.1 time: 0.588040 Oct 13 09:07:11.565853 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3000/6387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:10 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1267 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:11.687221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:11.688161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:11.708541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:11.716579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:11.717670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:11.718631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:11.719271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:11.719892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:11.997807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:11.998993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:12.013985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.014521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.014976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:12.015697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.016165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.016599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:12.390201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:12.627079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:12.662189 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0d7a638-5231-4875-80c5-ba3f561d6d8b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1282 microversion: 2.1 time: 0.665516 Oct 13 09:07:12.665354 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3001/6388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:11 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1282 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:12.681727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:12.687114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:12.708843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.714497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.717241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:12.724799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.725500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.726107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:12.908166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:12.919024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:12.924875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:12.927346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40f534c8-0eb2-43ac-80ea-f168d881558b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 1.243802 Oct 13 09:07:12.928100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3388/6389] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:11 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:12.944079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:12.944975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:12.953139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.953632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.954073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:12.954803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:12.955259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:12.955686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:13.165850 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da291edc-ac67-4690-9637-30f69123fdbc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.498968 Oct 13 09:07:13.169499 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3002/6390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:12 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:13.365263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:13.380307 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c58dde4a-ea15-49ac-b127-9dfc0effa9d3 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1273 microversion: 2.1 time: 0.440472 Oct 13 09:07:13.380916 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3389/6391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:12 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1273 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:13.689236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:13.690593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:13.705720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:13.706602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:13.707624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:13.708611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:13.709271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:13.710972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:13.953875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:13.955202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:13.968455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:13.969283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:13.969916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:13.972369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:13.974965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:13.975658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:14.169959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:14.187923 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c63933f6-5386-45f9-953d-3cac4ff60133 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1282 microversion: 2.1 time: 0.503093 Oct 13 09:07:14.204015 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3003/6392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:13 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:14.209366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:14.210393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:14.229240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:14.230115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:14.230857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:14.232472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:14.233196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:14.233855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:14.735164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:14.747442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:14.755549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:14.757027 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-204d7e14-1b94-4b7f-89f2-0bc39c34ec08 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.807849 Oct 13 09:07:14.767221 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3390/6393] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:13 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:07:14.773057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:14.782556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:14.808073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:14.817455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:14.819313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:14.820201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:14.821337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:14.829767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:14.974606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47bbe77f-fe30-46d5-9912-f280133f872d tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 0.764279 Oct 13 09:07:14.984484 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3004/6394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:14 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:14.995027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272161a4-e290-480a-b98f-e5482cb65afa", "name": "network-vif-plugged", "status": "completed", "tag": "a6243f5e-7607-4bdb-8ab4-74ff528cd450"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:15.014769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:15.017102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:15.017893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:15.042485 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] Creating event network-vif-plugged:a6243f5e-7607-4bdb-8ab4-74ff528cd450 for instance 272161a4-e290-480a-b98f-e5482cb65afa on n-h1-858384-11 Oct 13 09:07:15.059137 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-96e83837-1873-4bb7-bf10-688fc6e1dfba req-5d0380fc-fdf4-4aea-8419-5499f0463e6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073007 Oct 13 09:07:15.063424 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3005/6395] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:15.223298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:15.224110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:15.288270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:15.288793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:15.289356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:15.289967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:15.290456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:15.290890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:15.834608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:15.844768 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a0bcffee-b8d5-4e3a-aa3a-48aa1fe33808 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 1.075373 Oct 13 09:07:15.847125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3391/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:14 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:16.137704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:16.150889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:16.151775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:16.152479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:16.164894 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] Creating event network-changed:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:07:16.171332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-74082e43-9ef2-4b6f-a06c-3c5c351f5bbe req-d962d74a-fa42-49c1-a7ef-779d9f795fe3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321084 Oct 13 09:07:16.172210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3392/6397] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:16.177954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:16.179124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:16.190719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:16.192051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:16.192739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:16.193732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:16.194535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:16.196073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:16.235570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:16.253258 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd595d66-906e-4440-9b61-8d9380a4ea9e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1282 microversion: 2.1 time: 1.045126 Oct 13 09:07:16.254779 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3006/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:15 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1282 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:16.259687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:16.263488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:16.278132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:16.279043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:16.279816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:16.280778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:16.281746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:16.282447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:16.942743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:16.956706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:16.970722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:16.972245 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aac55b32-e6fb-441b-8b0e-fad809a0e086 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.798697 Oct 13 09:07:16.973004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3393/6399] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:16 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:16.991130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:16.992026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:16.998845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:17.001372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:17.007133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:17.008254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:17.008911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:17.009532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:17.302117 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9ef88de1-d5c7-4c98-b96f-8c0ef8b81528 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1465 microversion: 2.1 time: 1.045776 Oct 13 09:07:17.303596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3007/6400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:16 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1465 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:17.310109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:17.311526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:17.318644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:17.319379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:17.320004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:17.321126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:17.321750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:17.322512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:17.434074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:17.446126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4d62b38-2ccb-45c0-a93c-86a2a07dcc98 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.471351 Oct 13 09:07:17.447489 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3394/6401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:16 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:17.474426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:17.486499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:17.487371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:17.488065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:17.502532 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] Creating event network-changed:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:07:17.508900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a415eab6-2dbe-4e47-8306-8eac4925809f req-407238d9-f7c3-4c6f-9c46-0d00ce966a56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038459 Oct 13 09:07:17.510102 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3395/6402] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:17.780323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:17.803583 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6075f89a-6256-4adb-a70b-feba483998ff tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.498520 Oct 13 09:07:17.809272 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3008/6403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:17 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:18.002045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:18.002769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:18.009597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.010565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.011787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.012583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.014680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.015442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.339575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:18.345348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:18.346648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:18.361061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:18.366461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.367381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:18.369808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5de51e49-6e8a-40bf-b341-ccbf1055d17d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.372421 Oct 13 09:07:18.370391 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3396/6404] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:17 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:18.374053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.374053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.374639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.381346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.381861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.472854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:18.479469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:18.491102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.491706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.492349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.493217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.493799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.495292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.773578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:18.782745 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88527ad3-2086-4803-8625-1faf38218ac6 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.316002 Oct 13 09:07:18.785911 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3397/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:18 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:18.837573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:18.838636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:18.849869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.850382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.852783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:18.858351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:18.858960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:18.859412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.056471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7c23da9-8c3a-4fd1-a9aa-a45f68cc40bc tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1650 microversion: 2.1 time: 0.729151 Oct 13 09:07:19.057075 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3009/6406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:18 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1650 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:19.071462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:19.086070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:19.086712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:19.093475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:19.094905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.095398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.095830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.096542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.096994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.097418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.108596 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fdb9b7e-f977-4e6e-992a-871593d06db3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.271768 Oct 13 09:07:19.109440 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3398/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:18 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:19.399199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:19.399918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:19.406545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=14 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:19.410588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.411486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.412185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.413167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.413891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.414643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.832760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=22 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:19.898265 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-92d45a49-02b0-4fbb-a132-6617726ee4e9 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1650 microversion: 2.1 time: 0.815818 Oct 13 09:07:19.902029 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3010/6408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:19 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1650 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:19.925364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:19.933505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:19.953400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.957320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.957900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:19.958774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:19.960167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:19.960708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.077542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:20.091594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:20.094825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:20.098567 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57315b55-3985-456e-b1bc-6667a7c615ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.703300 Oct 13 09:07:20.101676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3399/6409] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:19 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:07:20.107031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d776e812-46d7-426a-9511-c6a717d4eedf", "tag": "b39a2a02-cceb-48b7-9e10-0ef5230454b7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:20.143271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:20.146749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:20.147366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.181764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] Creating event network-changed:b39a2a02-cceb-48b7-9e10-0ef5230454b7 for instance d776e812-46d7-426a-9511-c6a717d4eedf on n-h1-858384-11 Oct 13 09:07:20.195776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-85617156-c323-4859-8b3e-76af631ead4e req-4c174c1a-ba49-465c-9aba-e32b76bda890 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092477 Oct 13 09:07:20.196848 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3400/6410] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:20.208939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:20.209985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:20.219310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:20.220109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:20.220730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.221909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:20.222774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:20.223417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.578051 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4586cf00-21e6-4875-9041-613c8ceb8d94 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1650 microversion: 2.1 time: 0.379773 Oct 13 09:07:20.604302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3401/6411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:20 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1650 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:20.636624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:20.644517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:20.645170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:20.647314 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c483c192-9702-41f7-a879-73787157c3cf tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.743748 Oct 13 09:07:20.667058 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3011/6412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:19 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:20.737757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:20.741636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:20.746096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.749930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:20.756104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:20.757084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:20.897807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:21.021082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-922429325", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "availability_zone": "nova:n-h2-858384-11", "networks": [{"uuid": "c08fd27d-8c4e-4929-a544-6ca399ecc7fe"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:21.056913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:21.160943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] validate_networks() for [('c08fd27d-8c4e-4929-a544-6ca399ecc7fe', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:07:21.479592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:21.497705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-038e91c1-7b51-4c6e-9596-46e97add8dfa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.891970 Oct 13 09:07:21.500836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3402/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:20 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:21.740687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73628ae7-4ade-4111-804b-a53a4ca06478 tempest-ExtensionsTest-328077668 tempest-ExtensionsTest-328077668-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:21.743309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73628ae7-4ade-4111-804b-a53a4ca06478 tempest-ExtensionsTest-328077668 tempest-ExtensionsTest-328077668-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.237770 Oct 13 09:07:21.749575 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3403/6414] 10.222.0.23 () {58 vars in 1170 bytes} [Thu Oct 13 09:07:21 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:21.759944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:21.763486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:21.780922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:21.782982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:21.783995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:21.787988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:21.788790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:21.790869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.097705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:22.115448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:22.117210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:22.121485 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ac06655-32fc-49d4-a156-9dc6e7b8aca4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.370461 Oct 13 09:07:22.122483 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3404/6415] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:21 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:22.136412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:22.137317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:22.166902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.167421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.170623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.171446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.171918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.174940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.518367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:22.543112 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad3af79c-4021-401d-a8aa-702e4428f03f tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.416529 Oct 13 09:07:22.543966 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3405/6416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:22 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:22.565392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e3591c6-6146-434e-bb7c-467209033aef tempest-ExtensionsTest-328077668 tempest-ExtensionsTest-328077668-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:22.570615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e3591c6-6146-434e-bb7c-467209033aef tempest-ExtensionsTest-328077668 tempest-ExtensionsTest-328077668-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008896 Oct 13 09:07:22.571778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3406/6417] 10.222.0.23 () {58 vars in 1134 bytes} [Thu Oct 13 09:07:22 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:07:22.577592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "name": "network-vif-plugged", "status": "completed", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:22.590721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.591532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.592666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.607457 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] Creating event network-vif-plugged:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:07:22.613888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7d222722-cd0e-4189-9773-a614790be00f req-317718ca-14be-4326-b099-685849f8ae52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040521 Oct 13 09:07:22.615144 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3407/6418] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:22.622634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:22.624140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:22.632315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.633329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.634124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.635755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.636490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.637294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.828900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:07:22.829480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:07:22.830193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:07:22.830764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:07:22.831290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:07:22.866379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.868794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.871016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.875639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:22.878139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:22.880999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:22.933167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Getting quotas for project edc54dcb9f404b8b9dcab06e1d6d72b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:07:22.962710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Getting quotas for user f1154eec3c474ab8a1f61f9c49a0643d and project edc54dcb9f404b8b9dcab06e1d6d72b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:07:22.996466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:07:22.999398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:07:23.120056 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b502fe5-6e8b-46b9-8678-4f2fe092c9a3 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.102575 Oct 13 09:07:23.120738 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3012/6419] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:07:23.132727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88129c00-aa96-45f6-9e44-581d26295c43 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:23.133430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88129c00-aa96-45f6-9e44-581d26295c43 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:23.677301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88129c00-aa96-45f6-9e44-581d26295c43 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1328 microversion: 2.1 time: 0.548526 Oct 13 09:07:23.678760 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3013/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:23 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1328 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:23.685195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:23.686288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:23.693668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:23.694540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:23.695291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:23.696750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:23.697454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:23.698107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:23.938251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:23.947257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c80ed68-57d5-424a-9615-7d00572e5b4f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 1.330705 Oct 13 09:07:23.948072 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3408/6421] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:22 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:23.970702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:23.972596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:23.987499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:23.988230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:23.988838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:23.990496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:23.993061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:23.993676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:24.383405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:24.397491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:24.399997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:24.403775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6af065ca-cbb4-4dea-aca5-cfcbee9165f0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1407 microversion: 2.20 time: 0.723606 Oct 13 09:07:24.423486 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3014/6422] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:23 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1407 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:24.614211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:24.629710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8bdadedf-a22e-490f-ad4c-c4e380b74e95 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.663078 Oct 13 09:07:24.631863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3409/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:23 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:24.701320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:24.702200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:24.713552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:24.714062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:24.714533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:24.717717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:24.718203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:24.718670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:24.975108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:24.976002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:24.987215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.004751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.006587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.007488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.014692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.015459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.048910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=100 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:25.060481 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-264cd9c5-337a-4d38-ab0d-c11f49603acd tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1337 microversion: 2.1 time: 0.361908 Oct 13 09:07:25.073056 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3015/6424] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:24 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1337 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:25.431897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:25.439549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:25.440460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:25.450759 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbb90939-401a-4dfa-b738-28508675d50d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.479624 Oct 13 09:07:25.454096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3410/6425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:24 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:25.460536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.461031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.467784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.469550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.471836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.476226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.654337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:25.655295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:25.675532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.677841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.682211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.692760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.694758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.699327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.854324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:25.870066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:25.874903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:25.879346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-adb7fae0-52d0-487b-8da2-db0253debddd tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1599 microversion: 2.20 time: 0.445797 Oct 13 09:07:25.881513 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3016/6426] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:07:25 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1599 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:07:25.910996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:25.911500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:25.921570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.922092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.922545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:25.923271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:25.923733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:25.924166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:26.355394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:26.387412 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85dc42b4-a104-4959-b95b-72960d29d492 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.736939 Oct 13 09:07:26.393923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3411/6427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:25 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:26.411193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:26.412088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:26.426210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:26.429115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:26.430004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:26.433837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:26.437064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:26.439389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:26.754382 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-876a0c1d-d47c-4a0b-a06e-e031e62eba6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.847752 Oct 13 09:07:26.755879 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3017/6428] 10.222.0.23 () {60 vars in 1316 bytes} [Thu Oct 13 09:07:25 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-interface => generated 284 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:07:26.761073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:26.761882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:26.788341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:26.792820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:26.793317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:26.797690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:26.800307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:26.802281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:27.053406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-231fe96b-8511-4e36-9504-efe86a09c834 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1425 microversion: 2.1 time: 0.657924 Oct 13 09:07:27.069344 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3412/6429] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:26 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1425 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:27.420778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1d065c9-5fca-4c3f-b6db-e38b274c9c63 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] Calling method '.version_select at 0x7f5375857b80>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:27.532158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1d065c9-5fca-4c3f-b6db-e38b274c9c63 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.465113 Oct 13 09:07:27.535155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3413/6430] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 09:07:27 2022] GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4/defaults => generated 371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:27.546920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:27.548593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:27.563692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:27.564197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:27.566806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:27.567873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:27.568236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:27.568676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:27.800341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:27.811266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fa5bea1-25e3-4a09-a38b-7c36852129a6 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 1.054240 Oct 13 09:07:27.814593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3018/6431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:26 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:27.832277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-887eca8a-5312-4b42-be28-59f4e1d3e0ff tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] Calling method '.version_select at 0x7f5375d90af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:27.931020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:27.946541 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa6ec0a1-5796-4859-9c4f-bcb784e3a995 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.404843 Oct 13 09:07:27.947744 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3414/6432] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:27 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:28.079128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:28.079762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:28.089491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:28.090170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:28.090877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:28.095172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:28.095869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:28.096523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:28.136262 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-887eca8a-5312-4b42-be28-59f4e1d3e0ff tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4" status: 200 len: 371 microversion: 2.1 time: 0.320485 Oct 13 09:07:28.138154 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3019/6433] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 09:07:27 2022] GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4 => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:28.156540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c4b0e31-dc92-4ae5-8838-52e3efca51e6 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] Calling method '.version_select at 0x7f53755e5790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:28.278848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca72bf19-8723-44a1-aa8b-b75463c58244 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1423 microversion: 2.1 time: 0.205152 Oct 13 09:07:28.290884 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3415/6434] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:28 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1423 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:28.439206 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c4b0e31-dc92-4ae5-8838-52e3efca51e6 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.287429 Oct 13 09:07:28.440835 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3020/6435] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 09:07:28 2022] GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4/defaults => generated 371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:28.468490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44726af4-0ec6-49a7-bef9-0f80e488d7f2 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] Calling method '.version_select at 0x7f53765d0940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:28.836246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:28.837192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:28.864562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:28.865452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:28.866081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:28.866980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:28.867598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:28.868172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:28.875250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44726af4-0ec6-49a7-bef9-0f80e488d7f2 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4" status: 200 len: 371 microversion: 2.1 time: 0.420281 Oct 13 09:07:28.877076 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3416/6436] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 09:07:28 2022] GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4 => generated 371 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:28.894583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-388fae6d-f822-46c2-bc45-67a513641ac0 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] Calling method '.version_select at 0x7f53756b0a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:29.195890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-388fae6d-f822-46c2-bc45-67a513641ac0 tempest-QuotasTestJSON-1748656404 tempest-QuotasTestJSON-1748656404-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4?user_id=81cf294b608c4a06a20a89151621da71" status: 200 len: 371 microversion: 2.1 time: 0.310631 Oct 13 09:07:29.225234 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3417/6437] 10.222.0.23 () {58 vars in 1323 bytes} [Thu Oct 13 09:07:28 2022] GET /compute/v2.1/os-quota-sets/7811ea572bbe4704b107978853f81cd4?user_id=81cf294b608c4a06a20a89151621da71 => generated 371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:29.251589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:29.252492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:29.267808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:29.268653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:29.270417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:29.272684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:29.273357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:29.274001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:29.561613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:29.576927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-689cfc41-0b11-4476-9d53-ae913ee48998 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.739553 Oct 13 09:07:29.577758 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3021/6438] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:28 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:29.586998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d776e812-46d7-426a-9511-c6a717d4eedf", "name": "network-vif-plugged", "status": "completed", "tag": "b39a2a02-cceb-48b7-9e10-0ef5230454b7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:29.611383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:29.612073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:29.612806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:29.632740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] Creating event network-vif-plugged:b39a2a02-cceb-48b7-9e10-0ef5230454b7 for instance d776e812-46d7-426a-9511-c6a717d4eedf on n-h1-858384-11 Oct 13 09:07:29.649981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-25b25e5e-233d-4fda-842e-628716a57daa req-6d9d6a23-b450-47b3-8367-ed0258548846 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070730 Oct 13 09:07:29.651207 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3022/6439] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:29.656959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:29.657658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:29.677562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:29.678053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:29.687144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:29.687914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:29.699361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:29.699691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:29.912115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:29.924994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdb9b817-87bb-4257-8a7d-c6ca7ecfdd10 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.693454 Oct 13 09:07:29.929699 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3418/6440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:29 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:30.561699 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-abe53bde-88ea-47f2-a599-a5138451dc15 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.909040 Oct 13 09:07:30.562381 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3023/6441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:29 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:30.602038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:30.602804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:30.611929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:30.612811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:30.613465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:30.614526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:30.615729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:30.616397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:30.953984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:30.954869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:30.961011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:30.972484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:30.973298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:30.974018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:30.976984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:30.977683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:30.978362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:30.997739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ab7c3cd-33d8-4b13-8eb7-82172721368f tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.400227 Oct 13 09:07:31.013011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3419/6442] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:30 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:31.597690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:31.598932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:31.619499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:31.624702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:31.627485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:31.630258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:31.631957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:31.632739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:31.660910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:31.676145 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac55ded1-e4a6-46bd-ad14-d6441af807f9 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1315 microversion: 2.1 time: 0.724164 Oct 13 09:07:31.677549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3024/6443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:30 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:31.978919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9160a9e2-6144-40f7-89e5-f73f10d35a30 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.394500 Oct 13 09:07:31.981872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3420/6444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:31 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:32.022681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:32.023581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:32.038523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:32.041422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:32.042068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:32.043186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:32.047086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:32.047735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:32.614391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:32.640268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:32.641016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:32.641464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:32.663614 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] Creating event network-changed:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:07:32.672110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f474aa36-b3bf-427c-a6f0-9f92ab180827 req-683cadfe-ba7c-45c2-92e1-4c1674f752cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066041 Oct 13 09:07:32.673476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3421/6445] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:32.709167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:32.710367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:32.722603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:32.723105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:32.724362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:32.725221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:32.727868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:32.728496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:32.822046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:32.831195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40367ec8-c2b1-4f8d-a2f9-1200d7acc116 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.813584 Oct 13 09:07:32.831794 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3025/6446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:32 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:33.009073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:33.009709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:33.021185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:33.022952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.023458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.023927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.032318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.032968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.033433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.573396 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e6c73551-4149-4a26-b4f2-a295a28ea5ef tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.566928 Oct 13 09:07:33.577250 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3026/6447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:33 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:33.607855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:33.616036 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a808626c-2cab-42b4-afa5-df6ed2f52a23 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1465 microversion: 2.1 time: 0.915433 Oct 13 09:07:33.623345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3422/6448] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:32 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1465 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:33.695038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:33.695512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:33.711101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.711809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.713692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.714668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.716329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.717917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.790860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:07:33.866068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:33.868113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:33.891693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.901673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.902523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.907365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.909378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.909930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.937608 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94f5e743-672e-4792-98aa-c1d67b5cfc14 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 204 len: 0 microversion: 2.1 time: 0.247256 Oct 13 09:07:33.940390 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3027/6449] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:07:33 2022] DELETE /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:07:33.954465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:33.955527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:33.968904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.970867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.971681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:33.974817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:33.975620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:33.976226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:34.429299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:34.444144 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd4b6fe0-1c01-48b7-b8de-28d3381e3e7c tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1471 microversion: 2.1 time: 0.499483 Oct 13 09:07:34.448632 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3028/6450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:33 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:34.599666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:34.600697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:34.610377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:34.613549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:34.614279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:34.616843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:34.617694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:34.620251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:34.759695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:34.778379 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-022b44b6-9360-499b-b134-562c093ef086 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.923321 Oct 13 09:07:34.780183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3423/6451] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:33 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:34.793928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "name": "network-vif-plugged", "status": "completed", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:34.818926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:34.821755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:34.840998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:34.871183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] Creating event network-vif-plugged:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:07:34.885582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1537d30a-7837-4be1-8a44-473dc39bead1 req-e81311a9-0f26-435b-92fb-c76147d85527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103668 Oct 13 09:07:34.886852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3424/6452] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:34.896195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b40f362-0c60-4d85-8273-e93a2dc395d5", "tag": "3493487f-7bab-4b01-95ae-44bfa63a4684"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:34.923098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:34.938727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:34.939284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:34.944062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:34.988366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] Creating event network-changed:3493487f-7bab-4b01-95ae-44bfa63a4684 for instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 on n-h2-858384-11 Oct 13 09:07:34.990382 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bdee8b0-0c3e-4c46-ac76-97448ff5d31e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.394832 Oct 13 09:07:34.992310 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3029/6453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:34 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:35.010878 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a939de68-7c37-44db-9d27-8ae682430900 req-3efc0583-9611-4b4c-aa79-5a95f577dfee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122259 Oct 13 09:07:35.015157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3425/6454] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:35.472776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:35.473532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:35.486751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:35.492355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:35.493491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:35.495739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:35.498776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:35.499496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:35.808310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:35.809575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:35.830172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:35.831202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:35.834662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:35.834951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:35.835497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:35.838805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:35.846683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:35.860115 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7d4cbed3-c277-426b-84e3-649c79f087d7 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1471 microversion: 2.1 time: 0.391098 Oct 13 09:07:35.862539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3030/6455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:35 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:35.890129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=100 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:36.013032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:36.014097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:36.035787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:36.036341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:36.036782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:36.037566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:36.038274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:36.038938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:36.272137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:36.290802 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-794c644f-e2b4-4778-a544-067bd692d2aa tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.490665 Oct 13 09:07:36.293093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3426/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:35 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:36.773950 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d08e934-ead6-4fc9-b66f-db7064013848 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.764578 Oct 13 09:07:36.788637 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3031/6457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:36 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:36.884497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:36.885170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:36.905464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:36.909222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:36.909794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:36.915307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:36.915964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:36.916449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.185637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d776e812-46d7-426a-9511-c6a717d4eedf", "name": "network-vif-deleted", "tag": "b39a2a02-cceb-48b7-9e10-0ef5230454b7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:37.208799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:37.211513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:37.212242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.224488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ec0b04e9a648d8a938ce8c1a16cdfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd9a338f2be4df89c4309d1c561816c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:37.245524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] Creating event network-vif-deleted:b39a2a02-cceb-48b7-9e10-0ef5230454b7 for instance d776e812-46d7-426a-9511-c6a717d4eedf on n-h1-858384-11 Oct 13 09:07:37.256110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0b407e1-84f2-4b46-a2fb-bb43ce64ed96 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 200 len: 1300 microversion: 2.1 time: 0.375750 Oct 13 09:07:37.272286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ce0e912e-90df-43ad-8df4-c830ead9add5 req-3f3de81e-d505-485d-9fc6-72b3591eb5de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090520 Oct 13 09:07:37.275463 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3032/6458] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:07:37.280930 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3427/6459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:36 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 1300 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:37.320115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:37.322451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:37.350110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:37.351125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:37.352547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.353511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:37.367743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:37.369168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.794176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:37.802116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:37.802999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:37.815315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:37.818212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:37.821177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.821987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:37.823350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:37.823494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:37.832600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc22c1a8-9b13-4676-9e6f-ec37bd2e4ab0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.503462 Oct 13 09:07:37.833305 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3033/6460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:37 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:38.135800 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62416f85-8626-47f6-879d-1b84138300a0 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.334352 Oct 13 09:07:38.136462 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3428/6461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:37 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:38.286073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:38.286898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] [instance: d776e812-46d7-426a-9511-c6a717d4eedf] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:38.300679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:38.302647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:38.304227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:38.305265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:38.306176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:38.306868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:38.315617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:38.335114 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] HTTP exception thrown: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Request method failure captured: Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf HTTP/1.1 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9U28npXZbfoEx9sLgdO5GHBnNiJTNCTCLl82jCW6c8U8YJnXxPwvxTbc8gaL_bW-7e4ONjKXw-GoZAtrXIoJeqqYHItF2jXboR7Q2Ak_Ge8TwoxyCgpSb1APZwunvi37v1B3tVZhh6UjdmrES7eFY8_zGJ5nBrKe4_sXemZNs6vsNw Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: edd9a338f2be4df89c4309d1c561816c Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesNegativeTest-1305345292 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edd9a338f2be4df89c4309d1c561816c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edd9a338f2be4df89c4309d1c561816c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edd9a338f2be4df89c4309d1c561816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edd9a338f2be4df89c4309d1c561816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesNegativeTest-1305345292 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: edd9a338f2be4df89c4309d1c561816c Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesNegativeTest-1305345292 Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesNegativeTest-1305345292-project Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 79ec0b04e9a648d8a938ce8c1a16cdfa Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesNegativeTest-1305345292-project Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'd776e812-46d7-426a-9511-c6a717d4eedf'} Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:38.348877 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. Oct 13 09:07:38.353879 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:38.356011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] Returning 404 to user: Instance d776e812-46d7-426a-9511-c6a717d4eedf could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:07:38.357229 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7fd53015-eed1-4a45-aad4-f1074ebc4026 tempest-VolumesNegativeTest-1305345292 tempest-VolumesNegativeTest-1305345292-project] 10.222.0.23 "GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf" status: 404 len: 111 microversion: 2.1 time: 0.076548 Oct 13 09:07:38.378136 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3034/6462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:38 2022] GET /compute/v2.1/servers/d776e812-46d7-426a-9511-c6a717d4eedf => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:07:38.856006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:38.856973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:38.867632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:38.879726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:38.880258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:38.881030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:38.881500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:38.882070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:39.160901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:39.161517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:39.169024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:39.169616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:39.170235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:39.171631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:39.172254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:39.173474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:39.188382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:39.198173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:39.423622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-979875b4-ac03-4855-a181-eafef70d5f0e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.266021 Oct 13 09:07:39.424280 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3035/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:39 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:39.572465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:39.584113 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56da028e-e98e-48d2-9922-05ad45bfb798 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1270 microversion: 2.1 time: 0.732171 Oct 13 09:07:39.613871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3429/6464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:38 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1270 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:40.453669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:40.454301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:40.470252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:40.470970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:40.471351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:40.480568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:40.481622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:40.482181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:40.549243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40f362-0c60-4d85-8273-e93a2dc395d5", "name": "network-vif-plugged", "status": "completed", "tag": "3493487f-7bab-4b01-95ae-44bfa63a4684"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:40.571464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:40.572212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:40.576981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:40.599195 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] Creating event network-vif-plugged:3493487f-7bab-4b01-95ae-44bfa63a4684 for instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 on n-h2-858384-11 Oct 13 09:07:40.618895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-69873177-6d72-4e69-90b9-e748ab5b34d0 req-1380e1a9-401a-4afd-8d28-aa56b65996d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077968 Oct 13 09:07:40.621141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3430/6465] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:40.641111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:40.643054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:40.652548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:40.653299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:40.654805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:40.656577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:40.676221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:40.680676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:40.804176 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ecbf68aa-995b-4696-bb08-da777eba7958 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.354775 Oct 13 09:07:40.805824 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3036/6466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:40 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:41.263431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:41.278096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89c5ecd2-245f-439d-9b3c-878bc3fe315d tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1459 microversion: 2.1 time: 0.654578 Oct 13 09:07:41.293641 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3431/6467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:40 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1459 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:41.312535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:41.313384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:41.326237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:41.326760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:41.344021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:41.345637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:41.346773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:41.347723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:41.799412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:07:41.813229 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e22ceef8-6e4e-45be-b572-c8e815a0298e tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1459 microversion: 2.1 time: 0.505802 Oct 13 09:07:41.826879 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3037/6468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:41 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1459 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:41.832813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:41.835506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:41.874463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:41.876652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:41.878108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:41.879580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:41.880727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:41.881711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:42.268295 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eddcbe21-040c-4269-a477-fb643ab6c374 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1465 microversion: 2.1 time: 0.445175 Oct 13 09:07:42.269252 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3432/6469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:41 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1465 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:07:43.293102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:43.293922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:43.358893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:43.359554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:43.360816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:43.361576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:43.363462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:43.363918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:44.362004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ef73d038-3672-4a0c-9cf3-3cbd1bf92584 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1650 microversion: 2.1 time: 1.072037 Oct 13 09:07:44.366632 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3038/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:43 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1650 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:44.395404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:44.396832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:44.413960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:44.417053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:44.418388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:44.420942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:44.422687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:44.424190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:44.971317 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d798f9ea-6ac2-4f8a-ab9b-1cd3dba0d1df tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1650 microversion: 2.1 time: 0.580291 Oct 13 09:07:44.979997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3433/6471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:44 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1650 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:45.009031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:45.010003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:45.038282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:45.039951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:45.041455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:45.065011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:45.071338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:45.071802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:46.001705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-945985a8-d4b0-45b9-b783-9dbd84c32565 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1650 microversion: 2.1 time: 1.000989 Oct 13 09:07:46.041094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:46.041688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:46.053120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:46.054105 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3039/6472] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:44 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1650 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:46.061505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:46.062584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:46.063884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:46.064914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:46.068086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:46.137130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:07:46.366813 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6cda158-2f36-4455-a8b5-496c9956619f tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 204 len: 0 microversion: 2.1 time: 0.332611 Oct 13 09:07:46.371707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3434/6473] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:07:46 2022] DELETE /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:07:46.377513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:46.378835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:46.399251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:46.399651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:46.400110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:46.400851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:46.401312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:46.401745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:46.979845 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-011f5415-2b96-4f6a-8f52-18c9d4636f03 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1656 microversion: 2.1 time: 0.606157 Oct 13 09:07:46.982281 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3040/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:46 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1656 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:48.009461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:48.010348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:48.056696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:48.060578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:48.061197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:48.062086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:48.070868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:48.071744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:48.781427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-be739983-7060-4295-9b3a-ded10b986363 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1656 microversion: 2.1 time: 0.773310 Oct 13 09:07:48.795910 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3435/6475] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:48 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1656 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:48.883314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:48.912905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:48.914945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:48.918963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:48.959787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] Creating event network-changed:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:07:48.973649 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b9c6a287-2fba-4547-bdf8-e60f9c8e08d4 req-bb230b97-6457-414b-bcab-32d06b2f2d75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093707 Oct 13 09:07:48.974461 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3041/6476] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:49.808495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:49.809117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:49.831704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:49.832198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:49.832635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:49.835021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:49.835931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:49.836560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:50.087623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40f362-0c60-4d85-8273-e93a2dc395d5", "name": "network-vif-deleted", "tag": "3493487f-7bab-4b01-95ae-44bfa63a4684"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:50.111644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:50.113545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:50.117693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:50.153121 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] Creating event network-vif-deleted:3493487f-7bab-4b01-95ae-44bfa63a4684 for instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 on n-h2-858384-11 Oct 13 09:07:50.179907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cf2e884a-bfc3-4041-abc2-131f221caa31 req-a1d01c1d-bc63-4cb6-9061-08a9cd451e7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098116 Oct 13 09:07:50.180736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3042/6477] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:07:50.218626 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-205298c3-f677-49fa-bc24-40e7741841f6 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1614 microversion: 2.1 time: 0.410829 Oct 13 09:07:50.236603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3436/6478] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:49 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1614 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:51.251089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:51.252164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:51.262595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:07:51.275310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:51.275904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:51.276346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:51.289568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:51.290073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:51.290541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:51.400734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:51.401223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:51.401660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:51.402115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lazy-loading 'fault' on Instance uuid 6b40f362-0c60-4d85-8273-e93a2dc395d5 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:07:51.596548 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ecf44a10-f915-4aa3-8f53-bd7dfd280276 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 200 len: 1455 microversion: 2.1 time: 0.349728 Oct 13 09:07:51.606865 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3043/6479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:51 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 1455 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:52.625594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:52.628335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 6b40f362-0c60-4d85-8273-e93a2dc395d5] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:52.650908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:52.654790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:52.659109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:52.659982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:52.662586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:52.663223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:52.713926 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] HTTP exception thrown: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Request method failure captured: Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 HTTP/1.1 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9UohetV_0ODxQN48rta8bt93tx8MskQKIYM4jA3VRw23OQoaJ0Zq7DE45dr-YldxZT5EOpRL4iGmf2v631MWGKoqVjH0oTGmNKa0a0m5x5NLNERicYgd17_CB37f3Krak8I9LxNGGmpbUydrpGBpfq0CRrQFaecvAuClNOf5lly-W4 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: edc54dcb9f404b8b9dcab06e1d6d72b4 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestServerMultinode-1243613578 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestServerMultinode-1243613578 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: edc54dcb9f404b8b9dcab06e1d6d72b4 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestServerMultinode-1243613578 Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestServerMultinode-1243613578-project-admin Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: f1154eec3c474ab8a1f61f9c49a0643d Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestServerMultinode-1243613578-project-admin Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6b40f362-0c60-4d85-8273-e93a2dc395d5'} Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:52.716459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Returning 404 to user: Instance 6b40f362-0c60-4d85-8273-e93a2dc395d5 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:07:52.720193 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfe09248-9e7f-4d47-9370-2105ceef6c91 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5" status: 404 len: 111 microversion: 2.1 time: 0.099253 Oct 13 09:07:52.734883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3437/6480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:52 2022] GET /compute/v2.1/servers/6b40f362-0c60-4d85-8273-e93a2dc395d5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:07:52.755273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:52.756506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:52.777828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:52.781041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:52.783531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:52.787805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:52.788749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:52.796237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:52.851658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:07:53.105128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e681654-996e-499f-af62-85b56aea97c5 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 204 len: 0 microversion: 2.1 time: 0.368763 Oct 13 09:07:53.105653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3044/6481] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:07:52 2022] DELETE /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:07:53.114566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:53.115189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:53.125890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:53.126393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:53.126857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:53.127573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:53.128038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:53.128467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:53.860245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:53.889384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:53.889786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:53.890216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:53.918568 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] Creating event network-changed:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:07:53.931363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e382d711-8b66-4c69-ab4b-cc0c536ad450 req-895e537d-4deb-4e48-a6af-d9381b034254 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075647 Oct 13 09:07:53.936384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3045/6482] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:07:53.953409 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64ea8773-6c43-43a8-841b-adf2e7f74466 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1656 microversion: 2.1 time: 0.842661 Oct 13 09:07:53.964767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3438/6483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:53 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1656 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:54.987219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:54.990112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:55.016621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:55.017734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:55.021126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:55.030753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:55.033779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:55.036072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:55.988483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:56.008958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:56.009783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:56.010924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:56.084531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cafecbe5-4ba5-46cb-9ddc-abd12591950e tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 200 len: 1656 microversion: 2.1 time: 1.103040 Oct 13 09:07:56.085384 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] Creating event network-changed:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:07:56.088801 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3046/6484] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:54 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 1656 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:07:56.113201 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ffa5308d-818c-4def-886d-d5dea9a81e59 req-3c662658-9c10-4aa9-af5a-7a03f35c04d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128592 Oct 13 09:07:56.116021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3439/6485] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:07:57.138558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:07:57.141501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] [instance: 272161a4-e290-480a-b98f-e5482cb65afa] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:07:57.170314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:57.173951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:57.174759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:57.176400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:57.177742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:57.180221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:57.219018 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] HTTP exception thrown: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Request method failure captured: Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa HTTP/1.1 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9UohetV_0ODxQN48rta8bt93tx8MskQKIYM4jA3VRw23OQoaJ0Zq7DE45dr-YldxZT5EOpRL4iGmf2v631MWGKoqVjH0oTGmNKa0a0m5x5NLNERicYgd17_CB37f3Krak8I9LxNGGmpbUydrpGBpfq0CRrQFaecvAuClNOf5lly-W4 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: edc54dcb9f404b8b9dcab06e1d6d72b4 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestServerMultinode-1243613578 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edc54dcb9f404b8b9dcab06e1d6d72b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestServerMultinode-1243613578 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: edc54dcb9f404b8b9dcab06e1d6d72b4 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestServerMultinode-1243613578 Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestServerMultinode-1243613578-project-admin Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: f1154eec3c474ab8a1f61f9c49a0643d Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestServerMultinode-1243613578-project-admin Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '272161a4-e290-480a-b98f-e5482cb65afa'} Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:07:57.220973 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. Oct 13 09:07:57.224847 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:07:57.226189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] Returning 404 to user: Instance 272161a4-e290-480a-b98f-e5482cb65afa could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:07:57.229060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4230e9e3-fdac-4d0f-85a9-cabf9d21a043 tempest-TestServerMultinode-1243613578 tempest-TestServerMultinode-1243613578-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa" status: 404 len: 111 microversion: 2.1 time: 0.114448 Oct 13 09:07:57.231588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3047/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:07:57 2022] GET /compute/v2.1/servers/272161a4-e290-480a-b98f-e5482cb65afa => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:07:58.477780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272161a4-e290-480a-b98f-e5482cb65afa", "name": "network-vif-deleted", "tag": "a6243f5e-7607-4bdb-8ab4-74ff528cd450"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:07:58.508743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:07:58.509868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:07:58.519045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:07:58.558887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] Creating event network-vif-deleted:a6243f5e-7607-4bdb-8ab4-74ff528cd450 for instance 272161a4-e290-480a-b98f-e5482cb65afa on n-h1-858384-11 Oct 13 09:07:58.573222 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1e1dbfe2-eae8-46c2-b649-c1dc2490a49c req-5f7ab39a-4d7d-450c-addd-a48005141e7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102112 Oct 13 09:07:58.577805 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3440/6487] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:08:22.899704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:22.900259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:22.903073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:22.913468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:22.974257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:22.981383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:22.983631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:22.989606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:22.990105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:22.990589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:23.093215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:08:23.163851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:08:23.201669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:23.206397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:23.213342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:23.216134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:23.220554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:23.294718 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] Creating event network-changed:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:08:23.313066 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4fda0e34-a41b-4266-b243-9c099148b47c req-a7f92e65-c99d-451d-8910-d8bd060ea1df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168721 Oct 13 09:08:23.316893 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3441/6488] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 13 09:08:23.351132 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5111cd41-5316-4adb-af77-810cdf00ac91 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 204 len: 0 microversion: 2.1 time: 0.455487 Oct 13 09:08:23.354765 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3048/6489] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:08:22 2022] DELETE /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:08:23.363606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:23.364323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:23.379164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:23.379661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:23.380105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:23.380822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:23.381280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:23.381714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:24.439518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:24.458469 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f26b3eaf-1f68-45b5-a2b9-7264bdcf9404 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1584 microversion: 2.1 time: 1.099004 Oct 13 09:08:24.460302 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3442/6490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:23 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1584 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:25.488952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:25.489830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:25.504446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:25.505900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:25.507625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:25.510906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:25.520956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:25.521054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:26.565491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:26.586573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6350a017-b839-4b5f-8287-fa18920bfbf3 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1584 microversion: 2.1 time: 1.099881 Oct 13 09:08:26.588097 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3049/6491] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:25 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1584 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:27.616040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:27.616601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:27.629807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:27.630675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:27.631346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:27.632293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:27.633082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:27.633743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:28.915345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f3bd44-ab51-41b4-8f08-b8eb78d66eab", "name": "network-vif-deleted", "tag": "201b659a-60f2-460f-9239-865a2a8eff40"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:08:28.962538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:28.963908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:28.963908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:28.998749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:29.010739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2fd140eb-3b23-4047-b874-d675a3ba6302 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1465 microversion: 2.1 time: 1.401943 Oct 13 09:08:29.018731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] Creating event network-vif-deleted:201b659a-60f2-460f-9239-865a2a8eff40 for instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab on n-h2-858384-11 Oct 13 09:08:29.021103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3443/6492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:27 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1465 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:29.066387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-68046fba-014c-463d-90e6-67f665fd4811 req-27be208d-2b7e-47d5-bea4-ff3c9cd1da28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155547 Oct 13 09:08:29.071903 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3050/6493] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:08:30.047033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:30.050127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:30.080613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:30.083657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:30.085356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:30.095340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:30.097088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:30.102875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:30.381946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:30.393570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40d20126-0a40-45cf-ba0f-9ed4eea6e3ae tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.350406 Oct 13 09:08:30.398053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3444/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:30 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:31.426270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:31.427175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:31.443308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:31.443950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:31.445634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:31.447779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:31.449642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:31.451005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:31.656848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:31.671162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-873f6bfb-8f00-4fd3-b6e0-42ce5c60b4d1 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.249972 Oct 13 09:08:31.678539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3051/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:31 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:32.703307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:32.703957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:32.724152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:32.724571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:32.729843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:32.734313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:32.734831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:32.738474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:33.140109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:33.151509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd55e3cc-e016-4e16-ac48-8e0241c9b290 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.453251 Oct 13 09:08:33.158173 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3445/6496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:32 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:33.283999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:33.285164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:33.297053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:33.298591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:33.299903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:33.315940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:33.317737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:33.318622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:33.392341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d02a2dd-485a-4686-8453-916c446ef9bf tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/ips" status: 200 len: 151 microversion: 2.20 time: 0.608754 Oct 13 09:08:33.393253 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3052/6497] 10.222.0.23 () {60 vars in 1289 bytes} [Thu Oct 13 09:08:32 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/ips => generated 151 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 13 09:08:34.179006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:34.179830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:34.223546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:34.224333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:34.224794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:34.225560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:34.235643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:34.238531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:34.526174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:34.538122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-27a79b0a-ff18-4605-8ba0-34fb45fe846c tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.363999 Oct 13 09:08:34.539923 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3446/6498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:34 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:35.568168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:35.569473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:35.584853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:35.588363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:35.588935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:35.604454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:35.606340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:35.607642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:35.951026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:35.971087 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa70fb15-df98-4c94-92a3-117007aec14b tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.406763 Oct 13 09:08:35.971965 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3053/6499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:35 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:36.998785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:36.999988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:37.017585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:37.019184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:37.024217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:37.028884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:37.030141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:37.032310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:37.459517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:37.502599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-575658cc-4f98-4b79-9a18-20a0f5b86eda tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.501014 Oct 13 09:08:37.504211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3447/6500] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:36 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:37.928237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:08:37.928791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:37.963881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:37.964382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:37.964884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:37.965606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:37.966060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:37.966589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:38.059955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lazy-loading 'flavor' on Instance uuid 846cedb9-0155-449d-a03c-8369e0637ed1 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:08:38.534036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:38.535226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:38.553444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:38.556909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:38.561031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:38.562969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:38.565301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:38.570744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:38.709955 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ce82aea-8329-4c49-8d65-a233a09f0e73 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/action" status: 202 len: 0 microversion: 2.20 time: 0.787408 Oct 13 09:08:38.712147 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3054/6501] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 09:08:37 2022] POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:08:38.733353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:38.735384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:38.750605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:38.753571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:38.757296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:38.758659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:38.759347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:38.760018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:38.808689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:38.817551 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3c834ea-9399-4a79-8c4b-4558c8a638e0 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1229 microversion: 2.1 time: 0.292755 Oct 13 09:08:38.823200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3448/6502] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:38 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:39.572373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:39.601809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:39.615718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:39.617229 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6dea11d0-53c7-4206-98f2-65907be96739 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.898906 Oct 13 09:08:39.623691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3055/6503] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:38 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:39.848375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:39.849019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:39.943268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:39.945063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.083s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:39.951417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:39.954943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:39.957187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:39.959223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:40.103000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:40.103514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:40.103968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:40.109311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lazy-loading 'fault' on Instance uuid e5f3bd44-ab51-41b4-8f08-b8eb78d66eab {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:08:40.602534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8372012a17394b5e9e90d7475f749675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab0ebf030c941a1879de9b2c1c94b69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:40.617437 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54a771b0-30c2-412b-9f84-8e7f4bb371d5 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 200 len: 1188 microversion: 2.1 time: 0.774640 Oct 13 09:08:40.627163 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3449/6504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:39 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 1188 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:08:40.651654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:40.652839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:40.663753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:40.664498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:40.665801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:40.667515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:40.668471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:40.669061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:40.959295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:40.978200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:40.981544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:40.983212 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc0876eb-9094-4992-b510-2c8a1dd82519 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.337747 Oct 13 09:08:40.984359 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3056/6505] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:40 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:41.644885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:41.648403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] [instance: e5f3bd44-ab51-41b4-8f08-b8eb78d66eab] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:41.663329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:41.664302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:41.666957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:41.670783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:41.671421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:41.672011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:41.708148 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] HTTP exception thrown: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Request method failure captured: Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab HTTP/1.1 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9QPoHoGKs29CJ_DIHEgw6FXl0A9GDHY_m6kaVhyvroZKH5Y6LlgI48sbCt7i0oCYc4J-GYDq19GrdWzPdSdqyK9b3ObOvKlGQAFZe3V8RKttypNSAE_KKxXwtMgbc5KAvTuQarMrzvHjfXk0uThM9JkA7ObUaPgSfu5jvj1_c9BUyc Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 0ab0ebf030c941a1879de9b2c1c94b69 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBackupRestore-174777913 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab0ebf030c941a1879de9b2c1c94b69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ab0ebf030c941a1879de9b2c1c94b69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ab0ebf030c941a1879de9b2c1c94b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ab0ebf030c941a1879de9b2c1c94b69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBackupRestore-174777913 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 0ab0ebf030c941a1879de9b2c1c94b69 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBackupRestore-174777913 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBackupRestore-174777913-project Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 8372012a17394b5e9e90d7475f749675 Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBackupRestore-174777913-project Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'e5f3bd44-ab51-41b4-8f08-b8eb78d66eab'} Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:08:41.710459 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. Oct 13 09:08:41.715537 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:08:41.718242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Returning 404 to user: Instance e5f3bd44-ab51-41b4-8f08-b8eb78d66eab could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:08:41.719233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83ed81bd-3e04-45f5-b296-2a11d22ac824 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab" status: 404 len: 111 microversion: 2.1 time: 0.079264 Oct 13 09:08:41.722559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3450/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:08:41 2022] GET /compute/v2.1/servers/e5f3bd44-ab51-41b4-8f08-b8eb78d66eab => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:08:42.012830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:42.014377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:42.056192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:42.056706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:42.057154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:42.057883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:42.082840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:42.083350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:42.962374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:42.981721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:42.987905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:42.990217 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ab8fff7-4fe0-4339-8b2d-e02d428610c0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.981642 Oct 13 09:08:42.993956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3057/6507] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:42 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:43.182878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc2f4c96-2c63-4a40-bb53-5313bfc07ff4 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] Calling method '.version_select at 0x7f5375dbdc10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:43.229300 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc2f4c96-2c63-4a40-bb53-5313bfc07ff4 tempest-TestVolumeBackupRestore-174777913 tempest-TestVolumeBackupRestore-174777913-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1948739658" status: 202 len: 0 microversion: 2.1 time: 0.052189 Oct 13 09:08:43.231778 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3451/6508] 10.222.0.23 () {58 vars in 1269 bytes} [Thu Oct 13 09:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1948739658 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:08:44.039749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:44.040557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:44.059677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:44.060193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:44.060644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:44.063521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:44.064001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:44.064449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:44.970028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:45.005352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:45.012425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:45.013688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71b1f17f-db10-4cb7-9865-a3f88d1d2214 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.982273 Oct 13 09:08:45.017867 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3058/6509] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:44 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:46.048363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:46.049508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:46.096086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:46.096541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:46.097001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:46.106123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:46.112336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:46.112876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:47.289391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:47.299123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:47.300612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:47.301850 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6dfe41dd-1cef-4e05-ae50-216e0e76763e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 1.259856 Oct 13 09:08:47.346821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3452/6510] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:46 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:48.337481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:48.338093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:48.361605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:48.362193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:48.362703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:48.372027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:48.373871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:48.374358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:49.217315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:49.229433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:49.236348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:49.237844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d67b560-dd48-4024-a4a7-c2321480191a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.905043 Oct 13 09:08:49.260306 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3059/6511] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:48 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:50.267963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:50.268581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:50.288671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:50.289183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:50.289638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:50.297802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:50.298429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:50.298884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:50.996738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:51.015882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:51.021545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:51.029775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b67f373-f4b0-4f39-8688-f0344aa286eb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1744 microversion: 2.20 time: 0.764524 Oct 13 09:08:51.048353 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3453/6512] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:50 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1744 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:52.061724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:52.062547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:52.076601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:52.078289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:52.080537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:52.082221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:52.092773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:52.094245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:52.835650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:52.845627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:52.848785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:52.857515 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a2d0a8fc-d8b1-40d2-9f74-2dd8f295afb0 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1744 microversion: 2.20 time: 0.800134 Oct 13 09:08:52.859585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3060/6513] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:52 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1744 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:53.888042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:53.888966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:53.892390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:53.910798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:53.913543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:53.914332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:53.916517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:53.919163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:53.925724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:53.947984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=67 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:54.391406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:54.408898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:54.417509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:54.420008 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c00f2115-2882-4030-ad4f-5ab031652720 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1744 microversion: 2.20 time: 0.536368 Oct 13 09:08:54.420794 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3454/6514] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:53 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1744 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:55.447268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:55.447881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:55.451889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:55.469038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:55.469573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:55.470069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:55.470896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:55.471361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:55.471844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:55.487951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:08:56.422293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:56.434867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:56.436277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:56.437557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04c02d79-8f85-49fe-baa6-6ed7abf11993 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1744 microversion: 2.20 time: 0.994422 Oct 13 09:08:56.450845 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3061/6515] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:55 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1744 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:08:57.464407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:08:57.465739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:08:57.481937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:57.485344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:57.486101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:57.487138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:57.487833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:57.491233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:58.798912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "name": "network-vif-plugged", "status": "completed", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:08:58.823032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:08:58.825481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:08:58.827023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:08:58.864660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] Creating event network-vif-plugged:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:08:58.878991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-edcb5aba-770a-4a78-a7ac-86fce9e55cf8 req-d53f682c-81f0-486a-b842-ad0b86bdfdd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084500 Oct 13 09:08:58.880232 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3062/6516] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:08:58.958711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:58.977349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:58.983113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:08:58.985387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-915f7069-0a43-4a0f-94dc-6588b6efa508 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.525059 Oct 13 09:08:58.986588 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3455/6517] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:08:57 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:00.018794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:00.020810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:00.063789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:00.065372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:00.068518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:00.077722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:00.079406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:00.083122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:01.329662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:01.348361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:01.360884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:01.367844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51063865-8988-4f7c-88d5-098037ff17f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.354780 Oct 13 09:09:01.372434 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3063/6518] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:00 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:02.393976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:02.394832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:02.414992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:02.420422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:02.421175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:02.422192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:02.423026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:02.424198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:03.259772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:03.275938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:03.281077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:03.284404 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7f2c0ae-bf59-46a3-9b58-d68bf59e20ce tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 0.895029 Oct 13 09:09:03.307151 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3456/6519] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:02 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:04.314295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:04.315264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:04.336681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:04.337191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:04.337655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:04.338458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:04.338974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:04.339594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:05.691091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:05.701131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:05.702658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:05.703893 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16cc74ab-0329-4041-b2c4-4cdfbfa8f093 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.394626 Oct 13 09:09:05.722933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3064/6520] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:04 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:06.735397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:06.736082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:06.748484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:06.750635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:06.752195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:06.753139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:06.755976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:06.756648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:07.518761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:07.527698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:07.529158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:07.530374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0522cd37-1eef-4e63-a995-5cce28e26fff tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 0.799388 Oct 13 09:09:07.561859 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3457/6521] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:06 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:08.570333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:08.570988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:08.599498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:08.600246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:08.600849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:08.602484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:08.603108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:08.603694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:09.772761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:09.783361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:09.800385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:09.801908 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0191ff21-82fc-4b47-91ae-1868a3e383b8 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.236922 Oct 13 09:09:09.802871 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3065/6522] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:08 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:10.830301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:10.830951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:10.846193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:10.846728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:10.847184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:10.847913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:10.848369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:10.865213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:11.646153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:11.676448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:11.684924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:11.692333 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d63b14a3-1d5e-4571-87df-002e78beb872 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 0.859858 Oct 13 09:09:11.695716 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3458/6523] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:10 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:12.729654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:12.730346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:12.742596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:12.743109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:12.743553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:12.744278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:12.758600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:12.759075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:14.370732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:14.404429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:14.419497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:14.425834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1ad0e69-2b59-4c8e-a21f-26c30d97ce6a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.701078 Oct 13 09:09:14.426668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3066/6524] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:12 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:15.457800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:15.459186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:15.471031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:15.471800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:15.472841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:15.474215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:15.476768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:15.477400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:16.962681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:16.976446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:16.993370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:16.994774 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cba992b5-f9c1-4ab5-b790-3b0f2f0bceb1 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.543059 Oct 13 09:09:16.995380 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3459/6525] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:15 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:18.042446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:18.043983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:18.072463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:18.073197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:18.073912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:18.074752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:18.075217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:18.075656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:18.709710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:18.721928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:18.723548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:18.739672 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-05f85e75-1419-4d37-b480-a5a8b2a0f989 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 0.706453 Oct 13 09:09:18.740206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3067/6526] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:18 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:19.504259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44802460-6923-4072-952a-a5c2e979bbad tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Action: 'create', calling method: .version_select at 0x7f5375c6d9d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1383796912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAppkkz9YZ5PHXcls1Phj62/xPeCtlNzHjTjwPLlP/1TS54OqfiVSx2pZzIpb47+4VdmKk9uFapEskZ5wOTrJsqP7O3VRp1aXbSWedYcKNjDQtt4Bwyx/oBssWtHw7XTaA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:19.565130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-44802460-6923-4072-952a-a5c2e979bbad tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for project 9fc11efee7604ed693baeb556349e02b. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:09:19.581110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-44802460-6923-4072-952a-a5c2e979bbad tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for user ad501c0212474a80bb3d1c5d8ae70166 and project 9fc11efee7604ed693baeb556349e02b. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:09:19.638910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44802460-6923-4072-952a-a5c2e979bbad tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.458880 Oct 13 09:09:19.641938 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3460/6527] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:09:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:09:19.768170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:19.768786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:19.780920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:19.782296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:19.782925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:19.785652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:19.786390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:19.787570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:21.011722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:21.023145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:21.036659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:21.040162 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b9288f4-d2f5-4f95-b4e1-d00194617ee7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.276511 Oct 13 09:09:21.043874 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3068/6528] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:19 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:22.076143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:22.076920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:22.098089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:22.100019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:22.100661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:22.102337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:22.110075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:22.110798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:23.102535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:23.135867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:23.137789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:23.139281 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d1e2449-e7f1-477e-9acd-6b1150641d59 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.070275 Oct 13 09:09:23.140347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3461/6529] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:22 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:24.170020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:24.170796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:24.187119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:24.188614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:24.195061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:24.200173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:24.200861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:24.205950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:25.593962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:25.597693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=48 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:25.613645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:25.615998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:25.620508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9b93c578-fa06-4404-a761-8c119683b0f7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.454555 Oct 13 09:09:25.623235 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3069/6530] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:24 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:26.649150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:26.649845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:26.660203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:26.663068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:26.667214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:26.669278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:26.670341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:26.671004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:26.671590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:26.691049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=42 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:27.281659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:27.354583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:27.357558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:27.362142 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e2af231-1fdb-4226-bd8b-3a09303b792c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 0.716862 Oct 13 09:09:27.383437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3462/6531] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:26 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:27.934722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-990811530", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1383796912", "security_groups": [{"name": "tempest-secgroup-smoke-533455576"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "ea8f90e4-9ea9-4990-952f-8a8a34068cfc"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:27.961094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=18 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:28.372981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] validate_networks() for [('ea8f90e4-9ea9-4990-952f-8a8a34068cfc', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:09:28.396890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:28.398257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:28.426351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:28.427254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:28.430574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:28.435803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:28.436895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:28.437553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:29.603990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:29.629783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:29.648270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:29.649708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:29.655613 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5672854-c8ee-4287-b498-5796279588c9 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1739 microversion: 2.20 time: 1.262918 Oct 13 09:09:29.675226 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3463/6532] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:28 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1739 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:09:29.950879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for project 9fc11efee7604ed693baeb556349e02b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:09:29.958863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for user ad501c0212474a80bb3d1c5d8ae70166 and project 9fc11efee7604ed693baeb556349e02b. Resources: dict_keys(['metadata_items']) {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:09:30.007666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:09:30.008399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:09:30.009108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:09:30.009743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:09:30.010393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:09:30.020497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:30.021241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:30.021864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:30.022824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:30.024857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:30.026037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:30.080253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for project 9fc11efee7604ed693baeb556349e02b. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:09:30.087378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Getting quotas for user ad501c0212474a80bb3d1c5d8ae70166 and project 9fc11efee7604ed693baeb556349e02b. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:09:30.106480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:09:30.109138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:09:30.169531 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7eef77cb-ebbd-4e31-ac24-c1a279c74f31 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.240082 Oct 13 09:09:30.170961 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3070/6533] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:09:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:09:30.183064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac59b1d5-e70b-4276-8296-eef4858284f9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:30.183678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac59b1d5-e70b-4276-8296-eef4858284f9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:30.342651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac59b1d5-e70b-4276-8296-eef4858284f9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:30.354228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac59b1d5-e70b-4276-8296-eef4858284f9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1302 microversion: 2.1 time: 0.175494 Oct 13 09:09:30.370677 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3464/6534] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:30 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:30.689651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:30.690922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:30.721997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:30.722818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:30.723686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:30.729690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:30.731151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:30.734721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:31.256662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:31.270462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:31.274160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:31.275574 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82bfc482-d1ac-4884-bd45-c8f53f73a520 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1721 microversion: 2.20 time: 0.595302 Oct 13 09:09:31.278730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3071/6535] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:30 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1721 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:31.377259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:31.377873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:31.386707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:31.387203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:31.387642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:31.388367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:31.388822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:31.389261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:31.540091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:31.552064 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f46fe457-f2a0-4d0f-9cb4-7581b4563ef9 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1354 microversion: 2.1 time: 0.178633 Oct 13 09:09:31.552652 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3465/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:31 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:32.303514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:32.303893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:32.308878 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:09:32.310946 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 (ip 10.222.0.23) !!! Oct 13 09:09:32.333488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:32.333982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:32.334470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:32.335149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:32.335598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:32.336022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:32.574803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:32.579810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:32.580512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:32.584463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:32.590090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:32.592602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:32.594359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d699bf67-58c9-4221-b5f4-cd1c44418d39 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1721 microversion: 2.20 time: 0.295629 Oct 13 09:09:32.595172 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3072/6537] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:32 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:32.599677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:32.607657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:32.608696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:32.609403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:32.610052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:32.811791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:32.851536 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40a9ea9a-5a7c-4f43-8ede-dca94165a4e3 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1360 microversion: 2.1 time: 0.277370 Oct 13 09:09:32.855304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3466/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:32 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:33.119946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "name": "network-vif-unplugged", "status": "completed", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:33.141464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:33.142098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:33.142821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:33.168740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] Creating event network-vif-unplugged:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:09:33.174849 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-82d7488f-4727-41f2-955f-ea9fd19d5575 req-16e28387-1953-4289-960c-ad5751527573 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059951 Oct 13 09:09:33.175992 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3073/6539] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:09:33.626845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:33.627596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:33.656173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:33.656688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:33.657192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:33.657924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:33.658382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:33.658839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:33.881933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:33.884587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:33.906496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:33.907205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:33.907834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:33.908769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:33.909413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:33.910029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:34.244170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:34.262901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:34.267394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:34.270860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-888b7602-b86f-460d-9934-c6a01d29de46 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1724 microversion: 2.20 time: 0.649638 Oct 13 09:09:34.289198 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3467/6540] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:33 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1724 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:34.304769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15ce3c46-2226-48da-8f2f-9d7cb4435ff7"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:34.316175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:34.344303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:34.345734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:34.347878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:34.348965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:34.351001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:34.351688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:34.374850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:34.381254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e310e054-efa2-4768-ad14-d281e5fbdf54 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.503719 Oct 13 09:09:34.393591 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3074/6541] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:33 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:34.945048 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5faa4a0-7869-44b4-b87d-86a1e80709a7 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.648967 Oct 13 09:09:34.952140 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3468/6542] 10.222.0.23 () {62 vars in 1364 bytes} [Thu Oct 13 09:09:34 2022] POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments => generated 188 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:09:35.214778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:35.216314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:35.234040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.236284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.237649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:35.240078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.241448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.242617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:35.405353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:35.406037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:35.435955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.436688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.438514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:35.439990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.445990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.446528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:35.730592 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa903de1-5aa8-4a5b-9f04-0556f8383a4f tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments/15ce3c46-2226-48da-8f2f-9d7cb4435ff7" status: 202 len: 0 microversion: 2.20 time: 0.531604 Oct 13 09:09:35.734892 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3075/6543] 10.222.0.23 () {60 vars in 1457 bytes} [Thu Oct 13 09:09:35 2022] DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments/15ce3c46-2226-48da-8f2f-9d7cb4435ff7 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:09:35.862141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:35.871134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-abf6c26f-444c-448b-9ebe-65a825ecdce6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.470518 Oct 13 09:09:35.879550 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3469/6544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:35 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:09:35.899926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:35.900151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:35.910185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.910707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.911149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:35.911863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:35.917161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:35.917851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:36.004977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127031) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 09:09:36.184546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cae5b85c-d9a8-48a7-bec5-cd2bf66a9744 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/action" status: 202 len: 0 microversion: 2.20 time: 0.284094 Oct 13 09:09:36.185352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3076/6545] 10.222.0.23 () {62 vars in 1319 bytes} [Thu Oct 13 09:09:35 2022] POST /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:09:36.194529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:36.195335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:36.209672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:36.210285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:36.210765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:36.211524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:36.211987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:36.213863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:36.572812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:36.586018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:36.587554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:36.588945 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2ef02f7d-9825-4584-9032-d637284cae66 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1672 microversion: 2.20 time: 0.398940 Oct 13 09:09:36.606754 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3470/6546] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:36 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1672 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:36.788053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d08b6b-1b6b-4317-a8c3-038e3284f66c", "tag": "0a22f01c-4bad-4e90-9834-d5b509423296"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:36.811130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:36.812638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:36.827164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:36.856420 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] Creating event network-changed:0a22f01c-4bad-4e90-9834-d5b509423296 for instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c on n-h1-858384-11 Oct 13 09:09:36.878722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9a9b2e07-2ed1-4e3a-a207-4984bf537f61 req-7bd447d0-9242-4941-b6ef-992f6b636f19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094157 Oct 13 09:09:36.880018 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3077/6547] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:09:36.893049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:36.894004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:36.905552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:36.906399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:36.915615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:36.916889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:36.917594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:36.918243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:37.625760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:37.627379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:37.642279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:37.642976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:37.643485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:37.644262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:37.644782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:37.645267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:37.852446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:37.870746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4a106456-d014-4089-abcf-23cb04a499b0 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.981383 Oct 13 09:09:37.871529 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3471/6548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:36 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:38.136447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:38.146924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:38.152101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:38.154825 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fa521cc-cf7a-4e6d-98e3-11ccf14ec571 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1672 microversion: 2.20 time: 0.537658 Oct 13 09:09:38.177719 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3078/6549] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:37 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1672 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:09:38.901295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:38.902080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:38.924427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:38.924944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:38.925393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:38.926128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:38.926922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:38.937716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:39.203071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:39.206842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:39.229823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:39.230440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:39.231099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:39.232127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:39.232594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:39.233031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:39.799666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:39.820727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:39.821465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:39.833222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:39.835764 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5eca185-d255-463a-9aa2-b53551abc222 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.656419 Oct 13 09:09:39.839060 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4421b90c-2062-4d14-bd0e-fea588f6c1f2 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.942579 Oct 13 09:09:39.843599 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3079/6550] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:39 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:09:39.856513 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3472/6551] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:38 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:40.861134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:40.862545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:40.866100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:40.867318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:40.871299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:40.871524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:40.872316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:40.889934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:40.890359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:40.890830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:40.891554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:40.891717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:40.892017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:40.892447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:40.892847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:40.893766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:40.894752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:40.895525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:40.896129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:41.359506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:41.375334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:41.378257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:41.387678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f7ab0a7-87b4-4de9-b6cc-ac79aeb7c701 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.517957 Oct 13 09:09:41.389510 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3473/6552] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:40 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:09:41.936403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:41.948619 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-878b1659-2c6c-45f9-be27-2f8f54437740 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 1.088792 Oct 13 09:09:41.950006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3080/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:40 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:42.417809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:42.419325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:42.430842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:42.441063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:42.442175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:42.443616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:42.446398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:42.447633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:42.975860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:42.977903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:42.992080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:42.998350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:42.999146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:43.001866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:43.004958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:43.005456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:43.242040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:43.255828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:43.261950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:43.269592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3cd629a5-0584-453d-bbe1-c74fd7671456 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.856125 Oct 13 09:09:43.271771 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3474/6554] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:42 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:43.729641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:43.738555 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afaff802-4946-4d0d-a276-81ea96b674a5 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.769056 Oct 13 09:09:43.746653 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3081/6555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:42 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:44.305509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:44.307953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:44.320601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:44.326262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:44.330025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:44.336960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:44.338950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:44.339983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:44.773221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:44.773923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:44.789622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:44.800347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:44.800821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:44.801579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:44.802051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:44.802518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:44.848983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:44.863017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:44.867010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:44.870598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57166c47-16b9-49a6-85ed-43758911d08e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.570364 Oct 13 09:09:44.874273 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3475/6556] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:44 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:45.535050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:45.552168 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b9ae83c-fa82-418f-9683-44c533e5281d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.779041 Oct 13 09:09:45.574368 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3082/6557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:44 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:45.740441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d08b6b-1b6b-4317-a8c3-038e3284f66c", "name": "network-vif-plugged", "status": "completed", "tag": "0a22f01c-4bad-4e90-9834-d5b509423296"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:45.787743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:45.789225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:45.789811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:45.832348 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] Creating event network-vif-plugged:0a22f01c-4bad-4e90-9834-d5b509423296 for instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c on n-h1-858384-11 Oct 13 09:09:45.848158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-47dd1406-1aa1-43e3-813a-e03eb04537a8 req-96f91fd7-a6cc-4951-bad4-bdb30843597e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117913 Oct 13 09:09:45.848954 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3476/6558] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:09:45.904736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:45.905940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:45.926062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:45.926615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:45.927084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:45.930576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:45.931731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:45.933871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:46.262569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:46.277858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:46.283662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:46.301624 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6bbaf1f1-628e-44ae-930b-bc9acc1a5e89 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.400930 Oct 13 09:09:46.306528 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3083/6559] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:45 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:46.585511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:46.591281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:46.618389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:46.621769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:46.622742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:46.627762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:46.628968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:46.631040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:47.497536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:47.500066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:47.521479 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b6cd4d96-9d3e-4014-a97f-ce335304da1f tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1427 microversion: 2.1 time: 0.945432 Oct 13 09:09:47.526963 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3477/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:46 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1427 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:47.574287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:47.575037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:47.605563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:47.609142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:47.611111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:47.614642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:47.615410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:47.616094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:47.739422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f59b9e95-fbe7-4278-b1e5-c015ebe8e779 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Action: 'create', calling method: .version_select at 0x7f5375545820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1506682449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqmb39ycGA7ezWAO7MQPjKX21xAQ4S4EomBMBP0U+sUDwG2WJXSBwhZilDq0rrXiLB5NtmTVyuGeYssE8RaAOMNd2RRyiOsWt1AINhdrOEbNy75AfssMzuFhz1MGiX75w=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:47.773770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f59b9e95-fbe7-4278-b1e5-c015ebe8e779 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for project 492f248215584ee5816691f867d068f5. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:09:47.797962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f59b9e95-fbe7-4278-b1e5-c015ebe8e779 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for user b526540260764740bcd666f1259af88d and project 492f248215584ee5816691f867d068f5. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:09:47.866224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f59b9e95-fbe7-4278-b1e5-c015ebe8e779 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.720756 Oct 13 09:09:47.888880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3084/6561] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:09:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:09:48.174018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:48.193085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:48.194456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:48.197742 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2f86037-f49d-47bc-b210-201dd5d02f65 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.669550 Oct 13 09:09:48.200728 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3478/6562] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:47 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:48.546218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:48.547284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:48.562649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:48.568188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:48.569036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:48.570376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:48.572643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:48.574892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.121711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:49.128796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:49.174958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e22712f-e81c-4f09-8054-12b7bc125d15 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1607 microversion: 2.1 time: 0.614084 Oct 13 09:09:49.176413 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3085/6563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:48 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1607 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:49.204681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:49.205838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:49.235253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.236026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:49.236661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:49.238216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.240392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.242978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.250037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.250796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.274313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.274956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.275442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.280586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.281395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.281851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.776019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:49.784468 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c563c9fc-3eaf-45b9-a9a0-af29160398ca tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1607 microversion: 2.1 time: 0.584203 Oct 13 09:09:49.785045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3479/6564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:49 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1607 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:09:49.811791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:49.812673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:49.827600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.828361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.829576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:49.830603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:49.831212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:49.831788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:50.069957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:50.095405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:50.098585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:50.101102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75cb860c-a950-421c-8ae5-58310287f2a3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.868858 Oct 13 09:09:50.103912 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3086/6565] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:49 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:50.243412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:50.257529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c9de0ab-5fc9-442d-aa6a-da781ad02f1b tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1607 microversion: 2.1 time: 0.449488 Oct 13 09:09:50.258106 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3480/6566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:09:49 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1607 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:09:51.140020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:51.141389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:51.155541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:51.163537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:51.165045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:51.168209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:51.171085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:51.171754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:51.732027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:51.745089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:51.749627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:51.753601 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7dc52b67-d4a4-4f69-b742-ec2b3a58c31d tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.624551 Oct 13 09:09:51.758707 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3087/6567] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:51 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:52.802421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:52.803269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:52.813306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:52.813811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:52.814257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:52.818481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:52.818983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:52.824732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:54.382184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:54.392069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:54.393527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:54.417495 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-13f408b7-c59e-4efa-8cab-ab1f21241284 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 1.609463 Oct 13 09:09:54.439003 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3481/6568] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:52 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:55.450879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:55.453615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:55.474570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:55.484544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:55.485248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:55.488513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:55.489316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:55.492030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:56.010977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:56.030353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:56.032953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:56.035239 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c380fef1-9753-4568-a7af-2666fe8ceaa3 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.594025 Oct 13 09:09:56.036526 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3088/6569] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:55 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:57.064776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:57.065388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:57.068378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=42 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:57.078864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:57.081217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:57.081898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:57.084506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:57.085141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:57.090444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:57.417632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:57.474365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:57.480833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:57.483026 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-adb35f78-ab72-4e15-8cf8-0b5dcab8d77e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.422186 Oct 13 09:09:57.484324 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3482/6570] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:57 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:09:58.509666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:09:58.510649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:09:58.513611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:58.514304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:09:58.520970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:58.521470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:58.521915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:58.522686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:58.523150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:58.523581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:58.957453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d08b6b-1b6b-4317-a8c3-038e3284f66c", "tag": "0a22f01c-4bad-4e90-9834-d5b509423296"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:09:58.976227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:09:58.977475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:09:58.978592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:09:59.011175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] Creating event network-changed:0a22f01c-4bad-4e90-9834-d5b509423296 for instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c on n-h1-858384-11 Oct 13 09:09:59.022117 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e81155bd-b8ee-427a-8331-faa9ea519745 req-32c13537-3083-4e9c-8e97-a64872fdff0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070150 Oct 13 09:09:59.030208 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3483/6571] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:09:59.100022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:59.127948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:59.135649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:09:59.137516 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc714a1e-957d-43f0-9fee-34c13002ad19 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.632016 Oct 13 09:09:59.157930 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3089/6572] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:09:58 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:00.172621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:00.173332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:00.187589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:00.188094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:00.188535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:00.189426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:00.190041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:00.190672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:00.565662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:00.575218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:00.577503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:00.579131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4b6fed93-c295-4ce5-9d35-378c317fbd31 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.411798 Oct 13 09:10:00.598081 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3484/6573] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:00 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:01.616683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:01.624991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:01.652377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:01.654779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:01.655324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:01.657968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:01.660036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:01.662976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:02.381873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:02.394929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:02.396480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:02.402903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25ac2f97-ba87-450b-9c9a-c76bc73d37c5 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.801242 Oct 13 09:10:02.404092 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3090/6574] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:01 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:03.433887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:03.435846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:03.460179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:03.460988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:03.463061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:03.465341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:03.468526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:03.471242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:03.865712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2036125699-access_point-246495005", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "897a042d-54ae-4bca-9880-d25790b56797"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1506682449", "security_groups": [{"name": "tempest-secgroup_access--163822626"}, {"name": "tempest-secgroup_general--1645985057"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:04.039843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:04.054195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:04.057675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:04.060550 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-14de86ea-e9dd-46a0-89b7-88808b14f651 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.631841 Oct 13 09:10:04.063680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3485/6575] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:03 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:04.267439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] validate_networks() for [('897a042d-54ae-4bca-9880-d25790b56797', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:10:05.092412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:05.093595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:05.102311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:05.103608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:05.104508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:05.107093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:05.108721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:05.109364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:05.320263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:05.331055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:05.333266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:05.335819 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe0d7ee1-9b85-42cb-9180-a26a61769945 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.248768 Oct 13 09:10:05.352138 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3486/6576] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:05 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:10:05.364880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "name": "network-vif-plugged", "status": "completed", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:05.377152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:05.386878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:05.387714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:05.402860 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] Creating event network-vif-plugged:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:10:05.426034 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0e4ee60c-0064-4c68-96db-f361f779615c req-fd49d7db-e4bc-4977-b940-7a1e520209ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072165 Oct 13 09:10:05.427895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3487/6577] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:10:05.934738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:10:05.935226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:10:05.935717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:10:05.936135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:10:05.936662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:10:05.965014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:05.965806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:05.966501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:05.967453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:05.968062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:05.968907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:05.993955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for project 492f248215584ee5816691f867d068f5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:10:06.011327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for user b526540260764740bcd666f1259af88d and project 492f248215584ee5816691f867d068f5. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:10:06.082626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:10:06.085664 n-d-858384-11 devstack@n-api.service[127031]: WARNING nova.utils [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2036125699-access_point-246495005 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2036125699-ac Oct 13 09:10:06.087876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:10:06.160018 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-15e12c9c-8594-44ed-a915-c9973ec7a510 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.299795 Oct 13 09:10:06.161220 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3091/6578] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:10:03 2022] POST /compute/v2.1/servers => generated 457 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:10:06.174902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f860e1e6-5806-41fb-b62a-e255357f1917 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:06.175869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f860e1e6-5806-41fb-b62a-e255357f1917 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:06.348152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f860e1e6-5806-41fb-b62a-e255357f1917 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:06.359145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f860e1e6-5806-41fb-b62a-e255357f1917 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1294 microversion: 2.1 time: 0.188484 Oct 13 09:10:06.361055 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3488/6579] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:06 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:06.370376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:06.371587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:06.380265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:06.381980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:06.382800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:06.384215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:06.384839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:06.385937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:06.584496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:06.597075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:06.599868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:06.601279 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1102ac2d-4739-4d9e-8f9c-f1e4ca1fc84b tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.236440 Oct 13 09:10:06.602216 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3092/6580] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:06 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 13 09:10:07.384631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:07.385394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:07.406166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:07.406796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:07.407429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:07.408437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:07.409039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:07.409778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:07.538036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:07.560673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e5bd2c3d-45b1-433a-978d-934d7e3f695d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1290 microversion: 2.1 time: 0.178334 Oct 13 09:10:07.588653 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3489/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:07 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:07.634353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:07.635139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:07.666583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:07.667425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:07.668087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:07.669695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:07.672098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:07.672784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:08.214395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:08.228521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:08.232964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:08.237263 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-42fdfaf7-bafb-4555-92f7-07aae4933b3a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1730 microversion: 2.20 time: 0.606362 Oct 13 09:10:08.252407 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3093/6582] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:07 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1730 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:08.591911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:08.594022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:08.614751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:08.617226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:08.617719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:08.618626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:08.622362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:08.623363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:08.920570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:08.939116 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f68bf6f7-a842-4fa5-9ad5-56d5fcd2310b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1352 microversion: 2.1 time: 0.351650 Oct 13 09:10:08.939869 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3490/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:08 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1352 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:09.269593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:09.270973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:09.291285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:09.295043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:09.298132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:09.301493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:09.302435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:09.306220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:09.957999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:09.965267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:09.965799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:09.972912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:09.974386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:09.975425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:09.975918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:09.977028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98b1b665-0378-4847-8911-1f53740b760e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1717 microversion: 2.20 time: 0.710632 Oct 13 09:10:09.977741 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3094/6584] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:10:09 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1717 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:10:09.982730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:09.983501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:09.983979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:09.984416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:10.249231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:10.274724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-019dcb2c-be44-4769-b774-44848327cdcc tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1352 microversion: 2.1 time: 0.311577 Oct 13 09:10:10.279149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3491/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:09 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1352 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:10:11.302164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:11.303478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:11.317715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:11.318967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:11.319833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:11.320793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:11.329291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:11.330053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:12.267890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:12.283819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51590083-4f0a-4344-b8ce-fdf1702aa104 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.985588 Oct 13 09:10:12.286963 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3095/6586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:11 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:13.195719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab63940-681a-4082-9eee-82604afe3ef8", "tag": "526c1976-ff70-4436-8045-50d77edd5ca8"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:13.214424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:13.216250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:13.216805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:13.231562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] Creating event network-changed:526c1976-ff70-4436-8045-50d77edd5ca8 for instance aab63940-681a-4082-9eee-82604afe3ef8 on n-h2-858384-11 Oct 13 09:10:13.253183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-86d9ede6-a308-4fbe-a3f5-7392ab05204b req-0b4172e1-d41b-46d0-9687-46fc74041919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062063 Oct 13 09:10:13.254333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3492/6587] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:10:13.313859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:13.314553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:13.321829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:13.322431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:13.322974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:13.323945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:13.324662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:13.325184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:13.919696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:13.935294 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b5c50202-fd3c-40e0-9e38-c14b65a42967 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.625557 Oct 13 09:10:13.941303 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3096/6588] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:13 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:14.962964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:14.963875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:14.977021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:14.979145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:14.980540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:14.981387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:14.983255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:14.987371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:15.270839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:15.280598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2745e174-21c0-4a30-8547-6477ef6fd42d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.322704 Oct 13 09:10:15.281199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3493/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:14 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:16.307618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:16.308268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:16.315196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:16.315871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:16.321737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:16.322251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:16.337750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:16.338671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:16.339165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:16.339607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:16.786065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:16.797854 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f84e017d-238e-4ef8-a488-16a0753f6c45 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.496157 Oct 13 09:10:16.799906 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3097/6590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:16 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:17.824350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:17.824976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:17.832719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:17.838228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:17.839985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:17.841432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:17.845306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:17.846244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:17.846930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:17.860761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=80 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:18.242632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:18.268500 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62892b48-34a2-4df3-b0a2-d1c94103f6ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.446823 Oct 13 09:10:18.270517 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3494/6591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:17 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:19.294585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:19.295910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:19.304934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:19.305862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:19.306497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:19.307461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:19.308760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:19.309384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:19.314670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=69 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:19.421502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab63940-681a-4082-9eee-82604afe3ef8", "name": "network-vif-plugged", "status": "completed", "tag": "526c1976-ff70-4436-8045-50d77edd5ca8"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:19.453286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:19.463545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:19.464368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:19.496149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] Creating event network-vif-plugged:526c1976-ff70-4436-8045-50d77edd5ca8 for instance aab63940-681a-4082-9eee-82604afe3ef8 on n-h2-858384-11 Oct 13 09:10:19.507301 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cc706649-c5f3-4804-9352-cd756b8a174e req-13944c29-6003-44ea-a2c1-d56600674429 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089447 Oct 13 09:10:19.515918 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3495/6592] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:10:19.745853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:19.755449 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c00ae902-0135-4a4a-89e5-fb477a93e071 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.465973 Oct 13 09:10:19.774194 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3098/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:19 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:20.801047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:20.802750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:20.809998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:20.810909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:20.811519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:20.815566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:20.816231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:20.817411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:21.382472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:21.399779 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-01b8280d-e718-4ffb-9542-05844cab7e6b tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1471 microversion: 2.1 time: 0.614996 Oct 13 09:10:21.418879 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3496/6594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:20 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1471 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:22.426892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:22.429151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:22.445250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:22.446175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:22.446869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:22.448410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:22.449051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:22.449884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:22.824514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:22.834587 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ecbaf894-c05c-4fef-a1c7-1952daf955ed tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1641 microversion: 2.1 time: 0.412867 Oct 13 09:10:22.835998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3099/6595] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:22 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1641 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:22.858295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:22.859111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:22.866290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:22.867033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:22.867552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:22.868208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:22.868847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:22.869512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:23.084083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:10:23.103987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22a6b7ca-a4fc-479c-99a2-e368c42b7d54 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1641 microversion: 2.1 time: 0.249499 Oct 13 09:10:23.105718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3497/6596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:22 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1641 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:23.128291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:23.128826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:23.136781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:23.137427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:23.137998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:23.138754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:23.139220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:23.139650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:23.803178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e18454e3-4114-4fe8-85f4-83c71fdf4543 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1794 microversion: 2.1 time: 0.679277 Oct 13 09:10:23.824018 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3100/6597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:10:23 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1794 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:10:25.419940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:10:25.421781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:10:25.429873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:25.432791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:25.433510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:25.435517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:25.436221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:25.436899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:25.485395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6eeabb81-824a-4582-95ec-daec2aa38238 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.071804 Oct 13 09:10:25.486801 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3498/6598] 10.222.0.23 () {58 vars in 1293 bytes} [Thu Oct 13 09:10:25 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c/os-server-password => generated 116 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:10:27.895965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab63940-681a-4082-9eee-82604afe3ef8", "tag": "526c1976-ff70-4436-8045-50d77edd5ca8"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:27.916610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:10:27.917221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:10:27.917851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:10:27.949844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] Creating event network-changed:526c1976-ff70-4436-8045-50d77edd5ca8 for instance aab63940-681a-4082-9eee-82604afe3ef8 on n-h2-858384-11 Oct 13 09:10:27.970111 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-69e65de7-065f-49c7-82f2-6e2a520590fd req-c9c6b004-24c8-441c-82f3-3ce9a97cfb51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078851 Oct 13 09:10:27.973705 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3101/6599] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:10:50.510356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=35 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:50.511146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=23 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:10:50.867855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2251c04c-8bcd-425c-a239-7d63580257a9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: .version_select at 0x7f5375848ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1755869227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYp8M2jX1FyGCKG+2o69Sm5FBbynH31PBJ4CkWi8UgNa76rAPpAo3amkw31LJq9UMpxciHMvwnuxtBhLMckx22yQy0B/G4YEShNH8hqEyyOoyopVPdGDBtjgpytGs3gjA=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:10:50.887613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2251c04c-8bcd-425c-a239-7d63580257a9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:10:50.894424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2251c04c-8bcd-425c-a239-7d63580257a9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:10:50.932196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2251c04c-8bcd-425c-a239-7d63580257a9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.429818 Oct 13 09:10:50.932818 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3499/6600] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:10:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:02.604858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:02.605597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=19 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:02.611809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1318853165", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "ae2a9830-9eba-41f5-8eed-065b67a1a4bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1755869227", "security_groups": [{"name": "tempest-secgroup-smoke-1455563923"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:02.834759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] validate_networks() for [('ae2a9830-9eba-41f5-8eed-065b67a1a4bf', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:11:03.546980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:11:03.547459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:11:03.547937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:11:03.548369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:11:03.549353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:11:03.559379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:03.560053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:03.560765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:03.561761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:03.562427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:03.563011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:03.585984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:11:03.592800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:11:03.609045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:11:03.612671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:11:03.677202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-799243e4-2739-4796-a840-783e797f7954 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.074044 Oct 13 09:11:03.691114 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3102/6601] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:11:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:11:03.699353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b346dca0-c63b-4d85-b6fc-ba5dc8cbb5b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:03.700349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b346dca0-c63b-4d85-b6fc-ba5dc8cbb5b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:03.704101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:03.725683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:03.825315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b346dca0-c63b-4d85-b6fc-ba5dc8cbb5b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:03.839787 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b346dca0-c63b-4d85-b6fc-ba5dc8cbb5b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1267 microversion: 2.1 time: 0.150359 Oct 13 09:11:03.855874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3500/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:03 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:04.864701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:04.865639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:04.873696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:04.874231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:04.874703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:04.875423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:04.875872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:04.876295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:05.016495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:05.041686 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7d9cc34b-5a99-416f-b0b7-d938d634f523 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1319 microversion: 2.1 time: 0.172078 Oct 13 09:11:05.042366 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3103/6603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:04 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:06.002213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:06.004967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:06.018317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.022350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.022907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.023671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.024137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.024571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.067264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:06.070882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:06.079653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.083895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.084569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.087326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.089127 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83e74aea-f3cd-4e2d-924f-1647c6bb09f4 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.098228 Oct 13 09:11:06.089748 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3501/6604] 10.222.0.23 () {60 vars in 1343 bytes} [Thu Oct 13 09:11:05 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:06.096754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.097590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.208851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:06.211429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:06.235086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.236945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.237636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.241422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.241833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.242290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.295492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:11:06.484422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9895bdb-a584-4552-a2d2-d2d77afce454 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 204 len: 0 microversion: 2.20 time: 0.289195 Oct 13 09:11:06.487220 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3502/6605] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:11:06 2022] DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:11:06.498444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:06.500073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:06.509150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.510204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.510891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.520444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:06.521370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:06.522035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:06.791508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:06.808571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:06.810240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:06.811764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9cc169aa-98f3-4391-8f91-a690e15ffa2c tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.319462 Oct 13 09:11:06.812915 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3503/6606] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:06 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:11:06.922697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:06.942642 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-158386b4-ef2a-4d50-a18a-9f2f156d11a4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1325 microversion: 2.1 time: 0.879801 Oct 13 09:11:06.943256 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3104/6607] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:06 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1325 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:11:07.838647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:07.840083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:07.848922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:07.849739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:07.851285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:07.852589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:07.853227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:07.854021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:07.969571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:07.970813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:07.993723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:07.994754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:07.996640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:07.997704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:07.998582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:07.999560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:08.096010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:08.107175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:08.113179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:08.114625 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfd6d373-9814-40f1-99f2-d808ec3a838a tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.280618 Oct 13 09:11:08.117025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3504/6608] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:07 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:11:08.453567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:08.471595 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d689cfc-d146-471e-8d97-bcbbbb2b8ea8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.507890 Oct 13 09:11:08.472391 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3105/6609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:07 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:09.033778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:09.055504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:09.055997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:09.058420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:09.082593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] Creating event network-changed:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h1-858384-11 Oct 13 09:11:09.098934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e5f21b05-7c3b-44a7-9113-723ab60f16e9 req-1fbf8dc7-b98f-48ba-abc3-6ef58f3b3cb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068950 Oct 13 09:11:09.099549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3505/6610] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:09.143607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:09.145220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:09.163506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:09.166139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:09.167042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:09.168082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:09.169763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:09.171228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:09.502571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:09.503370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:09.513546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:09.514391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:09.515077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:09.515952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:09.516571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:09.517161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:09.523530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:09.537993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:09.541184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:09.548448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-72ff5de8-fe0e-40db-afdf-53c30ea947ab tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1723 microversion: 2.20 time: 0.405792 Oct 13 09:11:09.563110 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3106/6611] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:09 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:11:09.824524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:09.841689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c8c8c24-7e26-4a11-abeb-013c3ca10919 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.343036 Oct 13 09:11:09.843069 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3506/6612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:09 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:11:10.580412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:10.581760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:10.591431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:10.592263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:10.593242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:10.594332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:10.595067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:10.595716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:10.670160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:10.672884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:10.673508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:10.674126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lazy-loading 'fault' on Instance uuid 846cedb9-0155-449d-a03c-8369e0637ed1 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:11:10.744685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:10.758522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:10.771133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b165892374c048329f8d7cb1c29aa395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86809284aea846728abda8b2e94f2717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:10.776171 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81eaedc7-6824-42f7-a739-5ae2be521982 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 200 len: 1371 microversion: 2.20 time: 0.198286 Oct 13 09:11:10.778772 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3107/6613] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:10 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 13 09:11:10.867087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:10.867710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:10.885097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:10.890362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:10.892447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:10.896034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:10.900839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:10.901506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:11.150049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846cedb9-0155-449d-a03c-8369e0637ed1", "name": "network-vif-deleted", "tag": "4f12d77e-b593-4420-ab58-0b90d587490c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:11.188216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:11.188697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:11.189126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:11.215901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] Creating event network-vif-deleted:4f12d77e-b593-4420-ab58-0b90d587490c for instance 846cedb9-0155-449d-a03c-8369e0637ed1 on n-h2-858384-11 Oct 13 09:11:11.242026 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-69a16279-feea-4afa-8177-a3691b0e1617 req-4ddafa69-bfc2-40e0-85d1-7959fd948c10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095409 Oct 13 09:11:11.244120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3108/6614] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:11.515817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:11.531484 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbdac418-5cd4-4c6d-b458-e322ae24ef20 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.665680 Oct 13 09:11:11.532994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3507/6615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:10 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:11.808220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:11.808926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:11.817222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:11.817713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:11.818149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:11.818882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:11.819876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:11.820302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:11.839582 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 HTTP/1.1 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '846cedb9-0155-449d-a03c-8369e0637ed1'} Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:11.841390 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:11.849272 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ded77279-0b57-43c1-a082-e6f361a87e0e tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 404 len: 111 microversion: 2.20 time: 0.039971 Oct 13 09:11:11.853308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58386e78-1ad0-49d9-a4d8-61d1d2029c90 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '.version_select at 0x7f53754bd160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:11.857888 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3109/6616] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:11 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:11:11.877587 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58386e78-1ad0-49d9-a4d8-61d1d2029c90 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494202853" status: 204 len: 0 microversion: 2.20 time: 0.028162 Oct 13 09:11:11.881564 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3508/6617] 10.222.0.23 () {60 vars in 1262 bytes} [Thu Oct 13 09:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494202853 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 13 09:11:12.556482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:12.557197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:12.563877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:12.564596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:12.565024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:12.566273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:12.566979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:12.567266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:12.857058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:12.875306 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25018094-1a8b-4ccc-a2b8-b3502560d5ca tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.323422 Oct 13 09:11:12.876308 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3110/6618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:12 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:13.897035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:13.902263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:13.903098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:13.917689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:13.918083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:13.918558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:13.919284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:13.924527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:13.926165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:14.159153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:14.199090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-296698b1-089e-4cb3-b175-e2b6c8a8eb36 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.303688 Oct 13 09:11:14.199636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3509/6619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:13 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:15.225113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:15.226174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:15.228914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:15.230399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:15.249509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:15.250294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:15.251342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:15.253745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:15.254393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:15.255506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:15.689237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:15.703112 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61edbe56-ff0c-4962-aac5-ea7a50510aa1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.482632 Oct 13 09:11:15.705244 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3111/6620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:15 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:15.872107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "name": "network-vif-plugged", "status": "completed", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:15.889374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:15.889873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:15.892965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:15.912890 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] Creating event network-vif-plugged:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h1-858384-11 Oct 13 09:11:15.926126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0bc8e29f-52d7-4d0f-9179-c4393241682b req-b4b270a3-cfae-4a98-be25-0120ca494e2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296615 Oct 13 09:11:15.930624 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3510/6621] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:11:16.558245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:16.558878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:16.570229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.570762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.571209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:16.571936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.572400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.572831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:16.605639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 HTTP/1.1 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '846cedb9-0155-449d-a03c-8369e0637ed1'} Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:11:16.610520 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.614612 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.617382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:16.619335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-306a1bdd-9704-452b-9f75-1f05b05c45bb tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 404 len: 111 microversion: 2.20 time: 0.066218 Oct 13 09:11:16.621460 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3112/6622] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:11:16 2022] DELETE /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:11:16.633471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:16.633660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 846cedb9-0155-449d-a03c-8369e0637ed1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:16.641459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.642491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.642953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:16.643692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.644162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.644603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:16.669805 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 HTTP/1.1 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '846cedb9-0155-449d-a03c-8369e0637ed1'} Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.676365 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. Oct 13 09:11:16.680752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:16.683351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 846cedb9-0155-449d-a03c-8369e0637ed1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:16.693224 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3d0cbd3-491d-462f-9698-d4ab083ef007 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1" status: 404 len: 111 microversion: 2.20 time: 0.066054 Oct 13 09:11:16.697093 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3511/6623] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:16 2022] GET /compute/v2.1/servers/846cedb9-0155-449d-a03c-8369e0637ed1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:11:16.731541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:16.732436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:16.750665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.751659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.752420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:16.753740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:16.755272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:16.755975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:17.032797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:17.043951 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b70c631-ce7f-46c9-80a4-603e1a06c865 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1393 microversion: 2.1 time: 0.316196 Oct 13 09:11:17.047741 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3113/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:16 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1393 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:18.069967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:18.070711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:18.087081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:18.087874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:18.088694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:18.089742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:18.090373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:18.093154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:18.691815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:18.701753 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62928c27-86d1-4c48-9dea-9ecc1df77401 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1564 microversion: 2.1 time: 0.636268 Oct 13 09:11:18.708258 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3512/6625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:18 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1564 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:18.731247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:18.731853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:18.742276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:18.742696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:18.743348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:18.744216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:18.745121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:18.745728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:19.044774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:19.060404 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d4ef010-6cf6-413c-ac3a-332893398901 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1564 microversion: 2.1 time: 0.332842 Oct 13 09:11:19.071469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3114/6626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:18 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1564 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:21.249102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:21.249668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:21.265832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.270931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.272652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:21.273226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.273719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.277400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:21.320935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 HTTP/1.1 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6'} Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:11:21.324899 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.329315 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.331395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:21.333707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54a01fb7-e3c3-41af-80e1-acb742a66c96 tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 404 len: 111 microversion: 2.20 time: 0.091277 Oct 13 09:11:21.348221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:21.348969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] [instance: 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:21.355262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3513/6627] 10.222.0.23 () {60 vars in 1280 bytes} [Thu Oct 13 09:11:21 2022] DELETE /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:11:21.361482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.367868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.368936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:21.374236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.375013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.376883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:21.412521 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] HTTP exception thrown: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Request method failure captured: Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 HTTP/1.1 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9QyWvGidqVuoyiKUqVztxWq2Cy_wEqakdJRSzP7mPjX1SE1KhNOX-BIDB3X655WccX86F82b0XC7C6EY57dzvg7SKkWSy_uhVYdHhVyEfNzPJtQc8tnYXiroWpJkbfU7HyySE5mb1QdxB2V2GP2-XEPGrBbB5urypQ_VIbKkPYYU9o Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Openstack-Nova-Api-Version: 2.20 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86809284aea846728abda8b2e94f2717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86809284aea846728abda8b2e94f2717"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 86809284aea846728abda8b2e94f2717 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1963264710 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b165892374c048329f8d7cb1c29aa395 Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1963264710-project Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6'} Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.419773 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. Oct 13 09:11:21.424269 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:21.426289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] Returning 404 to user: Instance 424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:21.429235 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c61f85d4-2478-4b2c-9720-9af7bcaf80ed tempest-AttachVolumeShelveTestJSON-1963264710 tempest-AttachVolumeShelveTestJSON-1963264710-project] 10.222.0.23 "GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6" status: 404 len: 111 microversion: 2.20 time: 0.088112 Oct 13 09:11:21.438157 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3115/6628] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Oct 13 09:11:21 2022] GET /compute/v2.1/servers/424d4db5-bc60-4fdc-bc0c-3ad78a7d1af6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:11:21.916406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:21.917096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:21.947087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.947583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.948026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:21.948747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:21.954826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:21.955609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:22.054575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:22.074888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:22.075389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:22.075835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:22.100495 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] Creating event network-changed:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h1-858384-11 Oct 13 09:11:22.138418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ca654c85-ba1b-4e91-9fa4-8b4a74655501 req-e1033d7e-4112-4cfc-ad15-a79ec0a1568a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196335 Oct 13 09:11:22.139165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3116/6629] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:22.409367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:22.421349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90c4fca7-7fca-48d7-bee6-f9d9300f42d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1564 microversion: 2.1 time: 0.508795 Oct 13 09:11:22.422835 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3514/6630] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:21 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1564 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:28.976532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-462c8edd-bc93-41f4-89c0-bc546f8c5c1c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Action: 'create', calling method: .version_select at 0x7f53754433a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1871441979"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:29.659410 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-462c8edd-bc93-41f4-89c0-bc546f8c5c1c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.839304 Oct 13 09:11:29.660375 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3117/6631] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Oct 13 09:11:28 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 842 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 13 09:11:29.674161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c230737-68f1-4d65-8368-279690fc19c8 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375dd2940>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:29.770304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c230737-68f1-4d65-8368-279690fc19c8 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.100521 Oct 13 09:11:29.770933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3515/6632] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:29 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:30.786078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0a512ae-bd7b-4c06-966d-5aa2d19c9e12 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53753fe160>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:30.868757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0a512ae-bd7b-4c06-966d-5aa2d19c9e12 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.087470 Oct 13 09:11:30.869338 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3118/6633] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:30 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:31.886136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e6170ea-4e7e-4abe-999c-0006ed83bf61 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375d58160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:31.946918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:31.993106 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e6170ea-4e7e-4abe-999c-0006ed83bf61 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 346 microversion: 2.1 time: 0.113600 Oct 13 09:11:32.001610 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3516/6634] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:31 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:32.009707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9045b9c2-bda2-4090-9c79-0a19dc0fbdef tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Action: 'create', calling method: .version_select at 0x7f53755e5310>, body: {"snapshot": {"volume_id": "3af6b4bd-5641-4788-829b-58beda9fb0ba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1205901320"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:32.066067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:32.083123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=68 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:32.390486 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9045b9c2-bda2-4090-9c79-0a19dc0fbdef tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.386955 Oct 13 09:11:32.391379 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3119/6635] 10.222.0.23 () {60 vars in 1162 bytes} [Thu Oct 13 09:11:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:32.404073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe7e3f94-ad73-4cad-bb73-0c310fe826a1 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f537ac121f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:32.417513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:32.470284 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe7e3f94-ad73-4cad-bb73-0c310fe826a1 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.071546 Oct 13 09:11:32.474345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3517/6636] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:32 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:32.486286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e3ab674-f3e2-49b6-a86f-ed912f06a45f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53755f8dc0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:32.595203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e3ab674-f3e2-49b6-a86f-ed912f06a45f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113505 Oct 13 09:11:32.595781 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3120/6637] 10.222.0.23 () {58 vars in 1140 bytes} [Thu Oct 13 09:11:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:32.609436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-822eccee-1738-4414-9c74-4d6dd269b9b9 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53758a0040>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:32.689173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-822eccee-1738-4414-9c74-4d6dd269b9b9 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.085160 Oct 13 09:11:32.690301 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3518/6638] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:32 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:33.703996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b46c7f1c-2337-4e65-a0d8-6dd6c67afa0d tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53754e3f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:33.763645 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b46c7f1c-2337-4e65-a0d8-6dd6c67afa0d tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.064349 Oct 13 09:11:33.764231 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3121/6639] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:33 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:34.778273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aada959b-f583-41be-afe8-a8897be5d1fe tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375dd2160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:34.833649 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aada959b-f583-41be-afe8-a8897be5d1fe tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 288 microversion: 2.1 time: 0.059061 Oct 13 09:11:34.834496 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3519/6640] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:34 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:34.847034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9bb65371-67a8-40ed-b371-5f337b5f318e tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375555940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:35.005113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9bb65371-67a8-40ed-b371-5f337b5f318e tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 202 len: 0 microversion: 2.1 time: 0.162226 Oct 13 09:11:35.005706 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3122/6641] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 13 09:11:34 2022] DELETE /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:11:35.015341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8fced7f1-1f0d-43fb-a574-0197e30e6b30 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5376e479d0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:35.077066 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8fced7f1-1f0d-43fb-a574-0197e30e6b30 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.066048 Oct 13 09:11:35.079343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3520/6642] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:35 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:36.093215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c857bd28-6379-40fe-bce3-59e173bd2275 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f537559c040>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:36.135200 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c857bd28-6379-40fe-bce3-59e173bd2275 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.046786 Oct 13 09:11:36.136075 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3123/6643] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:36 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:37.149880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c7296e22-8408-4fb1-9aa6-66624f52d595 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375880c10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:37.211353 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c7296e22-8408-4fb1-9aa6-66624f52d595 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 200 len: 287 microversion: 2.1 time: 0.066896 Oct 13 09:11:37.212064 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3521/6644] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:37 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:38.226073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-179b7fe7-4664-4cf8-90ab-a3857e69d92c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375545af0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:38.294901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-179b7fe7-4664-4cf8-90ab-a3857e69d92c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] HTTP exception thrown: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-179b7fe7-4664-4cf8-90ab-a3857e69d92c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Request method failure captured: Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed HTTP/1.1 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ZA52VhEd3F--_KH01pSnmmVLQfXAS7NYP0V8rmi3OwVa81_n0zU9UOrksSTJhNXHkUYx3hCDBmUCNyr6JJfAR9U0buk4Kp6Mqi6KV3lWXLg8TkwZEzBgK0T3--3t38HOQuCsfpMuRHy2M_5qW0131R6YprnDpgPqwmZfs_rntDmW8 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c5b69e25396b451390d5758aa59185a4 Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: exception: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '4e611f4b-4bf9-4a6a-9faa-d4787f64bfed'} Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. (HTTP 404) (Request-ID: req-e54d0e53-f78b-4f87-83a4-22c6295f76e6) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:11:38.313237 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-179b7fe7-4664-4cf8-90ab-a3857e69d92c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Returning 404 to user: Snapshot 4e611f4b-4bf9-4a6a-9faa-d4787f64bfed could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-179b7fe7-4664-4cf8-90ab-a3857e69d92c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed" status: 404 len: 111 microversion: 2.1 time: 0.094088 Oct 13 09:11:38.317859 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3124/6645] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 09:11:38 2022] GET /compute/v2.1/os-snapshots/4e611f4b-4bf9-4a6a-9faa-d4787f64bfed => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:11:38.324869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3285ecdd-3a0f-4879-a490-90c6b1039b26 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375dbdca0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:38.471915 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3285ecdd-3a0f-4879-a490-90c6b1039b26 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 202 len: 0 microversion: 2.1 time: 0.151212 Oct 13 09:11:38.472819 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3522/6646] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:11:38 2022] DELETE /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:11:38.482480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b75c231f-b2fa-46fb-aed9-cabf81ad619c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375545ee0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:38.655588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b75c231f-b2fa-46fb-aed9-cabf81ad619c tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.177514 Oct 13 09:11:38.656316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3125/6647] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:38 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:39.672182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cdec2741-0bac-43b7-8b2c-5cf02b284918 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375dbd1f0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:39.824309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cdec2741-0bac-43b7-8b2c-5cf02b284918 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.156834 Oct 13 09:11:39.825642 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3523/6648] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:39 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:40.845676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84f6fe8a-9254-42fd-9666-b595100a5fba tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375486a60>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:40.956021 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84f6fe8a-9254-42fd-9666-b595100a5fba tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.114446 Oct 13 09:11:40.961689 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3126/6649] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:40 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:41.330311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-38978910", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "c0288edd-c9f3-4f49-81f8-147607cc80b7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1506682449", "security_groups": []}, "os:scheduler_hints": {"different_host": ["aab63940-681a-4082-9eee-82604afe3ef8"]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:41.422812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] validate_networks() for [('c0288edd-c9f3-4f49-81f8-147607cc80b7', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:11:41.928354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:41.938382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:41.954595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:41.957391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:41.958089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:41.960130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:41.965422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:41.966362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:42.070143 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-181ced30-b961-4867-aff7-fd09e473b0b7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action" status: 200 len: 24572 microversion: 2.1 time: 0.146906 Oct 13 09:11:42.075008 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3127/6650] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:11:41 2022] POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action => generated 24572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:11:42.086290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b3862b9-58d4-4ea2-a3ad-034737462014 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f5375545550>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:42.169068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b3862b9-58d4-4ea2-a3ad-034737462014 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 200 len: 345 microversion: 2.1 time: 0.092446 Oct 13 09:11:42.169962 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3128/6651] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:42 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:43.186560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a84b9b5-aa73-420e-97f4-d3ea73c0684f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53754e3f70>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:43.233001 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4a84b9b5-aa73-420e-97f4-d3ea73c0684f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] HTTP exception thrown: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a84b9b5-aa73-420e-97f4-d3ea73c0684f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Request method failure captured: Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba HTTP/1.1 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ZA52VhEd3F--_KH01pSnmmVLQfXAS7NYP0V8rmi3OwVa81_n0zU9UOrksSTJhNXHkUYx3hCDBmUCNyr6JJfAR9U0buk4Kp6Mqi6KV3lWXLg8TkwZEzBgK0T3--3t38HOQuCsfpMuRHy2M_5qW0131R6YprnDpgPqwmZfs_rntDmW8 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c5b69e25396b451390d5758aa59185a4 Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: exception: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3af6b4bd-5641-4788-829b-58beda9fb0ba'} Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. (HTTP 404) (Request-ID: req-2e8361f9-7ebd-40d2-a9cc-914b4d960c1f) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:11:43.235967 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a84b9b5-aa73-420e-97f4-d3ea73c0684f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Returning 404 to user: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a84b9b5-aa73-420e-97f4-d3ea73c0684f tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 404 len: 109 microversion: 2.1 time: 0.057655 Oct 13 09:11:43.239766 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3129/6652] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:43 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:11:43.250538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e32b5e98-9f61-47c0-8981-3dcd7bd49e0b tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f53753431f0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:43.305065 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-e32b5e98-9f61-47c0-8981-3dcd7bd49e0b tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] HTTP exception thrown: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e32b5e98-9f61-47c0-8981-3dcd7bd49e0b tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Request method failure captured: Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba HTTP/1.1 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ZA52VhEd3F--_KH01pSnmmVLQfXAS7NYP0V8rmi3OwVa81_n0zU9UOrksSTJhNXHkUYx3hCDBmUCNyr6JJfAR9U0buk4Kp6Mqi6KV3lWXLg8TkwZEzBgK0T3--3t38HOQuCsfpMuRHy2M_5qW0131R6YprnDpgPqwmZfs_rntDmW8 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c5b69e25396b451390d5758aa59185a4 Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: exception: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3af6b4bd-5641-4788-829b-58beda9fb0ba'} Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. (HTTP 404) (Request-ID: req-e8e28011-4fb8-4c9c-b89f-20eee5774d66) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:11:43.307507 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e32b5e98-9f61-47c0-8981-3dcd7bd49e0b tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Returning 404 to user: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e32b5e98-9f61-47c0-8981-3dcd7bd49e0b tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 404 len: 109 microversion: 2.1 time: 0.065048 Oct 13 09:11:43.312355 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3130/6653] 10.222.0.23 () {58 vars in 1248 bytes} [Thu Oct 13 09:11:43 2022] DELETE /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:11:43.319048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd0a6280-1fa3-405e-b6ca-e5788e14a7d0 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Calling method '.version_select at 0x7f537534f700>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:43.372557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-cd0a6280-1fa3-405e-b6ca-e5788e14a7d0 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] HTTP exception thrown: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd0a6280-1fa3-405e-b6ca-e5788e14a7d0 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Request method failure captured: Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba HTTP/1.1 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9ZA52VhEd3F--_KH01pSnmmVLQfXAS7NYP0V8rmi3OwVa81_n0zU9UOrksSTJhNXHkUYx3hCDBmUCNyr6JJfAR9U0buk4Kp6Mqi6KV3lWXLg8TkwZEzBgK0T3--3t38HOQuCsfpMuRHy2M_5qW0131R6YprnDpgPqwmZfs_rntDmW8 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17f520f464fb4a80913bed6da0909d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 17f520f464fb4a80913bed6da0909d3e Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1155503858 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c5b69e25396b451390d5758aa59185a4 Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1155503858-project Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: method: Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: exception: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '3af6b4bd-5641-4788-829b-58beda9fb0ba'} Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. (HTTP 404) (Request-ID: req-cf256a0e-6f79-4e85-8af2-0f977ffe8f9b) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 13 09:11:43.374698 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cd0a6280-1fa3-405e-b6ca-e5788e14a7d0 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] Returning 404 to user: Volume 3af6b4bd-5641-4788-829b-58beda9fb0ba could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cd0a6280-1fa3-405e-b6ca-e5788e14a7d0 tempest-VolumesSnapshotsTestJSON-1155503858 tempest-VolumesSnapshotsTestJSON-1155503858-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba" status: 404 len: 109 microversion: 2.1 time: 0.062482 Oct 13 09:11:43.378331 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3131/6654] 10.222.0.23 () {58 vars in 1245 bytes} [Thu Oct 13 09:11:43 2022] GET /compute/v2.1/os-volumes/3af6b4bd-5641-4788-829b-58beda9fb0ba => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:11:43.460187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:11:43.460677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:11:43.461097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:11:43.461510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:11:43.461925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:11:43.483920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:43.487542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:43.488029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:43.491255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:43.491752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:43.492203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:43.547343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for project 492f248215584ee5816691f867d068f5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:11:43.556057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Getting quotas for user b526540260764740bcd666f1259af88d and project 492f248215584ee5816691f867d068f5. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:11:43.578533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:11:43.586063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:11:43.670841 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:11:44.681678 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 42874. Oct 13 09:11:44.688188 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dfaa5620-d968-40a1-8341-9c8410c2d5db tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.363585 Oct 13 09:11:44.690096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3524/6655] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:11:41 2022] POST /compute/v2.1/servers => generated 361 bytes in 3367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:11:44.702314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-14824596-ad3f-4840-8eff-586da42e7029 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:44.703122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-14824596-ad3f-4840-8eff-586da42e7029 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:44.835810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-14824596-ad3f-4840-8eff-586da42e7029 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:44.863210 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-14824596-ad3f-4840-8eff-586da42e7029 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1240 microversion: 2.1 time: 0.163241 Oct 13 09:11:44.865619 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3132/6656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:44 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1240 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:45.892461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:45.893173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:45.907095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:45.909956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:45.910638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:45.911845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:45.913228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:45.915263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:46.070659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:46.082364 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4dc61533-1c3b-4fc1-8206-919c12106edb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1236 microversion: 2.1 time: 0.194959 Oct 13 09:11:46.085027 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3525/6657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:45 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1236 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:47.112715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:47.113549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:47.149761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:47.150656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:47.151294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:47.152247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:47.152873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:47.153468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:47.308932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:47.328408 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-af3b4f91-6e49-4746-a81a-bb8ba67e1c2a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.219351 Oct 13 09:11:47.342496 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3133/6658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:47 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:48.357920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:48.359269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:48.377821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:48.379938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:48.381577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:48.386627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:48.387221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:48.387763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:48.639261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:48.648023 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7902f0d3-71bb-4b46-925b-4844a4ea9db5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.295502 Oct 13 09:11:48.652982 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3526/6659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:48 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:49.677533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:49.678111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:49.685340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:49.685841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:49.686282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:49.687029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:49.687487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:49.687923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:49.773646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:49.782350 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08335358-1ec1-4c9e-97f3-bb9e4c34fe8d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.108882 Oct 13 09:11:49.782977 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3134/6660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:49 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:50.319821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa19b21d-4c73-4e83-b391-486d9c9799a6", "tag": "7806f8ba-f338-4470-b03c-27a029d14274"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:50.353170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:50.353695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:50.354130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:50.388804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] Creating event network-changed:7806f8ba-f338-4470-b03c-27a029d14274 for instance fa19b21d-4c73-4e83-b391-486d9c9799a6 on n-h1-858384-11 Oct 13 09:11:50.401304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9a5fa149-fb10-4c0b-ac16-ecf3ad8695ea req-ca233616-fffe-4859-9671-5b8575be83ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089907 Oct 13 09:11:50.402962 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3527/6661] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:11:50.809071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:50.810397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:50.817201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:50.818623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:50.819310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:50.820244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:50.820920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:50.821586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:50.973234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:50.985074 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ed4a13f-d736-4704-bc4c-53e997eff91d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.182258 Oct 13 09:11:50.987210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3135/6662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:50 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:52.013335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:52.014138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:52.041454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:52.056007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:52.058473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:52.061568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:52.062255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:52.064104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:52.263223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:52.273794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35bd0a94-cb04-498c-80bb-f3a0600f210a tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.266537 Oct 13 09:11:52.289552 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3528/6663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:52 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:53.049034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:53.049652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:53.057717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.058509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.059331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.060280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.061124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.062036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.301693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:53.302226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:53.312146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.313463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.314322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.318731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.319476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.320215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.441576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:53.449974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47622e5e-1291-4a74-9292-424203c35fdb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.152528 Oct 13 09:11:53.463106 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3529/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:53 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:53.489132 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7fe7753b-d1e9-47eb-83da-3ef69cf971c3 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1836 microversion: 2.1 time: 0.443635 Oct 13 09:11:53.489636 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3136/6665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:53 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1836 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:53.512589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:53.513554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:53.515986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:53.522135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.523221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.523907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.525125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.525826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.526361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.571255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:53.701253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:53.713583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d49d8f0-9548-48d8-b161-fea65d46421b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1683 microversion: 2.1 time: 0.203808 Oct 13 09:11:53.714662 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3530/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:53 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:53.882485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:53.885117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:53.897975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.898498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.898948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.899671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:53.900132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:53.904240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:53.976059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec82ecc9-25f2-4c61-ab3e-6bb6f9c31e03 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action" status: 200 len: 32646 microversion: 2.1 time: 0.097363 Oct 13 09:11:53.978552 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3137/6667] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:11:53 2022] POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action => generated 32646 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:11:54.165489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:54.166212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:54.197226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.197968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.198577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.199400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.199945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.200441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.290062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7cf5a42bb013434cba6d221d2c2ef2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16977c4c5ef54d31b5f8697cd08c0b78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:54.291008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] flavor_id is None. Assuming migration. {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 13 09:11:54.291790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:11:54.477934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:54.479312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:54.493995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.494799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.497589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.498608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.500735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.502574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.669564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:54.687201 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c93687ec-f3f4-4bfe-aa7a-a7b8e76ce2eb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.215090 Oct 13 09:11:54.689963 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3138/6668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:54 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:11:54.696989 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bbf50a8e-e104-493e-9819-cd2cb7f1c299 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action" status: 202 len: 0 microversion: 2.1 time: 0.535372 Oct 13 09:11:54.697540 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3531/6669] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:11:54 2022] POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:11:54.718860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:54.720290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:54.738037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.738621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.741306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.743158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:54.743919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:54.746677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:54.846940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:11:55.302114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:55.315110 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9025ff44-7690-40c2-ba60-ee5361791d21 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1692 microversion: 2.1 time: 0.607071 Oct 13 09:11:55.316788 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3139/6670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:54 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1692 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:55.724702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:55.725364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:55.738835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:55.742090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:55.742557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:55.744898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:55.745567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:55.745997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:55.926897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:55.949547 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6c2bd350-0a7e-4c2d-aa7a-a97b3dafa1f4 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.236762 Oct 13 09:11:55.951457 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3532/6671] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:55 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:56.174723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa19b21d-4c73-4e83-b391-486d9c9799a6", "name": "network-vif-plugged", "status": "completed", "tag": "7806f8ba-f338-4470-b03c-27a029d14274"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:11:56.200897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:56.202533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:56.204458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:56.241133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] Creating event network-vif-plugged:7806f8ba-f338-4470-b03c-27a029d14274 for instance fa19b21d-4c73-4e83-b391-486d9c9799a6 on n-h1-858384-11 Oct 13 09:11:56.250701 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-19ee18ab-c91f-4f9a-ae75-256dc1e3dd8c req-06f6748a-163a-4d44-a53d-f7127ca6cd77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082036 Oct 13 09:11:56.251728 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3140/6672] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:11:56.351492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:56.356171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:56.375136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:56.376864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:56.377871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:56.380613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:56.382503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:56.387933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:56.822742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:56.833037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a106eef-c80a-465d-9eb9-190fb9c282be tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1692 microversion: 2.1 time: 0.492138 Oct 13 09:11:56.838806 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3533/6673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:56 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1692 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:56.975593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:56.976296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:56.993502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:56.994028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:56.995643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:56.998556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:56.999054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:57.001234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:57.210004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:57.223964 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c998824-a2be-4d6f-9d25-f18f5d24e5ea tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1298 microversion: 2.1 time: 0.253648 Oct 13 09:11:57.224673 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3141/6674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:56 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1298 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:57.865523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:57.866117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:57.887202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:57.889211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:57.890953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:57.893655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:57.895638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:57.899643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:58.182949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:58.191519 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc254f81-a5f3-435c-ae3d-e635cbb7745b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1692 microversion: 2.1 time: 0.330671 Oct 13 09:11:58.202826 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3534/6675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:57 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1692 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:58.251787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:58.252409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:58.264963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:58.265585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:58.266285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:58.267936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:58.269555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:58.270813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.059689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:59.075527 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e236126-25a8-4e5a-81ca-22d8cb2738ba tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1470 microversion: 2.1 time: 0.827430 Oct 13 09:11:59.076135 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3142/6676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:58 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1470 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:59.100772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:59.102330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:59.118767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.124005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.125141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.129297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.130944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.132609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.217587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:59.218534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:59.231501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.239138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.241696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.242492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.242958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.243393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.391647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:59.404170 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87c3b26f-2a40-45bb-b2ba-e1f491f8e6b2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1470 microversion: 2.1 time: 0.309289 Oct 13 09:11:59.421458 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3535/6677] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:59 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:59.431646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:59.440655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:59.453846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.454636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.456118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.459713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.460390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.460990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.628553 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61cf980d-8691-4944-9e22-a3829f34054f tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1623 microversion: 2.1 time: 0.201092 Oct 13 09:11:59.629151 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3536/6678] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:59 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1623 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:11:59.654467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:11:59.655102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:11:59.661017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:11:59.679739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.679739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.679739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.681255 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1afe6f7e-f3c4-464a-a53f-a486b10eab5e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.467989 Oct 13 09:11:59.682043 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3143/6679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:59 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:11:59.682648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:11:59.683273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:11:59.683896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:11:59.962686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-581b193d-7776-44b0-96ae-a119d124ddc6 tempest-TestSecurityGroupsBasicOps-1338600726 tempest-TestSecurityGroupsBasicOps-1338600726-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1912 microversion: 2.1 time: 0.310063 Oct 13 09:11:59.978886 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3537/6680] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:11:59 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1912 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:12:00.137747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:00.138245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:00.148745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.149238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.149675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:00.150381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.150858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.151281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:00.214903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:12:00.383342 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db750917-eecb-44a3-9af1-04a5c708b0fb tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 204 len: 0 microversion: 2.1 time: 0.249144 Oct 13 09:12:00.390711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3144/6681] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:12:00 2022] DELETE /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:12:00.399550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:00.400170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:00.419691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.426148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.430563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:00.430563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.431199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.431753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:00.624108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:00.636263 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64382643-eb5c-45c7-afb5-beb39652a2e2 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1476 microversion: 2.1 time: 0.241353 Oct 13 09:12:00.638944 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3538/6682] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:00 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:00.716783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:00.718020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:00.731760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.732170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.732612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:00.733335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:00.733782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:00.734215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:01.057343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:01.076711 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bee15992-0fb5-4955-8e74-813fedbdf538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.367242 Oct 13 09:12:01.078054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3145/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:00 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:01.664391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:01.665272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:01.685390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:01.686754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:01.687298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:01.688720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:01.693906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:01.694507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:02.083509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:02.095421 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42272d9a-689d-4b5b-ad37-f5ba7791e60c tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1476 microversion: 2.1 time: 0.435508 Oct 13 09:12:02.096333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3539/6684] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:01 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:02.119362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:02.120219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:02.124179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:02.132890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:02.133628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:02.136132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:02.137453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:02.138609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:02.139486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:02.147957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:02.361111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:02.378101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b441d10-1422-4d02-8660-b625e5f62167 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.263202 Oct 13 09:12:02.379020 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3146/6685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:02 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:03.125462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:03.126089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:03.128975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:03.141898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:03.142462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:03.142898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:03.145409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:03.146457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:03.146965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:03.152012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:03.324288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:03.335063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-351b47a7-d31e-4309-bdac-4bb21ab2d7e5 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 200 len: 1476 microversion: 2.1 time: 0.213618 Oct 13 09:12:03.336294 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3540/6686] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:03 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:03.406643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:03.418368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:03.433622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:03.437970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:03.438966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:03.441733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:03.445637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:03.446328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:03.455284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa19b21d-4c73-4e83-b391-486d9c9799a6", "name": "network-vif-deleted", "tag": "7806f8ba-f338-4470-b03c-27a029d14274"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:03.514492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:03.519990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:03.520629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:03.573911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] Creating event network-vif-deleted:7806f8ba-f338-4470-b03c-27a029d14274 for instance fa19b21d-4c73-4e83-b391-486d9c9799a6 on n-h1-858384-11 Oct 13 09:12:03.592878 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-68b73298-dae7-4adc-a8ca-f823f8f2eee1 req-28660599-d233-424d-adf7-69c31b030422 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141304 Oct 13 09:12:03.604137 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3541/6687] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:12:03.816416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:03.843053 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d0e4da2-9c8d-4fd0-b0cb-98e07f5a076e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.443162 Oct 13 09:12:03.845252 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3147/6688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:03 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:04.361614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:04.362493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: fa19b21d-4c73-4e83-b391-486d9c9799a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:04.375129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:04.378293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:04.379092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:04.380192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:04.384570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:04.385228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:04.418311 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] HTTP exception thrown: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Request method failure captured: Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 HTTP/1.1 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9XYyYwwKCtObRWP3n522f1z4UUikAyTsNN8sbIMjA6JGaCAkaQbbCSBthD6PILN7XYPpNlf6hOjP9tPFf3qKdlB5xptuqDn6Pno_hqq-1E4byj5ZvPQtyyEJU5hW22cuvhFjl3_0dQpu-zJ1_RA9lm8XWygL69dXNOluXqyZ5DBXhQ Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 492f248215584ee5816691f867d068f5 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/492f248215584ee5816691f867d068f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_492f248215584ee5816691f867d068f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/492f248215584ee5816691f867d068f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/492f248215584ee5816691f867d068f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 492f248215584ee5816691f867d068f5 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestSecurityGroupsBasicOps-2036125699-project Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b526540260764740bcd666f1259af88d Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2036125699-project Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'fa19b21d-4c73-4e83-b391-486d9c9799a6'} Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:12:04.420215 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:12:04.424886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Returning 404 to user: Instance fa19b21d-4c73-4e83-b391-486d9c9799a6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:12:04.426816 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e11e4f4-87cc-4fb5-8c10-663f1ccb0e7d tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6" status: 404 len: 111 microversion: 2.1 time: 0.070198 Oct 13 09:12:04.428491 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3542/6689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:04 2022] GET /compute/v2.1/servers/fa19b21d-4c73-4e83-b391-486d9c9799a6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:12:04.868248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:04.868851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:04.883019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:04.883520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:04.883961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:04.884674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:04.885131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:04.885561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:05.336821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:05.351924 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d7516f6-c1f9-4904-a297-e6c75b2fabd1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.487564 Oct 13 09:12:05.353157 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3148/6690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:04 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:06.379540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:06.381653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:06.395234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:06.397278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:06.398362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:06.399480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:06.400181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:06.400855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:06.787169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:06.795974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cb7870a-0e92-4bdb-ae60-adf751fcf978 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.423310 Oct 13 09:12:06.796932 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3543/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:06 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:07.826661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:07.827278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:07.837414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:07.837905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:07.841819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:07.842861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:07.843496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:07.845710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:08.273987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:08.306227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ab3d25f-5ef8-43de-8e58-7b4c71961120 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.485208 Oct 13 09:12:08.331083 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3149/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:07 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:09.341799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:09.343171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:09.370573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:09.379522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:09.381149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:09.381876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:09.382348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:09.385087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:09.897662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:09.907081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7defb91f-eacc-4c1a-9895-c5b2e8d9e9c3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.575990 Oct 13 09:12:09.908092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3544/6693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:09 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:10.933809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:10.934636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:10.950249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:10.951372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:10.952507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:10.970953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:10.972249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:10.975475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:11.363764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:11.402509 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9edb2fe3-f8f5-4cd0-972b-5223d74f32b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1697 microversion: 2.1 time: 0.474077 Oct 13 09:12:11.403120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3150/6694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:10 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1697 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:12.052464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "name": "network-vif-unplugged", "status": "completed", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:12.075513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:12.076062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:12.076527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:12.099444 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Creating event network-vif-unplugged:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h2-858384-11 Oct 13 09:12:12.118506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:12:12.134606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4fb0d1f6-3e8e-4377-a2d8-4f18eb8eecc3 req-89a8ed77-ac78-4f9a-8c0e-865e1bf4bc66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086196 Oct 13 09:12:12.138860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3545/6695] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:12:12.430713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:12.431453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:12.438608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:12.439106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:12.439549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:12.440255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:12.440704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:12.441225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:12.862099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:12.871657 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3ad3552c-2b6f-4bde-93ce-4cf130a7b2d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1696 microversion: 2.1 time: 0.445205 Oct 13 09:12:12.876406 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3151/6696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:12 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1696 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:13.324492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:13.326003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:13.339051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab63940-681a-4082-9eee-82604afe3ef8", "tag": "526c1976-ff70-4436-8045-50d77edd5ca8"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:13.359402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.360188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.361682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.363796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.365321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.366032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.366735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.369902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.373860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.407641 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] Creating event network-changed:526c1976-ff70-4436-8045-50d77edd5ca8 for instance aab63940-681a-4082-9eee-82604afe3ef8 on n-h2-858384-11 Oct 13 09:12:13.430120 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6477e2dd-4d5e-4f4a-8f38-82b5a781d469 req-366634bd-6afa-4904-a867-631ee50e9bec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095048 Oct 13 09:12:13.432842 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3152/6697] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:12:13.455485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:12:13.605367 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f79d625a-955e-4879-8c5d-224ad184a134 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 204 len: 0 microversion: 2.1 time: 0.285827 Oct 13 09:12:13.607854 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3546/6698] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:12:13 2022] DELETE /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:12:13.621934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:13.623370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:13.630590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.631526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.632399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.633685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.634439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.635141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.850235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:13.859088 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-34bd2d13-dbd1-4be9-943d-73681c7fb063 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1765 microversion: 2.1 time: 0.245902 Oct 13 09:12:13.859696 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3153/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:13 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1765 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:12:13.904575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:13.905839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:13.926438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.927909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.930092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:13.930868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:13.934432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:13.935841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:14.233475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:14.255625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:14.256427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:14.257290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:14.268659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:14.285627 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d432c06-41c6-40cc-ac50-492ec5ff9f6b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1696 microversion: 2.1 time: 0.386257 Oct 13 09:12:14.287399 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3547/6700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:13 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1696 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:14.311119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Creating event network-changed:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h2-858384-11 Oct 13 09:12:14.329482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:12:14.352087 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f06dfbc7-5d48-4539-991a-2f1e037c409c req-b533398c-1daf-4285-9cd1-3192459f94ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124092 Oct 13 09:12:14.356906 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3154/6701] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:12:14.883370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:14.884101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:14.902079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:14.903700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:14.904256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:14.908315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:14.911654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:14.912412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:15.318732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:15.320421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:15.331094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:15.331838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:15.334632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:15.335602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:15.338328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:15.339056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:15.456093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:15.472349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a00e590-56be-4135-b3ac-300a7d3d1f35 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1765 microversion: 2.1 time: 0.593275 Oct 13 09:12:15.472952 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3548/6702] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:14 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1765 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:15.955495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:15.973873 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fb505dea-0853-4d4b-845b-790956a45ee7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1696 microversion: 2.1 time: 0.655146 Oct 13 09:12:15.974519 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3155/6703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:15 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1696 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:16.497926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:16.499222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:16.516252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:16.517244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:16.518980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:16.522329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:16.523057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:16.524394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:16.630216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:16.641455 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c62413df-33ec-447b-a86e-e9a0a3923efe tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1528 microversion: 2.1 time: 0.148022 Oct 13 09:12:16.642193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3549/6704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:16 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1528 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:16.745170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab63940-681a-4082-9eee-82604afe3ef8", "name": "network-vif-deleted", "tag": "526c1976-ff70-4436-8045-50d77edd5ca8"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:16.763320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:16.764210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:16.765009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:16.780136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] Creating event network-vif-deleted:526c1976-ff70-4436-8045-50d77edd5ca8 for instance aab63940-681a-4082-9eee-82604afe3ef8 on n-h2-858384-11 Oct 13 09:12:16.797945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-68288c67-f50f-439d-a680-100f80526d39 req-da3c58fc-1c4d-4e9d-b99f-1eb80cf8a777 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266852 Oct 13 09:12:16.801713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3156/6705] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:12:17.002185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:17.003182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:17.012097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:17.015116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:17.015945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:17.017875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:17.018617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:17.019320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:17.613915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:17.623427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0564f80f-dfa3-423c-ad0f-5ff7154653c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1694 microversion: 2.1 time: 0.625218 Oct 13 09:12:17.624120 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3550/6706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:16 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1694 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:17.667568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:17.668458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:17.675690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:17.676303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:17.677465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:17.678272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:17.679145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:17.679618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:17.815798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:17.825380 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-731af935-d81a-4e9b-9cce-a42d45927900 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1528 microversion: 2.1 time: 0.162810 Oct 13 09:12:17.825958 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3157/6707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:17 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1528 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:18.648212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:18.652324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:18.664845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:18.665673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:18.666507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:18.667673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:18.668434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:18.669150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:18.860884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:18.865787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:18.894291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:18.902860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:18.904487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:18.905289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:18.906006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:18.906465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:18.994378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:19.007155 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9f75f0a-ab25-4349-b0ff-cdc4f2a50d89 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1694 microversion: 2.1 time: 0.362520 Oct 13 09:12:19.023299 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3551/6708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:18 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1694 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:19.101784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b526540260764740bcd666f1259af88d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492f248215584ee5816691f867d068f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:19.120478 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7d8ba79-8ad9-49f8-82e8-7449a3fccd18 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 200 len: 1379 microversion: 2.1 time: 0.274739 Oct 13 09:12:19.121097 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3158/6709] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:18 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 1379 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:12:20.034510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:20.035852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:20.045022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.048697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.049327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.050068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.050557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.050996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.143329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:20.144183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] [instance: aab63940-681a-4082-9eee-82604afe3ef8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:20.158972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.158972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.158972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.159352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.166949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.168290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.204635 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] HTTP exception thrown: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Request method failure captured: Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 HTTP/1.1 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9XYyYwwKCtObRWP3n522f1z4UUikAyTsNN8sbIMjA6JGaCAkaQbbCSBthD6PILN7XYPpNlf6hOjP9tPFf3qKdlB5xptuqDn6Pno_hqq-1E4byj5ZvPQtyyEJU5hW22cuvhFjl3_0dQpu-zJ1_RA9lm8XWygL69dXNOluXqyZ5DBXhQ Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 492f248215584ee5816691f867d068f5 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/492f248215584ee5816691f867d068f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_492f248215584ee5816691f867d068f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/492f248215584ee5816691f867d068f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/492f248215584ee5816691f867d068f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 492f248215584ee5816691f867d068f5 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-2036125699 Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestSecurityGroupsBasicOps-2036125699-project Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b526540260764740bcd666f1259af88d Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestSecurityGroupsBasicOps-2036125699-project Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'aab63940-681a-4082-9eee-82604afe3ef8'} Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:12:20.206707 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. Oct 13 09:12:20.211069 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:12:20.213106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Returning 404 to user: Instance aab63940-681a-4082-9eee-82604afe3ef8 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:12:20.214546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d560e2de-748d-4d9f-8d29-34952aac6c09 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8" status: 404 len: 111 microversion: 2.1 time: 0.075049 Oct 13 09:12:20.218636 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3159/6710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:20 2022] GET /compute/v2.1/servers/aab63940-681a-4082-9eee-82604afe3ef8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:12:20.273679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:20.287502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b5a5e0f0-ac6d-4d10-89c0-307829b7f9d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1691 microversion: 2.1 time: 0.255524 Oct 13 09:12:20.311010 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3552/6711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:20 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:20.314342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:20.315025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:20.322253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.323177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.323844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.325340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.326304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.327245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.422620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e501014-b02b-4295-a673-36c0f2d402e6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action" status: 204 len: 0 microversion: 2.1 time: 0.111863 Oct 13 09:12:20.424278 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3160/6712] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:12:20 2022] POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:12:20.436663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:20.437824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:20.476610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.480061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.482571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.493456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:20.495747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:20.497763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:20.898940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:20.913608 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d406d41b-3328-4156-81ee-bf66fbd17ca2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1691 microversion: 2.1 time: 0.483278 Oct 13 09:12:20.915989 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3553/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:20 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1691 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:21.386269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "name": "network-vif-plugged", "status": "completed", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:21.412009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:21.413263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:21.414936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:21.442809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Creating event network-vif-plugged:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h2-858384-11 Oct 13 09:12:21.449706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:12:21.466673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-57ebfbdc-4128-4314-b779-3bdd938c58f5 req-1f5c4896-683e-4194-b8b3-d55c0656f457 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087176 Oct 13 09:12:21.468109 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3161/6714] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:12:21.943433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:21.944875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:21.959813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:21.960318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:21.961314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:21.962052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:21.962572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:21.963011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:22.408561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:22.420446 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67111124-8bec-4d1f-95a1-89110cfbe56f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1691 microversion: 2.1 time: 0.481565 Oct 13 09:12:22.422509 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3554/6715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:21 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1691 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:23.448074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:23.450562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:23.470199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:23.475365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:23.475883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:23.476630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:23.477092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:23.477520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:23.792026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:12:23.804493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cb2b151-5258-402e-96f7-90ebfa59b2a3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1683 microversion: 2.1 time: 0.361561 Oct 13 09:12:23.805363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3162/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:12:23 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1683 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:12:26.072330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5be5cd5b-5777-4b76-92fa-a0a75dc1f109 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] Calling method '.version_select at 0x7f5375555820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:26.119772 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5be5cd5b-5777-4b76-92fa-a0a75dc1f109 tempest-TestSecurityGroupsBasicOps-2036125699 tempest-TestSecurityGroupsBasicOps-2036125699-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1506682449" status: 202 len: 0 microversion: 2.1 time: 0.057661 Oct 13 09:12:26.121631 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3163/6717] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Oct 13 09:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1506682449 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:12:26.200681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Calling method '.version_select at 0x7f5375705a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:12:26.203662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:26.204266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:26.204976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:26.233468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:26.234623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:26.236355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:26.251786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:26.266003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:26.268991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:26.283377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28d49184-f703-4b2d-8ea4-b21adaca65b6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2025522090-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.345590 Oct 13 09:12:26.292710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3555/6718] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 09:12:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:12:52.217603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:52.219129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:12:52.225764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:12:52.232745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:12:52.252621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:52.253338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:52.254359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:52.261142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:12:52.261483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:12:52.261924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:12:52.365206 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81911675-1502-467a-91a6-bf92bae34fa2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action" status: 200 len: 24573 microversion: 2.1 time: 0.146272 Oct 13 09:12:52.366268 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3164/6719] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:12:52 2022] POST /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52/action => generated 24573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:13:15.487095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:15.487810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:15.493743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:15.494646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:15.503825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:15.504365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:15.504817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:15.505558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:15.506024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:15.506480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:15.699892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d1ebbba-3525-4640-86ad-61c1525c6e9b tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1836 microversion: 2.1 time: 0.215844 Oct 13 09:13:15.700494 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3556/6720] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:15 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1836 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:17.567830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:17.569028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:17.576410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:17.582614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:17.584205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:17.587469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:17.591253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:17.593128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:17.593985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:17.597809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:17.598522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:17.599453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:17.600117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:17.602212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:17.615096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] Creating event network-changed:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h2-858384-11 Oct 13 09:13:17.623774 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2cf1ae8c-cdaf-4d9b-a7ad-321e012385eb req-d5d27484-63c5-4d79-83df-b7905fda2e2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053989 Oct 13 09:13:17.626764 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3557/6721] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:13:17.654030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:13:17.800856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1cea002a-4214-44e0-addc-81e587c0a57f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 204 len: 0 microversion: 2.1 time: 0.237060 Oct 13 09:13:17.805071 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3165/6722] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:13:17 2022] DELETE /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:13:17.812095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:17.812095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:17.818583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:17.819332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:17.819976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:17.820886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:17.821535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:17.822177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:18.095514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:18.113529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1390069b-e2c6-461a-b376-f74c7fc22dce tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1689 microversion: 2.1 time: 0.306779 Oct 13 09:13:18.114704 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3558/6723] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:17 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:19.140988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:19.142545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:19.150955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:19.151859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:19.152532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:19.164940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:19.165765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:19.166596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:19.602656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:19.613030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3b036ddf-15ab-4a54-9fd0-cb372ece441d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1689 microversion: 2.1 time: 0.475895 Oct 13 09:13:19.614637 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3166/6724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:19 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1689 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:20.397494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483baf67-0854-47a7-b1f7-b1358c38cd52", "name": "network-vif-deleted", "tag": "4893f0a7-5b2c-4194-bcf1-a95c9373b2b1"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:20.408716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:20.409295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:20.409799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:20.421959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] Creating event network-vif-deleted:4893f0a7-5b2c-4194-bcf1-a95c9373b2b1 for instance 483baf67-0854-47a7-b1f7-b1358c38cd52 on n-h2-858384-11 Oct 13 09:13:20.428922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6cc442c7-68cc-4539-8f87-5f72fda487b7 req-faf79717-92e7-4e9a-9358-afdfc51eb234 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035554 Oct 13 09:13:20.430153 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3559/6725] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:13:20.639994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:20.641399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:20.649860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:20.650681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:20.651483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:20.652550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:20.653218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:20.653888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:20.706335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:20.707022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:20.707777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:20.708481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lazy-loading 'fault' on Instance uuid 483baf67-0854-47a7-b1f7-b1358c38cd52 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:13:20.789199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:20.797336 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ff8871a-9d1b-4e28-973f-94db5209602b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 200 len: 1357 microversion: 2.1 time: 0.163338 Oct 13 09:13:20.801267 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3167/6726] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:20 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:21.829491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:21.830204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 483baf67-0854-47a7-b1f7-b1358c38cd52] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:21.837254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:21.837987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:21.838643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:21.839874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:21.840739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:21.841190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:21.856922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] HTTP exception thrown: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Request method failure captured: Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 HTTP/1.1 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9YZy1WJTEtlY4DCfYx2Fz9zfKTI0hQtCnPMrxZjt6W0RM0S_QaDt8los54gzDHkwG_3TXjpy_LQ63nHsSr17c_x9jKvLrDP3lFeXPNpoNZ4iVVXRKcbMohjh6EIBhNCEoq6Ke4w8iH4sjw6hreH64dG036na1kdCUtcG6RFqFo5bXo Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 850ba2a31bb348fea90990d005b3bf58 Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '483baf67-0854-47a7-b1f7-b1358c38cd52'} Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:13:21.858757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. Oct 13 09:13:21.864142 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:13:21.865642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Returning 404 to user: Instance 483baf67-0854-47a7-b1f7-b1358c38cd52 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:13:21.866711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53922b66-fe04-47fb-867d-964a4c5a85d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52" status: 404 len: 111 microversion: 2.1 time: 0.042348 Oct 13 09:13:21.880080 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3560/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:21 2022] GET /compute/v2.1/servers/483baf67-0854-47a7-b1f7-b1358c38cd52 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:13:27.455246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b228fb0-c01a-44d9-9daa-1e2f42ab4967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '.version_select at 0x7f5375372b80>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:27.576688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b228fb0-c01a-44d9-9daa-1e2f42ab4967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1755869227" status: 202 len: 0 microversion: 2.1 time: 0.126982 Oct 13 09:13:27.591854 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3168/6728] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Oct 13 09:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1755869227 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:13:27.625074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a79e16c1-1164-4660-86b1-34c199aa2b9b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: .version_select at 0x7f5375c25280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1743835279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBH8XxowBLCx6QzljTBZveXZa+ciph/A4PocRrPaSETazLBSkTc8dAU5TOZT/wOJ+m96+qcUruE2gEIKdVPnOZ4DVRD/0QaScyNuRmEr9IpJn09VLSfEOJ8Vr8L4nz/aQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:27.696475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a79e16c1-1164-4660-86b1-34c199aa2b9b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:13:27.705041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-a79e16c1-1164-4660-86b1-34c199aa2b9b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:13:27.744126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a79e16c1-1164-4660-86b1-34c199aa2b9b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.125374 Oct 13 09:13:27.744741 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3561/6729] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:13:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:13:37.434520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1257007467", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "1e5ca520-d7f0-4a57-a619-2fc6425be3c5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1743835279", "security_groups": [{"name": "tempest-secgroup-smoke-1624614531"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:37.491433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:37.660916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] validate_networks() for [('1e5ca520-d7f0-4a57-a619-2fc6425be3c5', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:13:39.005022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:13:39.005703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:13:39.005922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:13:39.006352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:13:39.007067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:13:39.028589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:39.029091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:39.029539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:39.039679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:39.040310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:39.040782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:39.089075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:13:39.100213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:13:39.116781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:13:39.120793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:13:39.210073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c68c48eb-0a5e-4552-9fe7-51e1c33ffefa tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.779437 Oct 13 09:13:39.218543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3169/6730] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:13:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:13:39.220784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=18 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:39.221775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:39.222827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:39.242453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-552b3cea-2183-412f-b929-fbd09778f8b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:39.246033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-552b3cea-2183-412f-b929-fbd09778f8b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:39.341697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-552b3cea-2183-412f-b929-fbd09778f8b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:39.353225 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-552b3cea-2183-412f-b929-fbd09778f8b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1267 microversion: 2.1 time: 0.134442 Oct 13 09:13:39.371934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3562/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:39 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:40.380526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:40.381149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:40.407968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:40.415082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:40.415563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:40.416339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:40.416823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:40.417268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:40.792412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:40.804437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d3f5bae-3fb6-429a-a34d-ae5983f18d08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1263 microversion: 2.1 time: 0.428711 Oct 13 09:13:40.826635 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3170/6732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:40 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1263 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:41.833726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:41.835062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:41.852707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:41.853763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:41.854535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:41.855744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:41.856652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:41.857464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:42.086536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:42.101242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-71d3dab6-aedb-44fe-bbfd-2d6049d8f69b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1325 microversion: 2.1 time: 0.272307 Oct 13 09:13:42.125578 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3563/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:41 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1325 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:43.133669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:43.134791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:43.157312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:43.157813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:43.165316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:43.166118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:43.166664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:43.167103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:43.738719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:43.753673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6d68ed2-bbfc-49b5-9ea1-0ad1e4ff1dc5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.618149 Oct 13 09:13:43.754496 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3171/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:43 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:44.648164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:44.673006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:44.674623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:44.677562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:44.704422 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] Creating event network-changed:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:13:44.717097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-565484cf-15e5-49c0-8f48-0f7201b8671b req-e1ff655a-3b74-4d24-8cf7-025936752d7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074716 Oct 13 09:13:44.718205 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3564/6735] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:13:44.804074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:44.805784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:44.832865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:44.834610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:44.835076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:44.843464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:44.845503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:44.854214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:45.387030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:45.392048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c2cdeb3-4b3d-4c70-ae60-106927a77e2c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.610929 Oct 13 09:13:45.407326 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3172/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:44 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:46.417439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:46.418951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:46.444128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:46.444635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:46.445118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:46.448738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:46.451061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:46.451891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:46.868956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:46.885815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-15d3b156-2e48-4636-88ab-dbf376752888 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.473264 Oct 13 09:13:46.887068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3565/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:46 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:13:47.909727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:47.912522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:47.922960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:47.935912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:47.937010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:47.941228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:47.942453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:47.943177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:47.943775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:48.378565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:48.389135 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bdad630-fe8e-48ba-a43d-dd6583f5ee5b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.483732 Oct 13 09:13:48.395878 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3173/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:47 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:49.418644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:49.419293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:49.422429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:49.448026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:49.449785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:49.454225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:49.456002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:49.457135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:49.457746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:49.761960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:49.770782 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2dcb206f-7dc2-4fa7-9492-5f3cd7a8b90c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.356381 Oct 13 09:13:49.773966 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3566/6739] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:49 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:50.800528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:50.801779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:50.806065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:50.806706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:13:50.825728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:50.826244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:50.826723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:50.827455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:50.827921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:50.828358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:51.063755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:51.072075 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e81f956-11ea-431f-8967-290f847f4ba9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.275474 Oct 13 09:13:51.072744 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3174/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:50 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:52.098795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:52.100252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:52.116465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:52.117411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:52.118175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:52.119714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:52.122800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:52.124285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:52.366363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:52.378766 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1310ed28-bbdd-405e-b931-120bfc50e4e8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.284943 Oct 13 09:13:52.382749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3567/6741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:52 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:53.414445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:53.415213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:53.427936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:53.428795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:53.429484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:53.432751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:53.438975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:53.440326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:54.026655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:54.038921 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43cfbacd-1244-4292-94e4-4c293329fc65 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.637096 Oct 13 09:13:54.060828 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3175/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:53 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:54.292748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-plugged", "status": "completed", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:13:54.322754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:54.324085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:54.324843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:54.345689 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] Creating event network-vif-plugged:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:13:54.371835 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cb04e17c-2947-4bde-8dde-19b3380e08b6 req-3595e80a-1221-4241-ae62-f62fec7644ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080406 Oct 13 09:13:54.372717 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3568/6743] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:13:55.067674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:55.068413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:55.081673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:55.086347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:55.087063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:55.087963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:55.088559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:55.092196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:55.505329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:55.534813 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6571dcd4-af0a-4c51-8bdb-b8de29e8e7f5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1393 microversion: 2.1 time: 0.469365 Oct 13 09:13:55.535690 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3176/6744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:55 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1393 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:56.565382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:56.566996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:56.575914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:56.576730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:56.577407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:56.578929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:56.579596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:56.580306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:56.917127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:56.946339 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e428931e-fdee-47a3-b8fd-47c9d9ff4fb3 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1566 microversion: 2.1 time: 0.386442 Oct 13 09:13:56.947087 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3569/6745] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:56 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1566 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:13:56.979870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:13:56.980523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:13:56.998186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:56.998820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:56.999277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:57.000038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:13:57.000445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:13:57.000944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:13:57.549556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:13:57.563773 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-adaebfe0-85e3-47f8-9b5e-9419c2414399 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1566 microversion: 2.1 time: 0.588703 Oct 13 09:13:57.565456 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3177/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:13:56 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1566 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:00.968921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:00.970935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:00.971597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:00.989223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:00.989757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:00.990250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:00.990912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:00.991377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:00.991851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:01.006017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:01.006641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:01.007099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:01.036981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] Creating event network-changed:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:14:01.051777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4e447805-17b9-4adc-a4af-07210ed7de60 req-4047634f-13fd-40e3-a442-be362e4e5078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086349 Oct 13 09:14:01.052571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3178/6747] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:14:01.449121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:01.467754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1bfc4a81-7d62-430d-b051-ddf144ea2b5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1566 microversion: 2.1 time: 0.507237 Oct 13 09:14:01.468697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3570/6748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:00 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1566 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:09.043882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1937382118", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "3c4df3fa-5771-462b-b3e8-289bf908e4a1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:09.526699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] validate_networks() for [('3c4df3fa-5771-462b-b3e8-289bf908e4a1', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:14:10.102019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:14:10.102694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:14:10.103186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:14:10.103840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:14:10.106537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:14:10.119793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:10.120400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:10.120924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:10.121728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:10.122671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:10.123226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:10.134478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=53 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:10.149781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Getting quotas for project 2ae225b02a86400084c396a69dd77460. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:14:10.160589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Getting quotas for user c7c76a36877c4c90a8b867195b3eeeef and project 2ae225b02a86400084c396a69dd77460. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:14:10.181161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:14:10.184394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:14:10.236985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79375fe6-de25-44c6-bf9b-bfad6a60765e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202673 Oct 13 09:14:10.237918 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3179/6749] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:14:10.254365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae1e2ede-9ffa-4be3-b4e0-de95cb6bc29e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:10.254950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae1e2ede-9ffa-4be3-b4e0-de95cb6bc29e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:10.261493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=21 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:10.457557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae1e2ede-9ffa-4be3-b4e0-de95cb6bc29e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:10.466032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae1e2ede-9ffa-4be3-b4e0-de95cb6bc29e tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1214 microversion: 2.1 time: 0.220344 Oct 13 09:14:10.466817 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3571/6750] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:10 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:11.492854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:11.494821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:11.508241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:11.509057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:11.511310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:11.512289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:11.513022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:11.513678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:11.744061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:11.761267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7d3eee3-fc59-4ef1-a1e5-b5ffb202f4a5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1274 microversion: 2.1 time: 0.273309 Oct 13 09:14:11.771168 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3180/6751] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:11 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:12.785350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:12.785894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:12.790785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=40 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:12.803502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:12.803997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:12.804438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:12.805144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:12.805600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:12.806026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:13.133662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:13.155004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc1ff25b-e483-4d5e-ad4f-657183fecf96 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.373594 Oct 13 09:14:13.162734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3572/6752] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:12 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:13.548700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc477ef8-e9a8-40be-bce1-4628d5f0bcbd", "tag": "526970af-6cce-435a-befd-8cf447223ed0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:13.564602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:13.565203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:13.565914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:13.580048 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] Creating event network-changed:526970af-6cce-435a-befd-8cf447223ed0 for instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd on n-h1-858384-11 Oct 13 09:14:13.585142 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4ada71de-3c6d-4b65-bbd0-aa90518ec0d9 req-3dea2b14-1e39-42ee-a69b-7bf22c8bcb70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040614 Oct 13 09:14:13.585767 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3181/6753] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:14.183065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:14.183637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:14.191464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:14.191958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:14.192626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:14.193125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:14.193587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:14.194015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:14.374042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:14.383323 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9d68b333-fb21-4181-b2c1-0e8b956c4d17 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.204201 Oct 13 09:14:14.384492 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3573/6754] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:14 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:15.409650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:15.410370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:15.429743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:15.430246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:15.430733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:15.431450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:15.431951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:15.432388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:15.690157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:15.700588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c81a9652-3a9e-419b-9f0a-590bc7020075 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.296873 Oct 13 09:14:15.717298 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3182/6755] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:15 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:16.724684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:16.725294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:16.734035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:16.734513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:16.735169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:16.735931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:16.736385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:16.737013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:16.912810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:16.928171 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05fb9532-f753-4009-8576-325820772c4f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.207965 Oct 13 09:14:16.938487 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3574/6756] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:16 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:17.956727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:17.957437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:17.963183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:17.972978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:17.973802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:17.975033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:17.977316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:17.978030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:17.980940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:18.289916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:18.300703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc477ef8-e9a8-40be-bce1-4628d5f0bcbd", "name": "network-vif-plugged", "status": "completed", "tag": "526970af-6cce-435a-befd-8cf447223ed0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:18.316428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:18.316714 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0c8a494-76ca-43b5-aa96-f9deccf24912 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.364695 Oct 13 09:14:18.317482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:18.318157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:18.319230 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3183/6757] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:17 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:18.336371 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] Creating event network-vif-plugged:526970af-6cce-435a-befd-8cf447223ed0 for instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd on n-h1-858384-11 Oct 13 09:14:18.359467 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-aeb1bdee-2dd8-4dc5-8330-892d94f9c4f3 req-6ee487e4-11d8-4f2e-99d7-e33c2731e9d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062995 Oct 13 09:14:18.362339 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3575/6758] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:19.344596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:19.346882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:19.357395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:19.357395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:19.357395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:19.358518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:19.358732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:19.359113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:19.542307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:19.550275 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f693b5ab-539f-4d4f-9fb9-d63d05c17952 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1314 microversion: 2.1 time: 0.209975 Oct 13 09:14:19.562972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3184/6759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:19 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:20.572011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:20.576566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:20.577492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:20.584705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:20.585210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:20.585654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:20.586469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:20.586942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:20.587382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:20.742738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:20.753287 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7ea659a1-90c7-4a2e-928e-3e37f2a732f5 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1497 microversion: 2.1 time: 0.183298 Oct 13 09:14:20.753881 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3576/6760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:20 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:21.273978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:21.274512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:21.276516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:21.277486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:21.284456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:21.284956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:21.285401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:21.286792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:21.287444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:21.287884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:21.316933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:14:21.429758 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-efc4fb74-7688-4b92-8a1b-aa3ab010236f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 204 len: 0 microversion: 2.1 time: 0.159485 Oct 13 09:14:21.430464 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3185/6761] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:14:21 2022] DELETE /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:14:21.442328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:21.443287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:21.449714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:21.450208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:21.450681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:21.451557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:21.452015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:21.453238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:21.614924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:21.625859 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e91cf2ba-f54c-4881-8161-0869aa67d659 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1503 microversion: 2.1 time: 0.190137 Oct 13 09:14:21.627403 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3577/6762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:21 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:14:22.652816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:22.653531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:22.661046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:22.661544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:22.661988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:22.662730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:22.663175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:22.663605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:22.842442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:22.851727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25621f7e-01d3-4046-a61e-bad94592ae75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1503 microversion: 2.1 time: 0.203180 Oct 13 09:14:22.867531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3186/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:22 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:23.376048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc477ef8-e9a8-40be-bce1-4628d5f0bcbd", "name": "network-vif-deleted", "tag": "526970af-6cce-435a-befd-8cf447223ed0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:23.388766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:23.389161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:23.389985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:23.403928 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] Creating event network-vif-deleted:526970af-6cce-435a-befd-8cf447223ed0 for instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd on n-h1-858384-11 Oct 13 09:14:23.409158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ff5b4b97-4293-460c-9471-b15b64dc64ca req-24b69bea-4206-424d-8776-7e877596dcc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036988 Oct 13 09:14:23.410128 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3578/6764] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:23.877872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:23.878753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:23.896004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:23.896600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:23.897173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:23.898149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:23.898800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:23.899348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:23.943989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:23.945607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:23.946451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:23.947260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lazy-loading 'fault' on Instance uuid dc477ef8-e9a8-40be-bce1-4628d5f0bcbd {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:14:24.002187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:24.013611 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fce9fa9-6c98-4eed-99a9-ebc21d2b9b82 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 200 len: 1304 microversion: 2.1 time: 0.140525 Oct 13 09:14:24.014644 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3187/6765] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:23 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:25.045488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:25.049463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: dc477ef8-e9a8-40be-bce1-4628d5f0bcbd] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:25.057391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:25.057975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:25.058544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:25.059597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:25.060163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:25.060829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:25.080729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] HTTP exception thrown: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Request method failure captured: Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd HTTP/1.1 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9bdsNhd4uuI-PAcvstH_F5QOEhiqSylzp5MwXwcY4mqJqOEls0OBF61z1ALE1W_wTOATxFHPGsVqmYX_i7S1oeAGYWN3GbhVGI4C_G46SWAB5MVn3U8MvUd0bicyFUSYnRKRlz8705EkoHjZLMhu-szgMkRrBFJBBnTzwzMNJZc9Kw Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2ae225b02a86400084c396a69dd77460 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesActionsTest-263445988 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae225b02a86400084c396a69dd77460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ae225b02a86400084c396a69dd77460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae225b02a86400084c396a69dd77460"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ae225b02a86400084c396a69dd77460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesActionsTest-263445988 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2ae225b02a86400084c396a69dd77460 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesActionsTest-263445988 Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesActionsTest-263445988-project Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c7c76a36877c4c90a8b867195b3eeeef Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesActionsTest-263445988-project Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'dc477ef8-e9a8-40be-bce1-4628d5f0bcbd'} Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:25.082467 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Returning 404 to user: Instance dc477ef8-e9a8-40be-bce1-4628d5f0bcbd could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4a4ee4a-ad53-4616-8517-a1dca33d0015 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd" status: 404 len: 111 microversion: 2.1 time: 0.043032 Oct 13 09:14:25.088670 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3579/6766] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:25 2022] GET /compute/v2.1/servers/dc477ef8-e9a8-40be-bce1-4628d5f0bcbd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:14:25.209037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1604141473", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "3c4df3fa-5771-462b-b3e8-289bf908e4a1"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:25.288842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] validate_networks() for [('3c4df3fa-5771-462b-b3e8-289bf908e4a1', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:14:25.696288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:14:25.696712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:14:25.697364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:14:25.697780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:14:25.698329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:14:25.708024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:25.708648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:25.709093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:25.709821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:25.710326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:25.710991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:25.728949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Getting quotas for project 2ae225b02a86400084c396a69dd77460. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:14:25.734455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Getting quotas for user c7c76a36877c4c90a8b867195b3eeeef and project 2ae225b02a86400084c396a69dd77460. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:14:25.748093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:14:25.750363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:14:25.802983 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5753e0a3-65a9-4c69-b85c-a42754bdacd3 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598652 Oct 13 09:14:25.810166 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3188/6767] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:14:25.818132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-73ef7de1-850d-4132-94bd-3a82b240ae3f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:25.821449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-73ef7de1-850d-4132-94bd-3a82b240ae3f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:25.922188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-73ef7de1-850d-4132-94bd-3a82b240ae3f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:25.933053 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-73ef7de1-850d-4132-94bd-3a82b240ae3f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1214 microversion: 2.1 time: 0.118190 Oct 13 09:14:25.933654 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3580/6768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:25 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:26.960308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:26.961076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:26.979987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:26.980759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:26.981667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:26.982855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:26.983587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:26.984450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:27.112515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:27.121801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8cd04d9d-6728-43b4-a209-a3b418c48f75 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1274 microversion: 2.1 time: 0.165627 Oct 13 09:14:27.122394 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3189/6769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:26 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:28.161917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:28.161917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:28.179700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:28.180209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:28.180664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:28.181398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:28.200050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:28.200610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:28.455020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:28.468541 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbb9c389-3cf0-433a-bf6a-b2909528c490 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.326221 Oct 13 09:14:28.471700 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3581/6770] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:28 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:28.884757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ce35a8-d933-478e-8492-0ab8df687682", "tag": "f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:28.905842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:28.906353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:28.906846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:28.930764 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] Creating event network-changed:f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6 for instance 41ce35a8-d933-478e-8492-0ab8df687682 on n-h1-858384-11 Oct 13 09:14:28.943256 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-62101564-28d8-422e-a438-548e66fb14cb req-de33af6c-f73c-4ec8-83bc-d28421cc0917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063260 Oct 13 09:14:28.944420 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3190/6771] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:29.492393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:29.493555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:29.497065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:29.497963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:29.502671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.503236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.504138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.504862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.505329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.505756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.513472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.516762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.517912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.518798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.519256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.519711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.613812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:14:29.739462 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a296e120-a4d1-4b3c-b870-1db21717dff6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 204 len: 0 microversion: 2.1 time: 0.524086 Oct 13 09:14:29.740119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:29.740737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3582/6772] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:14:29 2022] DELETE /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:14:29.756691 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83fd2466-9cb0-4e50-ba6f-27a7e69ef39d tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.265848 Oct 13 09:14:29.758045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3191/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:29 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:29.760031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:29.760843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:29.768257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.769586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.770185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.771318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:29.772364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:29.773106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:29.973947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:29.982595 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8fa7537-492a-493a-8357-cdff45197022 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1732 microversion: 2.1 time: 0.235175 Oct 13 09:14:29.983526 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3583/6774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:29 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:14:30.781757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:30.783643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:30.790841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:30.791327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:30.793005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:30.793005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:30.793005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:30.795038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:30.967096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:30.984105 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94a427c6-f88a-4685-bc47-f02f4e841cdd tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.206409 Oct 13 09:14:30.984759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3192/6775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:30 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:31.007025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:31.015421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:31.023331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:31.023830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:31.024284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:31.024999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:31.025672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:31.026306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:31.267223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:31.281719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5c1ef175-4ee9-47cd-9bfa-eabd60c12f7c tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1732 microversion: 2.1 time: 0.278495 Oct 13 09:14:31.289413 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3584/6776] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:31 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:32.012528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:32.014045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:32.040784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.041943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.042922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.045399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.050897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.052507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.204887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:32.208033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:32.215105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.215856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.216521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.217456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.218110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.218764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.309140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5de1e14-89b9-4917-825e-e883568dc127 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action" status: 200 len: 24563 microversion: 2.1 time: 0.108340 Oct 13 09:14:32.310444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3585/6777] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:14:32 2022] POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action => generated 24563 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:14:32.316022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:32.319778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:32.337826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.338499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.339056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.340072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:32.340652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:32.350568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:32.578255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:32.591980 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc2cbb78-207e-48a3-b557-40eec897cf92 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1732 microversion: 2.1 time: 0.278582 Oct 13 09:14:32.592830 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3586/6778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:32 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:32.662429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:32.674213 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ff0daa3-b254-417c-a9a1-fec8c97f0d70 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.666539 Oct 13 09:14:32.675492 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3193/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:32 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:33.476363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d08b6b-1b6b-4317-a8c3-038e3284f66c", "name": "network-vif-deleted", "tag": "0a22f01c-4bad-4e90-9834-d5b509423296"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:33.508655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.509141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.509574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.555934 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] Creating event network-vif-deleted:0a22f01c-4bad-4e90-9834-d5b509423296 for instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c on n-h1-858384-11 Oct 13 09:14:33.569669 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-60be72ba-12f0-46b1-8edd-2fe13cd0c10a req-2b5e8577-3fc0-4ed9-bee3-03265f224717 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097463 Oct 13 09:14:33.573842 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3587/6780] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:33.619877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:33.621133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:33.632502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.642656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.652094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.664071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.667149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.669185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.699771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:33.700729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:33.711808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.712754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.716183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.717887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.720570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.721502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.735490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:33.736258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:33.736923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:33.737571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lazy-loading 'fault' on Instance uuid 40d08b6b-1b6b-4317-a8c3-038e3284f66c {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:14:33.785402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad501c0212474a80bb3d1c5d8ae70166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc11efee7604ed693baeb556349e02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:33.795682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5a64175-6e8f-4df0-8d6a-1fe8dc43812d tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 200 len: 1388 microversion: 2.1 time: 0.179954 Oct 13 09:14:33.796831 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3194/6781] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:33 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 1388 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:33.973598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:33.982705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8bb7288-60b4-4c73-863e-ab02c758989c tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.288688 Oct 13 09:14:33.983293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3588/6782] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:33 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:14:34.515389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ce35a8-d933-478e-8492-0ab8df687682", "name": "network-vif-plugged", "status": "completed", "tag": "f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:34.544788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:34.547094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:34.548256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:34.565645 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] Creating event network-vif-plugged:f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6 for instance 41ce35a8-d933-478e-8492-0ab8df687682 on n-h1-858384-11 Oct 13 09:14:34.576606 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f7cae041-c619-4d11-9bbb-5fb87934e05e req-e7971587-cf7d-4399-a00e-255d5ad1c784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063828 Oct 13 09:14:34.579186 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3195/6783] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:14:34.820597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:34.822098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:34.830552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:34.831343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:34.832029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:34.832960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:34.833636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:34.834654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:34.873734 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] HTTP exception thrown: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Request method failure captured: Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c HTTP/1.1 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Wk0c3XI1U0uVWkPwsx4ol_s5C3yKlKBVBgIFfBuQQCjR1r6SXnrcoIFDlzponDh-Jqogjny1824wgiS8hlJEejTnm1dI8PR1fP-yQDJ8cyiF4pPySf1M237gk8p2pQd0Owe9MjjDrDxl0Go2c_AQ92aWll3raPRv3dukBtDD8BWfo Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fc11efee7604ed693baeb556349e02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ad501c0212474a80bb3d1c5d8ae70166 Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '40d08b6b-1b6b-4317-a8c3-038e3284f66c'} Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:34.880311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Returning 404 to user: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b8a2492-680a-4f30-870a-d8eb4aab5e12 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 404 len: 111 microversion: 2.1 time: 0.067658 Oct 13 09:14:34.885206 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3589/6784] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:34 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:14:35.023068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:35.031191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:35.066270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.067264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.071693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.075605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.076947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.077591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.295405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:35.297657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:35.305521 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83efd955-45e8-4876-a269-b4b5af8b3206 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1314 microversion: 2.1 time: 0.286818 Oct 13 09:14:35.318116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3196/6785] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:35 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:35.636623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:35.637390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:35.644499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.644987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.645789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.646510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.646964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.647507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.662253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] HTTP exception thrown: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Request method failure captured: Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c HTTP/1.1 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9Wk0c3XI1U0uVWkPwsx4ol_s5C3yKlKBVBgIFfBuQQCjR1r6SXnrcoIFDlzponDh-Jqogjny1824wgiS8hlJEejTnm1dI8PR1fP-yQDJ8cyiF4pPySf1M237gk8p2pQd0Owe9MjjDrDxl0Go2c_AQ92aWll3raPRv3dukBtDD8BWfo Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fc11efee7604ed693baeb556349e02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ad501c0212474a80bb3d1c5d8ae70166 Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '40d08b6b-1b6b-4317-a8c3-038e3284f66c'} Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:14:35.663850 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Returning 404 to user: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:14:35.668311 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1d113be2-873f-40a4-a66e-0a9267f492b6 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 404 len: 111 microversion: 2.1 time: 0.032741 Oct 13 09:14:35.669144 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3590/6786] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:14:35 2022] DELETE /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:14:35.675897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:35.676507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] [instance: 40d08b6b-1b6b-4317-a8c3-038e3284f66c] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:35.684230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.684615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.685070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.685764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:35.686564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:35.686787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:35.701957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] HTTP exception thrown: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Request method failure captured: Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c HTTP/1.1 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9Wk0c3XI1U0uVWkPwsx4ol_s5C3yKlKBVBgIFfBuQQCjR1r6SXnrcoIFDlzponDh-Jqogjny1824wgiS8hlJEejTnm1dI8PR1fP-yQDJ8cyiF4pPySf1M237gk8p2pQd0Owe9MjjDrDxl0Go2c_AQ92aWll3raPRv3dukBtDD8BWfo Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9fc11efee7604ed693baeb556349e02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9fc11efee7604ed693baeb556349e02b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 9fc11efee7604ed693baeb556349e02b Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestServerBasicOps-1018564896 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ad501c0212474a80bb3d1c5d8ae70166 Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestServerBasicOps-1018564896-project Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '40d08b6b-1b6b-4317-a8c3-038e3284f66c'} Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:35.703910 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Returning 404 to user: Instance 40d08b6b-1b6b-4317-a8c3-038e3284f66c could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-809f4b46-aa54-4030-b88f-8f0b37116f84 tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c" status: 404 len: 111 microversion: 2.1 time: 0.035083 Oct 13 09:14:35.708104 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3197/6787] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:35 2022] GET /compute/v2.1/servers/40d08b6b-1b6b-4317-a8c3-038e3284f66c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:14:35.908272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bf1b57f7-ac02-4f0e-b15d-38929cba68ac tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] Calling method '.version_select at 0x7f537ac123a0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:35.928382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:35.929930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bf1b57f7-ac02-4f0e-b15d-38929cba68ac tempest-TestServerBasicOps-1018564896 tempest-TestServerBasicOps-1018564896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1383796912" status: 202 len: 0 microversion: 2.1 time: 0.027429 Oct 13 09:14:35.934271 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3591/6788] 10.222.0.23 () {58 vars in 1254 bytes} [Thu Oct 13 09:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1383796912 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:14:36.333968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:36.335387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:36.336369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:36.337648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:36.347403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:36.348182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:36.348769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:36.349778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:36.350379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:36.351017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:36.516214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:36.527334 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0fc991a-1587-400d-9f2b-2b27f4ccb99f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1498 microversion: 2.1 time: 0.197831 Oct 13 09:14:36.528238 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3198/6789] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:36 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1498 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:37.230432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:37.230974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:37.242248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:37.243037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:37.243658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:37.244523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:37.245262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:37.245850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:37.343025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:14:37.391772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:37.522177 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5aca75bd-7b73-4a08-9b47-0f5071d3fd6f tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 204 len: 0 microversion: 2.1 time: 0.296239 Oct 13 09:14:37.526437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3592/6790] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:14:37 2022] DELETE /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:14:37.531589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:37.532743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:37.540473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:37.541234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:37.541870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:37.542781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:37.543408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:37.543995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:37.720878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:37.730026 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8b6dc76-0957-40bb-9e17-b8636db75a02 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1504 microversion: 2.1 time: 0.202517 Oct 13 09:14:37.742954 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3199/6791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:37 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:38.754955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:38.755695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:38.771018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:38.771546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:38.773248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:38.774993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:38.775483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:38.775927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:39.097290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:39.105885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-979e8387-2a5f-46d7-9af3-939808ddedeb tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1504 microversion: 2.1 time: 0.356174 Oct 13 09:14:39.112452 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3593/6792] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:38 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:40.140463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:40.141724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:40.143351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ce35a8-d933-478e-8492-0ab8df687682", "name": "network-vif-deleted", "tag": "f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:14:40.152453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:40.172349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:40.174144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:40.175201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:40.180720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:40.182238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:40.186852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:40.187384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:40.187824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:40.215257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] Creating event network-vif-deleted:f5bdb996-da5a-4b03-8d1a-72f6c14a2ab6 for instance 41ce35a8-d933-478e-8492-0ab8df687682 on n-h1-858384-11 Oct 13 09:14:40.222133 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-34ffcd07-3312-4053-aef0-eae4f9db0328 req-5d8b6d01-4685-43ff-bc72-92beff0144aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082184 Oct 13 09:14:40.223591 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3594/6793] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:14:40.338528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c76a36877c4c90a8b867195b3eeeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae225b02a86400084c396a69dd77460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:14:40.353412 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-56ea53a1-dc43-45f3-bc36-7f081aeea6af tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 200 len: 1299 microversion: 2.1 time: 0.217758 Oct 13 09:14:40.356512 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3200/6794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:40 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:14:41.385601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:14:41.387005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] [instance: 41ce35a8-d933-478e-8492-0ab8df687682] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:14:41.413342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:14:41.451374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:41.457028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:41.463371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:41.466733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:14:41.467456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:14:41.468282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:14:41.515605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] HTTP exception thrown: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Request method failure captured: Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 HTTP/1.1 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9bdsNhd4uuI-PAcvstH_F5QOEhiqSylzp5MwXwcY4mqJqOEls0OBF61z1ALE1W_wTOATxFHPGsVqmYX_i7S1oeAGYWN3GbhVGI4C_G46SWAB5MVn3U8MvUd0bicyFUSYnRKRlz8705EkoHjZLMhu-szgMkRrBFJBBnTzwzMNJZc9Kw Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 2ae225b02a86400084c396a69dd77460 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-VolumesActionsTest-263445988 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae225b02a86400084c396a69dd77460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ae225b02a86400084c396a69dd77460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ae225b02a86400084c396a69dd77460"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ae225b02a86400084c396a69dd77460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-VolumesActionsTest-263445988 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 2ae225b02a86400084c396a69dd77460 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-VolumesActionsTest-263445988 Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-VolumesActionsTest-263445988-project Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c7c76a36877c4c90a8b867195b3eeeef Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-VolumesActionsTest-263445988-project Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '41ce35a8-d933-478e-8492-0ab8df687682'} Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:14:41.521802 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:14:41.527610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] Returning 404 to user: Instance 41ce35a8-d933-478e-8492-0ab8df687682 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:14:41.530293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0947175d-44eb-46b0-83de-d543f3a22d01 tempest-VolumesActionsTest-263445988 tempest-VolumesActionsTest-263445988-project] 10.222.0.23 "GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682" status: 404 len: 111 microversion: 2.1 time: 0.149265 Oct 13 09:14:41.531474 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3595/6795] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:14:41 2022] GET /compute/v2.1/servers/41ce35a8-d933-478e-8492-0ab8df687682 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:15:02.757545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:02.758680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:02.767643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:02.772986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=21 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:02.778074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:02.780680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:02.782509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:02.783923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:02.784922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:02.786214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.013675 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b382f94-98d9-4d44-8cf4-bf00c9e1871c tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1837 microversion: 2.1 time: 0.259988 Oct 13 09:15:03.036749 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3201/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:02 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1837 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:03.054038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:03.054513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:03.057197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:03.057992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:03.060348 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:15:03.061574 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 (ip 10.222.0.23) !!! Oct 13 09:15:03.078802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.083821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.085967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.085967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.085967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.086320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.398104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:03.407973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a531fc94-f05d-4130-aed0-985170713ec2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1684 microversion: 2.1 time: 0.358524 Oct 13 09:15:03.421537 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3596/6797] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:03 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1684 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:03.539943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:03.546098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:03.555340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.556214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.556995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.557905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.558576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.559182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.653224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59fa630d-495e-4b27-a4c1-ba521fc3c0d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action" status: 200 len: 32638 microversion: 2.1 time: 0.117530 Oct 13 09:15:03.654933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3202/6798] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:15:03 2022] POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action => generated 32638 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:15:03.893410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:03.897729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:03.903404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.903976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.907606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.909372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:03.911948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:03.913146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:03.958864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7cf5a42bb013434cba6d221d2c2ef2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16977c4c5ef54d31b5f8697cd08c0b78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:03.959569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] flavor_id is None. Assuming migration. {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 13 09:15:03.960096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:15:04.167506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-275080fe-b272-4644-af8b-7d7d69dcd162 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action" status: 202 len: 0 microversion: 2.1 time: 0.281642 Oct 13 09:15:04.168668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3597/6799] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:15:03 2022] POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:15:04.181436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:04.182182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:04.197594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:04.199755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:04.201115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:04.202139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:04.203996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:04.204929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:04.537653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:04.576437 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4685c870-8a2f-4c99-82b9-c99fb7ffcf8b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1693 microversion: 2.1 time: 0.402601 Oct 13 09:15:04.583959 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3203/6800] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:04 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1693 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:05.612935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:05.614785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:05.628832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:05.636543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:05.642779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:05.646953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:05.650013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:05.654486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:05.901576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:05.925702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbcd4c3a-d669-413a-b338-9f25f23e5243 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1693 microversion: 2.1 time: 0.318439 Oct 13 09:15:05.927600 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3598/6801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:05 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1693 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:06.950580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:06.951236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:06.967490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:06.968099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:06.968663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:06.969391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:06.969868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:06.970278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:07.410445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:07.427123 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0f54322-6540-4bbb-afe7-5a4eaa13bb3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1693 microversion: 2.1 time: 0.480557 Oct 13 09:15:07.428004 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3204/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:06 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1693 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:08.455473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:08.457659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:08.473246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:08.476970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:08.477798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:08.481534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:08.482716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:08.484069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:08.874387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:08.891398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-224b9e79-dd59-4a21-b806-6c730328693a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.436231 Oct 13 09:15:08.892478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3599/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:08 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:09.923381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:09.924776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:09.936111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:09.936812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:09.937422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:09.938440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:09.940303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:09.941376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:10.140646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:10.149786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1bd145d5-2338-4a3e-a5f0-1cfe9387c538 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.231474 Oct 13 09:15:10.151149 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3205/6804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:09 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:11.179897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:11.181262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:11.189100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:11.189874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:11.190614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:11.191573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:11.192377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:11.193043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:11.414992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:11.424328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd32ac65-af2e-469d-9aed-33c86ddf90c2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.251160 Oct 13 09:15:11.425366 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3600/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:11 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:15:12.452394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:12.453108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:12.461013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:12.461843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:12.462364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:12.463038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:12.463482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:12.463927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:12.690983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:12.714181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88371b88-876e-4a0b-be86-93b6e19112b1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.265585 Oct 13 09:15:12.728195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3206/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:12 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:13.742455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:13.743625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:13.756007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:13.763352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:13.763992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:13.764935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:13.766150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:13.766801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:13.958374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:13.966902 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-13f7b6e7-3bf6-43ee-9dfb-7e5d2a0b502c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.230865 Oct 13 09:15:13.971437 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3601/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:13 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:14.996698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:14.998152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:15.006577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:15.007348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:15.007844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:15.008598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:15.009243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:15.009510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:15.269945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:15.282086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e28ad70f-c52b-42e9-b780-ca05f8cbf26e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.289366 Oct 13 09:15:15.282826 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3207/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:14 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:16.306999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:16.307835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:16.318880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:16.320323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:16.320882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:16.322708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:16.324800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:16.325368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:16.563930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:16.574661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58fa03c3-cc88-40c8-84e0-7cbfb77a8829 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.271715 Oct 13 09:15:16.575881 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3602/6809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:16 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:17.603534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:17.604146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:17.610858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:17.611336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:17.611766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:17.612450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:17.612896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:17.613543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:17.764389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:17.772924 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ad9da73-8c41-47bb-bdb3-75e213e31fde tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.173240 Oct 13 09:15:17.773494 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3208/6810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:17 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:18.795365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:18.796046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:18.804421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:18.804839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:18.805287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:18.806019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:18.806480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:18.806907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:18.951520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:18.960004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f744da44-3010-47dd-aa3d-91e63ccfb3c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.168513 Oct 13 09:15:18.960590 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3603/6811] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:18 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:19.985813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:19.987189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:20.015844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:20.024356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:20.028826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:20.033173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:20.035856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:20.038798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:20.205792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:20.214582 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74d8cee2-9359-4144-8b5b-509fdfd353db tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.233356 Oct 13 09:15:20.215184 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3209/6812] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:19 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:21.237980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:21.238638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:21.245909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:21.246696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:21.247140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:21.247848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:21.248308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:21.248738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:21.397357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:21.405505 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ff7f0c9f-5c7e-4c27-8a67-12a5ab6e4db1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.171464 Oct 13 09:15:21.410446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3604/6813] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:21 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:22.429424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:22.430255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:22.438377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:22.439077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:22.439618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:22.440558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:22.441124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:22.441644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:22.599636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:22.607333 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69b0a598-d13c-4c06-8124-cf1136658796 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.181966 Oct 13 09:15:22.607900 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3210/6814] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:22 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:23.633226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:23.634899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:23.644364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:23.645211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:23.645879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:23.646860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:23.647875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:23.648648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:23.811192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:23.820903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79760f17-b07e-4b74-89a8-989e689bc012 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.192259 Oct 13 09:15:23.821575 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3605/6815] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:23 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:24.845134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:24.846045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:24.853320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:24.853824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:24.854264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:24.855070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:24.855574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:24.856049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:25.021237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:25.031028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-748759f0-d171-44d4-b1aa-21d72ea85ecd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1698 microversion: 2.1 time: 0.189142 Oct 13 09:15:25.032189 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3211/6816] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:24 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:25.733570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-unplugged", "status": "completed", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:25.747131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:25.748096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:25.748677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:25.764537 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Creating event network-vif-unplugged:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h1-858384-11 Oct 13 09:15:25.775355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:15:25.792454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-284b3d54-98a0-4882-8ece-2bbcc3306122 req-b2863040-5fd7-477d-ab42-ac3b501c6542 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064253 Oct 13 09:15:25.794280 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3606/6817] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:15:26.056005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:26.057291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:26.067049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:26.067858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:26.068409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:26.069242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:26.069804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:26.070332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:26.298169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:26.314671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3103ac55-5cbd-48df-988f-8617082bb8d8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1697 microversion: 2.1 time: 0.262422 Oct 13 09:15:26.315179 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3212/6818] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:26 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1697 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:27.341166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:27.341965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:27.349264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:27.349822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:27.350278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:27.351017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:27.351481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:27.352092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:27.535304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:27.543194 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-92d9897f-2791-46e8-b8fb-ef3b1563f222 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1695 microversion: 2.1 time: 0.207291 Oct 13 09:15:27.543783 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3607/6819] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:27 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:27.809692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:27.819828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:27.820302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:27.820754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:27.832812 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Creating event network-changed:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h1-858384-11 Oct 13 09:15:27.838507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:15:27.850184 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-95177d95-1060-48bd-aa51-9847785b3a27 req-ce2361c0-5a52-46e6-9b43-6480742f5918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044091 Oct 13 09:15:27.850812 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3213/6820] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:15:28.567149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:28.567778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:28.581677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:28.583453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:28.584200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:28.585254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:28.585881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:28.587796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:28.745507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:28.756661 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b4e7eda-c752-4fd9-bb55-62af1a7eb415 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1695 microversion: 2.1 time: 0.193209 Oct 13 09:15:28.757482 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3608/6821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:28 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:29.782490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:29.783197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:29.789359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:29.789846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:29.790283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:29.791012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:29.791464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:29.791889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:29.986094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:29.993834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18c7149b-9a76-44cd-b84b-c10d09003742 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1692 microversion: 2.1 time: 0.216501 Oct 13 09:15:29.994510 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3214/6822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:29 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:30.018118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:30.018865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:30.026037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:30.026693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:30.028504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:30.029240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:30.029700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:30.030126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:30.122385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:30.155410 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ac42dc1-c00d-4c18-82eb-205583a21206 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action" status: 202 len: 0 microversion: 2.1 time: 0.142610 Oct 13 09:15:30.156668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3609/6823] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:15:30 2022] POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:15:30.164985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:30.165630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:30.182806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:30.184281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:30.184281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:30.184558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:30.185011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:30.185440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:30.427233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:30.440678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-23101764-e24d-4a68-8461-b0fdb0cadd16 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.279307 Oct 13 09:15:30.441532 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3215/6824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:30 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:31.468684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:31.469388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:31.475841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:31.476325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:31.476756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:31.477628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:31.478088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:31.478858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:31.623391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:31.634617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ab594dd-f3c1-4448-aa1b-729dd24808e7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.171197 Oct 13 09:15:31.635188 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3610/6825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:31 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:32.473978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-plugged", "status": "completed", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:32.491975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:32.492499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:32.492933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:32.506807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Creating event network-vif-plugged:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h1-858384-11 Oct 13 09:15:32.512303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:15:32.525348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ab9ce997-99b1-40b8-b487-3c741aa35b4a req-9a469fa0-d9f6-4161-bff7-866f6ebec054 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055421 Oct 13 09:15:32.526558 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3216/6826] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:15:32.659566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:32.660401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:32.667890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:32.668508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:32.668973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:32.669760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:32.670253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:32.670657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:32.815419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:32.823783 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bdebaf3a-637b-4f8d-a667-23262bd7e0e4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.168913 Oct 13 09:15:32.824388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3611/6827] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:32 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:33.433879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-unplugged", "status": "completed", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:33.443703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=33 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:33.447061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:33.447638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:33.448204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:33.453907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=91 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:33.464997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Creating event network-vif-unplugged:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:15:33.471327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:15:33.484546 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-355aa336-1e2e-43ec-a085-cc4c2aada7b5 req-a0ddffe4-bdfb-41db-95bc-4ff005efbdff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054352 Oct 13 09:15:33.486313 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3217/6828] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:15:33.849213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:33.849931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:33.855143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=39 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:15:33.860593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:33.861310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:33.861771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:33.862861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:33.863502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:33.864271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:34.049851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:34.057834 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbca3a12-ebb2-4703-998d-60b8636ffae5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.213618 Oct 13 09:15:34.058425 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3612/6829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:33 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:35.081746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:35.082479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:35.089514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:35.089991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:35.090455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:35.091154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:35.091614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:35.092092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:35.228551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:35.237082 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dfc223f9-36e9-4b8d-9c50-a734239914d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.159513 Oct 13 09:15:35.237669 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3218/6830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:35 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:35.527043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:35.539464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:35.539968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:35.540396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:35.552929 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Creating event network-changed:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:15:35.559279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:15:35.575778 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-dbeab344-e79e-4aa0-a4c8-69822cf61025 req-9ad7374d-8769-4fe4-9fcc-fdafac3034f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052265 Oct 13 09:15:35.576433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3613/6831] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:15:36.261297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:36.261823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:36.269597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:36.270079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:36.270540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:36.271228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:36.271676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:36.272100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:36.408636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:36.416397 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd572de3-7e71-4bf3-adb1-b92d63147bf0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.159016 Oct 13 09:15:36.416910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3219/6832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:36 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:37.441898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:37.442805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:37.450060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:37.450773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:37.451290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:37.452416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:37.452951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:37.453451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:37.608774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:37.617842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20f5c344-1dfb-490e-911a-2f1564d78334 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1691 microversion: 2.1 time: 0.181753 Oct 13 09:15:37.618691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3614/6833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:37 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:38.645717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:15:38.646515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:15:38.658212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:38.659128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:38.660147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:38.661330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:38.661959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:38.662588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:38.800406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:15:38.808474 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c9aaddb-1961-4d18-8dcd-a7ba07c53408 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1684 microversion: 2.1 time: 0.168060 Oct 13 09:15:38.809045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3220/6834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:15:38 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:15:40.093424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-plugged", "status": "completed", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:15:40.105182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:15:40.105655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:15:40.106291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:15:40.117728 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] Creating event network-vif-plugged:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:15:40.122635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-87071611-638e-4796-b933-8dcfd48679e1 req-13bdc8c8-949b-4333-b9dc-104e9c95c91c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Oct 13 09:15:40.123273 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3615/6835] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:08.002976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1492941523", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:08.010145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:08.010841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=21 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:08.059926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] validate_networks() for None {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:16:08.623947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:16:08.624367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:16:08.624845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:16:08.625250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:16:08.625655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:16:08.634389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:08.634893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:08.635327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:08.636044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:08.636491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:08.636911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:08.653783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Getting quotas for project a0635a1c4d8740f0a3b2bc2a92645c33. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:16:08.659103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Getting quotas for user e890b185c6084a8988593edc18e9fefe and project a0635a1c4d8740f0a3b2bc2a92645c33. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:16:08.671194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:16:08.673412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:16:08.719141 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25b11442-c2d2-4f6b-b5b4-3dc69afdce40 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721066 Oct 13 09:16:08.726031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3221/6836] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:16:08.729524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:08.730270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:08.734815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-069219c6-7e20-421b-ab14-0f65d2f17a60 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:08.735511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-069219c6-7e20-421b-ab14-0f65d2f17a60 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:08.804509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-069219c6-7e20-421b-ab14-0f65d2f17a60 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:08.812949 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-069219c6-7e20-421b-ab14-0f65d2f17a60 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1214 microversion: 2.1 time: 0.085418 Oct 13 09:16:08.813545 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3616/6837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:08 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:16:09.222059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:09.224377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:09.233604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:09.234125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:09.234631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:09.235403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:09.235887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:09.236373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:09.322547 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3989478-4f5e-44fc-a94b-a10b731d50c0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action" status: 200 len: 63027 microversion: 2.1 time: 0.286171 Oct 13 09:16:09.324360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3222/6838] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:16:09 2022] POST /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405/action => generated 63027 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:16:09.836278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:09.837195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:09.846940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:09.847816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:09.848350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:09.849160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:09.849716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:09.850243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:09.915619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:09.923919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-57543657-0418-4b07-8323-179a5e97c7c4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1284 microversion: 2.1 time: 0.091633 Oct 13 09:16:09.924506 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3617/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:09 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:10.947405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:10.948183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:10.955771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:10.956261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:10.956698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:10.957599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:10.958189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:10.958881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:11.162556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:11.170257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6daa1156-a6da-43db-9167-645021d3eb72 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.227191 Oct 13 09:16:11.170869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3223/6840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:10 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:11.289952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5baaac75-52a0-4726-b129-8db3bf6517a2", "tag": "abd3995b-e7a1-472a-8fdd-dc8542159afb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:11.309354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:11.309710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:11.310369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:11.338100 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] Creating event network-changed:abd3995b-e7a1-472a-8fdd-dc8542159afb for instance 5baaac75-52a0-4726-b129-8db3bf6517a2 on n-h1-858384-11 Oct 13 09:16:11.346864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-43a2ecbd-7aa0-4900-9528-ad1f70558714 req-ce9f515b-8dab-4823-91a4-cf32c5842532 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062417 Oct 13 09:16:11.347542 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3618/6841] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:16:12.193539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:12.194136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:12.201948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:12.202738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:12.203171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:12.203867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:12.204330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:12.204776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:12.341757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:12.349994 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fbb88bf-4e18-4e93-81f4-3e094937773f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.160386 Oct 13 09:16:12.350636 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3224/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:12 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:13.374032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:13.374770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:13.382207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:13.382727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:13.383165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:13.383865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:13.384320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:13.384746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:13.518633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:13.526548 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3ac2f809-ff36-4c45-b419-2a2c2d11479f tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.157363 Oct 13 09:16:13.527117 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3619/6843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:13 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:14.549306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:14.550182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:14.557427 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:14.557904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:14.558340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:14.559078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:14.559532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:14.559959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:14.698323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:14.707035 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f274306b-5e33-4a75-9fb1-af1408f128dd tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.161685 Oct 13 09:16:14.707616 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3225/6844] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:14 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:15.729854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:15.730429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:15.737715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:15.738189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:15.738664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:15.739352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:15.739808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:15.740432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:15.878623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:15.886523 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc2460c2-f2b7-4d9a-ad37-df781dbd4d1a tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.160674 Oct 13 09:16:15.887103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3620/6845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:15 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:16.699437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baaac75-52a0-4726-b129-8db3bf6517a2", "name": "network-vif-plugged", "status": "completed", "tag": "abd3995b-e7a1-472a-8fdd-dc8542159afb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:16.709685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:16.710164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:16.710620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:16.722466 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] Creating event network-vif-plugged:abd3995b-e7a1-472a-8fdd-dc8542159afb for instance 5baaac75-52a0-4726-b129-8db3bf6517a2 on n-h1-858384-11 Oct 13 09:16:16.727615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a4b8126f-9df2-4bcb-8807-58624c500ebb req-c4fe2b29-dab9-4a2a-918f-4cf1cbd7639d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098397 Oct 13 09:16:16.728476 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3226/6846] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:16.909030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:16.909646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:16.916556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:16.917039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:16.917479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:16.918172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:16.918665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:16.919094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:17.047714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:17.055631 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c9dddee-0f04-4a61-9171-5f678ce15226 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1314 microversion: 2.1 time: 0.150502 Oct 13 09:16:17.056200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3621/6847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:16 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:18.081079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:18.081777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:18.089082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:18.089558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:18.089990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:18.090717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:18.091168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:18.092203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:18.222005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:18.229745 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1b5977dd-62ab-4e47-a6e6-75bf6de7a586 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1464 microversion: 2.1 time: 0.153763 Oct 13 09:16:18.230321 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3227/6848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:18 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:18.252470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8be734d-268a-4605-a49d-a2cba8cc5db9", "device": "/dev/sdb"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:18.254985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:18.261687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:18.262160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:18.262907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:18.264211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:18.264658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:18.265078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:18.505720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-990c9a9f-dc8f-46d4-9729-f0dbc3d4d577 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "POST /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256946 Oct 13 09:16:18.507061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3622/6849] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:16:18 2022] POST /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:25.708325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:25.709013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:25.813467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:25.814096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:25.819993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:25.820473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:25.820931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:25.821611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:25.822061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:25.822511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:25.952341 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e15a1b9c-8c17-400f-ae4b-3a101341e153 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1837 microversion: 2.1 time: 0.248643 Oct 13 09:16:25.952944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3228/6850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:25 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1837 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:26.793508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:26.794260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:26.800599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:26.803346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:26.803837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:26.804533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:26.805249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:26.805706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:26.806162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:26.835057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:16:26.861606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:26.871964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:26.872765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:26.873858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:26.885778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] Creating event network-changed:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:16:26.892648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1c876c45-208c-4285-8405-d324a6a57699 req-8fc79065-fd04-4649-a72b-430f56949a04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100773 Oct 13 09:16:26.893614 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3229/6851] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:26.916404 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6d1445b-1545-4cd8-be1b-d5eb320f354d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 204 len: 0 microversion: 2.1 time: 0.126884 Oct 13 09:16:26.917004 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3623/6852] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:16:26 2022] DELETE /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:16:26.926543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:26.927331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:26.941992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:26.942624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:26.943191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:26.943981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:26.944506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:26.945006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:27.105750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:27.113792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6aad9c32-8ed9-49e5-bc2a-e422644fb7b9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1690 microversion: 2.1 time: 0.191490 Oct 13 09:16:27.114368 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3230/6853] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:26 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:28.137783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:28.138555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:28.145264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:28.145750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:28.146185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:28.146896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:28.147348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:28.147768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:28.279441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:28.287163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-950cf721-1317-4091-b0a6-b023445a98a2 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1690 microversion: 2.1 time: 0.153670 Oct 13 09:16:28.287739 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3624/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:28 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:29.000983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1570d8-8b81-4ed0-8e7e-39c10bfd5405", "name": "network-vif-deleted", "tag": "92b85406-5c71-4439-b6cb-bde0ea014006"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:29.011411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:29.011886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:29.012313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:29.024573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] Creating event network-vif-deleted:92b85406-5c71-4439-b6cb-bde0ea014006 for instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 on n-h2-858384-11 Oct 13 09:16:29.030898 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d3be58a4-e849-4676-ae10-db12b7d3ba56 req-78c610df-6042-401f-aaf6-425387b052c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033950 Oct 13 09:16:29.031876 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3231/6855] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:29.319859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:29.324200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:29.332989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:29.333556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:29.334241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:29.335207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:29.335895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:29.336677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:29.380866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:29.381362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:29.381808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:29.382262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lazy-loading 'fault' on Instance uuid ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:16:29.429799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:29.441038 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-486c98c1-8296-4305-9b86-f294de322b0c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 200 len: 1357 microversion: 2.1 time: 0.133106 Oct 13 09:16:29.442062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3625/6856] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:29 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 1357 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:30.468338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:30.469037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: ab1570d8-8b81-4ed0-8e7e-39c10bfd5405] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:30.475944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:30.476434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:30.476874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:30.477579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:30.478118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:30.478619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:30.493659 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] HTTP exception thrown: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Request method failure captured: Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 HTTP/1.1 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9YZy1WJTEtlY4DCfYx2Fz9zfKTI0hQtCnPMrxZjt6W0RM0S_QaDt8los54gzDHkwG_3TXjpy_LQ63nHsSr17c_x9jKvLrDP3lFeXPNpoNZ4iVVXRKcbMohjh6EIBhNCEoq6Ke4w8iH4sjw6hreH64dG036na1kdCUtcG6RFqFo5bXo Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 850ba2a31bb348fea90990d005b3bf58 Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ab1570d8-8b81-4ed0-8e7e-39c10bfd5405'} Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:16:30.495402 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Returning 404 to user: Instance ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:16:30.500823 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fa4564f-cda7-4e78-ae0c-cc7464842c08 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405" status: 404 len: 111 microversion: 2.1 time: 0.035203 Oct 13 09:16:30.501694 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3232/6857] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:30 2022] GET /compute/v2.1/servers/ab1570d8-8b81-4ed0-8e7e-39c10bfd5405 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:16:34.535317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-19371d79-ef63-4bcd-9e18-add9a71975dd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '.version_select at 0x7f5375dd2670>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:34.566919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-19371d79-ef63-4bcd-9e18-add9a71975dd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1743835279" status: 202 len: 0 microversion: 2.1 time: 0.035383 Oct 13 09:16:34.567590 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3626/6858] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Oct 13 09:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1743835279 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:16:34.610244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: .version_select at 0x7f5375345700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1062285131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ5qPOQgwwpS9k9yF3hLEsaFNErVfVUCHm0CERoZmoQVI9gcqDZpqGdcCqk6wpJOIWC4l4QEesw7/CFrTiEPNDQkHa+CgYx/qm1dZhl9eoddyumsNeQEVxxnd4122RQrg=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:34.629558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:16:34.635501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:16:34.650931 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [3b8b464d-2dd2-452c-b8be-e5d90bb781e3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:16:35.659266 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [3b8b464d-2dd2-452c-b8be-e5d90bb781e3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 49066. Oct 13 09:16:35.674854 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f37dfaeb-77e4-4733-9151-88f50689733a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.070933 Oct 13 09:16:35.675757 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3233/6859] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:16:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:41.650993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:41.656287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-113331818", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "d9f2d70d-c368-473c-99fc-5f14d8a6b65d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1062285131", "security_groups": [{"name": "tempest-secgroup-smoke-1494390983"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:41.666041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:41.815783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] validate_networks() for [('d9f2d70d-c368-473c-99fc-5f14d8a6b65d', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:16:42.426643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:16:42.427497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:16:42.428204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:16:42.428849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:16:42.430046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:16:42.442168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:42.442968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:42.443679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:42.444683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:42.445196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:42.445845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:42.467047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:16:42.473821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:16:42.503526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:16:42.506339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:16:42.579123 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-edd157e4-acee-4de2-b346-e57915ee342a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929909 Oct 13 09:16:42.587219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3627/6860] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:16:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:16:42.591799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-12bc2134-171d-4e72-aee6-2fb5739b2cec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:42.592489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-12bc2134-171d-4e72-aee6-2fb5739b2cec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:42.600137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=50 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:42.601732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:42.682700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-12bc2134-171d-4e72-aee6-2fb5739b2cec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:42.691695 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-12bc2134-171d-4e72-aee6-2fb5739b2cec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1266 microversion: 2.1 time: 0.103987 Oct 13 09:16:42.692581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3234/6861] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:42 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:16:43.720629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:43.724168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:43.732767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:43.733407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:43.734215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:43.735174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:43.735711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:43.736206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:43.842196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:43.870646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-993a0f37-e5d9-4790-aa05-ac203b425c73 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1318 microversion: 2.1 time: 0.152117 Oct 13 09:16:43.878774 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3628/6862] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:43 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:44.902043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:44.907977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:44.923874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:44.924875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:44.925534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:44.926484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:44.927140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:44.927783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:45.104840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:45.114893 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1caaa189-2a09-4e7e-b473-a0deb3c42948 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.217569 Oct 13 09:16:45.126442 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3235/6863] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:44 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:45.963341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:45.977897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:45.978489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:45.978946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:45.991010 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] Creating event network-changed:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h2-858384-11 Oct 13 09:16:45.996079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9af8d77e-f1fd-4ed1-926e-0dd93fbb1228 req-d9878f33-4c9d-4bdf-889e-b37939b37418 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043431 Oct 13 09:16:45.997199 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3629/6864] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:46.138964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:46.139575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:46.146569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:46.147049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:46.147480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:46.148169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:46.148618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:46.149042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:46.279265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:46.286981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-573f7d8a-0169-4e7e-b54a-12c006ea0967 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.151736 Oct 13 09:16:46.287555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3236/6865] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:46 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:47.310330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:47.311227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:47.317579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:47.318139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:47.318606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:47.319300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:47.319750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:47.320177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:47.467916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:47.477696 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-acc55c64-a095-4853-bf59-fa1f2ee13d3a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.172421 Oct 13 09:16:47.478297 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3630/6866] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:47 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:48.505524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:48.506324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:48.513732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:48.514348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:48.515045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:48.516847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:48.517386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:48.517907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:48.663411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:48.671886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b649b6b-dfb1-4d67-8bd5-0f18130a46d6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.170640 Oct 13 09:16:48.672479 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3237/6867] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:48 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:49.694491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:49.695122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:49.702474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:49.702954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:49.703387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:49.704073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:49.704533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:49.704963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:49.843021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:49.851359 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48a591fb-34ee-48c6-8d62-391d3d420773 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.160730 Oct 13 09:16:49.852035 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3631/6868] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:49 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:50.875812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:50.876530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:50.883344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:50.883902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:50.884479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:50.885249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:50.885893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:50.886582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:51.032702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:51.042809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c870e81-9a54-48ed-8f3d-b4a828f58de1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.171005 Oct 13 09:16:51.043988 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3238/6869] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:50 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:52.070128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:52.070760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:52.077988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:52.078681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:52.078991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:52.079712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:52.080171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:52.080605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:52.217373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:52.225498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d3978c24-a62f-4b31-aa15-c7ec8f09353c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.162081 Oct 13 09:16:52.226073 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3632/6870] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:52 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:52.418846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "name": "network-vif-plugged", "status": "completed", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:52.431105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:52.431742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:52.432429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:52.444310 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] Creating event network-vif-plugged:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h2-858384-11 Oct 13 09:16:52.450167 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b5c120c0-25c0-4014-b4f3-61dd2d84b128 req-c74f1de9-84ef-4117-82e9-5aca35f72a3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034428 Oct 13 09:16:52.450900 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3239/6871] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:53.249790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:53.250467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:53.252444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:53.253214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:53.260046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:53.260538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:53.261004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:53.261713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:53.262227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:53.262684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:53.403928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:53.412009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b13a3c4-44b2-4437-a3eb-c8049121f198 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1392 microversion: 2.1 time: 0.166705 Oct 13 09:16:53.412726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3633/6872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:53 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:16:54.436972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:54.437666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:54.439721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:16:54.445811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:54.446280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:54.446741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:54.447431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:54.447880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:54.448306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:54.582992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:54.591629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5723a905-3f84-4b2b-b6df-fe9b4e74f1c4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1563 microversion: 2.1 time: 0.159394 Oct 13 09:16:54.592228 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3240/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:54 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:16:54.615842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:54.616457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:54.623657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:54.624269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:54.624781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:54.625627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:54.626159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:54.626681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:54.758579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:54.766930 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5052d8cf-c3a4-4001-a806-d34a3088f8d0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1563 microversion: 2.1 time: 0.154926 Oct 13 09:16:54.767541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3634/6874] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:54 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:16:56.459610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:16:56.460846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:16:56.463004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:16:56.469722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:56.470568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:56.471508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:56.472472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:56.473155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:56.473945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:56.474585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:16:56.475315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:16:56.475922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:16:56.495136 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] Creating event network-changed:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h2-858384-11 Oct 13 09:16:56.502085 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-716b87fc-1eb5-4137-b3a8-25e6825bf4f8 req-1ca1e253-6bf6-4e88-9105-13407654de65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043447 Oct 13 09:16:56.503831 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3635/6875] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:16:56.630017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:16:56.641060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4523f3a2-7a5d-4987-bf06-7ce421b02c7c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1563 microversion: 2.1 time: 0.185423 Oct 13 09:16:56.659623 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3241/6876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:16:56 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:17:23.174526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:17:23.175279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=42 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:17:23.179841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:23.180461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:23.188984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:23.189469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:23.189909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:23.190642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:23.191103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:23.191534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:23.270870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lazy-loading 'services' on Instance uuid 5baaac75-52a0-4726-b129-8db3bf6517a2 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:17:23.339662 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c60e8e04-4b21-460c-a2c3-07c385f0b4eb tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2/os-volume_attachments/e8be734d-268a-4605-a49d-a2cba8cc5db9" status: 202 len: 0 microversion: 2.1 time: 0.167304 Oct 13 09:17:23.340248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3636/6877] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:17:23 2022] DELETE /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2/os-volume_attachments/e8be734d-268a-4605-a49d-a2cba8cc5db9 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:17:28.695844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:28.696352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:28.699006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=17 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:17:28.699673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=38 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:17:28.705276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:28.705759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:28.706203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:28.706920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:28.707374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:28.707798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:28.732924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:17:28.804536 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-186dd46d-b5d5-4ff0-9680-2f278e32c757 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 204 len: 0 microversion: 2.1 time: 0.112381 Oct 13 09:17:28.805125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3242/6878] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:17:28 2022] DELETE /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:17:28.816135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:28.816848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:28.823113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:28.824215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:28.824668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:28.825367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:28.825827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:28.826260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:28.958749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:17:28.966973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7df8ce75-ac85-48b8-aaec-f1dc055186e4 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1470 microversion: 2.1 time: 0.156604 Oct 13 09:17:28.967539 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3637/6879] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:17:28 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:17:29.960215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:17:29.962479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:29.970795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:29.971278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:29.971974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:29.972662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:29.973111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:29.973534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:29.990514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:29.991143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:29.998022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:29.998549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:29.998988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:29.999721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:30.000155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:30.000577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:30.049025 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00ac803a-65bf-41db-9c5f-7afa56de3357 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action" status: 200 len: 24575 microversion: 2.1 time: 0.092879 Oct 13 09:17:30.056006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3243/6880] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:17:29 2022] POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action => generated 24575 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:17:30.131618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:17:30.139365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da65da70-7563-4279-b614-0fd84e0e927d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1470 microversion: 2.1 time: 0.153051 Oct 13 09:17:30.140155 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3638/6881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:17:29 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:17:30.774426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5baaac75-52a0-4726-b129-8db3bf6517a2", "name": "network-vif-deleted", "tag": "abd3995b-e7a1-472a-8fdd-dc8542159afb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:17:30.785697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:30.786171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:30.786627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:30.797436 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] Creating event network-vif-deleted:abd3995b-e7a1-472a-8fdd-dc8542159afb for instance 5baaac75-52a0-4726-b129-8db3bf6517a2 on n-h1-858384-11 Oct 13 09:17:30.802044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-73674cd4-ab74-4719-aaac-51d1743742fe req-9c0ec1b5-d34b-48dc-ab3b-ce6c7d514e51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095776 Oct 13 09:17:30.802923 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3244/6882] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:17:31.163577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:31.164224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:31.171807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:31.172420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:31.172932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:31.173871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:31.174359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:31.174826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:31.207729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:31.208209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:31.208675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:31.209152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lazy-loading 'fault' on Instance uuid 5baaac75-52a0-4726-b129-8db3bf6517a2 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:17:31.249971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e890b185c6084a8988593edc18e9fefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0635a1c4d8740f0a3b2bc2a92645c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:17:31.256922 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9781ca45-cfc2-4f32-8eae-52629cba60b5 tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 200 len: 1304 microversion: 2.1 time: 0.097711 Oct 13 09:17:31.257490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3639/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:17:31 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:17:32.281768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:17:32.282492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] [instance: 5baaac75-52a0-4726-b129-8db3bf6517a2] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:17:32.288670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:32.289145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:32.289581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:32.290259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:17:32.290755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:17:32.291175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:17:32.304819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] HTTP exception thrown: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Request method failure captured: Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 HTTP/1.1 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9dWRTHy0_UASwhzz9JzfCrQ-vTXUqbKMPZWdHRFh_lnY48jrHofZ6VEemX8dDTBIwvv6_mTNa3GorWI2RQYgWayPpXuM13PH-1WpzKEFZ-EVwKds2PbhsCJ1NtjhKHclaXj9lgmp__b3eMLIJg-fB73s9kll5ASo3uiEKcVJ63UwbU Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: a0635a1c4d8740f0a3b2bc2a92645c33 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-VolumesBackupsTest-602067243 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0635a1c4d8740f0a3b2bc2a92645c33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a0635a1c4d8740f0a3b2bc2a92645c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a0635a1c4d8740f0a3b2bc2a92645c33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a0635a1c4d8740f0a3b2bc2a92645c33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-VolumesBackupsTest-602067243 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: a0635a1c4d8740f0a3b2bc2a92645c33 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-VolumesBackupsTest-602067243 Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-VolumesBackupsTest-602067243-project Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: e890b185c6084a8988593edc18e9fefe Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-VolumesBackupsTest-602067243-project Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '5baaac75-52a0-4726-b129-8db3bf6517a2'} Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:17:32.306349 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] Returning 404 to user: Instance 5baaac75-52a0-4726-b129-8db3bf6517a2 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c9b8f85-e997-4175-b7f4-8c38211dc29d tempest-VolumesBackupsTest-602067243 tempest-VolumesBackupsTest-602067243-project] 10.222.0.23 "GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2" status: 404 len: 111 microversion: 2.1 time: 0.031015 Oct 13 09:17:32.312429 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3245/6884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:17:32 2022] GET /compute/v2.1/servers/5baaac75-52a0-4726-b129-8db3bf6517a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:18:00.427976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:00.428624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:00.431074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:00.431760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:00.437968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.438473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.438945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:00.439639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.440093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.440522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:00.577813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:00.585703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b82d20c9-1bda-414c-ae31-f4b318448ec4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1681 microversion: 2.1 time: 0.161729 Oct 13 09:18:00.586282 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3640/6885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:00 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:00.685688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:00.687825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:00.690596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:00.691254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:00.697364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.697852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.698293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:00.699430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.699537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.699871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:00.770395 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d6f46fa-15a5-4ba9-8a1a-8dc0ea5e5481 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action" status: 200 len: 32642 microversion: 2.1 time: 0.089016 Oct 13 09:18:00.776782 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3246/6886] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:18:00 2022] POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action => generated 32642 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:18:00.986745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:00.987308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:00.993345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.993832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.994269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:00.995505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:00.995960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:00.996393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:01.134782 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-669375bf-c3fc-494a-84b7-475a8e57fdc2 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1834 microversion: 2.1 time: 0.151884 Oct 13 09:18:01.136051 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3641/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:00 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1834 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:01.165131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:01.167686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:01.174689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:01.175175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:01.175617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:01.176308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:01.176767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:01.177193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:01.213695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lazy-loading 'flavor' on Instance uuid 453b4a50-a605-48ff-b85f-d7eee24203ff {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:18:01.226033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Going to try to live migrate instance to another host {{(pid=127031) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 13 09:18:02.710129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27437af5-4483-47ed-8c8a-92b49695c878 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action" status: 202 len: 0 microversion: 2.1 time: 1.549059 Oct 13 09:18:02.711861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3247/6888] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:18:01 2022] POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action => generated 0 bytes in 1552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:18:02.720799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:02.722267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:02.729994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:02.730531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:02.730978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:02.732256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:02.733736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:02.734182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:02.906796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:02.915540 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b8ee5fd-d81b-461d-bfb9-f8ee3013ec06 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.198646 Oct 13 09:18:02.916773 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3642/6889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:02 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:18:03.940654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:03.941725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:03.949882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:03.950555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:03.951107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:03.951935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:03.952720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:03.953256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:04.152451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:04.158996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:04.164300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:04.165128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:04.165796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:04.173030 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cca3a35b-e253-4cc0-88f4-0c32deeba01f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.236169 Oct 13 09:18:04.178790 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] Creating event network-vif-unplugged:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h2-858384-11 Oct 13 09:18:04.187465 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-945d7a2f-a525-4acb-9074-b5c98b07ac4f req-23dff686-58b3-450b-aa40-d3c55e5b5f04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040009 Oct 13 09:18:04.188394 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3643/6890] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:18:04.193444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3248/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:03 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:05.201258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:05.201955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:05.208513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:05.208998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:05.209433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:05.210120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:05.210607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:05.211046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:05.347037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:05.354966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee5de3d0-46db-499d-89cc-9399cf1c55e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.159355 Oct 13 09:18:05.355547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3644/6892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:05 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:06.227987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:06.239767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:06.240273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:06.240705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:06.250915 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] Creating event network-changed:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h2-858384-11 Oct 13 09:18:06.255771 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b9a96ad3-c7c9-46b3-b8db-81cb3e22db57 req-586be9d0-f98c-4490-9c82-a738090b5295 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031961 Oct 13 09:18:06.256346 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3249/6893] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:18:06.378364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:06.379056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:06.386223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:06.386747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:06.387185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:06.387887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:06.388339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:06.388766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:06.634364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:06.645855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93e48412-9bfd-46c2-9c82-dfab48e7afe7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.271321 Oct 13 09:18:06.646674 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3645/6894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:06 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:07.673544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:07.673953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:07.680330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:07.680833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:07.681270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:07.682585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:07.683046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:07.683478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:07.826238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:07.834936 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-13d94ab0-ef2b-44c8-be7c-459f6093478c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.166904 Oct 13 09:18:07.835906 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3250/6895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:07 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:08.867301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:08.868092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:08.875940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:08.876567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:08.877179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:08.877992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:08.878605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:08.879135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:09.017270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:09.025209 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5efd6e92-662f-4151-bbb1-27e0dcd51d5d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.161863 Oct 13 09:18:09.026048 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3646/6896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:08 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:10.052111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:10.053190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:10.060473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:10.061184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:10.061721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:10.062555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:10.063303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:10.063824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:10.212156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:10.221035 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f2dadff-c1f7-4ad4-ba66-dd90cf703772 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.175389 Oct 13 09:18:10.222032 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3251/6897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:10 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:11.245657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:11.246277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:11.253133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:11.253621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:11.254058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:11.254782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:11.256719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:11.257167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:11.395219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:11.412545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-344bb14e-11f3-4ac4-bc29-e00983cbf5e1 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1691 microversion: 2.1 time: 0.163905 Oct 13 09:18:11.419210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3647/6898] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:11 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:12.443035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:12.443608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:12.450539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.451025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.451468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.452163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.452620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.453150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.602783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:12.611442 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e990f99b-ee0c-4eef-b309-f3cd65811b91 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1681 microversion: 2.1 time: 0.171810 Oct 13 09:18:12.611898 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3252/6899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:12 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:12.639664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:12.640417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:12.647155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.647710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.648215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.648985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.649509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.650080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.789909 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b91e5453-e7e1-4f8f-b180-026e90aef055 tempest-TestNetworkAdvancedServerOps-1254315851 tempest-TestNetworkAdvancedServerOps-1254315851-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1834 microversion: 2.1 time: 0.155148 Oct 13 09:18:12.790497 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3648/6900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:12 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1834 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:12.814193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:12.814900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:12.820766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.821245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.821683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.822423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:12.822877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:12.823305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:12.950758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:12.958554 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b024ef83-5da2-4aac-83ca-78495e3f317f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1681 microversion: 2.1 time: 0.148378 Oct 13 09:18:12.959142 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3253/6901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:12 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:13.056071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:13.059082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:13.065863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:13.066441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:13.066950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:13.067717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:13.068238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:13.068665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:13.133772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5da84af9-d8a5-4515-bf7a-ff8109f73b3b tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action" status: 200 len: 38496 microversion: 2.1 time: 0.081459 Oct 13 09:18:13.134608 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3649/6902] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:18:13 2022] POST /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff/action => generated 38496 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:18:14.165126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:14.166368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:14.168288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:14.173695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:14.174551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:14.175256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:14.176242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:14.176928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:14.177593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:14.179477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:14.179961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:14.180397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:14.193012 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] Creating event network-changed:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h1-858384-11 Oct 13 09:18:14.197999 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d45a1db9-9ab2-403a-a03e-6ece60ee629e req-0fd2c3f7-88ab-4edf-8637-bf8483eb6c52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Oct 13 09:18:14.198710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3650/6903] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:18:14.234127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:18:14.358502 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c141dc09-ac4e-4478-b061-e1c2ded13397 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 204 len: 0 microversion: 2.1 time: 0.196739 Oct 13 09:18:14.364352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3254/6904] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:18:14 2022] DELETE /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:18:14.370484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:14.371529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:14.378038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:14.378860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:14.379403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:14.380432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:14.381131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:14.381656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:14.521257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:14.534366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a8644522-598d-4b13-b77a-7a45a656cc5f tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 200 len: 1687 microversion: 2.1 time: 0.168736 Oct 13 09:18:14.539955 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3651/6905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:14 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:15.573676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:15.575560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: 453b4a50-a605-48ff-b85f-d7eee24203ff] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:15.585096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:15.586098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:15.587250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:15.589270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:15.590144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:15.591007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:15.611647 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] HTTP exception thrown: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Request method failure captured: Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff HTTP/1.1 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9YZy1WJTEtlY4DCfYx2Fz9zfKTI0hQtCnPMrxZjt6W0RM0S_QaDt8los54gzDHkwG_3TXjpy_LQ63nHsSr17c_x9jKvLrDP3lFeXPNpoNZ4iVVXRKcbMohjh6EIBhNCEoq6Ke4w8iH4sjw6hreH64dG036na1kdCUtcG6RFqFo5bXo Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 850ba2a31bb348fea90990d005b3bf58 Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '453b4a50-a605-48ff-b85f-d7eee24203ff'} Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:18:15.614464 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. Oct 13 09:18:15.622459 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:18:15.624578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Returning 404 to user: Instance 453b4a50-a605-48ff-b85f-d7eee24203ff could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:18:15.625757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-863f01e3-f86e-4ce4-97fa-05b3ab6084d5 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff" status: 404 len: 111 microversion: 2.1 time: 0.058357 Oct 13 09:18:15.626572 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3255/6906] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:15 2022] GET /compute/v2.1/servers/453b4a50-a605-48ff-b85f-d7eee24203ff => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:18:16.213602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4a50-a605-48ff-b85f-d7eee24203ff", "name": "network-vif-deleted", "tag": "b8d2ad88-3e6d-42db-9042-e816da2683ab"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:16.226234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:16.226746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:16.227182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:16.239765 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] Creating event network-vif-deleted:b8d2ad88-3e6d-42db-9042-e816da2683ab for instance 453b4a50-a605-48ff-b85f-d7eee24203ff on n-h1-858384-11 Oct 13 09:18:16.246185 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c404fe14-c5b9-4686-9f74-60c4bf687605 req-b65b69e0-ddb3-4d1c-9f23-655f95f98c68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Oct 13 09:18:16.247598 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3652/6907] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:18:19.360466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f999edc9-2c8c-49ab-95ce-17258080e135 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '.version_select at 0x7f53752bcc10>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:19.400010 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f999edc9-2c8c-49ab-95ce-17258080e135 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1062285131" status: 202 len: 0 microversion: 2.1 time: 0.043200 Oct 13 09:18:19.400838 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3256/6908] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Oct 13 09:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1062285131 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:18:19.436576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-867351ac-3daa-48b5-8029-64e06aa8e128 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: .version_select at 0x7f537ab34790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-479108232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtWDmApC6DDQX046/uESPFLNw0XqOWdGHwxm8jZMpBVKxuwjsrowIk5fDn7EOsYRLf/nXdrqmIaebEkocXogGZSn3/vrtoPrWS5cpm4gnb6sRTJWxEKJd5My+tKSfs9rw=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:19.453054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-867351ac-3daa-48b5-8029-64e06aa8e128 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:18:19.459705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-867351ac-3daa-48b5-8029-64e06aa8e128 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:18:19.483280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-867351ac-3daa-48b5-8029-64e06aa8e128 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051922 Oct 13 09:18:19.483969 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3653/6909] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:18:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:18:25.329431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1009609909", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "0860d5d6-7e1f-4ea1-8ff7-5eacc3fe643f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-479108232", "security_groups": [{"name": "tempest-secgroup-smoke-2021096543"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:25.450815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] validate_networks() for [('0860d5d6-7e1f-4ea1-8ff7-5eacc3fe643f', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:18:25.613292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:25.946104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:18:25.947000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:18:25.947706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:18:25.948315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:18:25.948910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:18:25.959645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:25.960422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:25.961048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:25.962108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:25.963307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:25.963918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:25.991010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:18:26.000367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Getting quotas for user 850ba2a31bb348fea90990d005b3bf58 and project c7f35564ccd6405394054ca5572f04f0. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:18:26.016508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:18:26.020448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:18:26.097284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d95ad9e-1380-441d-87b4-581d8fa2667c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778254 Oct 13 09:18:26.098759 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3257/6910] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:18:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:18:26.130022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b5df3857-6cf3-47aa-a745-4e44f2c5e23e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:26.131016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b5df3857-6cf3-47aa-a745-4e44f2c5e23e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:26.232690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=64 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:26.306044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b5df3857-6cf3-47aa-a745-4e44f2c5e23e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:26.315499 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b5df3857-6cf3-47aa-a745-4e44f2c5e23e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1266 microversion: 2.1 time: 0.208642 Oct 13 09:18:26.319960 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3654/6911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:26 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:27.341639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:27.342268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:27.354812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:27.355610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:27.356238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:27.357134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:27.358647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:27.359788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:27.472831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:27.483085 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51041d65-c954-4ee6-b466-63e83ef66382 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1326 microversion: 2.1 time: 0.145522 Oct 13 09:18:27.484234 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3258/6912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:27 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:28.511609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:28.514033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:28.522712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:28.523640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:28.524301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:28.525516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:28.526181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:28.526859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:28.777796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:28.786552 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c67e5c53-9bcd-4c1d-9db2-afc096f5519a tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1392 microversion: 2.1 time: 0.281285 Oct 13 09:18:28.802854 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3655/6913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:28 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:29.169800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:29.192077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:29.193559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:29.194209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:29.209874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] Creating event network-changed:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:18:29.225234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-830cd6de-7a57-4bcd-9b73-9eca40185519 req-358212a4-fd89-49d6-84b1-078a9d6ac2a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059715 Oct 13 09:18:29.226272 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3259/6914] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:18:29.812988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:29.814034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:29.821535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:29.822683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:29.823128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:29.824631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:29.825160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:29.825596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:29.970774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:29.980332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b162b3ae-0e9e-479f-9e82-f919c99035c6 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1392 microversion: 2.1 time: 0.174377 Oct 13 09:18:29.981617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3656/6915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:29 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:31.006131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:31.006934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:31.009190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:31.015857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:31.016349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:31.016815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:31.017520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:31.017968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:31.018474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:31.180620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:31.189470 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b2ba7e07-4a9b-44ce-afcb-8dedbabeba37 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1392 microversion: 2.1 time: 0.188545 Oct 13 09:18:31.190055 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3260/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:30 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:32.213034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:32.213679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:32.216929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:32.222505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:32.222988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:32.223424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:32.224116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:32.224567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:32.225020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:32.361042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:32.369409 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7bc01171-a758-4c05-a0a5-5ba1ec4e2804 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1392 microversion: 2.1 time: 0.160238 Oct 13 09:18:32.369990 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3657/6917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:32 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:33.187946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "name": "network-vif-plugged", "status": "completed", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:33.199107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:33.199696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:33.200225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:33.212020 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] Creating event network-vif-plugged:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:18:33.220113 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-248fed9e-e909-476b-b4da-635198336345 req-5034d9f4-3f3a-4e51-aaf6-289987184821 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Oct 13 09:18:33.220718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3261/6918] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:18:33.391986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:33.392687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:33.400402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:33.400976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:33.401417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:33.402123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:33.402619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:33.403046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:33.543430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:33.551215 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74e3c0e6-f6f0-4fce-b084-9bada712a563 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1392 microversion: 2.1 time: 0.163172 Oct 13 09:18:33.551801 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3658/6919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:33 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:34.576432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:34.577302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:34.583564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:34.584043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:34.584479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:34.585167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:34.585621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:34.586050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:34.716636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:34.724786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ad898dc-ec69-473e-807d-1e7bcea9ddfd tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1564 microversion: 2.1 time: 0.153408 Oct 13 09:18:34.725369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3262/6920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:34 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:18:34.748794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:34.749206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:34.755878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:34.756391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:34.756877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:34.757624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:34.758089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:34.758546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:34.891355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:34.899256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd7b5d89-93f0-4be9-b81e-4fd10630d297 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1564 microversion: 2.1 time: 0.155095 Oct 13 09:18:34.900329 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3659/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:34 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:18:36.539631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:18:36.540584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:18:36.541868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:18:36.543143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:36.544198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:36.551880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:36.552236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:18:36.552400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:36.552798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:36.553507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:36.554019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:36.554469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:36.555678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:18:36.556913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:18:36.557666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:18:36.569656 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] Creating event network-changed:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:18:36.580205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-43a13e24-cfa3-4d08-aaee-ed4e4116ce21 req-921e114e-160f-4ba9-a693-e71d067c99a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041808 Oct 13 09:18:36.584768 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3660/6922] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:18:36.726677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:18:36.737070 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37ae1288-73e4-4b8e-a88d-07ad271ffb32 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1564 microversion: 2.1 time: 0.201258 Oct 13 09:18:36.750879 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3263/6923] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:18:36 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1564 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:00.001253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:00.001984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:00.006900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:19:00.009203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:00.016154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:00.016629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:00.017064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:00.017753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:00.018207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:00.018664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:00.069346 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-caaa4c85-b533-4425-8ba9-6b106a422bb8 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action" status: 200 len: 24570 microversion: 2.1 time: 0.069814 Oct 13 09:19:00.069996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3661/6924] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:18:59 2022] POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:19:11.168662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:19:11.175613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:11.181436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:11.182236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=30 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:11.184143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.184633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.185138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.185923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.186441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.186870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.437161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:19:11.437579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:19:11.438050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:19:11.438478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:19:11.439010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:19:11.500666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:11.522180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.522853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.523393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.524825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.525365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.525841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.555014 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-654f4eda-7b58-4cba-956b-bca23cf95e4d tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action" status: 202 len: 1138 microversion: 2.1 time: 0.391122 Oct 13 09:19:11.558654 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3264/6925] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:19:11 2022] POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action => generated 1138 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 13 09:19:11.576111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:11.576755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:11.583121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:11.584014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:11.587107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.587748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.588351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.589219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:11.589686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:11.590112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:11.827297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:11.837984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3982def7-57bd-454c-b6ba-2160a49b8278 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.266340 Oct 13 09:19:11.839262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3662/6926] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:11 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:12.865402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:12.866012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:12.873879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:12.874260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:12.874754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:12.875456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:12.875912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:12.876346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:13.017848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:13.026900 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b673df99-f472-454f-8ef4-c210e5a9a5a0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.165366 Oct 13 09:19:13.028005 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3265/6927] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:12 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:14.055107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:14.055672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:14.064478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:14.064982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:14.065600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:14.066340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:14.066832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:14.067260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:14.204616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:14.212626 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-044f7afb-2c51-4d5c-821f-777520acd54e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.161726 Oct 13 09:19:14.213201 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3663/6928] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:14 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:15.237777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:15.238331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:15.245301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:15.245797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:15.246239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:15.246989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:15.247449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:15.247879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:15.391812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:15.400361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1783e50-e044-4d11-b496-b728f247f8f0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.166695 Oct 13 09:19:15.400881 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3266/6929] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:15 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:16.424088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:16.424907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:16.432940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:16.433579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:16.434136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:16.434982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:16.444080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:16.444665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:16.683382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:16.691592 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7f7dfce-c02c-4d8b-91d9-b9c2d68864d7 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.271504 Oct 13 09:19:16.692181 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3664/6930] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:16 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:17.716253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:17.716898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:17.724200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:17.724697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:17.725135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:17.725835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:17.726426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:17.726740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:17.865548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:17.873622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9d11743e-d008-4929-af36-ead152428716 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.161275 Oct 13 09:19:17.874219 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3267/6931] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:17 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:18.899104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:18.899719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:18.906701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:18.907186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:18.907629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:18.908328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:18.908788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:18.909218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:19.051652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:19.060327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4636f178-7bbe-451a-8799-986305585e15 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.165115 Oct 13 09:19:19.061053 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3665/6932] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:18 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:20.084207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:20.084817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:20.093181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:20.093664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:20.094106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:20.094821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:20.095272 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:20.095693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:20.248187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:20.256264 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c61087d8-a9e1-4857-8908-a00e009c9e95 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.176306 Oct 13 09:19:20.256789 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3268/6933] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:20 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:21.280382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:21.280934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:21.288312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:21.288891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:21.290065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:21.290926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:21.291456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:21.291956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:21.438061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:21.446891 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3744b5b0-1c2c-45c1-baf4-48d69fa074b0 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.170362 Oct 13 09:19:21.447492 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3666/6934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:21 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:22.470370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:22.471067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:22.478583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:22.479072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:22.479510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:22.480211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:22.480667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:22.481124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:22.627856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:22.636725 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-590e21ab-8c76-44bc-a307-39831d40e339 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.170500 Oct 13 09:19:22.637297 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3269/6935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:22 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:23.660628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:23.661298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:23.668536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:23.669020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:23.669460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:23.670163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:23.670649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:23.671080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:23.802168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:23.810729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b1615e11-b0bf-4826-b5d9-f0753d88ee7e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.154002 Oct 13 09:19:23.811331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3667/6936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:23 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:24.834032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:24.834675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:24.841470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:24.841949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:24.842386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:24.843096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:24.843572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:24.844004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:25.234728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:25.242998 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b79a55ac-7b0f-4867-9810-4a1c5f142188 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.412852 Oct 13 09:19:25.243924 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3270/6937] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:24 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:26.266516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:26.267124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:26.274872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:26.275349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:26.275786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:26.276476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:26.276928 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:26.277349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:26.414558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:26.422910 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b8cfdc6f-1e7f-49ae-8369-b8c4db6e5952 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.160221 Oct 13 09:19:26.439502 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3668/6938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:26 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:27.448059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:27.448700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:27.455725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:27.456211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:27.456649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:27.457343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:27.457803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:27.458232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:27.594710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:27.603398 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1dbbcb53-cd6a-44c6-9553-2ba8131197e9 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1692 microversion: 2.1 time: 0.160073 Oct 13 09:19:27.604058 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3271/6939] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:27 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:28.628217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:28.628902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:28.637518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:28.638010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:28.638553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:28.639333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:28.640053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:28.640745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:28.782651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:28.791080 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e8dbb2c-365e-4b8e-accb-bb4475fc874c tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1698 microversion: 2.1 time: 0.167512 Oct 13 09:19:28.791673 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3669/6940] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:28 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:29.816293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:29.816989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:29.824252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:29.824847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:29.825250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:29.825966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:29.826444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:29.826870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:29.964692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:29.973161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67333a9d-5779-4013-abe0-ae728fc5b3bf tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1698 microversion: 2.1 time: 0.161026 Oct 13 09:19:29.973778 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3272/6941] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:29 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:30.996707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:19:30.997983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:31.005091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:31.005691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:31.006130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:31.006923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:31.007377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:31.007948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:31.155248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:19:31.163163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e070a53f-febf-43fd-87ac-090ad1162843 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1683 microversion: 2.1 time: 0.170367 Oct 13 09:19:31.163836 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3670/6942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:19:30 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:19:31.519429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:19:31.530446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:31.531039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:31.531508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:31.543559 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] Creating event network-vif-unplugged:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:19:31.548532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-765a8706-1f45-4287-91c1-5d8d29c71c3c req-dd2721e6-1267-4569-8a2e-1c0a6e8be7f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032879 Oct 13 09:19:31.549120 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3273/6943] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:19:33.565334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "name": "network-vif-plugged", "status": "completed", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:19:33.576460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:33.577025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:33.577522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:33.588704 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] Creating event network-vif-plugged:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:19:33.593599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-757f3e42-6f46-4e2e-80c3-972cbeed973e req-65f31daf-aab5-448f-8b05-d6c63d66b8f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Oct 13 09:19:33.594177 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3671/6944] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:19:55.371215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=24 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:55.372387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:19:55.376640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:19:55.378964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:19:55.387252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:55.387745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:55.388188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:55.388897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:19:55.389354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:19:55.389782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:19:55.441587 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0e07c85-abf1-4e66-9364-7a55bf72752e tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action" status: 200 len: 24572 microversion: 2.1 time: 0.072300 Oct 13 09:19:55.442243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3274/6945] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:19:55 2022] POST /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:20:07.594200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=20 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:07.594993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=56 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:07.600973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:07.601571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:20:07.603126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:07.610051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:07.610748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:07.611343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:07.612200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:07.613035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:07.613567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:07.613781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:07.614229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:07.616220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:07.616763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:07.617350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:07.631777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] Creating event network-changed:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:20:07.637195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c809e37f-0abe-48fe-b027-710819d7c73e req-a5b68e83-496c-4299-93ca-c3113482f130 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037917 Oct 13 09:20:07.638128 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3275/6946] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:07.651850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:20:07.757701 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2255fc2-5224-4b50-9d47-f276b0aca882 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 204 len: 0 microversion: 2.1 time: 0.164765 Oct 13 09:20:07.761613 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3672/6947] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:20:07 2022] DELETE /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:20:07.768062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:07.769080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:20:07.776039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:07.777574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:07.778280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:07.779135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:07.779808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:07.780454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:07.960936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:20:07.969365 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27146fb8-01f6-49ef-8a35-60da1437cecc tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1689 microversion: 2.1 time: 0.206062 Oct 13 09:20:07.970533 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3276/6948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:20:07 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:20:08.995313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:08.996034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:20:09.003526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:09.004023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:09.004474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:09.005214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:09.005677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:09.006106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:09.231002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850ba2a31bb348fea90990d005b3bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f35564ccd6405394054ca5572f04f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:20:09.236615 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-186f279e-3be1-4a3c-ae67-756ca43f91b4 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 200 len: 1689 microversion: 2.1 time: 0.245718 Oct 13 09:20:09.251219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3673/6949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:20:08 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 1689 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:20:09.565756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6506baa-29dc-4214-b8a4-7eb6f21b3eb8", "name": "network-vif-deleted", "tag": "14aaf0be-d0e6-4bb0-b766-177e8a8cb077"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:09.592300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:09.592921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:09.593784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:09.608281 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] Creating event network-vif-deleted:14aaf0be-d0e6-4bb0-b766-177e8a8cb077 for instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 on n-h1-858384-11 Oct 13 09:20:09.613403 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b57e64f6-2d4b-4e1c-9830-9f2eec42ae09 req-a28b6335-4574-4208-98d3-f9f82edf69c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051244 Oct 13 09:20:09.614112 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3277/6950] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:10.261849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:10.262646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] [instance: d6506baa-29dc-4214-b8a4-7eb6f21b3eb8] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:20:10.269559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:10.270047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:10.270516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:10.271215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:10.271684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:10.272099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:10.285791 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] HTTP exception thrown: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Request method failure captured: Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 HTTP/1.1 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9YZy1WJTEtlY4DCfYx2Fz9zfKTI0hQtCnPMrxZjt6W0RM0S_QaDt8los54gzDHkwG_3TXjpy_LQ63nHsSr17c_x9jKvLrDP3lFeXPNpoNZ4iVVXRKcbMohjh6EIBhNCEoq6Ke4w8iH4sjw6hreH64dG036na1kdCUtcG6RFqFo5bXo Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7f35564ccd6405394054ca5572f04f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: c7f35564ccd6405394054ca5572f04f0 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1966281935 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 850ba2a31bb348fea90990d005b3bf58 Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1966281935-project Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'd6506baa-29dc-4214-b8a4-7eb6f21b3eb8'} Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:20:10.287476 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Returning 404 to user: Instance d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8ff6e5e-5668-4009-99cc-eba2824ceb04 tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8" status: 404 len: 111 microversion: 2.1 time: 0.031158 Oct 13 09:20:10.291380 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3674/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:20:10 2022] GET /compute/v2.1/servers/d6506baa-29dc-4214-b8a4-7eb6f21b3eb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:20:13.578085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11eaf456-135d-498a-9821-017d08a31aec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] Calling method '.version_select at 0x7f53752fa790>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:13.620109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11eaf456-135d-498a-9821-017d08a31aec tempest-TestNetworkAdvancedServerOps-1966281935 tempest-TestNetworkAdvancedServerOps-1966281935-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-479108232" status: 202 len: 0 microversion: 2.1 time: 0.046622 Oct 13 09:20:13.620878 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3278/6952] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Oct 13 09:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-479108232 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:20:58.048626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:58.049617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:58.203572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23ce6cb2-bf68-4114-a45c-265036a2dec0 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1473641046", "availability_zone": "foo_zone"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.225996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.aggregate [None req-23ce6cb2-bf68-4114-a45c-265036a2dec0 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Generated uuid 40d3c8cb-f5c0-4010-98fc-df035c6b7ddb for aggregate {{(pid=127030) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 13 09:20:58.259794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23ce6cb2-bf68-4114-a45c-265036a2dec0 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.212322 Oct 13 09:20:58.266235 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3675/6953] 10.222.0.23 () {60 vars in 1164 bytes} [Thu Oct 13 09:20:58 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.272405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad809f0d-d14b-4653-b00d-47de3fb65c46 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.278017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:58.278706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:20:58.302513 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad809f0d-d14b-4653-b00d-47de3fb65c46 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.034494 Oct 13 09:20:58.303420 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3279/6954] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 09:20:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:20:58.314884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:58.319156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:58.319647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:58.320137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:58.320808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:58.321260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:58.321688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:58.348534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f905791a-0e26-47a1-af55-c6469c241cf5 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.037121 Oct 13 09:20:58.349157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3676/6955] 10.222.0.23 () {58 vars in 1176 bytes} [Thu Oct 13 09:20:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:20:58.360690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-391f5478-d74c-48c8-9264-1225d0b71b90 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:58.368425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-391f5478-d74c-48c8-9264-1225d0b71b90 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.011435 Oct 13 09:20:58.369003 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3280/6956] 10.222.0.23 () {58 vars in 1143 bytes} [Thu Oct 13 09:20:58 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.381425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6c2e7b7-04fa-4a13-aa1c-ee7256ca8adc tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-11"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.392980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c2e7b7-04fa-4a13-aa1c-ee7256ca8adc tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:58.393546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c2e7b7-04fa-4a13-aa1c-ee7256ca8adc tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:58.394052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6c2e7b7-04fa-4a13-aa1c-ee7256ca8adc tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:58.658090 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6c2e7b7-04fa-4a13-aa1c-ee7256ca8adc tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.281084 Oct 13 09:20:58.658726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3677/6957] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 09:20:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.670846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bfa973d4-6ef5-45f5-a40b-04acf3bd548c tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:58.679335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bfa973d4-6ef5-45f5-a40b-04acf3bd548c tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.012249 Oct 13 09:20:58.679868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3281/6958] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 09:20:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.690853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef10d852-9f7c-4780-9293-73468c1fc260 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1749072646", "availability_zone": "foo_zone"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.810459 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef10d852-9f7c-4780-9293-73468c1fc260 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.123216 Oct 13 09:20:58.811069 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3678/6959] 10.222.0.23 () {60 vars in 1173 bytes} [Thu Oct 13 09:20:58 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.822034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e336405-7f4b-4426-8dbb-e2ed3acdae1d tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.847212 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e336405-7f4b-4426-8dbb-e2ed3acdae1d tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.028813 Oct 13 09:20:58.847808 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3282/6960] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 09:20:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.859743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f75350be-26cb-470a-8a53-04c82c7e8ef3 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:58.868354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f75350be-26cb-470a-8a53-04c82c7e8ef3 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.012348 Oct 13 09:20:58.868884 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3679/6961] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Oct 13 09:20:58 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:58.880231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d4aadf1f-75bc-416b-8efc-b2830cc0959b tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-11"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:20:58.890607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4aadf1f-75bc-416b-8efc-b2830cc0959b tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:20:58.891090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4aadf1f-75bc-416b-8efc-b2830cc0959b tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:20:58.891526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4aadf1f-75bc-416b-8efc-b2830cc0959b tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:20:59.071524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d4aadf1f-75bc-416b-8efc-b2830cc0959b tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.195053 Oct 13 09:20:59.072132 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3283/6962] 10.222.0.23 () {60 vars in 1194 bytes} [Thu Oct 13 09:20:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:20:59.083229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea750988-a6b6-45f5-b52d-268d412b58c7 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:20:59.105160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea750988-a6b6-45f5-b52d-268d412b58c7 tempest-TestAggregatesBasicOps-1150367882 tempest-TestAggregatesBasicOps-1150367882-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.025478 Oct 13 09:20:59.105673 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3680/6963] 10.222.0.23 () {58 vars in 1155 bytes} [Thu Oct 13 09:20:59 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 13 09:21:28.199794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:28.201188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:28.205225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2038364913", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4a624bec-c41f-43cc-9459-a7426454d6af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:21:28.270760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:21:28.770263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:21:28.770748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:21:28.771226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:21:28.771632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:21:28.772043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:21:28.783376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:28.784248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:28.785044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:28.787184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:28.788018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:28.788819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:28.807813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:21:28.813109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:21:28.875037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:21:28.877149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a624bec-c41f-43cc-9459-a7426454d6af',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:21:29.012260 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae1f29f4-3279-4384-b25f-0fac4ee5cf66 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814341 Oct 13 09:21:29.013155 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3284/6964] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:21:29.022749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:29.023553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:29.025296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:29.028355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a4bc71c1-924d-46c0-8c7a-aa6b3a0e32b2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:29.028975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a4bc71c1-924d-46c0-8c7a-aa6b3a0e32b2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:29.088889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a4bc71c1-924d-46c0-8c7a-aa6b3a0e32b2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:29.095920 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a4bc71c1-924d-46c0-8c7a-aa6b3a0e32b2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1057 microversion: 2.1 time: 0.075205 Oct 13 09:21:29.096484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3681/6965] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:29 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1057 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:30.120613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:30.121234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:30.127810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:30.128448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:30.129418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:30.130325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:30.130881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:30.131310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:30.206101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:30.221625 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22df20ae-7725-4a6b-bf13-7be64b1de417 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1163 microversion: 2.1 time: 0.106066 Oct 13 09:21:30.222222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3285/6966] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:30 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1163 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:31.245586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:31.246991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:31.255064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:31.255792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:31.256237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:31.257096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:31.257563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:31.257990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:31.399386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:31.409494 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10386131-84c6-4faa-8cc7-bfa2150c4b3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1215 microversion: 2.1 time: 0.168034 Oct 13 09:21:31.410913 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3682/6967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:31 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:31.732123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604", "tag": "86eab252-5c1b-4408-91e0-3bb7a1422a69"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:21:31.750327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:31.750847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:31.751287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:31.772878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] Creating event network-changed:86eab252-5c1b-4408-91e0-3bb7a1422a69 for instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 on n-h1-858384-11 Oct 13 09:21:31.787885 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bd59ef8c-5056-4a87-98f2-188915846b17 req-35e42824-dd80-4a19-bc84-30d3a5753999 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065126 Oct 13 09:21:31.788856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3286/6968] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:21:32.433417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:32.434025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:32.441120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:32.442239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:32.442714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:32.443422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:32.443873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:32.444300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:32.595004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:32.604744 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54f83bd1-3dac-415d-ad7f-a76b1af4b4e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1215 microversion: 2.1 time: 0.175307 Oct 13 09:21:32.605825 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3683/6969] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:32 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:33.630935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:33.631626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:33.638921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:33.639418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:33.639862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:33.640571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:33.641033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:33.641459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:33.785898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:33.795415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6a72e402-d957-4834-a714-fd9a820f3ed2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1215 microversion: 2.1 time: 0.170208 Oct 13 09:21:33.796222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3287/6970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:33 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:34.819794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:34.820412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:34.827601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:34.828087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:34.828525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:34.829222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:34.829707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:34.830132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:34.964712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:34.973551 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdd4e062-4c5f-4b71-b79d-39a0c5b056c0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1215 microversion: 2.1 time: 0.157577 Oct 13 09:21:34.974222 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3684/6971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:34 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:35.996499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:35.997029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:36.004055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:36.004565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:36.005005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:36.005697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:36.006153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:36.006619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:36.137319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:36.144952 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-618bebe3-55bd-4d02-b43f-acd7eb3f8fa7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.152509 Oct 13 09:21:36.145559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3288/6972] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:35 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:21:37.169077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:37.169611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:37.177210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:37.177686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:37.178120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:37.178839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:37.179291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:37.179712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:37.306425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:37.314242 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e91aafc3-3abc-4dd5-9b5a-786d10d8cf74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.149117 Oct 13 09:21:37.314882 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3685/6973] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:37 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:21:38.337694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:38.338311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:38.344996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:38.345483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:38.345923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:38.346705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:38.347138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:38.348039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:38.791011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:38.798637 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78f78569-c886-4117-9d5c-17d0129ac155 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.464836 Oct 13 09:21:38.799206 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3289/6974] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:38 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:39.822061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:39.822613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:39.825383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:39.830842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:39.831340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:39.832323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:39.833018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:39.833467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:39.833889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:39.969572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:39.978504 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8696778-93c1-4897-86c3-f110881f0d20 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.160403 Oct 13 09:21:39.979103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3686/6975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:39 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:41.001594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:41.002200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:41.004905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:41.005592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:41.012780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:41.013277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:41.013725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:41.014450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:41.014913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:41.015343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:41.141115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:41.148748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2895bdb2-7fef-4019-99c8-1a6fbc12a82d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.151084 Oct 13 09:21:41.149435 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3290/6976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:40 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:42.172053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:42.172668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:42.180043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:42.180518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:42.180954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:42.181640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:42.182090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:42.182541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:42.310445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:42.318325 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5627537-ea57-4cf9-bf41-b9b9cfe2f657 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.150214 Oct 13 09:21:42.318935 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3687/6977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:42 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:43.341557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:43.342236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:43.350536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:43.351126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:43.351619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:43.352443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:43.352908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:43.353339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:43.484075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:43.492402 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a0bbf387-6a7e-4488-8288-b18347c3053c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.154809 Oct 13 09:21:43.492971 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3291/6978] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:43 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:44.265494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604", "name": "network-vif-plugged", "status": "completed", "tag": "86eab252-5c1b-4408-91e0-3bb7a1422a69"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:21:44.274957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:44.275431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:44.275861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:44.287061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] Creating event network-vif-plugged:86eab252-5c1b-4408-91e0-3bb7a1422a69 for instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 on n-h1-858384-11 Oct 13 09:21:44.292410 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f4c4ac89-a6a4-4cdd-8802-e4b47e369f37 req-edff5024-fbab-4952-9bf1-573241050c9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153701 Oct 13 09:21:44.293045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3688/6979] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:21:44.515303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:44.515820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:44.523239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:44.523726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:44.524162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:44.525047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:44.525499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:44.525926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:44.659899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:44.668196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aedbed4f-5d57-4a56-ad0a-1513550c6e51 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1203 microversion: 2.1 time: 0.156847 Oct 13 09:21:44.669054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3292/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:44 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:45.693006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:45.693733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:45.699994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:45.700475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:45.700912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:45.701610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:45.702066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:45.702521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:45.833413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:45.841169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c17b134-49b4-46bd-90a5-80d22612c9e4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1389 microversion: 2.1 time: 0.153336 Oct 13 09:21:45.841751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3689/6981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:45 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:45.864803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:45.865430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:45.872267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:45.872754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:45.873194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:45.873891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:45.874426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:45.874801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.001775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:46.009761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-effebe24-2cba-4f04-9326-b803e13c1805 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1389 microversion: 2.1 time: 0.149489 Oct 13 09:21:46.010336 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3293/6982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:45 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:46.032439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:46.033062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:46.039816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.040301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.040740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.041438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.041892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.043626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.167556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:46.175345 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18f0e7fd-17fb-4915-9b23-cabb82fc7466 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1389 microversion: 2.1 time: 0.146924 Oct 13 09:21:46.175917 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3690/6983] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:46 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:46.197195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:46.197692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:46.203596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.204076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.204513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.205208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.205659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.206082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.233174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:21:46.304777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46d4879e-9acd-4bde-9844-22f7c23c34fd tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 204 len: 0 microversion: 2.1 time: 0.111143 Oct 13 09:21:46.305370 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3294/6984] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:21:46 2022] DELETE /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:21:46.314673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:46.315453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:46.323009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.323492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.323922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.324615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:46.325081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:46.325483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:46.459343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:46.467044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f321941-11c5-4e4b-966c-5614c9fc5fe1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1395 microversion: 2.1 time: 0.157174 Oct 13 09:21:46.467617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3691/6985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:46 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:47.493243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:47.493949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:47.501448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:47.501933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:47.502372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:47.503089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:47.503545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:47.503970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:47.628905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:47.636671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-088a7029-a4b7-4c9c-aee1-e74211d54dae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1395 microversion: 2.1 time: 0.147830 Oct 13 09:21:47.637239 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3295/6986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:47 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1395 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:48.223005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604", "name": "network-vif-deleted", "tag": "86eab252-5c1b-4408-91e0-3bb7a1422a69"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:21:48.234341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:48.234865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:48.235300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:48.247677 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] Creating event network-vif-deleted:86eab252-5c1b-4408-91e0-3bb7a1422a69 for instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 on n-h1-858384-11 Oct 13 09:21:48.252974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-de352f7b-964d-4d23-8a89-544667fcf0d7 req-64a7d910-9105-4b9d-a393-86439b9295b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Oct 13 09:21:48.253628 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3692/6987] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:21:48.660209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:48.660815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:48.667901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:48.668322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:48.668757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:48.669448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:48.669895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:48.670320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:48.731842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:48.740134 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2292930f-a323-434a-8704-f5a13ed5a989 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1188 microversion: 2.1 time: 0.083889 Oct 13 09:21:48.740716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3296/6988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:48 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:49.765162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:49.765876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:49.772970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:49.773470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:49.773911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:49.774659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:49.775120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:49.775551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:49.840936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:49.850269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e680a01-d2a6-4737-8362-2001af028d44 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1188 microversion: 2.1 time: 0.090283 Oct 13 09:21:49.850899 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3693/6989] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:49 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:50.873211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:50.873736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:50.880618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:50.881105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:50.881571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:50.882262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:50.882750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:50.883179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:50.943290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:50.951186 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a47dacff-1f2d-4760-a83f-ed6c58b10714 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1188 microversion: 2.1 time: 0.081959 Oct 13 09:21:50.951767 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3297/6990] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:50 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1188 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:51.974726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:51.975464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:51.982265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:51.982844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:51.983314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:51.984011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:51.984465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:51.984886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:52.053284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:52.061332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70b9d968-9e8f-4080-b6bd-e2db82d7fc65 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 200 len: 1188 microversion: 2.1 time: 0.091466 Oct 13 09:21:52.061919 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3694/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:51 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:53.083662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:53.084377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:53.091041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:53.091528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:53.091969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:53.092670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:53.093158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:53.093591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:53.107502 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 HTTP/1.1 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604'} Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:21:53.109166 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32cec05a-8669-40c1-9269-e9294fef31a7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604" status: 404 len: 111 microversion: 2.1 time: 0.030857 Oct 13 09:21:53.113679 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3298/6992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:53 2022] GET /compute/v2.1/servers/c581a84f-fcf5-4dbd-bd5b-2de2c1dc4604 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:21:58.085032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-722684778", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "92c50e32-f8dc-4ae4-b7f1-a67151d77c01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:21:58.147573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:21:58.643985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:21:58.644442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:21:58.644921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:21:58.645334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:21:58.645774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:21:58.654948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:58.655381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:58.655846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:58.656643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:58.657103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:58.657563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:58.676246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:21:58.681596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:21:58.742052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:21:58.744201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92c50e32-f8dc-4ae4-b7f1-a67151d77c01',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:21:58.867879 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a763a31-f565-48f6-8a8c-af5fa1faa89b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787241 Oct 13 09:21:58.868539 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3695/6993] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:21:58.880113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29f4635e-2df8-4ded-9b87-8a20b4b52f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:58.880835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29f4635e-2df8-4ded-9b87-8a20b4b52f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:58.883890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:58.941873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29f4635e-2df8-4ded-9b87-8a20b4b52f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:21:58.948901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29f4635e-2df8-4ded-9b87-8a20b4b52f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1056 microversion: 2.1 time: 0.073216 Oct 13 09:21:58.949475 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3299/6994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:58 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:21:59.973033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:21:59.974644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:21:59.977571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:21:59.983937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:59.984430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:59.984871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:59.985580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:21:59.986036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:21:59.986491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:21:59.991970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=73 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:00.053595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:00.062280 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a22e5544-e8eb-429a-976d-23f0ec12d6bc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1172 microversion: 2.1 time: 0.094455 Oct 13 09:22:00.063232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3696/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:21:59 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1172 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:22:01.087505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:01.088273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:01.095793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:01.096380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:01.097493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:01.098281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:01.099644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:01.100096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:01.103093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:01.214103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13aa42c6-801b-4b0a-a420-b2a743d918fe", "tag": "047c6f58-8a9e-4d3e-935f-7939d34dfe0d"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:22:01.246631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:01.247583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:01.248251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:01.264297 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] Creating event network-changed:047c6f58-8a9e-4d3e-935f-7939d34dfe0d for instance 13aa42c6-801b-4b0a-a420-b2a743d918fe on n-h1-858384-11 Oct 13 09:22:01.271170 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-56df44dc-36a5-4851-a83b-dc39781f0616 req-b76d1303-43a6-4fbe-aad0-95de98fc9e80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064906 Oct 13 09:22:01.271952 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3697/6996] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:22:01.333416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:01.341698 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6eb7985-805a-45d0-aa9d-f3b7401386a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1214 microversion: 2.1 time: 0.257960 Oct 13 09:22:01.342703 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3300/6997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:01 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:02.368285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:02.368990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:02.375292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:02.375811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:02.376257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:02.376988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:02.377443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:02.378370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:02.512918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:02.521288 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a7b84aeb-bf79-4878-b9ab-49934986897c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1214 microversion: 2.1 time: 0.158187 Oct 13 09:22:02.521863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3698/6998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:02 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:03.545009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:03.545660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:03.553118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:03.553811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:03.554263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:03.555002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:03.555463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:03.555894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:03.689457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:03.697334 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e495e5f-43d4-427c-bf14-38e45173ba74 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1214 microversion: 2.1 time: 0.156294 Oct 13 09:22:03.697945 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3301/6999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:03 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:04.720835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:04.722717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:04.731093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:04.731568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:04.732010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:04.732717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:04.733173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:04.733732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:04.868364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:04.876120 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-30b4ff86-03bd-4542-94c9-0522a5f3e0e2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1214 microversion: 2.1 time: 0.159872 Oct 13 09:22:04.876703 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3699/7000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:04 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:05.900197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:05.900823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:05.907646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:05.908132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:05.908573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:05.909774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:05.910233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:05.910695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:06.038284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:06.046107 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9e07a1e1-3f58-4686-9ac4-03d24d16e1c5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.150079 Oct 13 09:22:06.046718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3302/7001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:05 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:07.069106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:07.069716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:07.076414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:07.076922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:07.077357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:07.078043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:07.078519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:07.078946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:07.208654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:07.216542 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-752d62c8-5719-4d89-841f-6a7004ec73bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.151347 Oct 13 09:22:07.217156 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3700/7002] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:07 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:08.240334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:08.240874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:08.247648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:08.248134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:08.248572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:08.249268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:08.249721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:08.250176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:08.380718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:08.388897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ff163d6-31f2-45ee-8ce4-bc2675ae4fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.153262 Oct 13 09:22:08.389556 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3303/7003] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:08 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:09.413076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:09.413690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:09.416499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:09.417211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:09.423506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:09.423990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:09.424431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:09.425163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:09.425678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:09.426150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:09.557239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:09.565664 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7d4f932-56d4-4fba-a327-8c23be26487e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.156625 Oct 13 09:22:09.566263 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3701/7004] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:09 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:10.589363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:10.589985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:10.591849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:10.598490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:10.599234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:10.599674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:10.600370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:10.600829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:10.601260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:10.727699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:10.735381 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8229ccfd-8f67-475f-ba1a-be8300e605a3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.149995 Oct 13 09:22:10.735960 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3304/7005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:10 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:11.757525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:11.758099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:11.764958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:11.765432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:11.765864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:11.766587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:11.767037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:11.767459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:11.897137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:11.904887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e1e70b4-bb68-4214-a3b5-334cb6766d8d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.151280 Oct 13 09:22:11.905454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3702/7006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:11 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:22:12.928742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:12.929400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:12.936161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:12.936640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:12.937078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:12.937765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:12.938218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:12.938667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:13.067993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:13.075620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-465662f2-05fd-478c-b0b9-8c5977f3fa96 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.151578 Oct 13 09:22:13.076182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3305/7007] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:12 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:14.099641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:14.100308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:14.107109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:14.107549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:14.107985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:14.108680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:14.109128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:14.109549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:14.226037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13aa42c6-801b-4b0a-a420-b2a743d918fe", "name": "network-vif-plugged", "status": "completed", "tag": "047c6f58-8a9e-4d3e-935f-7939d34dfe0d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:22:14.236754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:14.237837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:14.238284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:14.245602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:14.254057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fe94de2-b4a8-42d9-86d9-e0a3ea8f8ca1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.158983 Oct 13 09:22:14.254873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3703/7008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:14 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:14.257050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] Creating event network-vif-plugged:047c6f58-8a9e-4d3e-935f-7939d34dfe0d for instance 13aa42c6-801b-4b0a-a420-b2a743d918fe on n-h1-858384-11 Oct 13 09:22:14.262300 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a27cbb33-b4bc-4cad-a241-89aabc263bce req-a11ab3d4-066b-446c-99e4-55d37a38e22d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040716 Oct 13 09:22:14.263282 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3306/7009] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:22:15.276985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:15.277587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:15.284352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:15.284828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:15.285260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:15.285944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:15.286393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:15.286848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:15.425951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:15.433678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e56fb75-219a-4c66-821a-6884408b896d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1202 microversion: 2.1 time: 0.160596 Oct 13 09:22:15.434248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3704/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:15 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:16.458758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:16.459455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:16.465860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.466374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.466839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.467531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.467985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.468415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.596823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:16.605100 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-297619b6-57f1-4fbc-94c1-9af72a452ea4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1389 microversion: 2.1 time: 0.151924 Oct 13 09:22:16.605674 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3307/7011] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:16 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:16.627916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:16.628531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:16.635396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.635881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.636327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.637020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.637477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.637906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.765958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:16.774442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b787dfb-f1c3-4f0b-aacd-48e05adfba72 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1389 microversion: 2.1 time: 0.150497 Oct 13 09:22:16.775028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3705/7012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:16 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:16.796756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:16.797392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:16.803444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.803929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.804363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.805050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.805499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.805924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.936521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:16.945028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e112c2f4-1a84-4284-a0e2-8e898c2d3b69 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1389 microversion: 2.1 time: 0.152098 Oct 13 09:22:16.945609 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3308/7013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:16 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:16.967115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:16.967546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:16.973519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.974258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.974797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:16.975487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:16.975954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:16.976358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:17.001067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:22:17.074963 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-842ff49c-56ea-4416-9cad-15f01d4d84ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 204 len: 0 microversion: 2.1 time: 0.111812 Oct 13 09:22:17.075560 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3706/7014] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:22:16 2022] DELETE /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:22:17.084150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:17.084823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:17.090957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:17.091448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:17.091895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:17.092596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:17.093058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:17.093491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:17.223440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:17.231639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-726b6806-5695-479e-9fdd-9b59963aa848 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1395 microversion: 2.1 time: 0.151571 Oct 13 09:22:17.232223 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3309/7015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:17 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:18.256517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:18.257219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:18.267716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:18.268696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:18.269136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:18.269834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:18.270288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:18.270753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:18.399506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:18.408480 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2be725c-4b3a-435e-922a-eadd3a22efd3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1395 microversion: 2.1 time: 0.156232 Oct 13 09:22:18.409663 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3707/7016] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:18 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:18.968710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13aa42c6-801b-4b0a-a420-b2a743d918fe", "name": "network-vif-deleted", "tag": "047c6f58-8a9e-4d3e-935f-7939d34dfe0d"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:22:18.987011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:18.987328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:18.987672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:19.002665 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] Creating event network-vif-deleted:047c6f58-8a9e-4d3e-935f-7939d34dfe0d for instance 13aa42c6-801b-4b0a-a420-b2a743d918fe on n-h1-858384-11 Oct 13 09:22:19.011002 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-05a30abf-f1ff-448e-86e4-fb171da1b092 req-0c025485-03d0-42af-810b-0c1f08cf459f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046094 Oct 13 09:22:19.011937 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3310/7017] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:22:19.432814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:19.433422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:19.440956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:19.441436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:19.441871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:19.442632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:19.443082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:19.443504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:19.504917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:19.512746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d446b681-6a6f-4da3-9975-47096df53c84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1187 microversion: 2.1 time: 0.083843 Oct 13 09:22:19.513526 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3708/7018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:19 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:20.536747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:20.537450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:20.544681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:20.545154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:20.545589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:20.546296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:20.546774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:20.547204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:20.613202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:20.621816 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e82489e-bf04-4b9c-9ea2-1495287a778e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1187 microversion: 2.1 time: 0.089319 Oct 13 09:22:20.622399 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3311/7019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:20 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:21.646695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:21.647335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:21.653378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:21.653889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:21.654306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:21.655080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:21.655536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:21.655962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:21.719411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:21.727489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e238b5e-7317-40bd-9666-d1f77fe8ddc8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1187 microversion: 2.1 time: 0.086307 Oct 13 09:22:21.728063 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3709/7020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:21 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:22.749357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:22.749948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:22.757078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:22.757570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:22.758009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:22.758744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:22.759202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:22.759635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:22.822858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:22.830862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ef6630a-ef97-4aeb-af96-4884e10db203 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 200 len: 1187 microversion: 2.1 time: 0.085575 Oct 13 09:22:22.831736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3312/7021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:22 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:23.854156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:23.854788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 13aa42c6-801b-4b0a-a420-b2a743d918fe] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:23.861578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:23.862717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:23.863151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:23.863835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:23.864285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:23.864711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:23.878132 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe HTTP/1.1 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '13aa42c6-801b-4b0a-a420-b2a743d918fe'} Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:22:23.879790 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 13aa42c6-801b-4b0a-a420-b2a743d918fe could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d094cd6-e931-43bd-bfce-640a08d4e36e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe" status: 404 len: 111 microversion: 2.1 time: 0.031009 Oct 13 09:22:23.884269 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3710/7022] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:23 2022] GET /compute/v2.1/servers/13aa42c6-801b-4b0a-a420-b2a743d918fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:22:44.832463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-704992718", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66484b9f-d97a-471b-84cb-a34c5589d6b9", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:22:44.843170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=29 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:44.843838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=69 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:44.929157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:22:45.285311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:22:45.285735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:22:45.286237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:22:45.286686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:22:45.287097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:22:45.295792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:45.296275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:45.296715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:45.297435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:45.297887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:45.298314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:45.315639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:22:45.320895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:22:45.333514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:22:45.335573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='66484b9f-d97a-471b-84cb-a34c5589d6b9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:22:45.408433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d50260e5-b03a-4109-89ed-c79982df1901 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580061 Oct 13 09:22:45.409079 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3313/7023] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:22:45.420445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-de390be5-668f-4164-be01-e1b1bc86378d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:45.421053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-de390be5-668f-4164-be01-e1b1bc86378d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:45.424658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:45.425489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:45.482427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-de390be5-668f-4164-be01-e1b1bc86378d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:45.489750 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-de390be5-668f-4164-be01-e1b1bc86378d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1056 microversion: 2.1 time: 0.073161 Oct 13 09:22:45.490512 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3711/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:45 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:46.514456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:46.515824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:46.522852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:46.523661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:46.524315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:46.525182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:46.525838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:46.526275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:46.613643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:46.622013 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6982ecd3-74ea-45e3-93b4-bc276b8142e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1126 microversion: 2.1 time: 0.113444 Oct 13 09:22:46.622732 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3314/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:46 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1126 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:47.651224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:47.652061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:47.663801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:47.664357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:47.666616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:47.667371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:47.667855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:47.668272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:47.830854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:47.840498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-99163966-aab3-4ef4-978a-a1fff176db1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.198036 Oct 13 09:22:47.841104 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3712/7026] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:47 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:48.284447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba6ea1e-dde6-4b0a-961b-8e2292d44a62", "tag": "4ab8ae90-0519-479b-af23-eed0fd853368"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:22:48.295342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:48.295964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:48.296462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:48.308484 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] Creating event network-changed:4ab8ae90-0519-479b-af23-eed0fd853368 for instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 on n-h1-858384-11 Oct 13 09:22:48.314186 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2d84cf7b-8177-41b1-91af-13f9b69faa45 req-bab84ff8-3545-44c8-ab8d-15079557da33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122155 Oct 13 09:22:48.315264 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3315/7027] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:22:48.864382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:48.864998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:48.872027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:48.872520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:48.872964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:48.873701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:48.874164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:48.874704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:49.042778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:49.051857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-18e039c2-d66a-4be7-9df1-910592d6b0f2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.191388 Oct 13 09:22:49.052612 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3713/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:48 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:50.090473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:50.091064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:50.112729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:50.113851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:50.116470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:50.118916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:50.119581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:50.122083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:50.311267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:50.326154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba2273ed-7bf6-41a0-a939-3e505b93c663 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.252332 Oct 13 09:22:50.326756 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3316/7029] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:50 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:51.355489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:51.357559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:51.368224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:51.368715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:51.369449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:51.370189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:51.370811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:51.371242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:51.577767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:51.596031 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-358bb882-cb26-4778-acae-cb741fbdc012 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.246425 Oct 13 09:22:51.596962 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3714/7030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:51 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:22:52.623923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:52.624498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:52.631055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:52.631548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:52.631990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:52.632690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:52.633150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:52.633583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:52.803122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:52.812027 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0ff26f05-7f66-4797-8c32-446d0abbc5bb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.192306 Oct 13 09:22:52.814584 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3317/7031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:52 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:53.837225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:53.837869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:53.844903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:53.845931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:53.846365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:53.847086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:53.847632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:53.848113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:53.982575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:53.991152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11217675-6221-42d0-947e-a0614ed3f835 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.158423 Oct 13 09:22:54.006237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3715/7032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:53 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:55.013883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:55.014452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:55.021290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:55.021768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:55.022207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:55.022925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:55.023380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:55.023810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:55.153725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:55.163433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9469e29a-02ac-4494-be88-07d16cfd0f0b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.153467 Oct 13 09:22:55.164017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3318/7033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:55 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:56.187090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:56.187707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:56.190870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:56.196340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:56.196834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:56.197277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:56.197980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:56.198634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:56.198884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:56.335606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:56.343313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-74f8490e-73a0-4bac-a170-e648c66182da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.160321 Oct 13 09:22:56.343895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3716/7034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:56 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:57.367646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:57.368305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:57.370262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:57.370942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:22:57.378731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:57.379223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:57.379667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:57.380363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:57.380823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:57.381254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:57.510597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:57.518961 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a21cd12d-4913-40bc-bac1-9598158337fb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.155325 Oct 13 09:22:57.519543 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3319/7035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:57 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:58.542720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:58.543336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:58.550284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:58.550821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:58.551255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:58.551950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:58.552449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:58.552854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:58.681512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:58.690228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06a52d74-b625-424d-9c24-35c2a69d1abc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.151443 Oct 13 09:22:58.690831 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3717/7036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:58 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:22:59.713236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:22:59.713870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:22:59.721340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:59.721830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:59.722273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:59.723007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:22:59.723470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:22:59.723900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:22:59.855121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:22:59.863011 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de75603c-71d8-4d4f-87b8-e21dea50de57 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1168 microversion: 2.1 time: 0.153663 Oct 13 09:22:59.863607 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3320/7037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:22:59 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:00.887132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:00.887782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:00.895256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:00.895749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:00.896187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:00.896890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:00.897347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:00.897774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:01.046311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:01.054669 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1eba4ae-a99a-448b-9af3-07300c89c52a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1214 microversion: 2.1 time: 0.171813 Oct 13 09:23:01.055240 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3718/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:00 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:02.077619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:02.078229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:02.085704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:02.086190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:02.086660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:02.087358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:02.087811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:02.088235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:02.217257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:02.225208 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0de8d988-b158-45aa-8ec7-e2729cdf1a0a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.151533 Oct 13 09:23:02.225770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3321/7039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:02 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:03.247566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:03.248164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:03.255749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:03.256235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:03.256674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:03.257369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:03.257830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:03.258255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:03.385303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:03.393019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b9a15a1-99b2-409a-9d9b-387068832df3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.149335 Oct 13 09:23:03.393592 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3719/7040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:03 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:04.415765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:04.416371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:04.424147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:04.424663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:04.425108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:04.425836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:04.426296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:04.426785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:04.552914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:04.560834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e0754a25-df32-45ab-8cf4-e54db2e706e3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.149008 Oct 13 09:23:04.561445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3322/7041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:04 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:05.584267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:05.584891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:05.591558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:05.592050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:05.592490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:05.593188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:05.593648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:05.594081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:05.723944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:05.732033 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c17d83ec-9452-4c88-81bf-0dae75209034 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.151712 Oct 13 09:23:05.732598 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3720/7042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:05 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:06.755810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:06.756465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:06.763268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:06.763750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:06.764188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:06.764880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:06.765334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:06.765759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:06.899589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:06.907746 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79da8198-099e-4068-8864-e99337b38eda tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.155366 Oct 13 09:23:06.908330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3323/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:06 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:07.931348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:07.931915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:07.938936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:07.939423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:07.939862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:07.940563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:07.941017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:07.941442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:08.076490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:08.084215 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a19e86e-0d3e-4d33-982f-c48f02747c8e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.156871 Oct 13 09:23:08.084837 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3721/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:07 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:23:09.107449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:09.108066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:09.115349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:09.115842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:09.116288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:09.116982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:09.117440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:09.117867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:09.243756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:09.252278 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ac5fa9e-d88c-4f74-b4df-03a2c0c0d63b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.148918 Oct 13 09:23:09.252852 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3324/7045] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:09 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:10.274991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:10.275605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:10.283118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:10.283603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:10.284039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:10.284737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:10.285191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:10.285621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:10.414257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:10.422296 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ea04093b-039b-4b0a-8cba-fb14f7df203e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.151176 Oct 13 09:23:10.422909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3722/7046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:10 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:10.492818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba6ea1e-dde6-4b0a-961b-8e2292d44a62", "name": "network-vif-plugged", "status": "completed", "tag": "4ab8ae90-0519-479b-af23-eed0fd853368"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:23:10.505763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:10.506252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:10.506731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:10.518979 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] Creating event network-vif-plugged:4ab8ae90-0519-479b-af23-eed0fd853368 for instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 on n-h1-858384-11 Oct 13 09:23:10.524460 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-297f03bd-316b-427a-9223-1e774820fcd6 req-cc8d5509-4fdf-400a-9095-bd3e45bf5235 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Oct 13 09:23:10.525063 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3325/7047] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:23:11.445480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:11.446093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:11.453022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:11.453517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:11.453956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:11.455343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:11.455801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:11.456230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:11.587832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:11.595703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ae7ec0b-85f3-421c-88e1-a8c8f9f6c427 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1202 microversion: 2.1 time: 0.154155 Oct 13 09:23:11.596265 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3723/7048] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:11 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:12.620595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:12.621301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:12.627986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.628476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.628923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:12.629621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.630084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.630542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:12.756408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:12.764140 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2acd6f27-e37b-4b07-b4a4-b6b9d22ba8a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1388 microversion: 2.1 time: 0.148705 Oct 13 09:23:12.764726 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3326/7049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:12 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:12.786825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:12.787438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:12.794134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.794665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.795127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:12.795827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.796408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.796849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:12.925501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:12.933324 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bd5c4698-8cf3-43a0-b960-52752804fae8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1388 microversion: 2.1 time: 0.150373 Oct 13 09:23:12.933909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3724/7050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:12 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:12.955670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:12.956322 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:12.962323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.962845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.963287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:12.964009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:12.964512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:12.964987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:13.093206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:13.102206 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7a47a27a-a5aa-4255-bbdd-7d87ef86b836 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1388 microversion: 2.1 time: 0.150879 Oct 13 09:23:13.102807 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3327/7051] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:12 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:13.181061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:13.181560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:13.187656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:13.188138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:13.189115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:13.189801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:13.190251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:13.190709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:13.214958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:23:13.292771 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b17b8a99-b4bc-49d0-ba4a-a351ea4d3bdc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 204 len: 0 microversion: 2.1 time: 0.115391 Oct 13 09:23:13.293466 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3725/7052] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:23:13 2022] DELETE /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:23:13.301978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:13.302640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:13.308482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:13.308963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:13.309402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:13.310111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:13.310632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:13.311057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:13.440922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:13.448595 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-19840928-9325-4375-ab89-1109e136d621 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1394 microversion: 2.1 time: 0.150967 Oct 13 09:23:13.449169 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3328/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:13 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1394 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:14.472798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:14.473495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:14.480668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:14.481173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:14.481663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:14.482539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:14.482999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:14.483420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:14.612918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:14.616431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:14.621767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8e586852-53c0-4937-8471-841578734db5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1394 microversion: 2.1 time: 0.153949 Oct 13 09:23:14.622281 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3726/7054] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:14 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1394 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:15.195389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba6ea1e-dde6-4b0a-961b-8e2292d44a62", "name": "network-vif-deleted", "tag": "4ab8ae90-0519-479b-af23-eed0fd853368"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:23:15.201848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:15.210521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:15.210934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:15.211371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:15.214685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=85 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:15.226985 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] Creating event network-vif-deleted:4ab8ae90-0519-479b-af23-eed0fd853368 for instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 on n-h1-858384-11 Oct 13 09:23:15.232278 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bc8805b4-91eb-4908-857d-363ff427160e req-4e2e4746-4dd0-406f-9d95-faeb76e3de22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040947 Oct 13 09:23:15.233070 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3329/7055] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:23:15.644768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:15.645518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:15.649227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:15.656328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:15.656870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:15.657307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:15.658005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:15.658480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:15.658900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:15.726057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:15.733942 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5e4021ff-df25-4379-85c8-dec2203a0699 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1187 microversion: 2.1 time: 0.093673 Oct 13 09:23:15.734547 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3727/7056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:15 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:16.758274 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:16.759018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:16.765516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:16.766009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:16.766975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:16.767692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:16.768154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:16.768584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:16.846095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:16.854511 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d21e80e-0627-41d6-84ec-bcf4141fe683 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1187 microversion: 2.1 time: 0.101567 Oct 13 09:23:16.855097 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3330/7057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:16 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:17.878251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:17.878828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:17.885661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:17.886145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:17.886627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:17.887338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:17.887793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:17.888218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:17.950189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:17.958756 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-80523bef-285c-457c-80a2-6db0370357f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1187 microversion: 2.1 time: 0.085066 Oct 13 09:23:17.959338 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3728/7058] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:17 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:18.981289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:18.981885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:18.989376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:18.989860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:18.990300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:18.991025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:18.991481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:18.991906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:19.061852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:19.069892 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d0e0cf4a-7d5e-4c76-9706-dfc18719c0da tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 200 len: 1187 microversion: 2.1 time: 0.092546 Oct 13 09:23:19.070493 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3331/7059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:18 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:20.093136 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:20.093755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:20.101664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:20.102152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:20.102624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:20.103333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:20.103786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:20.104338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:20.119049 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 HTTP/1.1 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '0ba6ea1e-dde6-4b0a-961b-8e2292d44a62'} Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:20.120727 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:23:20.125071 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e444025a-4bcc-466d-ac22-b8682aa80e77 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 404 len: 111 microversion: 2.1 time: 0.032917 Oct 13 09:23:20.126588 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3729/7060] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:20 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:23:22.267811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:22.268313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:22.275010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:22.275507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:22.275953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:22.276658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:22.277144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:22.277580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:22.290840 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 HTTP/1.1 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '0ba6ea1e-dde6-4b0a-961b-8e2292d44a62'} Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:23:22.292544 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-105ac463-5008-4a67-be76-c96cc19993a9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 404 len: 111 microversion: 2.1 time: 0.030399 Oct 13 09:23:22.295933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3332/7061] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:23:22 2022] DELETE /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:23:22.303219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:22.303953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:22.310756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:22.311306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:22.311808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:22.312562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:22.313717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:22.314211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:22.327863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 HTTP/1.1 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '0ba6ea1e-dde6-4b0a-961b-8e2292d44a62'} Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:23:22.329437 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a393cde2-23ec-442e-80d8-60a8457d4429 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62" status: 404 len: 111 microversion: 2.1 time: 0.031416 Oct 13 09:23:22.333110 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3730/7062] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:22 2022] GET /compute/v2.1/servers/0ba6ea1e-dde6-4b0a-961b-8e2292d44a62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:23:42.149346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1666752027", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "521e45fa-e2d9-46af-b4a0-3fb4b1130a07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:23:42.160565 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:23:42.160701 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:23:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 13 09:23:42.161933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=7 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:42.162786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=15 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:42.216256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:23:42.580226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:23:42.580709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:23:42.581189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:23:42.581607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:23:42.582027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:23:42.591047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:42.591536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:42.591977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:42.592708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:42.593164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:42.594107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:42.610993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:23:42.616114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:23:42.675439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:23:42.677654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='521e45fa-e2d9-46af-b4a0-3fb4b1130a07',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:23:42.801376 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-383a3eab-7412-4bdf-9563-3c3d8b0e83ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655886 Oct 13 09:23:42.802013 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3333/7063] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:23:42.813921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ffe530c-3ec8-4e81-92f8-a239b129b5d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:42.814579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ffe530c-3ec8-4e81-92f8-a239b129b5d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:42.818057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:42.818722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=16 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:42.872138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ffe530c-3ec8-4e81-92f8-a239b129b5d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:42.880648 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ffe530c-3ec8-4e81-92f8-a239b129b5d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1071 microversion: 2.1 time: 0.071254 Oct 13 09:23:42.881200 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3731/7064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:42 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1071 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:43.910883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:43.912026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:43.920352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:43.920852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:43.921295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:43.922587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:43.922977 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:43.923411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:44.024645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:44.032952 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe5751d8-4af6-467c-a4cb-ef3bde50d5d8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1187 microversion: 2.1 time: 0.133213 Oct 13 09:23:44.033956 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3334/7065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:43 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:23:45.056289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:45.056863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:45.073875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:45.074370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:45.074995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:45.075769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:45.076231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:45.076651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:45.211607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:45.219606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09994a40-40dc-45b1-9a48-3aad981f0e9b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1229 microversion: 2.1 time: 0.167392 Oct 13 09:23:45.221684 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3732/7066] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:45 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:45.297961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936f337-514d-4cd0-a26b-ce82fa747618", "tag": "12ce22e0-1e58-4eab-a669-4049757ab231"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:23:45.320789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:45.321268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:45.323963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:45.340433 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] Creating event network-changed:12ce22e0-1e58-4eab-a669-4049757ab231 for instance c936f337-514d-4cd0-a26b-ce82fa747618 on n-h1-858384-11 Oct 13 09:23:45.347043 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-3c1b200e-66ea-42f9-bd28-6d269068403c req-8610a57a-448c-44d0-88a4-b95a1c496978 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053081 Oct 13 09:23:45.348770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3335/7067] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:23:46.245427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:46.246473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:46.254556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:46.255143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:46.255652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:46.256431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:46.256883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:46.257313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:46.392231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:46.400146 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-335cc51a-7355-4c01-90fa-ca66426dfc04 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1229 microversion: 2.1 time: 0.158852 Oct 13 09:23:46.400726 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3733/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:46 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:47.426104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:47.426510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:47.432543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:47.433031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:47.433475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:47.434177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:47.434655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:47.435087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:47.562421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:47.570163 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-569a9829-9c09-4895-91a4-04c91aa7ff24 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1229 microversion: 2.1 time: 0.150571 Oct 13 09:23:47.570770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3336/7069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:47 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1229 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:48.594219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:48.594828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:48.602755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:48.603245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:48.603682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:48.604390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:48.604841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:48.605265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:48.743231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:48.751579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-56d82ca0-8aa1-46b9-9a36-527675d1e722 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1229 microversion: 2.1 time: 0.161983 Oct 13 09:23:48.752141 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3734/7070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:48 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1229 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:23:49.776588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:49.777211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:49.784149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:49.784636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:49.785078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:49.785774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:49.786229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:49.786686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:49.915118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:49.923349 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5b39395-5a45-4447-b6ec-e2fe0ef68a05 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.150759 Oct 13 09:23:49.923917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3337/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:49 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:50.946997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:50.947606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:50.955295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:50.955781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:50.956218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:50.956916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:50.957368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:50.957790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:51.087187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:51.094898 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc56a672-176d-4fb8-a357-dbea8f3b4259 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.151882 Oct 13 09:23:51.095481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3735/7072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:50 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:23:52.117900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:52.118570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:52.125303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:52.125795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:52.126244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:52.126988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:52.127453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:52.127884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:52.256892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:52.264624 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-61464b88-5cc3-45c2-b942-5b83c4808c79 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.150658 Oct 13 09:23:52.265783 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3338/7073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:52 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:53.288429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:53.289040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:53.291436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:53.296866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:53.297353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:53.297794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:53.298532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:53.298991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:53.299419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:53.431954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:53.440702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df3c3c1e-0290-40cb-a0cc-d5a057f1f67d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.156379 Oct 13 09:23:53.441274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3736/7074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:53 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:54.464174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:54.464791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:54.466775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:54.467556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:23:54.475477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:54.475969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:54.476408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:54.477102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:54.477558 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:54.477990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:54.607444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:54.615180 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-237d07f9-0836-4c50-a37a-c02db230041f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.155059 Oct 13 09:23:54.615771 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3339/7075] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:54 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:55.638732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:55.639329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:55.646129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:55.646657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:55.647097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:55.647790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:55.648246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:55.648678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:55.778891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:55.787295 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b365d070-e514-42d8-a056-b417b958030e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.152560 Oct 13 09:23:55.787866 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3737/7076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:55 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:56.810129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:56.810792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:56.818201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:56.818713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:56.819152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:56.819838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:56.820291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:56.820715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:56.950667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:56.958708 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b308372-6297-417b-ac17-4fb2ddb0713d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.152375 Oct 13 09:23:56.959475 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3340/7077] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:56 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:57.981722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:57.982263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:57.989137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:57.989615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:57.990049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:57.990776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:57.991228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:57.991651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:58.117393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:58.125149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-716b7b67-590c-4fe1-b874-91e8fbf3af85 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.147382 Oct 13 09:23:58.125736 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3738/7078] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:57 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:23:58.716010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936f337-514d-4cd0-a26b-ce82fa747618", "name": "network-vif-plugged", "status": "completed", "tag": "12ce22e0-1e58-4eab-a669-4049757ab231"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:23:58.726985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:58.727798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:58.727920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:58.742855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] Creating event network-vif-plugged:12ce22e0-1e58-4eab-a669-4049757ab231 for instance c936f337-514d-4cd0-a26b-ce82fa747618 on n-h1-858384-11 Oct 13 09:23:58.748271 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-08bd14e1-ad25-4dd3-ae58-c8abb2479ef9 req-8b4245c4-360e-4eab-85b5-ac9d33cc6045 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Oct 13 09:23:58.749055 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3341/7079] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:23:59.148416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:23:59.149053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:23:59.156407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:59.156881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:59.157314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:59.157997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:23:59.158471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:23:59.158898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:23:59.290051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:23:59.298382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a69e3fc-c0f6-4111-9279-422fe2acb1b9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1217 microversion: 2.1 time: 0.153831 Oct 13 09:23:59.298981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3739/7080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:23:59 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:00.322007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:00.322663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:00.329742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.330230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.330702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.331402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.331861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.332288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.461041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:00.468944 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dcdfc85-55d8-4a5b-a01d-15444ea78229 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1403 microversion: 2.1 time: 0.151316 Oct 13 09:24:00.469522 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3342/7081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:00 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:00.491647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:00.492251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:00.499049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.500161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.500607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.501309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.501770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.502259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.627403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:00.635375 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2dc709a8-5b50-4f76-81e8-14c0b941af09 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1403 microversion: 2.1 time: 0.147566 Oct 13 09:24:00.636015 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3740/7082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:00 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:00.658585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1858036159"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:00.660941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:00.666863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.667355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.667800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.668497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:00.668955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:00.669384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:00.759680 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Attempting to quiesce instance before volume snapshot. Oct 13 09:24:00.811809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 13 09:24:00.880079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Creating snapshot from volume 521e45fa-e2d9-46af-b4a0-3fb4b1130a07. {{(pid=127031) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 13 09:24:01.797248 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bee1d92-9220-4ae6-8a08-c23e2771dd35 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618/action" status: 202 len: 0 microversion: 2.1 time: 1.143130 Oct 13 09:24:01.798146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3343/7083] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:24:00 2022] POST /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618/action => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 09:24:02.957162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-545989618", "imageRef": "85b4995b-665e-4f59-9850-e74a0d09615f", "flavorRef": "452", "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:03.015300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:24:03.698281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:24:03.698830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:24:03.699263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:24:03.699744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:24:03.700064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:24:03.709529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:03.710008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:03.710469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:03.711197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:03.711660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:03.712088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:03.728958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:24:03.734140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:24:03.746247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:24:03.748792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5be315ab-589e-486a-b9f6-45504d66bb6c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:24:03.822013 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:24:04.831966 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54272. Oct 13 09:24:04.836198 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49ae8331-6656-42bf-bade-02ed57e61f97 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882895 Oct 13 09:24:04.836855 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3741/7084] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:24:04.849327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bc090c4b-910f-4038-833c-9fdea8f7598f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:04.850304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bc090c4b-910f-4038-833c-9fdea8f7598f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:04.906575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bc090c4b-910f-4038-833c-9fdea8f7598f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:04.914334 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bc090c4b-910f-4038-833c-9fdea8f7598f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1229 microversion: 2.1 time: 0.070159 Oct 13 09:24:04.914943 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3344/7085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:04 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1229 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:05.937802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:05.938509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:05.945210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:05.946067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:05.946886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:05.947759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:05.948440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:05.949042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:06.023282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:06.031663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e0fe1de5-ee30-40be-8fe0-a1c3ac334f11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1289 microversion: 2.1 time: 0.098703 Oct 13 09:24:06.032478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3742/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:05 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:07.055763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:07.056640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:07.063942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:07.064442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:07.065074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:07.065798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:07.066303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:07.066775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:07.206141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:07.216926 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9104b8b8-c8e9-410f-aa5d-0307d4b4130a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.164979 Oct 13 09:24:07.232662 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3345/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:07 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:07.542616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90dbd5c-f0ca-4e30-871e-d5f87c4541a6", "tag": "b83bfd16-be72-47af-8725-3997b6afe5f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:07.552470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:07.553169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:07.553805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:07.565599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] Creating event network-changed:b83bfd16-be72-47af-8725-3997b6afe5f6 for instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 on n-h2-858384-11 Oct 13 09:24:07.570634 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d1955498-cc96-4c74-bce5-c117b8d0592a req-cfc30c9f-d0e4-4991-a930-2cce3ce4229e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120238 Oct 13 09:24:07.571242 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3743/7088] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:24:08.240315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:08.241545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:08.248273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:08.248965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:08.250103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:08.251221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:08.251840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:08.252636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:08.421650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:08.436332 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e396ee2-1b3a-4340-9d46-e281b224bbff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.199932 Oct 13 09:24:08.438167 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3346/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:08 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:09.462854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:09.463563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:09.470079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:09.470612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:09.471048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:09.471750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:09.472205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:09.472637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:09.642585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:09.652678 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d73f50e-0e39-417e-812f-d0f3fa87ba86 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.195317 Oct 13 09:24:09.653254 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3744/7090] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:09 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:10.689203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:10.691729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:10.700399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:10.700898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:10.701408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:10.702140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:10.703308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:10.703746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:10.902292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:10.911590 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-357eed61-f1b7-41ca-91e8-056f8aa8f8b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.227164 Oct 13 09:24:10.912654 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3347/7091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:10 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:24:11.939115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:11.939773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:11.947544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:11.948353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:11.948505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:11.949419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:11.949871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:11.950330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:12.188065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:12.195729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ca0c74a1-27e3-48d9-822c-f1792fe68120 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.260666 Oct 13 09:24:12.198444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3745/7092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:11 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:13.223646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:13.224260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:13.227512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:13.234493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:13.235153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:13.235608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:13.236413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:13.236961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:13.237228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:13.240376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:13.788203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:13.797081 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91a7e448-b065-4b71-83ba-6deff73be2b8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.577281 Oct 13 09:24:13.797650 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3348/7093] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:13 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:14.820168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:14.820781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:14.823580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:14.824242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:14.824892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:14.831632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:14.832113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:14.832544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:14.833239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:14.833689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:14.834110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:14.839009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=77 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:14.963072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:14.971032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1931c3f-38b7-40f9-bc8f-24a11d56d306 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.154693 Oct 13 09:24:14.971596 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3746/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:14 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:15.995705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:15.996333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:15.999122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:16.004518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:16.005016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:16.005468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:16.006170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:16.006673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:16.007136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:16.136482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:16.144698 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-394af34e-d13c-4d87-a4c0-6ddd08e3cc3e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.152966 Oct 13 09:24:16.145273 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3349/7095] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:15 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:17.168368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:17.168966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:17.176129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:17.176615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:17.177181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:17.177879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:17.178323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:17.178777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:17.322369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:17.331079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ef69cf3-8254-44b3-af9a-2e086abfea70 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.166724 Oct 13 09:24:17.331767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3747/7096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:17 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:18.354103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:18.354827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:18.362815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:18.363447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:18.363879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:18.364680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:18.365238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:18.365681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:18.513567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:18.521678 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-79c1fd8c-fffd-4f82-b343-4da9eec89ca6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.171742 Oct 13 09:24:18.522444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3350/7097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:18 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:19.545042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:19.545693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:19.552843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:19.553329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:19.553942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:19.554565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:19.555025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:19.555452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:19.690316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:19.698114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b273b3b-76c2-4e8e-ad9f-8d81f18043ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1341 microversion: 2.1 time: 0.157055 Oct 13 09:24:19.698707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3748/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:19 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:20.721389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:20.721927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:20.729367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:20.729858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:20.730306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:20.731051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:20.731517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:20.731951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:20.861255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:20.869166 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e1d5444-c98e-4c73-baa6-c05b15ddebae tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.151988 Oct 13 09:24:20.869752 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3351/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:20 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:21.892863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:21.893394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:21.899883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:21.900365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:21.900803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:21.901506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:21.901963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:21.902388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:22.034233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:22.042073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c78e64c3-e53f-413a-bd17-d5af00bf0183 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.153318 Oct 13 09:24:22.042691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3749/7100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:21 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:23.066125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:23.066808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:23.073911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:23.074432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:23.074884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:23.075588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:23.076062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:23.076503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:23.216158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:23.224439 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8efff16f-7337-4ce6-9c4a-fe4c31547fa3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.162807 Oct 13 09:24:23.225277 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3352/7101] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:23 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:24.247941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:24.249330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:24.256199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:24.256680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:24.257119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:24.257811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:24.258269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:24.258746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:24.396595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:24.404534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-576119cb-9ce3-45ec-a0ae-d27b9ed419a8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.160413 Oct 13 09:24:24.405062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3750/7102] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:24 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:25.434005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:25.434655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:25.441383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:25.441906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:25.442352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:25.443076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:25.443547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:25.443978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:25.600105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:25.609754 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ea90ce8-9646-455e-8cee-a3e956669625 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.180654 Oct 13 09:24:25.610577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3353/7103] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:25 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:26.633583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:26.634269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:26.641962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:26.642483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:26.642926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:26.643664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:26.644195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:26.644624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:26.773044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:26.780765 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f0853824-4dc8-46a1-884c-674478a2e4e7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.151187 Oct 13 09:24:26.781361 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3751/7104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:26 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:27.804560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:27.805215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:27.812265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:27.812764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:27.813236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:27.813937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:27.814421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:27.814866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:27.962561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:27.971443 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b94cb809-8bc1-4216-b421-b5a85f380682 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.170797 Oct 13 09:24:27.972091 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3354/7105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:27 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:28.995859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:28.996470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:29.003697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:29.004175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:29.004612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:29.005302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:29.005763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:29.006192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:29.150094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:29.159046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af3605ce-dcb8-49a3-8f30-18e1924399ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.167001 Oct 13 09:24:29.159676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3752/7106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:28 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:30.184263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:30.184886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:30.192141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:30.192658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:30.193107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:30.193816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:30.194288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:30.194777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:30.330927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:30.339422 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2753a85d-7c24-4843-98d5-a0fefe3c2790 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.159179 Oct 13 09:24:30.339998 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3355/7107] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:30 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:31.367350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:31.368092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:31.375881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:31.376377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:31.376821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:31.377533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:31.377987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:31.378431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:31.531298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:31.539295 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45511cbc-6789-4092-8986-994ce4cdfe6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.176308 Oct 13 09:24:31.539892 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3753/7108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:31 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:32.565572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:32.566349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:32.574856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:32.575459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:32.576027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:32.576938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:32.577498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:32.578001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:32.731631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:32.740762 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c8739dd-260d-4bba-97fe-2ada492a9d11 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.180273 Oct 13 09:24:32.741416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3356/7109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:32 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:32.795053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90dbd5c-f0ca-4e30-871e-d5f87c4541a6", "name": "network-vif-plugged", "status": "completed", "tag": "b83bfd16-be72-47af-8725-3997b6afe5f6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:32.806650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:32.807177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:32.807653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:32.820046 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] Creating event network-vif-plugged:b83bfd16-be72-47af-8725-3997b6afe5f6 for instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 on n-h2-858384-11 Oct 13 09:24:32.825111 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a9d81d1a-65d6-4736-a6ef-0d9fecf53e95 req-a6870720-9a42-4d63-85e4-624a6a548040 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033865 Oct 13 09:24:32.825920 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3754/7110] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:24:33.765695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:33.766328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:33.773461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:33.773980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:33.774454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:33.775175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:33.775698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:33.776138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:33.907964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:33.915897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-773dd18b-097c-458f-9328-88d9904a4037 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1375 microversion: 2.1 time: 0.154275 Oct 13 09:24:33.916477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3357/7111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:33 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:34.941597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:34.942301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:34.948527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:34.949009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:34.949449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:34.950176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:34.950705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:34.951135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.087107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:35.095370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-df7c6733-2a70-4aad-bf58-9770571f6d5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1562 microversion: 2.1 time: 0.159693 Oct 13 09:24:35.095947 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3755/7112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:34 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:35.118605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:35.119232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:35.126372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.126911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.127406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.128158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.128631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.129077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.258997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:35.266875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dbdc9982-21e5-4a18-aeca-ea45fa2afe3c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1562 microversion: 2.1 time: 0.152173 Oct 13 09:24:35.267452 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3358/7113] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:35 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:35.348302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:35.348808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:35.356543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.357184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.357629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.358352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.358841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.359277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.386970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:24:35.463994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3e2e3682-264f-4cd5-bf12-b5f8f9cbe912 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 204 len: 0 microversion: 2.1 time: 0.119227 Oct 13 09:24:35.464603 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3756/7114] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:24:35 2022] DELETE /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:24:35.475577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:35.476204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:35.483586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.484077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.484523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.485222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:35.485688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:35.486257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:35.616908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:35.625115 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-425c2152-8c3d-46cd-81f9-416b62d2ee1c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1568 microversion: 2.1 time: 0.154291 Oct 13 09:24:35.625683 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3359/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:35 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:36.651202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:36.651930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:36.658888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:36.659369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:36.659805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:36.660493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:36.660943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:36.661365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:36.793447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:36.801864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-564d854d-88ba-47eb-82ef-ee63cc59685b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1568 microversion: 2.1 time: 0.154995 Oct 13 09:24:36.802457 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3757/7116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:36 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:37.669718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90dbd5c-f0ca-4e30-871e-d5f87c4541a6", "name": "network-vif-deleted", "tag": "b83bfd16-be72-47af-8725-3997b6afe5f6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:37.682520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:37.683022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:37.683478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:37.701817 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] Creating event network-vif-deleted:b83bfd16-be72-47af-8725-3997b6afe5f6 for instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 on n-h2-858384-11 Oct 13 09:24:37.707651 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ae285c08-c911-473a-81e5-908b4b1fe4da req-54e7e24b-f467-43aa-9d5a-d8010a75d034 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Oct 13 09:24:37.708398 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3360/7117] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:24:37.825407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:37.826083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:37.833539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:37.834026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:37.834527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:37.835235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:37.835685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:37.836205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:37.902643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:37.911286 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8fee2d9-bdc6-4644-b72a-54259f5275f3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1360 microversion: 2.1 time: 0.089963 Oct 13 09:24:37.920799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3758/7118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:37 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:38.936898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:38.937602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:38.944390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:38.944898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:38.945353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:38.946068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:38.946581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:38.947025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:39.013158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:39.021614 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a866de5-0116-4364-8c65-fee525295806 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1360 microversion: 2.1 time: 0.090213 Oct 13 09:24:39.022513 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3361/7119] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:38 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:40.046925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:40.047614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:40.056770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:40.057498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:40.058114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:40.059228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:40.059993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:40.060463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:40.147871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:40.158871 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e24f9ac-0aa1-4094-b49e-ff5f4a4e0189 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1360 microversion: 2.1 time: 0.116859 Oct 13 09:24:40.159615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3759/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:40 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1360 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:41.184565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:41.185330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:41.193742 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:41.194204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:41.195369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:41.195834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:41.195834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:41.196303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:41.277779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:41.287965 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-945f30ba-fe07-4aea-b92f-1c164880425b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1360 microversion: 2.1 time: 0.107275 Oct 13 09:24:41.303349 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3362/7121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:41 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1360 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:42.311780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:42.312348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:42.319137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:42.319625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:42.320065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:42.320772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:42.321229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:42.321661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:42.354677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:42.355168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:42.355613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:42.356063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lazy-loading 'fault' on Instance uuid b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:24:42.400169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:42.408693 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1f33565b-b766-42ab-8c1e-4b8d9e9c9c52 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 200 len: 1365 microversion: 2.1 time: 0.100838 Oct 13 09:24:42.409269 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3760/7122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:42 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:43.433251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:43.433948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:43.437552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=30 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:43.443423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:43.443931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:43.444381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:43.445111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:43.445576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:43.446013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:43.449198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=86 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:43.465249 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 HTTP/1.1 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b90dbd5c-f0ca-4e30-871e-d5f87c4541a6'} Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:43.467005 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4da920ac-5d3f-4fa4-88f6-951708427485 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 404 len: 111 microversion: 2.1 time: 0.039327 Oct 13 09:24:43.470844 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3363/7123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:43 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:24:47.750586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:47.751064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:47.754040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:47.759288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:47.759773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:47.760215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:47.760905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:47.761360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:47.761781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:47.766493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:24:47.790613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:24:47.864667 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5f3a47b-2bc3-4475-a1b4-348e37001974 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 204 len: 0 microversion: 2.1 time: 0.117643 Oct 13 09:24:47.865397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3761/7124] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:24:47 2022] DELETE /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:24:47.873834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:47.874482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:47.881319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:47.881813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:47.882259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:47.882986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:47.883480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:47.883916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:48.013039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:48.021292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04dd8c5c-bf15-461d-a6ab-3d3d5f9a97ff tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1409 microversion: 2.1 time: 0.151418 Oct 13 09:24:48.021859 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3364/7125] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:47 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:49.045857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:49.046599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:49.053364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:49.053845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:49.054287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:49.055010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:49.055463 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:49.055890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:49.186053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:49.193840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3931a1c3-cf47-46c6-8ba0-176b93d7f3fe tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1409 microversion: 2.1 time: 0.152366 Oct 13 09:24:49.194446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3762/7126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:49 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:49.797314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936f337-514d-4cd0-a26b-ce82fa747618", "name": "network-vif-deleted", "tag": "12ce22e0-1e58-4eab-a669-4049757ab231"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:49.808957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:49.809454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:49.809904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:49.821371 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] Creating event network-vif-deleted:12ce22e0-1e58-4eab-a669-4049757ab231 for instance c936f337-514d-4cd0-a26b-ce82fa747618 on n-h1-858384-11 Oct 13 09:24:49.826691 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-044dae24-203f-47c4-9f13-752f1f7a74d0 req-0732cb69-77c5-426d-a508-e135dfb41806 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Oct 13 09:24:49.827286 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3365/7127] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:24:50.217382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:50.218963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:50.226884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:50.227447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:50.227957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:50.228770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:50.229291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:50.229805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:50.291343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:50.299452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-215efd7c-1ad2-41b8-b1c6-2df696000d76 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1202 microversion: 2.1 time: 0.086509 Oct 13 09:24:50.299967 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3763/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:50 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:51.323918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:51.324544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:51.330759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:51.331258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:51.331710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:51.332413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:51.332876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:51.333313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:51.400919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:51.410084 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e480ac23-7b1c-4e20-86f2-d3a8b7ab22d9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1202 microversion: 2.1 time: 0.091289 Oct 13 09:24:51.410805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3366/7129] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:51 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:52.433491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:52.434130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:52.441288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:52.441767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:52.442197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:52.442915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:52.443412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:52.443786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:52.505261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:52.513098 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5c214b6-8db7-447d-8b68-40cc58c6467c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1202 microversion: 2.1 time: 0.083659 Oct 13 09:24:52.513710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3764/7130] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:52 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:53.536267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:53.536899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:53.543904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:53.544410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:53.545505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:53.546229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:53.546725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:53.547175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:53.614297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:24:53.622571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9462026e-8782-4da5-9bc4-66e5775b2b47 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 200 len: 1202 microversion: 2.1 time: 0.090202 Oct 13 09:24:53.623150 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3367/7131] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:53 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:24:54.645941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:54.646620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:54.653968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:54.654492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:54.654935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:54.655652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:54.656106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:54.656540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:54.674614 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 HTTP/1.1 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c936f337-514d-4cd0-a26b-ce82fa747618'} Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:54.676322 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cd892417-3755-460b-9513-34fd857029c3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 404 len: 111 microversion: 2.1 time: 0.035924 Oct 13 09:24:54.680392 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3765/7132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:54 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:24:56.819431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:56.819970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:56.827539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:56.828035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:56.828516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:56.829218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:56.829681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:56.830115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:56.843254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 HTTP/1.1 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b90dbd5c-f0ca-4e30-871e-d5f87c4541a6'} Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:56.844935 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca53fca9-ed2b-409d-b0ce-2e284089ddc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 404 len: 111 microversion: 2.1 time: 0.030950 Oct 13 09:24:56.849031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3368/7133] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:24:56 2022] DELETE /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:24:56.855568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:56.856262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: b90dbd5c-f0ca-4e30-871e-d5f87c4541a6] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:56.866079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:56.866679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:56.867199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:56.867965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:56.868417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:56.868845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:56.882973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 HTTP/1.1 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b90dbd5c-f0ca-4e30-871e-d5f87c4541a6'} Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:56.884498 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6bc2fa6e-af2e-4601-8750-f9f4e42b6975 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6" status: 404 len: 111 microversion: 2.1 time: 0.034113 Oct 13 09:24:56.889298 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3766/7134] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:56 2022] GET /compute/v2.1/servers/b90dbd5c-f0ca-4e30-871e-d5f87c4541a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:24:57.262055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:57.262633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:57.268823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:57.269330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:57.269801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:57.270552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:57.271031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:57.271479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:57.285589 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 HTTP/1.1 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c936f337-514d-4cd0-a26b-ce82fa747618'} Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:57.287202 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67dda478-8937-4cba-8eb7-67558cc81723 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 404 len: 111 microversion: 2.1 time: 0.030859 Oct 13 09:24:57.291074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3369/7135] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:24:57 2022] DELETE /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:24:57.298345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:24:57.299185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: c936f337-514d-4cd0-a26b-ce82fa747618] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:24:57.305177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:57.305662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:57.306098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:57.306828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:24:57.307281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:24:57.307703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:24:57.321804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 HTTP/1.1 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'c936f337-514d-4cd0-a26b-ce82fa747618'} Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:24:57.323367 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance c936f337-514d-4cd0-a26b-ce82fa747618 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5eaf4ab-1f6d-4435-8745-24aa61e4d042 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618" status: 404 len: 111 microversion: 2.1 time: 0.031021 Oct 13 09:24:57.327702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3767/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:24:57 2022] GET /compute/v2.1/servers/c936f337-514d-4cd0-a26b-ce82fa747618 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:24:57.402352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e3ae537-ceaa-48f5-96ae-eb234c240673 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: .version_select at 0x7f53755558b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-323031433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRiUUcvsj1Ee6rPn9PgwGTuFAzItRG95zvO0tZU2aXqr28TfIBeKd1XG2uLY5+y+r1CCbDLvR/Z6SZfJIGX8iDUQmYKAX0hXn/XZWka8doQzY0a7Ozin1FGSMUBdQCgdw=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:24:57.419955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0e3ae537-ceaa-48f5-96ae-eb234c240673 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:24:57.424944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0e3ae537-ceaa-48f5-96ae-eb234c240673 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:24:57.452335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e3ae537-ceaa-48f5-96ae-eb234c240673 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053928 Oct 13 09:24:57.452936 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3370/7137] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:24:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:25:13.649032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2142208023", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323031433", "security_groups": [{"name": "tempest-secgroup-smoke-36684067"}], "block_device_mapping_v2": [{"uuid": "1c147485-c1be-4c86-95ba-6b796a916666", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:25:13.661769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:13.662441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:13.767263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:25:14.132461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:25:14.132887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:25:14.133417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:25:14.133834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:25:14.134248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:25:14.143796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:14.144309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:14.144775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:14.145509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:14.145968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:14.146453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:14.164067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:25:14.169282 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:25:14.226342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:25:14.228546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c147485-c1be-4c86-95ba-6b796a916666',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:25:14.352152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0fbf000a-ed00-4cc3-bedb-9b81e4369ee4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.707274 Oct 13 09:25:14.352971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3768/7138] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:25:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:25:14.364469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-254773d6-0935-4234-bccb-43ad1f8ac573 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:14.365303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-254773d6-0935-4234-bccb-43ad1f8ac573 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:14.368268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=25 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:14.369076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:14.369769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:14.426829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-254773d6-0935-4234-bccb-43ad1f8ac573 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:14.434899 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-254773d6-0935-4234-bccb-43ad1f8ac573 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1094 microversion: 2.1 time: 0.074516 Oct 13 09:25:14.435676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3371/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:14 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:15.460156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:15.460829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:15.468288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:15.468964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:15.469412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:15.470124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:15.470613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:15.471045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:15.535566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:15.543565 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68eb91b3-3641-4342-8d2a-88415261344d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1210 microversion: 2.1 time: 0.089936 Oct 13 09:25:15.544559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3769/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:15 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:25:16.567010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:16.567781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:16.574980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:16.576049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:16.576864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:16.577657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:16.578332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:16.578861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:16.778791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:16.790867 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-da83782f-6fa5-4e90-b44b-eb73504ab998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1276 microversion: 2.1 time: 0.227761 Oct 13 09:25:16.792742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3372/7141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:16 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:16.805684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8bf045-7c02-4a0c-b367-c1a82b928057", "tag": "63085f2a-50cc-4de7-b9a7-1af20428b28e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:25:16.820010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:16.820592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:16.821125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:16.836895 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] Creating event network-changed:63085f2a-50cc-4de7-b9a7-1af20428b28e for instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 on n-h1-858384-11 Oct 13 09:25:16.843285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3064c395-7562-4b8d-b309-156b53f03bca req-f699f885-45db-4a09-bf91-2de9f53f1cd6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043538 Oct 13 09:25:16.844451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3770/7142] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:25:17.815694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:17.816338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:17.823363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:17.823868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:17.824329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:17.825041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:17.826090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:17.826567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:17.964792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:17.973328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8e0e27a1-cf72-4e85-bf3a-19ebcf0b1fd5 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1276 microversion: 2.1 time: 0.161613 Oct 13 09:25:17.973895 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3373/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:17 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:18.996969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:18.998216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:19.005345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:19.005831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:19.006268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:19.006997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:19.007456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:19.007885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:19.144156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:19.151995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-47760518-1ebc-4edf-bf23-ce614025ac4d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1276 microversion: 2.1 time: 0.159336 Oct 13 09:25:19.152573 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3771/7144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:18 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:20.175234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:20.175868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:20.182759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:20.183266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:20.183724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:20.184481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:20.184907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:20.185514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:20.319716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:20.328344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6262d232-e262-4d99-bc7d-17791c9c4a9c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1276 microversion: 2.1 time: 0.157077 Oct 13 09:25:20.328917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3374/7145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:20 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:21.351999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:21.352626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:21.359502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:21.359993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:21.360437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:21.361137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:21.361595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:21.362024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:21.493540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:21.501864 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e398fc41-01af-43a1-8bc0-5d52a6a9bee9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.154098 Oct 13 09:25:21.502456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3772/7146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:21 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:22.525687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:22.526318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:22.533341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:22.533841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:22.534297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:22.535049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:22.535521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:22.535963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:22.669789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:22.677613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-887ec587-5f68-4644-87c8-7e4fbe5df8f6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.155971 Oct 13 09:25:22.678195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3375/7147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:22 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:23.701804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:23.702464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:23.709717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:23.710196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:23.710663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:23.711355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:23.711814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:23.712233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:23.841524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:23.849234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-acfde33b-37cf-4207-bae2-a68d25709552 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.151890 Oct 13 09:25:23.849821 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3773/7148] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:23 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:24.873230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:24.873857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:24.876634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:24.882475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:24.883004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:24.883454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:24.884161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:24.884630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:24.885072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:25.012511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:25.020369 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1971f91e-25ef-4fad-b995-f421da49e76e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.151662 Oct 13 09:25:25.020947 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3376/7149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:24 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:26.043135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:26.043697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:26.046241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:26.047157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:25:26.054253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:26.054768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:26.055223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:26.055902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:26.056356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:26.056781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:26.188592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:26.196309 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-42fef102-b903-42b1-ae3b-c2966a2cefd2 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.157165 Oct 13 09:25:26.196875 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3774/7150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:26 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:27.219592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:27.220232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:27.227451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:27.227956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:27.228416 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:27.229161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:27.229638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:27.230089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:27.359660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:27.368160 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6d6cb3b-0a17-479b-baf0-c6a379ee43ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.153081 Oct 13 09:25:27.368741 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3377/7151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:27 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:28.391941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:28.392550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:28.399381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:28.399860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:28.400293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:28.400976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:28.401428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:28.401848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:28.530280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:28.537920 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c00ea7f8-9e6f-4f08-bf19-f276a03c7a4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.150410 Oct 13 09:25:28.538499 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3775/7152] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:28 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:29.561104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:29.561644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:29.568452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:29.568955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:29.569393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:29.570096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:29.570626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:29.571067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:29.704858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:29.712781 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6cd0794c-4639-4027-aa6d-ff90e76628ac tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.156280 Oct 13 09:25:29.713369 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3378/7153] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:29 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:30.735433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:30.736032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:30.742891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:30.743372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:30.743810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:30.744503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:30.744957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:30.745385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:30.878811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:30.886739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f76b79b6-3cc4-4cff-9220-f00860b5eb64 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.155739 Oct 13 09:25:30.887333 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3776/7154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:30 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:31.023156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8bf045-7c02-4a0c-b367-c1a82b928057", "name": "network-vif-plugged", "status": "completed", "tag": "63085f2a-50cc-4de7-b9a7-1af20428b28e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:25:31.034122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:31.034655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:31.035103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:31.047588 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] Creating event network-vif-plugged:63085f2a-50cc-4de7-b9a7-1af20428b28e for instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 on n-h1-858384-11 Oct 13 09:25:31.052557 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9d46da1b-0128-43bb-9b23-7ea30d33466f req-7f591746-98d0-4494-9ee4-386df2292a4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Oct 13 09:25:31.053153 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3379/7155] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:25:31.910330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:31.911166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:31.918483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:31.919610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:31.920046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:31.920737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:31.921190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:31.921613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:32.054503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:32.062285 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad836567-1929-4846-b5a8-c32975f3cd4c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1264 microversion: 2.1 time: 0.156226 Oct 13 09:25:32.062953 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3777/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:31 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:33.086138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:33.086891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:33.093122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:33.093618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:33.094067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:33.094824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:33.095280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:33.095723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:33.227588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:33.235973 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27e08dcc-1009-4378-9f16-4c08ce59d1ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1450 microversion: 2.1 time: 0.154917 Oct 13 09:25:33.236553 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3380/7157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:33 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:33.258568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:25:33.259179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:25:33.265955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:33.266461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:33.266896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:33.267583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:33.268032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:33.268455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:33.396737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:25:33.404919 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-26292cd0-edda-4807-8d73-7dd74a2855ee tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1450 microversion: 2.1 time: 0.150184 Oct 13 09:25:33.405480 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3778/7158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:25:33 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:25:35.303451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8bf045-7c02-4a0c-b367-c1a82b928057", "tag": "63085f2a-50cc-4de7-b9a7-1af20428b28e"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:25:35.314494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:25:35.315083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:25:35.315536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:25:35.326682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] Creating event network-changed:63085f2a-50cc-4de7-b9a7-1af20428b28e for instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 on n-h1-858384-11 Oct 13 09:25:35.331772 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8d8c1473-f525-4241-8786-703b240a6be4 req-3cf037fa-f310-4901-a9a7-36606a017cbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032169 Oct 13 09:25:35.332387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3381/7159] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:27:30.416440 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 09:27:30.417406 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 09:27:30.418232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:30.418994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=58 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:30.420441 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:27:30.420589 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 (ip 10.222.0.23) !!! Oct 13 09:27:30.422887 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 13 09:27:30.424237 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 13 09:27:30.480881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:30.481380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:30.488042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:30.488455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:30.488887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:30.489571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:30.490020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:30.490466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:30.518025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:27:30.593173 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5046e6d8-0d44-43f0-b5db-6abd41ec6ea7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 204 len: 0 microversion: 2.1 time: 0.178355 Oct 13 09:27:30.593769 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3779/7160] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:27:30 2022] DELETE /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:27:30.603251 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 09:27:30.604295 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 09:27:30.605110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=24 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:30.605998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=52 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:30.606748 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:27:30.606885 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 (ip 10.222.0.23) !!! Oct 13 09:27:30.608803 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 13 09:27:30.613290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:30.614056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:30.623959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:30.624463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:30.624929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:30.625651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:30.626127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:30.626620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:30.761937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:30.770524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-90f89ee6-9e58-4416-af28-e08854cb5e67 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1573 microversion: 2.1 time: 0.170357 Oct 13 09:27:30.771101 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3382/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:30 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:31.797280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:31.797979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:31.807918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:31.808154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:31.808593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:31.809347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:31.809875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:31.810305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:31.814999 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54724. Oct 13 09:27:31.818030 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54726. Oct 13 09:27:31.946809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:31.954606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1b32fd8-5b22-40b1-b169-cb080002720c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1573 microversion: 2.1 time: 0.162187 Oct 13 09:27:31.955190 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3780/7162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:31 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:32.978593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:32.979241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:32.989503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:32.990017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:32.990493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:32.991401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:32.991876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:32.992321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:33.017454 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54734. Oct 13 09:27:33.018324 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54736. Oct 13 09:27:33.024018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8bf045-7c02-4a0c-b367-c1a82b928057", "name": "network-vif-deleted", "tag": "63085f2a-50cc-4de7-b9a7-1af20428b28e"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:27:33.037384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:33.038708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:33.039384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:33.057017 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] Creating event network-vif-deleted:63085f2a-50cc-4de7-b9a7-1af20428b28e for instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 on n-h1-858384-11 Oct 13 09:27:33.074584 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7d2f1dfa-392e-47a8-8e2a-b7ab4c8c3301 req-a693ab83-6c9e-476a-83df-c66864da5def service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055267 Oct 13 09:27:33.075888 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3781/7163] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:27:33.093840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:33.107722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6400bad2-8247-4666-96ff-f21bb5e2e6d4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1507 microversion: 2.1 time: 0.132700 Oct 13 09:27:33.108436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3383/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:32 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1507 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:34.131906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:34.132618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:34.139820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:34.140340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:34.140785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:34.141489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:34.141948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:34.142383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:34.204835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:34.212724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-97f6ae55-60fe-43b9-820c-8e3f4a5cd4ed tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1225 microversion: 2.1 time: 0.085216 Oct 13 09:27:34.213297 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3782/7165] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:34 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:27:35.236696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:35.237324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:35.244277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:35.244798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:35.245252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:35.245985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:35.246474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:35.246918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:35.308199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:35.316757 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d1ec57eb-0a02-4b0a-91b1-988a5e18b751 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1225 microversion: 2.1 time: 0.084027 Oct 13 09:27:35.317332 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3384/7166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:35 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:36.339393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:36.340148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:36.347076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:36.347562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:36.348002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:36.348706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:36.349165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:36.349595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:36.414980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:36.422893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e2886ae-5b50-491c-ac47-7fcfd1a1733e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1225 microversion: 2.1 time: 0.087357 Oct 13 09:27:36.423481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3783/7167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:36 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:37.446256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:37.446947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:37.454358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:37.454890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:37.455348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:37.456143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:37.456622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:37.457063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:37.492708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:37.493209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:37.493659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:37.494121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lazy-loading 'fault' on Instance uuid 6e8bf045-7c02-4a0c-b367-c1a82b928057 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:27:37.535039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:37.543314 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6ee17772-24c0-4fea-9b5f-27d58ebc5132 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 200 len: 1230 microversion: 2.1 time: 0.100977 Oct 13 09:27:37.543898 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3385/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:37 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:38.566753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:38.567364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:38.574181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:38.574715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:38.575152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:38.576447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:38.576898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:38.577319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:38.590216 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 HTTP/1.1 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6e8bf045-7c02-4a0c-b367-c1a82b928057'} Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:27:38.591868 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f150c8ae-3650-489f-a164-5380dc4db7a0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 404 len: 111 microversion: 2.1 time: 0.030371 Oct 13 09:27:38.596691 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3784/7169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:38 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:27:38.641182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-579542500", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323031433", "security_groups": [{"name": "tempest-secgroup-smoke-36684067"}], "block_device_mapping_v2": [{"uuid": "1c147485-c1be-4c86-95ba-6b796a916666", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:27:38.752361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:27:39.155200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:27:39.155646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:27:39.156166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:27:39.156592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:27:39.157022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:27:39.165930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:39.166454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:39.166911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:39.167656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:39.168126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:39.168596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:39.185941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:27:39.191189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:27:39.248908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:27:39.251093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c147485-c1be-4c86-95ba-6b796a916666',volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:27:39.378783 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c829fe1-c52c-4f19-9022-051ff0021a95 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.742151 Oct 13 09:27:39.379434 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3386/7170] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:27:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:27:39.390430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-83fd1673-535f-4c96-b1d6-5aeccea80592 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:39.391061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-83fd1673-535f-4c96-b1d6-5aeccea80592 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:39.443837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-83fd1673-535f-4c96-b1d6-5aeccea80592 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:39.450799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-83fd1673-535f-4c96-b1d6-5aeccea80592 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1093 microversion: 2.1 time: 0.064163 Oct 13 09:27:39.451369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3785/7171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:39 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:40.473726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:40.474345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:40.482323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:40.482962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:40.483597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:40.484418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:40.484963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:40.485411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:40.564957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:40.573009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb034677-6729-4e39-ae75-f377d5aa38de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1199 microversion: 2.1 time: 0.103565 Oct 13 09:27:40.582304 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3387/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:40 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:41.597479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:41.598299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:41.606365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:41.606942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:41.607379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:41.608322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:41.608784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:41.609211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:41.749747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:41.758253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6293ceb3-c7ee-4190-9dd4-b9bd21e2c3f8 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1275 microversion: 2.1 time: 0.164964 Oct 13 09:27:41.758872 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3786/7173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:41 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:41.936109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40462a85-9145-4066-a994-31fadbdfbe2f", "tag": "c685da05-45a4-4b31-bbba-fc586554294c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:27:41.948646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:41.949435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:41.950064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:41.962457 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] Creating event network-changed:c685da05-45a4-4b31-bbba-fc586554294c for instance 40462a85-9145-4066-a994-31fadbdfbe2f on n-h1-858384-11 Oct 13 09:27:41.968220 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-a4871a59-466b-4e06-9b81-01559b861025 req-7b9ddf1f-a65c-4eeb-8230-6e7f819646b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 Oct 13 09:27:41.969013 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3388/7174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:27:42.781349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:42.782634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:42.789327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:42.789821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:42.790269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:42.791008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:42.791470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:42.791885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:42.939326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:42.948119 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f84ad71-ffe7-4526-9cd4-6a99852c4a62 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1275 microversion: 2.1 time: 0.170654 Oct 13 09:27:42.953957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3787/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:42 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:43.973377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:43.974201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:43.980925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:43.982003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:43.982506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:43.983221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:43.983719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:43.984164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:44.119019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:44.126959 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c47cf6da-db9d-4997-a867-ea2c3afc15de tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1275 microversion: 2.1 time: 0.159164 Oct 13 09:27:44.127542 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3389/7176] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:43 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:45.150084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:45.150663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:45.158585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:45.159072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:45.159509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:45.160214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:45.160666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:45.161117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:45.295405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:45.303456 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03f787d3-d1a6-457b-8148-6e6ca7e91d56 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1275 microversion: 2.1 time: 0.157636 Oct 13 09:27:45.304045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3788/7177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:45 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:46.326919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:46.327551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:46.334468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:46.334971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:46.335431 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:46.336140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:46.336609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:46.337053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:46.468767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:46.476875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d30b108e-19da-4c24-9e5e-18564c2fec17 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.154194 Oct 13 09:27:46.477455 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3390/7178] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:46 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:47.499692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:47.500303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:47.507254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:47.507772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:47.508207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:47.508895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:47.509345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:47.509766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:47.637295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:47.644971 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9d1ffa6-6e32-4f70-9748-6d5170b77a39 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.149199 Oct 13 09:27:47.645542 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3789/7179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:47 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:48.668386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:48.669451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:48.676335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:48.676840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:48.677302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:48.678021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:48.678526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:48.678975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:48.810748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:48.818538 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e1ad3fc5-09a0-43c0-bd18-da8531f54689 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.154229 Oct 13 09:27:48.819116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3391/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:48 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:49.841511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:49.842132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:49.845141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:49.850362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:49.850873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:49.851575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:49.852270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:49.852724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:49.853152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:49.985920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:49.993570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8442e87d-92eb-4130-a2da-2a4e4bceee5a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.156232 Oct 13 09:27:49.994143 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3790/7181] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:49 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:51.017170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:51.017798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:51.019858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:51.020527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:27:51.027467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:51.027997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:51.028655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:51.029371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:51.029839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:51.030281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:51.163707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:51.172019 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27085e16-dc87-4906-8dd9-cfff909961b6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.158739 Oct 13 09:27:51.172606 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3392/7182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:51 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:52.194387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:52.195016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:52.202642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:52.203119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:52.203550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:52.204231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:52.204681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:52.205102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:52.333707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:52.341622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a3447f87-d8ed-471b-890d-33c593862559 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.151109 Oct 13 09:27:52.342193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3791/7183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:52 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:53.365036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:53.365673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:53.372611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:53.373111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:53.373570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:53.374284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:53.374798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:53.375240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:53.511831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:53.520223 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ff93efe-4e1c-404e-b528-c10548be1163 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.159133 Oct 13 09:27:53.520813 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3393/7184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:53 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:54.542827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:54.543419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:54.550201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:54.550724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:54.551158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:54.551843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:54.552294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:54.552712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:54.686248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:54.693865 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49e86ff1-ac61-4779-ae32-12838973ec41 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.154998 Oct 13 09:27:54.694446 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3792/7185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:54 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:55.711175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40462a85-9145-4066-a994-31fadbdfbe2f", "name": "network-vif-plugged", "status": "completed", "tag": "c685da05-45a4-4b31-bbba-fc586554294c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:27:55.717047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:55.717745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:55.722352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:55.722896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:55.723344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:55.724820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:55.725325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:55.725752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:55.726742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:55.727207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:55.727641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:55.736129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] Creating event network-vif-plugged:c685da05-45a4-4b31-bbba-fc586554294c for instance 40462a85-9145-4066-a994-31fadbdfbe2f on n-h1-858384-11 Oct 13 09:27:55.741276 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-8a7cc077-90cd-4a98-9da6-03fa4896eb3a req-cbf1429b-ecdd-4c1f-b052-7407ec7a17ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095506 Oct 13 09:27:55.741891 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3394/7186] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:27:55.870589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:55.879069 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40253e89-5a5a-490f-8826-0762756aaaf1 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1263 microversion: 2.1 time: 0.166649 Oct 13 09:27:55.879666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3793/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:55 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:27:56.904515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:56.905320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:56.911665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:56.912176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:56.912666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:56.913397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:56.913869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:56.914317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:57.051785 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:57.059607 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16c42c1a-f2b2-4ac8-9441-eba226a0a31b tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1449 microversion: 2.1 time: 0.160976 Oct 13 09:27:57.060174 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3395/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:56 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1449 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:57.081923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:27:57.082567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:27:57.089326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:57.089801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:57.090262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:57.091559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:57.091990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:57.092411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:57.225584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:27:57.233953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-41413a57-7960-4324-932b-5b3bc51804ef tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1449 microversion: 2.1 time: 0.155863 Oct 13 09:27:57.234561 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3794/7189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:27:57 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:27:58.843836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40462a85-9145-4066-a994-31fadbdfbe2f", "tag": "c685da05-45a4-4b31-bbba-fc586554294c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:27:58.854432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:27:58.855021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:27:58.855540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:27:58.867411 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] Creating event network-changed:c685da05-45a4-4b31-bbba-fc586554294c for instance 40462a85-9145-4066-a994-31fadbdfbe2f on n-h1-858384-11 Oct 13 09:27:58.872534 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-62865a95-ca22-46d1-aef9-7a431b4e37d5 req-6ce3c80d-cf79-4c25-b735-f49dee3bdd77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033077 Oct 13 09:27:58.873143 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3396/7190] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:29:36.635994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:36.636912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:36.642528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-116568823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323031433", "security_groups": [{"name": "tempest-secgroup-smoke-36684067"}], "block_device_mapping_v2": [{"uuid": "c2966c0d-b0b5-431e-a4dc-989edd6a54e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51f8ef8e-146b-4091-ab95-e314d4cf1d1b"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:29:36.880537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] validate_networks() for [('51f8ef8e-146b-4091-ab95-e314d4cf1d1b', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:29:37.303257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:29:37.303689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:29:37.304165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:29:37.304580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:29:37.304994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:29:37.314455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:37.314941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:37.315376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:37.316100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:37.316553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:37.316978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:37.333446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:29:37.338691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Getting quotas for user 674dc3d3f9f242e0b89bf31fdee3a311 and project 97bd035d6440420ab9fec02e33e61240. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:29:37.396621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:29:37.398789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2966c0d-b0b5-431e-a4dc-989edd6a54e7',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:29:37.527705 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2af7878d-90b5-40e8-bcec-e0527c86658d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.893678 Oct 13 09:29:37.528353 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3795/7191] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:29:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:29:37.538146 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 09:29:37.539630 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 09:29:37.540524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:37.541275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=76 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:37.548478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad382561-d4da-4dd7-a124-23f614e81288 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:37.548814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad382561-d4da-4dd7-a124-23f614e81288 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:37.654885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ad382561-d4da-4dd7-a124-23f614e81288 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:37.663356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad382561-d4da-4dd7-a124-23f614e81288 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1093 microversion: 2.1 time: 0.126975 Oct 13 09:29:37.663914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3397/7192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:37 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:38.687534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:38.688153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:38.695347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:38.696288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:38.696687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:38.697560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:38.698687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:38.699466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:38.775805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:38.784680 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2bc234a8-a882-4b96-8e60-a5c7159576cb tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1209 microversion: 2.1 time: 0.102258 Oct 13 09:29:38.785275 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3796/7193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:38 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:39.808688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:39.809330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:39.818032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:39.818671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:39.819145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:39.819878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:39.820346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:39.821000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:39.851758 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54924. Oct 13 09:29:39.856605 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54922. Oct 13 09:29:39.965551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:39.974738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea780322-d78f-4cde-9809-d119185ac12c tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1275 microversion: 2.1 time: 0.170555 Oct 13 09:29:39.975333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3398/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:39 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:40.224790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02978c50-185b-4ddc-8e8d-23e8f3707c51", "tag": "b6ec6034-132f-45da-bf25-0f68354a0f03"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:29:40.235144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:40.235635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:40.236079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:40.248598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] Creating event network-changed:b6ec6034-132f-45da-bf25-0f68354a0f03 for instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 on n-h2-858384-11 Oct 13 09:29:40.254038 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c5122def-e693-409e-bcc4-2b7b47bacfb9 req-3ffcaa87-585f-45d8-867b-f3dfc4a4bc47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108794 Oct 13 09:29:40.254717 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3797/7195] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:29:40.998461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:40.999201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:41.006745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:41.007347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:41.007895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:41.008699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:41.009236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:41.009778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:41.162275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:41.170395 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-28a2c1a0-c8d4-463b-9838-6a36389187f0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1275 microversion: 2.1 time: 0.175821 Oct 13 09:29:41.171033 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3399/7196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:40 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:42.195238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:42.195848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:42.202125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:42.202649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:42.203089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:42.204455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:42.204909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:42.205336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:42.334708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:42.342535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d07fcd6b-8ca8-46ee-8636-6a8bdca7f276 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1275 microversion: 2.1 time: 0.152533 Oct 13 09:29:42.343118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3798/7197] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:42 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:29:43.365911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:43.366561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:43.373400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:43.373901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:43.374354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:43.375089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:43.376478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:43.376966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:43.517344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:43.525090 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c0269a46-7a9d-463b-a521-bca0f9c7b350 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1275 microversion: 2.1 time: 0.163194 Oct 13 09:29:43.525665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3400/7198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:43 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:44.548606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:44.549247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:44.556092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:44.556570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:44.557007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:44.557703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:44.558152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:44.558612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:44.686373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:44.694734 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3bd0b827-a209-495f-bd5e-485e38852753 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.150003 Oct 13 09:29:44.695309 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3799/7199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:44 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:45.718001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:45.718667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:45.726624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:45.727420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:45.727903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:45.728643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:45.729152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:45.729611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:45.857725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:45.865560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5e5b2dc-1976-468e-8f64-ba7f2a218fb3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.151846 Oct 13 09:29:45.866139 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3401/7200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:45 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:46.889187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:46.889830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:46.897548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:46.898023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:46.898479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:46.899165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:46.899614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:46.900036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:47.036496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:47.044293 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61db53e3-82eb-4d85-a3f9-93bb579f38b0 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.159053 Oct 13 09:29:47.045103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3800/7201] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:46 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:48.068524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:48.069244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:48.072144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:48.078258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:48.079042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:48.079462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:48.080308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:48.080783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:48.081301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:48.221469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:48.230062 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-855d8d83-ce4a-4a41-89e3-b9e19901ef6a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.166001 Oct 13 09:29:48.230780 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3402/7202] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:48 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:49.254835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:49.255472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:49.257421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:49.258199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:29:49.264778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:49.265264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:49.265704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:49.266432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:49.266913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:49.267323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:49.396132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:49.403903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2f533dfc-798a-49e0-9bad-90136b651cf6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.153660 Oct 13 09:29:49.404490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3801/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:49 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:50.426602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:50.427239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:50.434172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:50.434694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:50.435144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:50.435850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:50.436317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:50.436753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:50.567712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:50.575429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-40f891a2-4309-4d1b-97e6-4e6ee754bfc4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.152914 Oct 13 09:29:50.576000 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3403/7204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:50 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:51.597734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:51.598353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:51.605733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:51.606219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:51.606680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:51.607375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:51.607827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:51.608249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:51.741648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:51.749468 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3e199ae-c52d-4692-aae7-dd72618e1d1d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.155692 Oct 13 09:29:51.750032 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3802/7205] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:51 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:52.773370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:52.773933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:52.780852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:52.781354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:52.781791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:52.782514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:52.782975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:52.783409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:52.911680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:52.919510 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-243789c9-8f4e-4e79-9c21-a6fff804bd5f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.150164 Oct 13 09:29:52.920088 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3404/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:52 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:53.941979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:53.942620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:53.949351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:53.949826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:53.950259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:53.950987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:53.951436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:53.951855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:54.082234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:54.089873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee0d9f05-5303-4a17-aca1-9e90202e9797 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.151806 Oct 13 09:29:54.090458 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3803/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:53 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:54.687252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02978c50-185b-4ddc-8e8d-23e8f3707c51", "name": "network-vif-plugged", "status": "completed", "tag": "b6ec6034-132f-45da-bf25-0f68354a0f03"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:29:54.697875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:54.698388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:54.698858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:54.710747 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] Creating event network-vif-plugged:b6ec6034-132f-45da-bf25-0f68354a0f03 for instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 on n-h2-858384-11 Oct 13 09:29:54.715697 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2baef816-a25a-4ca3-af86-87aca10b7631 req-b4a3e1a7-fc52-4786-ad1a-0a454d81014c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032224 Oct 13 09:29:54.716301 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3405/7208] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:29:55.113911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:55.114484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:55.121329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:55.121811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:55.122247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:55.122968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:55.123422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:55.123845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:55.255364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:55.263092 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49fcf360-12b8-42f0-b75f-56d8ac66648e tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.153768 Oct 13 09:29:55.263662 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3804/7209] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:55 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:56.288694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:56.289467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:56.295768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:56.296278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:56.296736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:56.297458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:56.297928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:56.298428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:56.437289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:56.445707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-32d1f621-0193-484b-9a2d-9c12e678765a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1263 microversion: 2.1 time: 0.162323 Oct 13 09:29:56.446285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3406/7210] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:56 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:57.469041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:57.469686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:57.476534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:57.477008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:57.477707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:57.478413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:57.478874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:57.479298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:57.608799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:57.617186 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48f272af-49fd-4dc0-b137-35f7eb876578 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1450 microversion: 2.1 time: 0.152045 Oct 13 09:29:57.617761 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3805/7211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:57 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:57.639586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:29:57.640214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:29:57.647081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:57.647577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:57.648027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:57.648734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:57.649201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:57.649636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:57.776797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:29:57.785071 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1666cc88-e3c8-4672-a913-b7efa19753b4 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1450 microversion: 2.1 time: 0.149344 Oct 13 09:29:57.785650 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3407/7212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:29:57 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:29:59.811333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02978c50-185b-4ddc-8e8d-23e8f3707c51", "tag": "b6ec6034-132f-45da-bf25-0f68354a0f03"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:29:59.821367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:29:59.821808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:29:59.822228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:29:59.836107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] Creating event network-changed:b6ec6034-132f-45da-bf25-0f68354a0f03 for instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 on n-h2-858384-11 Oct 13 09:29:59.841254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-79fcf3e8-aeb7-4718-8a10-7bb6dd667385 req-88e9830f-1e7d-41c0-9022-7d7131c898e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094826 Oct 13 09:29:59.841800 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3806/7213] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:31:27.956593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:27.957226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:27.957486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:31:27.958852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=60 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:31:27.960630 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:31:27.960773 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 09:31:27.967902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=24 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:31:27.968903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=56 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:31:27.970108 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:31:27.970426 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 (ip 10.222.0.23) !!! Oct 13 09:31:27.972747 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:31:27.973171 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 (ip 10.222.0.23) !!! Oct 13 09:31:27.977787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02978c50-185b-4ddc-8e8d-23e8f3707c51", "tag": "b6ec6034-132f-45da-bf25-0f68354a0f03"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:31:27.980744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:27.981446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:27.981904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:27.982657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:27.983253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:27.983709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:27.995809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:27.996662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:27.997179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:28.009674 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] Creating event network-changed:b6ec6034-132f-45da-bf25-0f68354a0f03 for instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 on n-h2-858384-11 Oct 13 09:31:28.015200 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8a9ad6c6-3536-41be-b323-2880c41e0640 req-65ed8697-b0b0-4d45-839d-28d2c52d4c81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060922 Oct 13 09:31:28.015897 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3807/7214] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:31:28.016823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:31:28.102172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bd02415-e318-4cf1-80e3-5e573395c0dc tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 204 len: 0 microversion: 2.1 time: 0.150360 Oct 13 09:31:28.103652 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3408/7215] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:31:27 2022] DELETE /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:31:28.117655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:28.118477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:28.125274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:28.125802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:28.126306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:28.127052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:28.127512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:28.127942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:28.259850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:28.267888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c72669ef-d82b-44d3-acaa-52354bd68a45 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1575 microversion: 2.1 time: 0.159648 Oct 13 09:31:28.268470 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3808/7216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:28 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:29.293181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:29.293904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:29.301049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:29.301549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:29.302007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:29.302751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:29.303226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:29.303670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:29.744339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:29.752197 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b9164fc0-2fcd-4f78-9962-cf361046942d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1575 microversion: 2.1 time: 0.463429 Oct 13 09:31:29.752767 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3409/7217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:29 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1575 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:30.385568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02978c50-185b-4ddc-8e8d-23e8f3707c51", "name": "network-vif-deleted", "tag": "b6ec6034-132f-45da-bf25-0f68354a0f03"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:31:30.396419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:30.396940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:30.397382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:30.408884 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] Creating event network-vif-deleted:b6ec6034-132f-45da-bf25-0f68354a0f03 for instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 on n-h2-858384-11 Oct 13 09:31:30.414762 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-4fe2437d-8de9-47b7-9256-049ba5f01290 req-5b3889be-7386-44ae-87f4-d75cf3851c88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032908 Oct 13 09:31:30.415376 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3809/7218] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:31:30.777090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:30.777728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:30.785058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:30.785561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:30.786013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:30.786863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:30.787332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:30.787781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:30.850433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:30.858584 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eeaf1256-ee3a-4f2a-be3f-3894c8588998 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1224 microversion: 2.1 time: 0.085515 Oct 13 09:31:30.859165 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3410/7219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:30 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:31.882722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:31.883451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:31.889771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:31.890248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:31.890717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:31.891414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:31.891861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:31.892285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:31.959795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:31.967673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdc1d388-875d-4ee7-a019-d516cfcc8c7d tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1224 microversion: 2.1 time: 0.090190 Oct 13 09:31:31.968237 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3810/7220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:31 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:32.992409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:32.993036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:33.001437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:33.001941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:33.002392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:33.003136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:33.003997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:33.004446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:33.071491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:33.079492 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7fb10f3c-56b8-4a9a-b6f2-e77b9481a2f7 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1224 microversion: 2.1 time: 0.091711 Oct 13 09:31:33.080091 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3411/7221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:32 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:34.102059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:34.102704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:34.109780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:34.110270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:34.110747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:34.111448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:34.111901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:34.112327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:34.174126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:34.182545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-77f1b16a-3fbf-4224-b0fb-cfe38c5301c6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 200 len: 1224 microversion: 2.1 time: 0.084390 Oct 13 09:31:34.183118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3811/7222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:34 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:35.205402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:35.205948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 02978c50-185b-4ddc-8e8d-23e8f3707c51] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:35.213420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:35.213900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:35.214348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:35.215072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:35.215537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:35.215974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:35.229363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 HTTP/1.1 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '02978c50-185b-4ddc-8e8d-23e8f3707c51'} Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:35.231072 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 02978c50-185b-4ddc-8e8d-23e8f3707c51 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d5061cb-82bc-406f-bf27-2907380819d3 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51" status: 404 len: 111 microversion: 2.1 time: 0.031116 Oct 13 09:31:35.236050 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3412/7223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:35 2022] GET /compute/v2.1/servers/02978c50-185b-4ddc-8e8d-23e8f3707c51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:31:41.421329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:41.421875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:41.423694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40462a85-9145-4066-a994-31fadbdfbe2f", "tag": "c685da05-45a4-4b31-bbba-fc586554294c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:31:41.429583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:41.429874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:41.430308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:41.431039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:41.431490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:41.431914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:41.433123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:41.433627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:41.434084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:41.446121 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] Creating event network-changed:c685da05-45a4-4b31-bbba-fc586554294c for instance 40462a85-9145-4066-a994-31fadbdfbe2f on n-h1-858384-11 Oct 13 09:31:41.451542 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f20cae0a-bd3a-42ab-b8ce-0f7229a9273d req-33875260-c086-4328-b94c-99f875e5b569 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031778 Oct 13 09:31:41.452365 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3413/7224] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:31:41.459465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:31:41.561872 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d6ea2897-260c-45aa-8c7e-f1ef237afe3a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 204 len: 0 microversion: 2.1 time: 0.143513 Oct 13 09:31:41.562640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3812/7225] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:31:41 2022] DELETE /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:31:41.572373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:41.573097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:41.579979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:41.580483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:41.580950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:41.581656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:41.582282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:41.582806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:41.733032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:41.741314 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fb92ee00-b9ed-44ec-80ff-90898cf11737 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1573 microversion: 2.1 time: 0.174135 Oct 13 09:31:41.741887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3414/7226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:41 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:31:42.765887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:42.766728 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:42.774452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:42.775067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:42.775626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:42.776612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:42.777216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:42.777757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:42.912901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:42.920695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d6e1e8c-f09a-44a3-bd59-724be60a264f tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1573 microversion: 2.1 time: 0.159158 Oct 13 09:31:42.921272 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3813/7227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:42 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:43.515896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40462a85-9145-4066-a994-31fadbdfbe2f", "name": "network-vif-deleted", "tag": "c685da05-45a4-4b31-bbba-fc586554294c"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:31:43.526395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:43.526929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:43.527381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:43.539503 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] Creating event network-vif-deleted:c685da05-45a4-4b31-bbba-fc586554294c for instance 40462a85-9145-4066-a994-31fadbdfbe2f on n-h1-858384-11 Oct 13 09:31:43.544310 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-5a7d5a78-af71-4df2-91cf-0925a3c43b9e req-5c2c2086-a9b0-4bf8-b99b-ba36f15122c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032157 Oct 13 09:31:43.544914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3415/7228] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:31:43.944204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:43.944820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:43.951647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:43.952126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:43.952547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:43.953248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:43.953999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:43.954451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:44.016466 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:44.024840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-00bee57d-02f6-4777-a2cb-1458b186b3c9 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1224 microversion: 2.1 time: 0.084605 Oct 13 09:31:44.040718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3814/7229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:43 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:45.049153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:45.049865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:45.057110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:45.057613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:45.058071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:45.058836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:45.059305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:45.059744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:45.129089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:45.137722 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51a235af-96d2-4b9f-a500-0f78a70e6f84 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1224 microversion: 2.1 time: 0.093894 Oct 13 09:31:45.138318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3416/7230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:45 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:46.160755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:46.161292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:46.168071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:46.168575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:46.169011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:46.169699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:46.170146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:46.170605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:46.232102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:46.240493 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b741a5d2-8036-4e34-9c92-3dedba4860d6 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1224 microversion: 2.1 time: 0.083803 Oct 13 09:31:46.241066 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3815/7231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:46 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:47.263400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:47.264029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:47.271792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:47.272298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:47.272786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:47.273529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:47.274001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:47.274474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:47.336683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674dc3d3f9f242e0b89bf31fdee3a311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bd035d6440420ab9fec02e33e61240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:31:47.344551 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b30dcad3-e44d-47e3-a57f-fde2c842be34 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 200 len: 1224 microversion: 2.1 time: 0.085081 Oct 13 09:31:47.345124 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3417/7232] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:47 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:31:48.366803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:48.367472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 40462a85-9145-4066-a994-31fadbdfbe2f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:48.374266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.374769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.375202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.375892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.376340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.376765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.390107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f HTTP/1.1 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '40462a85-9145-4066-a994-31fadbdfbe2f'} Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.391757 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 40462a85-9145-4066-a994-31fadbdfbe2f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3fee66a3-6d40-4a29-8385-03755d785993 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f" status: 404 len: 111 microversion: 2.1 time: 0.030240 Oct 13 09:31:48.397561 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3816/7233] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:48 2022] GET /compute/v2.1/servers/40462a85-9145-4066-a994-31fadbdfbe2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:31:48.843052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:48.843552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:48.850823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.851331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.851793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.852508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.852986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.853689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.866990 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 HTTP/1.1 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '6e8bf045-7c02-4a0c-b367-c1a82b928057'} Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:31:48.868751 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c83676e8-b8f1-4caf-86df-cefe5d015099 tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 404 len: 111 microversion: 2.1 time: 0.031100 Oct 13 09:31:48.873377 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3418/7234] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:31:48 2022] DELETE /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:31:48.879074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:48.880216 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] [instance: 6e8bf045-7c02-4a0c-b367-c1a82b928057] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:31:48.886124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.886653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.887094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.887784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:31:48.888240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:31:48.888664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:31:48.902535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] HTTP exception thrown: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Request method failure captured: Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 HTTP/1.1 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9iRxIQiZ5vDsT-Fy0NVHie0vut4C9CQR-7fL15E025rObPSD-9a5WQM-xnEgGyYcaZc2q5NwldK5lo1SsGshbR_XgfvG4q2MfAOMGYVl7MnQzZ_eQke2G_7ptdOVkvaA8hlaDiAvle7I2i06Vl8V9FYzajzs_0ez4V_iHv8sMee5F4 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_97bd035d6440420ab9fec02e33e61240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/97bd035d6440420ab9fec02e33e61240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 97bd035d6440420ab9fec02e33e61240 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestVolumeBootPattern-497109745 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 674dc3d3f9f242e0b89bf31fdee3a311 Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestVolumeBootPattern-497109745-project Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '6e8bf045-7c02-4a0c-b367-c1a82b928057'} Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:31:48.904067 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Returning 404 to user: Instance 6e8bf045-7c02-4a0c-b367-c1a82b928057 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a27fbd0b-1d71-4184-bdac-f090e7e76e1a tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057" status: 404 len: 111 microversion: 2.1 time: 0.030203 Oct 13 09:31:48.908316 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3817/7235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:31:48 2022] GET /compute/v2.1/servers/6e8bf045-7c02-4a0c-b367-c1a82b928057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:31:52.323928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9751a600-cda2-4f79-935a-681924c9bcaf tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] Calling method '.version_select at 0x7f53755583a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:31:52.356317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9751a600-cda2-4f79-935a-681924c9bcaf tempest-TestVolumeBootPattern-497109745 tempest-TestVolumeBootPattern-497109745-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-323031433" status: 202 len: 0 microversion: 2.1 time: 0.036361 Oct 13 09:31:52.357195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3419/7236] 10.222.0.23 () {58 vars in 1260 bytes} [Thu Oct 13 09:31:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-323031433 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:32:10.921453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:10.922187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:11.079295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1482634544", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:11.333113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] validate_networks() for None {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:32:11.639685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:32:11.640114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:32:11.640588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:32:11.640998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:32:11.641413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:32:11.651083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:11.651566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:11.652007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:11.652730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:11.653183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:11.653609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:11.670187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Getting quotas for project ef8b42f1ada1453183552552a407c4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:32:11.675425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Getting quotas for user 6528f891374149c993500eaab15ef027 and project ef8b42f1ada1453183552552a407c4fa. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:32:11.687700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:32:11.689950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:32:11.731504 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:32:12.738924 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55210. Oct 13 09:32:12.743331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-746721a4-69b3-49c8-86ee-16711c44454b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.825751 Oct 13 09:32:12.743998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3818/7237] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:32:12.756970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc6c05f6-4bf5-4a3f-8395-3cfe0166bfc8 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:12.757846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc6c05f6-4bf5-4a3f-8395-3cfe0166bfc8 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:12.760058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:12.760904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:12.985922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc6c05f6-4bf5-4a3f-8395-3cfe0166bfc8 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:12.993636 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc6c05f6-4bf5-4a3f-8395-3cfe0166bfc8 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1222 microversion: 2.1 time: 0.240719 Oct 13 09:32:12.994093 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3420/7238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:12 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1222 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:14.017706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:14.018438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:14.024538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:14.025021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:14.025457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:14.026153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:14.026632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:14.027054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:14.102973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:14.111175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b096e90-46c3-4372-bd88-1018fcfb8473 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1280 microversion: 2.1 time: 0.098237 Oct 13 09:32:14.111752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3819/7239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:14 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:15.135821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:15.136446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:15.143460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:15.143961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:15.144421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:15.145133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:15.145611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:15.146050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:15.282481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:15.290356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20887014-d113-4e03-a8b5-c5aeb1a23db0 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.158529 Oct 13 09:32:15.290991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3421/7240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:15 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:15.560069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300400a9-5361-4ef7-9ba5-256404b1dd12", "tag": "ce2b03ff-ad06-43bd-a582-aaf649bb0704"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:15.573713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:15.574202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:15.574697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:15.585619 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] Creating event network-changed:ce2b03ff-ad06-43bd-a582-aaf649bb0704 for instance 300400a9-5361-4ef7-9ba5-256404b1dd12 on n-h1-858384-11 Oct 13 09:32:15.591005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7ca1df33-3b52-4094-9a24-2431768cbd97 req-56554041-b64f-40cb-89b1-743dffd6bfc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085577 Oct 13 09:32:15.591618 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3820/7241] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:16.313260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:16.313814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:16.320763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:16.321266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:16.321723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:16.322461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:16.322936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:16.323382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:16.449463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:16.457786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-204ba147-3429-45ad-97f1-29ecd7d33c4a tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.148620 Oct 13 09:32:16.458364 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3422/7242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:16 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:17.482200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:17.482916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:17.489809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:17.490290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:17.490754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:17.491457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:17.491905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:17.492333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:17.621724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:17.629775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7fdc826-ed2a-4cb3-aa7f-696ba3d33cd3 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.152977 Oct 13 09:32:17.630343 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3821/7243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:17 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:18.651706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:18.652339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:18.659353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:18.659831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:18.660286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:18.661001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:18.661470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:18.661910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:18.790504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:18.799727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a06fb1a2-902d-430d-812f-2f1138b8a4cf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.151949 Oct 13 09:32:18.800304 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3423/7244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:18 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:32:19.823260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:19.823799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:19.830691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:19.831175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:19.832267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:19.832985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:19.833439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:19.833867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:19.960024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:19.967808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-983ec533-9649-4ffc-8357-a30a179550bf tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.148549 Oct 13 09:32:19.968388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3822/7245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:19 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:20.765542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300400a9-5361-4ef7-9ba5-256404b1dd12", "name": "network-vif-plugged", "status": "completed", "tag": "ce2b03ff-ad06-43bd-a582-aaf649bb0704"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:20.777316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:20.777833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:20.778260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:20.789849 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] Creating event network-vif-plugged:ce2b03ff-ad06-43bd-a582-aaf649bb0704 for instance 300400a9-5361-4ef7-9ba5-256404b1dd12 on n-h1-858384-11 Oct 13 09:32:20.794913 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-750eb7d7-66d3-47a5-966b-90e25e15aec5 req-a8878be7-c8df-4c2c-b6d6-9ee40d9e4b97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Oct 13 09:32:20.795683 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3424/7246] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:32:20.989729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:20.990336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:20.997057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:20.997533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:20.997965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:20.998679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:20.999130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:20.999551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:21.126936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:21.134494 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-22d02f50-cd91-4756-9484-de2e94b5b50b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1322 microversion: 2.1 time: 0.148803 Oct 13 09:32:21.135061 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3823/7247] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:20 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:22.157793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:22.158534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:22.166062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.166599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.167052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.167757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.168227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.168671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.299903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:22.308323 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ff4d94f-c9fd-4825-91aa-658c7c9e119e tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1471 microversion: 2.1 time: 0.154847 Oct 13 09:32:22.308899 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3425/7248] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:22 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:22.332898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:22.333641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:22.379847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-da57c571-628a-4d8e-a857-299211f1bb24 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '.version_select at 0x7f5375542310>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:22.442837 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-da57c571-628a-4d8e-a857-299211f1bb24 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ddb91a7d5177430d882afffc3fcfd97d" status: 200 len: 371 microversion: 2.1 time: 0.114359 Oct 13 09:32:22.443403 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3824/7249] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 09:32:22 2022] GET /compute/v2.1/os-quota-sets/ddb91a7d5177430d882afffc3fcfd97d => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:22.455796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f5697ee-9515-409f-ab84-81b99a074d78 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1092256220", "id": 180441447, "os-flavor-access:is_public": "True"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:22.474907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f5697ee-9515-409f-ab84-81b99a074d78 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022897 Oct 13 09:32:22.475482 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3426/7250] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:32:22 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:22.487602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "180441447"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:22.489880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:22.495862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.496343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.496777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.497497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.497960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.498369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.582930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c0f8680f52ab4d5699933728aba172e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb91a7d5177430d882afffc3fcfd97d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:22.588759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1092256220 {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:32:22.595522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.596176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.596777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.598151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.598642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.599067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.619441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Getting quotas for project ef8b42f1ada1453183552552a407c4fa. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:32:22.624388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Getting quotas for user 6528f891374149c993500eaab15ef027 and project ef8b42f1ada1453183552552a407c4fa. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:32:22.636049 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] ram quota exceeded for ddb91a7d5177430d882afffc3fcfd97d, tried to resize instance. Oct 13 09:32:22.636573 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Request method failure captured: Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action HTTP/1.1 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 38 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9saGUEKscb5SUfnlAQOBIM5vj--b077z-oAcL8OVGWOxHN9m6PrjIS9f--rcFlT9MAoUCMWayga26XE55Vt4L9cevJhGO2NuFfJOKmhSfiQXSW7jKY-EbKiTb94l7GgKEcr1Uk4FYEKGJZFD0UQFXbWcLzyj-Auu5J2WOutMsnaM2k Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ddb91a7d5177430d882afffc3fcfd97d Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,admin,reader Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,admin,reader Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ddb91a7d5177430d882afffc3fcfd97d Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-343746504-project-admin Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: c0f8680f52ab4d5699933728aba172e9 Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-343746504-project-admin Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: {"resize": {"flavorRef": "180441447"}} Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '300400a9-5361-4ef7-9ba5-256404b1dd12', 'body': {'resize': {'flavorRef': '180441447'}}} Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.638629 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6e0edca0-22f8-4e34-a3e0-6952baf19eb8 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action" status: 403 len: 118 microversion: 2.1 time: 0.156219 Oct 13 09:32:22.642909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3825/7251] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:32:22 2022] POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action => generated 118 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:32:22.649550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6087cf52-b899-4761-98e8-7472248ba075 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:22.666949 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6087cf52-b899-4761-98e8-7472248ba075 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/180441447" status: 202 len: 0 microversion: 2.1 time: 0.021105 Oct 13 09:32:22.667590 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3427/7252] 10.222.0.23 () {58 vars in 1158 bytes} [Thu Oct 13 09:32:22 2022] DELETE /compute/v2.1/flavors/180441447 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:32:22.675151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96d4e23a-b9c4-4f00-a410-885f922891a2 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:22.698527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96d4e23a-b9c4-4f00-a410-885f922891a2 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026918 Oct 13 09:32:22.699083 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3826/7253] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 09:32:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:32:22.719352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-558b5a16-2936-4ba3-88c7-5a7a29b9e5af tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '.version_select at 0x7f5375d18d30>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:22.787327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-558b5a16-2936-4ba3-88c7-5a7a29b9e5af tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/ddb91a7d5177430d882afffc3fcfd97d" status: 200 len: 371 microversion: 2.1 time: 0.071570 Oct 13 09:32:22.787917 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3428/7254] 10.222.0.23 () {58 vars in 1242 bytes} [Thu Oct 13 09:32:22 2022] GET /compute/v2.1/os-quota-sets/ddb91a7d5177430d882afffc3fcfd97d => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:22.799614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d0992fb7-923b-43fd-b967-dbe88168e7bf tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-933888864", "id": 1259632525, "os-flavor-access:is_public": "True"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:22.818019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d0992fb7-923b-43fd-b967-dbe88168e7bf tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022256 Oct 13 09:32:22.818633 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3827/7255] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:32:22 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:32:22.830853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1259632525"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:22.833781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:22.839833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.840334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.840806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.841502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.841968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.842425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.928182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c0f8680f52ab4d5699933728aba172e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb91a7d5177430d882afffc3fcfd97d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:22.933931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-933888864 {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:32:22.940509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.941529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.941978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.942741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:22.943207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:22.943641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:22.970080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Getting quotas for project ef8b42f1ada1453183552552a407c4fa. Resources: {'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:32:22.975170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Getting quotas for user 6528f891374149c993500eaab15ef027 and project ef8b42f1ada1453183552552a407c4fa. Resources: {'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:32:22.988429 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] cores quota exceeded for ddb91a7d5177430d882afffc3fcfd97d, tried to resize instance. Oct 13 09:32:22.988967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Request method failure captured: Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action HTTP/1.1 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 39 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9saGUEKscb5SUfnlAQOBIM5vj--b077z-oAcL8OVGWOxHN9m6PrjIS9f--rcFlT9MAoUCMWayga26XE55Vt4L9cevJhGO2NuFfJOKmhSfiQXSW7jKY-EbKiTb94l7GgKEcr1Uk4FYEKGJZFD0UQFXbWcLzyj-Auu5J2WOutMsnaM2k Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: ddb91a7d5177430d882afffc3fcfd97d Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,admin,reader Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,admin,reader Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ddb91a7d5177430d882afffc3fcfd97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: ddb91a7d5177430d882afffc3fcfd97d Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-343746504 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersAdminNegativeTestJSON-343746504-project-admin Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: c0f8680f52ab4d5699933728aba172e9 Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersAdminNegativeTestJSON-343746504-project-admin Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: {"resize": {"flavorRef": "1259632525"}} Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '300400a9-5361-4ef7-9ba5-256404b1dd12', 'body': {'resize': {'flavorRef': '1259632525'}}} Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.991077 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-496e482c-5b47-4e0f-997b-ca6ce38a5990 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action" status: 403 len: 113 microversion: 2.1 time: 0.165698 Oct 13 09:32:22.995330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3429/7256] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:32:22 2022] POST /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12/action => generated 113 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:32:23.001293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90859da8-8dce-4b45-ba9d-4f4ca6b0692f tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:23.017642 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90859da8-8dce-4b45-ba9d-4f4ca6b0692f tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1259632525" status: 202 len: 0 microversion: 2.1 time: 0.020125 Oct 13 09:32:23.018181 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3828/7257] 10.222.0.23 () {58 vars in 1161 bytes} [Thu Oct 13 09:32:22 2022] DELETE /compute/v2.1/flavors/1259632525 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:32:23.026704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cbe2c43c-1d9f-4475-95ea-677063e39554 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:23.046819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cbe2c43c-1d9f-4475-95ea-677063e39554 tempest-ServersAdminNegativeTestJSON-343746504 tempest-ServersAdminNegativeTestJSON-343746504-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023746 Oct 13 09:32:23.047394 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3430/7258] 10.222.0.23 () {58 vars in 1146 bytes} [Thu Oct 13 09:32:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:23.067897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:23.068491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:23.074485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:23.074972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:23.075412 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:23.076105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:23.076558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:23.077014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:23.102651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:32:23.174218 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e3e6cf0-d184-4e02-be6c-42f892d00cdc tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "DELETE /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 204 len: 0 microversion: 2.1 time: 0.110508 Oct 13 09:32:23.174962 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3829/7259] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:32:23 2022] DELETE /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:32:23.183836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:23.184471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:23.192089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:23.192597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:23.193053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:23.193775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:23.194246 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:23.194733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:23.323541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:23.331297 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf7296f4-38ff-41dd-969c-0a18e51a6e0b tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1477 microversion: 2.1 time: 0.151424 Oct 13 09:32:23.331869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3431/7260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:23 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:24.354613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:24.355340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:24.362029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:24.362541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:24.362981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:24.363671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:24.364120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:24.364539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:24.540914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6528f891374149c993500eaab15ef027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8b42f1ada1453183552552a407c4fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:24.548820 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3286df0-8393-46fa-83c8-4baba88547e2 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 200 len: 1477 microversion: 2.1 time: 0.198778 Oct 13 09:32:24.549609 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3830/7261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:24 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 1477 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:24.934237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300400a9-5361-4ef7-9ba5-256404b1dd12", "name": "network-vif-deleted", "tag": "ce2b03ff-ad06-43bd-a582-aaf649bb0704"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:24.947020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:24.947561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:24.948014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:24.960454 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] Creating event network-vif-deleted:ce2b03ff-ad06-43bd-a582-aaf649bb0704 for instance 300400a9-5361-4ef7-9ba5-256404b1dd12 on n-h1-858384-11 Oct 13 09:32:24.965562 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6350a61c-40c8-4e92-9b81-2b8ed623916f req-5724b42d-6d69-41e4-8e7e-dc1407915a76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035351 Oct 13 09:32:24.966182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3432/7262] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:25.571490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:25.572073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] [instance: 300400a9-5361-4ef7-9ba5-256404b1dd12] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:25.579051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:25.579531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:25.579971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:25.580670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:25.581125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:25.582050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:25.595212 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] HTTP exception thrown: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Request method failure captured: Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 HTTP/1.1 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9sargcqangQMyBzFBPFERFIY3YFsJjYc0KIcy3CdO2XneGx2pBBNDH0UjME7lqa4D0Aa3gqi9tLJOWWCLIbcFC2t7LERBxw1Q0eiVuR2GtRitfVSVnj-dfpFWQtT8B09dQrYQrEkzv3fbGULZE40teu_mDk8WVEGJ-qqHlAZW1nT14 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: ef8b42f1ada1453183552552a407c4fa Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1596315627 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b42f1ada1453183552552a407c4fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef8b42f1ada1453183552552a407c4fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef8b42f1ada1453183552552a407c4fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef8b42f1ada1453183552552a407c4fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1596315627 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: ef8b42f1ada1453183552552a407c4fa Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1596315627 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersAdminNegativeTestJSON-1596315627-project Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 6528f891374149c993500eaab15ef027 Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1596315627-project Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '300400a9-5361-4ef7-9ba5-256404b1dd12'} Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:25.596873 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] Returning 404 to user: Instance 300400a9-5361-4ef7-9ba5-256404b1dd12 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-734c9f07-0eb9-404d-8e5e-51d3f001d955 tempest-ServersAdminNegativeTestJSON-1596315627 tempest-ServersAdminNegativeTestJSON-1596315627-project] 10.222.0.23 "GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12" status: 404 len: 111 microversion: 2.1 time: 0.031423 Oct 13 09:32:25.605211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3831/7263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:25 2022] GET /compute/v2.1/servers/300400a9-5361-4ef7-9ba5-256404b1dd12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:32:31.986511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1885732436", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "cc433d70-a318-444b-b353-52b7299f00ec"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:32.050945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] validate_networks() for [('cc433d70-a318-444b-b353-52b7299f00ec', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:32:32.554810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:32:32.555289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:32:32.555817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:32:32.556248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:32:32.556684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:32:32.566048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:32.566595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:32.567057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:32.567814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:32.568312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:32.568741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:32.586208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Getting quotas for project 377309b0e3c142879f152a7a01731b75. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:32:32.591652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Getting quotas for user 850787ec4cf94acaa50ad2ee9974e49a and project 377309b0e3c142879f152a7a01731b75. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:32:32.607193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:32:32.609557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:32:32.659301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-24f73021-281b-4220-8a6a-de9d36ec7c5e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817104 Oct 13 09:32:32.660517 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3433/7264] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:32:32.672314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-609fcb7c-641d-41d9-abba-d4529c7a5c45 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:32.673040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-609fcb7c-641d-41d9-abba-d4529c7a5c45 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:32.676183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:32.684844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:32.743678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-609fcb7c-641d-41d9-abba-d4529c7a5c45 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:32.751681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-609fcb7c-641d-41d9-abba-d4529c7a5c45 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1215 microversion: 2.1 time: 0.083596 Oct 13 09:32:32.752342 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3832/7265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:32 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:33.775935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:33.776578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:33.787144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:33.787482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:33.788264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:33.789164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:33.789646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:33.790323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:33.860447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:33.868752 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d37d707-cec4-47d2-9125-3a966cb0d3ff tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1285 microversion: 2.1 time: 0.097162 Oct 13 09:32:33.869540 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3434/7266] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:33 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:34.891922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:34.892708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:34.901449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:34.902050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:34.902619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:34.903399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:34.903927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:34.904432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:35.132443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:35.141013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d20371dc-ba19-4410-a373-8f37e76e809d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.253117 Oct 13 09:32:35.142039 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3833/7267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:34 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:35.323174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:35.334284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:35.334979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:35.336087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:35.349042 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] Creating event network-changed:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h1-858384-11 Oct 13 09:32:35.354983 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ed8b5cfb-85ff-4d2c-b67b-eb991decd5c9 req-7a419c9f-01ec-41a4-be09-06922d4b52b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037066 Oct 13 09:32:35.356045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3435/7268] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:36.165554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:36.166177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:36.173016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:36.173503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:36.173951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:36.174681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:36.175199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:36.175634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:36.304705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:36.312719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95f4c2ef-69d1-4a13-8ad7-8ba5449f2ac9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.151106 Oct 13 09:32:36.313307 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3834/7269] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:36 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:37.337435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:37.338156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:37.344418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:37.344916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:37.345379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:37.346079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:37.346577 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:37.347506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:37.486093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:37.493958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5bcb0265-61e4-436c-9483-198379dbf670 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.161690 Oct 13 09:32:37.494577 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3436/7270] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:37 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:38.516655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:38.517274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:38.524102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:38.524587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:38.525027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:38.525725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:38.526183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:38.526639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:38.660975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:38.668659 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-531682b2-63d5-4198-beec-8ee29a518e1d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.155946 Oct 13 09:32:38.669235 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3835/7271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:38 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:39.692251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:39.692913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:39.699857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:39.700353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:39.700808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:39.701512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:39.702055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:39.702524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:39.828873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:39.836563 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78405307-1a9a-4fe6-84a4-6fea359d286e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.148786 Oct 13 09:32:39.837133 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3437/7272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:39 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:40.859813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:40.860488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:40.867882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:40.868365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:40.868850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:40.869534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:40.870034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:40.870560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:40.958157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "name": "network-vif-plugged", "status": "completed", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:40.967643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:40.968155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:40.968592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:40.979927 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] Creating event network-vif-plugged:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h1-858384-11 Oct 13 09:32:40.985009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-de544bb4-d75a-4943-be3e-2c60bdde0aed req-73d93341-4ebd-4c98-82bb-5411c2d8e1bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085808 Oct 13 09:32:40.985676 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3438/7273] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:32:41.013477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:41.016462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:41.025832 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3862c6f6-28bd-4fcd-9922-1fff74c26e20 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.170130 Oct 13 09:32:41.026436 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3836/7274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:40 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:42.050310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:42.051052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:42.057541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:42.058088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:42.058504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:42.059207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:42.059673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:42.060111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:42.198175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:42.211725 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a2bcf04-30da-4619-86fe-bdfb0d23ecb0 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1315 microversion: 2.1 time: 0.166535 Oct 13 09:32:42.212359 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3439/7275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:42 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:43.235382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:43.235992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:43.239364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.240153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.246429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.246920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.247354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.248042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.248490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.248914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.378349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:43.386621 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89e7c95f-8794-4d39-a79c-f37109a91de9 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1502 microversion: 2.1 time: 0.155488 Oct 13 09:32:43.387183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3837/7276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:43 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:43.408836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:32:43.411189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:43.413152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.413820 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=10 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.415406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.422026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.422551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.423003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.423706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.424174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.424613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.430413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=78 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:32:43.454279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:43.459655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:32:43.465982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:32:43.466436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:32:43.466922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:32:43.467340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:32:43.467761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:32:43.530670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1f95c5e2-79f8-437b-8d06-af28fcd61444 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "POST /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848/action" status: 202 len: 0 microversion: 2.1 time: 0.125683 Oct 13 09:32:43.531344 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3440/7277] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:32:43 2022] POST /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:32:43.539621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:43.540231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:43.546098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.546616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.547054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.547743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:43.548196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:43.548617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:43.716338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:43.725247 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c557f6d-c563-4d01-9ec4-622e7d058a32 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1511 microversion: 2.1 time: 0.189616 Oct 13 09:32:43.725871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3838/7278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:43 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:44.749751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:44.750380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:44.757950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:44.758476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:44.758933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:44.759646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:44.760118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:44.760560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:44.894906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:44.902929 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f173c8d8-78c5-41b0-8afa-c02a4055c0c5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1511 microversion: 2.1 time: 0.157886 Oct 13 09:32:44.903443 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3441/7279] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:44 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:45.925421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:45.927318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:45.935236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:45.935724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:45.936161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:45.936952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:45.937405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:45.937835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:46.070458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:46.078100 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e07d605-f097-46ea-bd7a-7c723d6aef1b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.156583 Oct 13 09:32:46.078707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3839/7280] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:45 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:47.102101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:47.103457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:47.111034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:47.111534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:47.111986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:47.112701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:47.113167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:47.113636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:47.248199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:47.257861 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-23946b9d-d8c1-4ab4-a989-343370f3b6e2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.160326 Oct 13 09:32:47.258983 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3442/7281] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:47 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:48.281331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:48.281949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:48.289008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:48.289498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:48.289950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:48.290692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:48.291156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:48.291590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:48.428593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:48.436521 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9940f5e0-d495-44ea-92c8-9c1bfd17b558 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.159291 Oct 13 09:32:48.437105 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3840/7282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:48 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:49.460702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:49.461331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:49.468223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:49.468723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:49.469176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:49.469886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:49.470353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:49.470818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:49.600412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:49.608372 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eed91a38-1969-47b7-823f-1be572fcedf2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.152183 Oct 13 09:32:49.608949 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3443/7283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:49 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:50.631278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:50.631873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:50.638682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:50.639162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:50.639596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:50.640285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:50.640740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:50.641180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:50.772910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:50.780603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3d8e1c9-ab9e-4f79-bbd1-b50b68e3604e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.153277 Oct 13 09:32:50.781170 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3841/7284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:50 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:51.804399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:51.804935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:51.811757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:51.812251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:51.812720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:51.813402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:51.813864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:51.814301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:51.940969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:51.949215 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df133f5a-6fd7-42fb-b7ec-297766eecc42 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.148914 Oct 13 09:32:51.949798 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3444/7285] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:51 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:52.972493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:52.973110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:52.980176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:52.980662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:52.981099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:52.981794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:52.982251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:52.982704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:53.363195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:53.371398 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f1832f2-9d5e-4431-b887-315e9e4677b4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.402769 Oct 13 09:32:53.371976 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3842/7286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:52 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:54.394726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:54.395963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:54.403584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:54.404081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:54.404529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:54.405233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:54.405697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:54.406136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:54.537493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:54.545318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e344043e-f36e-4ee4-a3bc-2805e746095d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.154546 Oct 13 09:32:54.545892 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3445/7287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:54 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:55.568066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:55.568682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:55.575560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:55.576047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:55.576486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:55.577178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:55.577634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:55.578065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:55.708561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:55.716873 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-329c5f34-738e-418c-8f8e-25353ccfb24f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.152723 Oct 13 09:32:55.717438 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3843/7288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:55 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:56.740230 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:56.740883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:56.748411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:56.748913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:56.749368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:56.750079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:56.750601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:56.751050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:56.876588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:56.884226 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d92e4f7-cd61-4761-aad5-14727cc0f6bd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.147988 Oct 13 09:32:56.884809 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3446/7289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:56 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:57.908413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:57.909026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:57.916070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:57.916552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:57.916986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:57.917672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:57.918123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:57.918581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:58.046850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:58.054534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4cd1fa0f-8a5d-44c8-92cc-f44f2f77234f tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.150405 Oct 13 09:32:58.055103 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3844/7290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:57 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:32:59.077227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:32:59.077860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:32:59.085282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:59.085781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:59.086233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:59.086973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:32:59.087446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:32:59.087887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:32:59.212390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:32:59.220104 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dd8a1a0b-1351-4e39-be35-8c8b4ec45ca7 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.146852 Oct 13 09:32:59.220684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3447/7291] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:32:59 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:00.243757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:00.244302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:00.251192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:00.251679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:00.252149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:00.252843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:00.253300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:00.253729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:00.382930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:00.390605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce1efb2b-2fc8-446d-9ba8-a2774e5c9cc5 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.150825 Oct 13 09:33:00.391174 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3845/7292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:00 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:01.415054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:01.415686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:01.422725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:01.423228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:01.423685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:01.424415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:01.424895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:01.425337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:01.559937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:01.567736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ae5ba404-7d25-4169-9780-9db9863d4b41 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.157363 Oct 13 09:33:01.568330 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3448/7293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:01 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:02.589654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:02.590294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:02.596704 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:02.597226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:02.597663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:02.598366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:02.598870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:02.599275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:02.729241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:02.737081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b6c173a-075e-4f92-b69d-0026c81525e4 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.151386 Oct 13 09:33:02.737655 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3846/7294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:02 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:03.761617 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:03.762243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:03.769062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:03.769557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:03.770007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:03.770732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:03.771196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:03.771634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:03.899147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:03.906837 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f53da91d-8519-4838-b28f-487be27192f6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.149119 Oct 13 09:33:03.907415 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3449/7295] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:03 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:04.930219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:04.930784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:04.937668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:04.938149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:04.938617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:04.939329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:04.939766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:04.940194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:05.073697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:05.081549 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cc579aa1-baba-48d9-87d7-fbf259d52d4e tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.155246 Oct 13 09:33:05.082123 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3847/7296] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:04 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:06.105216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:06.105846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:06.113119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:06.113620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:06.114071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:06.114803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:06.115275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:06.115718 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:06.246633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:06.254317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0578ad03-c9f5-4254-a5f6-e8fe14ef5ba2 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.153940 Oct 13 09:33:06.254925 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3450/7297] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:06 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:07.278004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:07.278671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:07.285556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:07.286034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:07.286499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:07.287188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:07.287673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:07.288086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:07.419441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:07.427250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-122ee9ab-099a-40bd-8552-944786d74985 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.153259 Oct 13 09:33:07.427826 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3848/7298] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:07 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:08.450259 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:08.450953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:08.459148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:08.459662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:08.460120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:08.460859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:08.461333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:08.461781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:08.593152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:08.601037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bfeb57bc-5dc5-463b-a3a2-192252e5bacd tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.154838 Oct 13 09:33:08.601629 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3451/7299] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:08 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:09.625017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:09.625628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:09.633121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:09.634186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:09.634649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:09.635350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:09.635812 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:09.636230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:09.761859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:09.769533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7aa5036c-04ba-4b6a-8c58-3784e40e6e1c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.148413 Oct 13 09:33:09.770099 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3849/7300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:09 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:10.792541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:10.793180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:10.799361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:10.799867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:10.800325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:10.801034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:10.801513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:10.801963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:10.931748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:10.941318 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-80c1252f-a8ae-4883-bf8c-4d3d5f45fc09 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.152728 Oct 13 09:33:10.942170 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3452/7301] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:10 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:11.966998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:11.967609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:11.974385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:11.974889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:11.975326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:11.976019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:11.976469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:11.976904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:12.112864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:12.120571 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-07c10e7a-848c-4060-87d2-5170c793619b tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1516 microversion: 2.1 time: 0.157460 Oct 13 09:33:12.121185 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3850/7302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:11 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:13.144629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:13.145922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:13.156951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:13.157773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:13.158238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:13.159010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:13.159483 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:13.159936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:13.296168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:13.304591 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3894236e-7938-494d-9d1d-bbad6cb3257c tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1515 microversion: 2.1 time: 0.164021 Oct 13 09:33:13.305185 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3453/7303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:13 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:13.381011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "name": "network-vif-unplugged", "status": "completed", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:13.390327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=28 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:13.396539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:13.397041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:13.397481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:13.402591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=86 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:13.411812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Creating event network-vif-unplugged:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h2-858384-11 Oct 13 09:33:13.417614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:33:13.428807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ac43021c-cac5-44f9-b066-7c8429cd8443 req-b1724180-8f22-43b0-a519-1dac418cceeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051526 Oct 13 09:33:13.429585 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3851/7304] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:33:14.328284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:14.328945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:14.331676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=32 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:14.337668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:14.338173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:14.338658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:14.339380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:14.339852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:14.340296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:14.344571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:14.479001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:14.482292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18b74933-0bac-4b48-8cc2-ecc39c56f02d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1515 microversion: 2.1 time: 0.157876 Oct 13 09:33:14.482933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3454/7305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:14 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:15.506838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:15.507552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:15.514206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:15.514727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:15.515171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:15.515861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:15.516318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:15.516746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:15.650452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:15.658150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28bb9307-016e-4ccb-aa20-5f188e8e0da1 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1513 microversion: 2.1 time: 0.156659 Oct 13 09:33:15.658757 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3852/7306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:15 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:15.674190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:15.684075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:15.684568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:15.685013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:15.699740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Creating event network-changed:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h2-858384-11 Oct 13 09:33:15.705231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:33:15.716414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-bc63ec3c-92ff-4bef-855e-b3d2a3b00a80 req-7d606dc5-5d23-485e-bc48-6ae3f9c7299e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045821 Oct 13 09:33:15.717026 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3455/7307] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:33:16.680823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:16.681446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:16.688522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:16.689015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:16.689460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:16.690168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:16.690666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:16.691102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:16.819143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:16.826833 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0480ed84-4fb5-4510-b2e8-648d4402cce6 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1513 microversion: 2.1 time: 0.149992 Oct 13 09:33:16.827408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3853/7308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:16 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:17.851852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:17.852575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:17.859552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:17.860055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:17.860513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:17.861226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:17.861700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:17.862145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:17.996122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:18.004022 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea25485e-24b0-4d3c-9833-02f68a19383a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1510 microversion: 2.1 time: 0.157457 Oct 13 09:33:18.004595 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3456/7309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:17 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:18.025831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:18.026346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:18.033237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:18.033715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:18.034151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:18.034874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:18.035324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:18.035749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:18.066095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:33:18.115624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.compute.api [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Found an unconfirmed migration during delete, id: 16, status: finished Oct 13 09:33:19.483582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af8e0838-3b84-4ee6-9f6e-dbf9077ffc8d tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 204 len: 0 microversion: 2.1 time: 1.461418 Oct 13 09:33:19.484511 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3854/7310] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:33:18 2022] DELETE /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 0 bytes in 1463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:33:19.492918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:19.493543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:19.501074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:19.501566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:19.502014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:19.502740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:19.503205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:19.503646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:19.631668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:19.639683 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83cafb16-d101-4650-b27e-207e195f2221 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1502 microversion: 2.1 time: 0.150880 Oct 13 09:33:19.640271 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3457/7311] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:19 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:19.767641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "name": "network-vif-plugged", "status": "completed", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:19.778311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:19.778827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:19.779263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:19.790231 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] Creating event network-vif-plugged:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h2-858384-11 Oct 13 09:33:19.795527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-f51eb62d-3832-4111-9fcc-5ee8a95be768 req-fbf97293-7df3-455b-98e2-240a46ddde16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031977 Oct 13 09:33:19.796127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3855/7312] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:33:20.663219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:20.663846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:20.670664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:20.671163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:20.671612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:20.672310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:20.672779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:20.673215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:20.803699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850787ec4cf94acaa50ad2ee9974e49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377309b0e3c142879f152a7a01731b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:20.811993 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b666555f-f732-4fce-9618-94851dcc4084 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 200 len: 1502 microversion: 2.1 time: 0.152730 Oct 13 09:33:20.812566 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3458/7313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:20 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:21.565794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e5202a-4b03-4462-a81c-a6f35feb6848", "name": "network-vif-deleted", "tag": "03d5606a-b214-49bc-96b7-2560d48cc23f"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:21.576233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.576801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.577306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.589306 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] Creating event network-vif-deleted:03d5606a-b214-49bc-96b7-2560d48cc23f for instance 82e5202a-4b03-4462-a81c-a6f35feb6848 on n-h2-858384-11 Oct 13 09:33:21.594179 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b98bb1c5-636b-4b2e-b1fc-b819f64a9a1b req-6a8c0dbc-d89d-404c-b064-4c629ced173f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Oct 13 09:33:21.594803 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3856/7314] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:33:21.834306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:21.835205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:21.843349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.843854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.844309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.845030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.845493 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.845931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.860892 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] HTTP exception thrown: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Request method failure captured: Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 HTTP/1.1 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9svlmlQJlvFxFEvgkbz-1sBdNhYIftAsYX-l4jJTk-_PsgsZmh5k8EkRZT9XcU35qQfpCbUcXyLpsILOgGXWk6653HeAXw-hOlr68lzGYaHA8xdHdQIBinEmfb21N7rmeUZ8YPYx10vLIFSoqDD1SMFtPsJoYcehjacq33U5alUTMM Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_377309b0e3c142879f152a7a01731b75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 850787ec4cf94acaa50ad2ee9974e49a Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '82e5202a-4b03-4462-a81c-a6f35feb6848'} Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.862645 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Returning 404 to user: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85ab3a56-f2e4-48cc-8cbb-9ba95666ae05 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 404 len: 111 microversion: 2.1 time: 0.033781 Oct 13 09:33:21.867600 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3459/7315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:21 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:33:21.886827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:21.887747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:21.894366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.894947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.895390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.896098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.896557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.896984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.910885 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] HTTP exception thrown: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Request method failure captured: Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 HTTP/1.1 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9svlmlQJlvFxFEvgkbz-1sBdNhYIftAsYX-l4jJTk-_PsgsZmh5k8EkRZT9XcU35qQfpCbUcXyLpsILOgGXWk6653HeAXw-hOlr68lzGYaHA8xdHdQIBinEmfb21N7rmeUZ8YPYx10vLIFSoqDD1SMFtPsJoYcehjacq33U5alUTMM Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_377309b0e3c142879f152a7a01731b75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 850787ec4cf94acaa50ad2ee9974e49a Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '82e5202a-4b03-4462-a81c-a6f35feb6848'} Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:33:21.912613 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Returning 404 to user: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05c95a5f-bd96-46ad-bd62-0ec346734533 tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 404 len: 111 microversion: 2.1 time: 0.032717 Oct 13 09:33:21.917007 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3857/7316] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:33:21 2022] DELETE /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:33:21.922667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:21.923302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] [instance: 82e5202a-4b03-4462-a81c-a6f35feb6848] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:21.929709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.930197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.930671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.931388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:21.932396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:21.932835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:21.947115 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] HTTP exception thrown: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Request method failure captured: Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 HTTP/1.1 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9svlmlQJlvFxFEvgkbz-1sBdNhYIftAsYX-l4jJTk-_PsgsZmh5k8EkRZT9XcU35qQfpCbUcXyLpsILOgGXWk6653HeAXw-hOlr68lzGYaHA8xdHdQIBinEmfb21N7rmeUZ8YPYx10vLIFSoqDD1SMFtPsJoYcehjacq33U5alUTMM Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_377309b0e3c142879f152a7a01731b75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/377309b0e3c142879f152a7a01731b75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 377309b0e3c142879f152a7a01731b75 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-DeleteServersTestJSON-837971952 Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 850787ec4cf94acaa50ad2ee9974e49a Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-DeleteServersTestJSON-837971952-project Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '82e5202a-4b03-4462-a81c-a6f35feb6848'} Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:33:21.949535 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] Returning 404 to user: Instance 82e5202a-4b03-4462-a81c-a6f35feb6848 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18f8beeb-79c8-4b2f-8093-48f4d506ca2a tempest-DeleteServersTestJSON-837971952 tempest-DeleteServersTestJSON-837971952-project] 10.222.0.23 "GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848" status: 404 len: 111 microversion: 2.1 time: 0.032322 Oct 13 09:33:21.957599 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3460/7317] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:21 2022] GET /compute/v2.1/servers/82e5202a-4b03-4462-a81c-a6f35feb6848 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:33:30.492010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1404257987", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "5e59be2e-c321-4c32-a5ea-f84bf25623c1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:30.550342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] validate_networks() for [('5e59be2e-c321-4c32-a5ea-f84bf25623c1', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:33:31.013567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:33:31.013981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:33:31.014493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:33:31.014904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:33:31.015707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:33:31.027932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:31.028420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:31.028868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:31.029609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:31.030065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:31.030522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:31.051859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:33:31.057149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for user 60d59d4115204901b6f0022ad633b2e8 and project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:33:31.069316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:33:31.071638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:33:31.118395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-30b93a63-627a-4bbc-9482-d6afe0b2db1b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772345 Oct 13 09:33:31.119201 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3858/7318] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:33:31.130463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30e6e104-6ccc-4d2f-bc48-09b8f3daea13 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:31.131100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30e6e104-6ccc-4d2f-bc48-09b8f3daea13 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:31.188779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30e6e104-6ccc-4d2f-bc48-09b8f3daea13 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:31.206507 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30e6e104-6ccc-4d2f-bc48-09b8f3daea13 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1218 microversion: 2.1 time: 0.079858 Oct 13 09:33:31.207622 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3461/7319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:31 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:32.232449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:32.233843 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:32.240712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:32.241524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:32.242252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:32.243218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:32.243944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:32.244590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:32.337214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:32.346134 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3270f3a-a598-4342-a10f-046657aa36cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1278 microversion: 2.1 time: 0.119229 Oct 13 09:33:32.347043 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3859/7320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:32 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:33:33.371218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:33.372498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:33.374653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=31 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:33.382218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:33.382761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:33.383223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:33.383957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:33.385096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:33.385553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:33.533662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:33.542328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77b9af83-3609-429a-bc19-dd3b31cb2418 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.175748 Oct 13 09:33:33.543141 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3462/7321] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:33 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:33.760976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:33.774028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:33.774554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:33.775179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:33.786531 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] Creating event network-changed:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h2-858384-11 Oct 13 09:33:33.793072 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b088176e-3a12-46de-b0fd-dd2546434b90 req-623f2b1a-11bc-4510-bca1-3cb8a2c3eea3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Oct 13 09:33:33.794569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3860/7322] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:33:34.566275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:34.566844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:34.575377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:34.575880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:34.576330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:34.577059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:34.577523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:34.577961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:34.714898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:34.722653 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3acd4056-342d-4885-816a-0b09e6805a34 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.160411 Oct 13 09:33:34.723240 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3463/7323] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:34 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:35.747094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:35.747810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:35.753936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:35.754426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:35.754875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:35.755565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:35.756014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:35.756438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:35.889897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:35.897598 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f3619343-6d96-4ee1-87c4-a43dbb1c3119 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.156213 Oct 13 09:33:35.898172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3861/7324] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:35 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:36.919316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:36.920085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:36.926808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:36.927307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:36.927755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:36.928454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:36.928918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:36.929352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:37.056903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:37.064924 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7eb0a90f-c92a-41fe-9447-25e2e51beadd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.149461 Oct 13 09:33:37.065624 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3464/7325] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:36 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:38.089253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:38.089871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:38.096984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:38.097470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:38.097907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:38.098635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:38.099101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:38.099532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:38.228090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:38.236282 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-27b05669-5611-4ebc-b676-92566f8917b4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.151601 Oct 13 09:33:38.236876 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3862/7326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:38 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:39.258769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:39.259439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:39.266311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:39.266833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:39.267284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:39.267986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:39.268448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:39.268882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:39.399269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:39.407602 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-019265ed-c879-4887-98ca-573dbc61a641 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.152834 Oct 13 09:33:39.408176 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3465/7327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:39 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:39.887291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "name": "network-vif-plugged", "status": "completed", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:39.898299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:39.898825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:39.899270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:39.910663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] Creating event network-vif-plugged:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h2-858384-11 Oct 13 09:33:39.915711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-cdf9c0d2-f770-4128-8237-368db2cd933c req-336bb5b8-5047-4c68-b925-a21ed8adcfea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032813 Oct 13 09:33:39.916518 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3863/7328] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:33:40.430713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:40.431956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:40.438184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:40.438703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:40.439176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:40.439879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:40.440341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:40.440778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:40.567312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:40.575093 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-618f861c-05a0-4858-9b94-1d5d946106c4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1318 microversion: 2.1 time: 0.148329 Oct 13 09:33:40.575670 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3466/7329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:40 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:41.599301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:41.600008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:41.602839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:41.603581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:41.610139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.610642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.611078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:41.611768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.612221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.612648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:41.741744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:41.750163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03016554-5313-4ef1-a234-0a0bf70b16d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1508 microversion: 2.1 time: 0.155252 Oct 13 09:33:41.750787 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3864/7330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:41 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:41.772164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:41.772795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:41.774829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:41.781034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.781536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.781992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:41.782737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.783212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.783660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:41.913394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:41.921679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-123b96b8-afa8-4931-ae18-70471f4bb4d0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1508 microversion: 2.1 time: 0.153540 Oct 13 09:33:41.922262 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3467/7331] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:41 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:41.943898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:41.946343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:41.952371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.952857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.953300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:41.953993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:41.954470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:41.954909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.017849 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2530218-7bd8-47fc-a914-a1a6a308c595 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "PUT /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1080 microversion: 2.1 time: 0.077727 Oct 13 09:33:42.020482 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3865/7332] 10.222.0.23 () {60 vars in 1256 bytes} [Thu Oct 13 09:33:41 2022] PUT /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:42.036777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:42.037407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:42.044046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.044552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.045007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.045894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.046176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.046670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.174996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:42.182858 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ec564f28-9c96-4894-b255-58933f0396c7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1506 microversion: 2.1 time: 0.149931 Oct 13 09:33:42.183436 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3468/7333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:42 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:42.204363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:42.204998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:42.211029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.211513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.211961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.213153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.213611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.214068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.340751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:42.348537 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-663597c4-6d85-4b8a-ad28-5c5a241d28cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1506 microversion: 2.1 time: 0.148137 Oct 13 09:33:42.349118 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3866/7334] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:42 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:42.370966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:33:42.373285 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:42.379249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.379749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.380205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.380913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.381382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.381824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.411346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:42.417611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:33:42.424213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:33:42.424687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:33:42.425174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:33:42.425598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:33:42.426026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:33:42.489236 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b54bed53-2b39-430d-991f-8cb9033c0dc4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be/action" status: 202 len: 0 microversion: 2.1 time: 0.122139 Oct 13 09:33:42.491182 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3469/7335] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:33:42 2022] POST /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:33:42.498279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:42.499075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:42.505007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.505492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.505925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.506653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:42.507107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:42.507532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:42.684045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:42.691908 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f7174dc-374c-49f3-9d55-f12907ebfefc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1517 microversion: 2.1 time: 0.197691 Oct 13 09:33:42.692665 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3867/7336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:42 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:43.717061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:43.717688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:43.728570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:43.729345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:43.729800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:43.730545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:43.731018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:43.731464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:43.860590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:43.868748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8df27e73-9d49-487c-b6d6-e969d998b4da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1517 microversion: 2.1 time: 0.156246 Oct 13 09:33:43.869519 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3470/7337] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:43 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:44.891241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:44.891846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:44.894810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:44.900602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:44.901131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:44.901521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:44.902209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:44.902687 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:44.903114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:44.908013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:45.037296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:45.045686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c75fa7c5-6433-4e9b-b633-d0be4dedd2bd tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.158317 Oct 13 09:33:45.046263 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3868/7338] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:44 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:46.069157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:46.069790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:46.072609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=40 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:33:46.077857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:46.078359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:46.078841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:46.079548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:46.080019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:46.080462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:46.214709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:46.222509 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a00fe778-e0a6-4fa4-a555-ab06e872d187 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.157312 Oct 13 09:33:46.223089 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3471/7339] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:46 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:47.245701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:47.246238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:47.253122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:47.253607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:47.254050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:47.254783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:47.255240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:47.255669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:47.383071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:47.390720 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cf797b7-c067-40b5-be65-e790d3bd1499 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.149643 Oct 13 09:33:47.391289 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3869/7340] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:47 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:33:48.416452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:48.417070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:48.423641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:48.424145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:48.424576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:48.425279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:48.425743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:48.426188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:48.561012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:48.568761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8149a281-ecfa-4f07-9cae-17f4d3d76a47 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.156405 Oct 13 09:33:48.569344 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3472/7341] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:48 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:49.591805 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:49.592450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:49.599360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:49.599847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:49.600289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:49.600988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:49.601446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:49.601971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:49.776662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:49.784569 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e6812ef1-90d2-4187-9149-52e00df43567 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.196730 Oct 13 09:33:49.785149 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3870/7342] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:49 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:50.807613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:50.808240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:50.815279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:50.815770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:50.816225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:50.816944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:50.817407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:50.817840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:50.950038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:50.957771 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3bc9962-4cb0-42cb-bb8f-f25c3c798018 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.154157 Oct 13 09:33:50.958347 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3473/7343] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:50 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:51.981914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:51.982488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:51.989417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:51.989896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:51.990333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:51.991047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:51.991503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:51.991926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:52.121609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:52.129349 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4c826a52-d1c9-4bed-8125-d347389b78da tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.152328 Oct 13 09:33:52.129920 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3871/7344] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:51 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:53.153529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:53.154159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:53.161185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:53.161681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:53.162132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:53.162874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:53.163344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:53.163782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:53.293871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:53.301670 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-89ba80ef-0c1f-4d4d-90e7-dd43bdca084a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.152776 Oct 13 09:33:53.302242 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3474/7345] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:53 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:54.325899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:54.326470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:54.333433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:54.333920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:54.334364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:54.335090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:54.335546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:54.335976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:54.466071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:54.473900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-336cdc08-9745-4663-924c-4165d0847f95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.152671 Oct 13 09:33:54.474489 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3872/7346] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:54 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:55.497439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:55.498069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:55.504920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:55.505413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:55.505859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:55.506597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:55.507063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:55.507499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:55.635489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:55.643164 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ebca710e-5c41-41d1-bbab-80e0f07d27cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.149725 Oct 13 09:33:55.643736 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3475/7347] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:55 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:56.665931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:56.666576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:56.673350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:56.673836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:56.674281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:56.675000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:56.675455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:56.675888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:56.811657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:56.819350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9eafe46c-0709-4d33-9999-0bfffc4cbf02 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.157952 Oct 13 09:33:56.819934 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3873/7348] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:56 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:57.842812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:57.843448 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:57.853109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:57.853607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:57.854060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:57.855061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:57.855532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:57.856004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:57.988275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:57.996013 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11b94e4e-bfe4-4fc9-9154-1a57225bb653 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.157161 Oct 13 09:33:57.996597 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3476/7349] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:57 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:33:59.018639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:33:59.019253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:33:59.029129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:59.029611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:59.030048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:59.030781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:33:59.031230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:33:59.031652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:33:59.163546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:33:59.171861 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e5f80d7-a1c8-47d4-a647-db9bb87a93e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.157158 Oct 13 09:33:59.172426 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3874/7350] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:33:59 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:00.194939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:00.195569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:00.202481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:00.202973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:00.203420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:00.204118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:00.204580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:00.205017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:00.209026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:00.334243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:00.342463 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2fda9876-5afe-439f-9a36-c1a6297ae5c8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.151449 Oct 13 09:34:00.343045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3477/7351] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:00 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:01.365697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:01.366318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:01.375844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:01.376333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:01.376780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:01.377481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:01.377945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:01.378375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:01.510877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:01.518579 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebcdcac2-c06e-4790-9c19-2044d2f40f6d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.156749 Oct 13 09:34:01.519162 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3875/7352] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:01 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:02.542252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:02.542913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:02.549674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:02.550168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:02.550650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:02.551352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:02.551815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:02.552252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:02.684359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:02.692117 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-173814ea-811e-4cf3-b1ac-b92c8b4764d8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.153808 Oct 13 09:34:02.692691 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3478/7353] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:02 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:03.716034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:03.716630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:03.722877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:03.723357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:03.723796 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:03.724479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:03.724932 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:03.725355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:03.853541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:03.861627 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-359c10dc-a2ff-4a49-8f19-5afe8b0a17cb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.150211 Oct 13 09:34:03.862211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3876/7354] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:03 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:04.884770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:04.885384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:04.892358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:04.892851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:04.893300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:04.893996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:04.894492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:04.894932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:05.023640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:05.032110 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-01e3ec8e-3a31-4d0c-b88b-1f56bcf7254a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.151247 Oct 13 09:34:05.032685 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3479/7355] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:04 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:06.054744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:06.055371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:06.062875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:06.063371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:06.063821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:06.064522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:06.064984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:06.065419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:06.193369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:06.201097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90b7ea21-edfc-4f30-93d8-641536e7bdf8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.150340 Oct 13 09:34:06.201662 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3877/7356] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:06 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:07.223939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:07.224565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:07.232108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:07.232599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:07.233048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:07.233750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:07.234213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:07.234676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:07.365066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:07.373355 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-65010f7c-b4e7-4d9f-8ef4-299fff990086 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.153317 Oct 13 09:34:07.373931 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3480/7357] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:07 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:08.396251 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:08.396956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:08.404513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:08.405006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:08.405571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:08.406288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:08.406779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:08.407237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:08.542641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:08.550482 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25546e60-d478-4ebf-a1e7-cafb118fe553 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.158312 Oct 13 09:34:08.551064 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3878/7358] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:08 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:09.574152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:09.574811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:09.581582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:09.582072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:09.582546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:09.583247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:09.583709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:09.584144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:09.713119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:09.720866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a7b4361-18c8-4ae8-92a4-c145b4df15f8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.151097 Oct 13 09:34:09.721442 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3481/7359] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:09 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:10.743759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:10.744357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:10.751294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:10.751772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:10.752207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:10.752898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:10.753352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:10.753778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:10.880663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:10.888447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-acf6227d-e42e-4e34-82a7-13da1f944c3c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1522 microversion: 2.1 time: 0.148637 Oct 13 09:34:10.889029 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3879/7360] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:10 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:11.866215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "name": "network-vif-unplugged", "status": "completed", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:11.877215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:11.877777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:11.878251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:11.893745 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Creating event network-vif-unplugged:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h1-858384-11 Oct 13 09:34:11.899275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] Instance 50619289-b512-4a2c-b211-34dc8b4500be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:34:11.910594 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-082e3bb5-bab2-4428-bf0a-8e4f988e1590 req-0a59622e-a45a-4600-a519-0917270a7ab4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048202 Oct 13 09:34:11.911555 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3482/7361] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:11.912481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:11.913300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:11.920918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:11.921485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:11.922040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:11.922971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:11.923433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:11.923870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:12.158810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:12.167356 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0bdc42f4-5b6c-4986-9d13-32e278a7070a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1521 microversion: 2.1 time: 0.259193 Oct 13 09:34:12.182707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3880/7362] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:11 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:34:13.193045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:13.193793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:13.201428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:13.201922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:13.202370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:13.203118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:13.203580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:13.204015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:13.333500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:13.341215 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b64d06b3-890a-4d8d-a354-c6562ebe4ffc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1519 microversion: 2.1 time: 0.152444 Oct 13 09:34:13.341784 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3483/7363] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:13 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:13.935319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:13.945572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:13.946587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:13.947023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:13.958365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Creating event network-changed:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h1-858384-11 Oct 13 09:34:13.964234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] Instance 50619289-b512-4a2c-b211-34dc8b4500be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:34:13.975040 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a27ad414-c001-43cd-946e-26f30bb46957 req-c77ff0dc-4ed5-462a-9a87-1616903a0002 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043540 Oct 13 09:34:13.975627 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3881/7364] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:14.364700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:14.365365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:14.372863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.373360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.373808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.374535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.374999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.375436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.512127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:14.520509 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fd75ece7-ac8d-4ab3-826b-2bb36cc2454d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1516 microversion: 2.1 time: 0.159662 Oct 13 09:34:14.521146 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3484/7365] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:14 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:14.544029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:14.544664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:14.551424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.551943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.552389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.553296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.553766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.554193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.618703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0c2c6909-7415-4cc0-bdbc-e1de8fff533b tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be/action" status: 204 len: 0 microversion: 2.1 time: 0.078297 Oct 13 09:34:14.619403 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3882/7366] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:34:14 2022] POST /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:34:14.628291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:14.628936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:14.635727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.636336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.636916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.637904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:14.638798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:14.639273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:14.847120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:14.856227 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c05462ee-2114-4859-a03c-8a6317addcb8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1516 microversion: 2.1 time: 0.232615 Oct 13 09:34:14.856833 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3485/7367] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:14 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:15.881061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:15.881697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:15.883778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=30 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:15.890070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:15.890595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:15.891044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:15.891751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:15.892386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:15.892901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:15.896271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:16.035881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:16.050149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a3e666c-95d5-4964-a073-9ee2ac12e599 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1508 microversion: 2.1 time: 0.174179 Oct 13 09:34:16.051210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3883/7368] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:15 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:16.073637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:16.074288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:16.081321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:16.081813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:16.082262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:16.082989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:16.083453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:16.083889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:16.210679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:16.218354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-047730ae-1c1b-4b60-b2c1-a69666e421b8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1508 microversion: 2.1 time: 0.149199 Oct 13 09:34:16.219025 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3486/7369] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:16 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:16.245115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad17cffa-3dcc-409d-9438-cecc68632b97 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'create', calling method: .version_select at 0x7f53758f7430>, body: {"keypair": {"name": "tempest-keypair-86925746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtaZajWXb4J3Aji3vSZXd4LvOlFheeAS2d/NdEgXnlOBLMmree+vRq6VVbNUadNZCM1I06q2ed7Eojiz2Gm/cUhxqHFk26k2kooVS/wSlym/tqwuRaXFfHXBJVluJs+2w=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:16.260147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ad17cffa-3dcc-409d-9438-cecc68632b97 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:34:16.265299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-ad17cffa-3dcc-409d-9438-cecc68632b97 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for user 60d59d4115204901b6f0022ad633b2e8 and project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:34:16.292347 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad17cffa-3dcc-409d-9438-cecc68632b97 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051755 Oct 13 09:34:16.292938 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3884/7370] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:34:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:17.401803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "name": "network-vif-plugged", "status": "completed", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:17.409085 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=32 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:17.416846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:17.417347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:17.417796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:17.429658 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] Creating event network-vif-plugged:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h1-858384-11 Oct 13 09:34:17.437344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-87620e89-e5ef-43e9-8d78-834a21b756e7 req-77b2c929-082f-411a-aab4-e863bedaa2dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038797 Oct 13 09:34:17.439445 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3487/7371] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:17.692307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:17.692926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:17.699610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:17.700092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:17.700539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:17.701236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:17.701692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:17.702124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:17.828639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:17.836310 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37d45b6a-2166-4316-a96c-911d641088e2 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 200 len: 1508 microversion: 2.1 time: 0.148786 Oct 13 09:34:17.836876 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3885/7372] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:17 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:17.859374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:17.859970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:17.866018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:17.866550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:17.867003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:17.867708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:17.868170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:17.868639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:17.893225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:34:17.969339 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60f40e0f-0fa3-49e0-b90c-a951fb6af768 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 204 len: 0 microversion: 2.1 time: 0.113900 Oct 13 09:34:17.970011 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3488/7373] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:34:17 2022] DELETE /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:34:18.027168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1217390365", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "5e59be2e-c321-4c32-a5ea-f84bf25623c1"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:18.080797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] validate_networks() for [('5e59be2e-c321-4c32-a5ea-f84bf25623c1', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:34:18.450295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:34:18.450750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:34:18.451238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:34:18.451656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:34:18.452076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:34:18.461133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:18.461624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:18.462067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:18.462879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:18.463345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:18.463780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:18.483889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:34:18.490388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Getting quotas for user 60d59d4115204901b6f0022ad633b2e8 and project 4ebc98fc92024e7cbe9e5edc0707e252. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:34:18.505399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:34:18.509105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:34:18.554289 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cfd7b57d-40fb-4014-b920-8d783d3c8381 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531725 Oct 13 09:34:18.554990 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3886/7374] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:34:18.567244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88cfdcc2-5801-4c64-aeb2-a04b14137694 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:18.568119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88cfdcc2-5801-4c64-aeb2-a04b14137694 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:18.628373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88cfdcc2-5801-4c64-aeb2-a04b14137694 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:18.636687 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88cfdcc2-5801-4c64-aeb2-a04b14137694 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1218 microversion: 2.1 time: 0.073789 Oct 13 09:34:18.637270 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3489/7375] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:18 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:19.660410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:19.661356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:19.668352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:19.669076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:19.669514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:19.670219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:19.670774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:19.671202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:19.795485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:19.803772 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8860521-33b7-4e3b-910f-ae6a3884e38f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1270 microversion: 2.1 time: 0.148192 Oct 13 09:34:19.812412 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50619289-b512-4a2c-b211-34dc8b4500be", "name": "network-vif-deleted", "tag": "8199f024-30c0-41b7-bb5b-412c5ebdf1fb"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:19.824030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3887/7376] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:19 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:19.832941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:19.833806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:19.834278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:19.850579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] Creating event network-vif-deleted:8199f024-30c0-41b7-bb5b-412c5ebdf1fb for instance 50619289-b512-4a2c-b211-34dc8b4500be on n-h1-858384-11 Oct 13 09:34:19.856127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9c822e33-7ea6-4b56-a6bd-9fe06768db6c req-bb10ddc1-7cff-4556-be63-d62716373f1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047876 Oct 13 09:34:19.856747 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3490/7377] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:34:20.839158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:20.840085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:20.848005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:20.848495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:20.848937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:20.849650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:20.850100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:20.850556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:20.999400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:21.008517 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5bdcd986-0957-4669-acb9-8d09ba3d42f9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.173420 Oct 13 09:34:21.018857 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3888/7378] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:20 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:21.600499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:21.610362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:21.610885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:21.611337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:21.622181 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] Creating event network-changed:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h1-858384-11 Oct 13 09:34:21.626903 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1165acbe-432a-4b12-ae9a-ffbd87679629 req-8ed3ce9d-a1f9-4026-bbca-536f8cc88b0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088676 Oct 13 09:34:21.627712 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3491/7379] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:22.031013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:22.031649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:22.039188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:22.039683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:22.040127 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:22.040836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:22.041297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:22.041729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:22.169297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:22.177019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1a28434-cbe0-4e7e-84e6-46e9943de264 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.149934 Oct 13 09:34:22.177597 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3889/7380] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:22 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:23.202112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:23.202769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:23.208847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:23.209345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:23.209793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:23.210517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:23.210983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:23.211419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:23.342674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:23.350554 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c500b4a-9f20-4cae-b98c-a35cc761b5d1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.154099 Oct 13 09:34:23.351130 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3492/7381] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:23 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:24.373886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:24.374528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:24.381286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:24.381767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:24.382204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:24.382917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:24.383370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:24.383795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:24.511581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:24.519252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04d8e06a-4930-44fb-9bde-34ba519896a3 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.149369 Oct 13 09:34:24.519818 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3890/7382] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:24 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:34:25.541598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:25.541982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:25.549252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:25.549752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:25.550207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:25.550958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:25.551429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:25.551875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:25.683827 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:25.691660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de30e66b-6622-42cd-94ac-c66268e5604d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.154261 Oct 13 09:34:25.692490 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3493/7383] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:25 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:26.714959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:26.715560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:26.722457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:26.722943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:26.723378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:26.724067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:26.724519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:26.724944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:26.855683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:26.863335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-320dbf63-842e-48c6-9a83-d5c0c8be2d61 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.152263 Oct 13 09:34:26.863907 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3891/7384] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:26 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:27.448327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "name": "network-vif-plugged", "status": "completed", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:27.459451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:27.459951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:27.460401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:27.471996 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] Creating event network-vif-plugged:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h1-858384-11 Oct 13 09:34:27.477157 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-95c99bf5-842d-46d0-b547-bf795e7ba3cd req-0cbeb213-dd6d-4516-88f2-0ad54a7533e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Oct 13 09:34:27.477795 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3494/7385] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:27.886980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:27.887546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:27.894517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:27.894994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:27.895427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:27.896114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:27.896562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:27.896984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:28.024971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:28.033184 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8f70732c-625b-4c82-9cdc-0396eade99bb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1318 microversion: 2.1 time: 0.150744 Oct 13 09:34:28.033773 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3892/7386] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:27 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:29.052993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:29.057186 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:29.057906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:29.064368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.064865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.065319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.066022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.066514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.066958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.198258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:29.205975 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-02401b4f-c2f5-41ae-aaae-28868b142236 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1508 microversion: 2.1 time: 0.154825 Oct 13 09:34:29.206564 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3495/7387] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:29 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:29.228880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:29.229885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:29.231844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:29.232510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=10 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:29.239046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.239533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.239974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.240675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.241130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.241558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.371451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:29.379174 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d082e9fa-f41a-46ea-9278-85231100cedb tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1508 microversion: 2.1 time: 0.154162 Oct 13 09:34:29.379751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3893/7388] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:29 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:29.401469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:29.403830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:29.409830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.410360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.410842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.411545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.412008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.412446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.416532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:29.444434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:29.451030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:34:29.459028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:34:29.459471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:34:29.460052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:34:29.460540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:34:29.461011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:34:29.523508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2e5078ce-f2a7-4e6c-a183-9f0ca08cef95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.126091 Oct 13 09:34:29.524347 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3496/7389] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:34:29 2022] POST /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:34:29.532614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:29.533670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:29.539244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.539800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.540361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.541065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:29.541522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:29.541965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:29.700906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:29.709017 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17b820ae-7dcb-4b85-bfe7-8a3ce84d7456 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1515 microversion: 2.1 time: 0.180539 Oct 13 09:34:29.709676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3894/7390] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:29 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:30.733013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:30.733672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:30.739658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:30.740157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:30.740608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:30.741320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:30.741783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:30.742224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:30.875107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:30.886862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99e06716-1e1d-4260-b1e3-53244395f47d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1515 microversion: 2.1 time: 0.158715 Oct 13 09:34:30.887434 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3497/7391] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:30 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:31.910023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:31.910667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:31.917542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:31.918025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:31.918494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:31.919195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:31.919652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:31.920082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:32.049302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:32.057114 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1baee6e-80d1-4f4d-a52f-2ddaf58eda5c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.151223 Oct 13 09:34:32.057690 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3895/7392] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:31 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:33.080214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:33.080837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:33.088135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:33.088623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:33.089068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:33.089766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:33.090225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:33.090687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:33.218226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:33.225996 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a7688c60-b55a-408e-9e5e-6ceaeac24ab0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.149765 Oct 13 09:34:33.226600 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3498/7393] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:33 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:34.249705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:34.250326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:34.257262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:34.257749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:34.258192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:34.258966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:34.259477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:34.259910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:34.397010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:34.404740 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dcdb4962-8779-4c3a-ba24-e52f30373759 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.158955 Oct 13 09:34:34.405325 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3896/7394] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:34 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:35.428161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:35.428795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:35.435509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:35.436000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:35.436444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:35.437142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:35.437601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:35.438032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:35.568397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:35.576127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-355d52fe-c37c-4f31-ae19-39377e631b91 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.151907 Oct 13 09:34:35.576720 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3499/7395] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:35 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:36.599362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:36.599979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:36.607116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:36.607596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:36.608034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:36.608720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:36.609172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:36.609595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:36.736010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:36.743801 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-03839fd6-cc1c-4861-9f4b-df73078d5638 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.148378 Oct 13 09:34:36.744379 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3897/7396] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:36 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:37.766691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:37.767327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:37.775124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:37.775621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:37.776078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:37.776814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:37.777287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:37.777731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:37.905162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:37.913303 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fcd376a-e6f2-4508-8dfd-c68e95192a95 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.150502 Oct 13 09:34:37.913818 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3500/7397] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:37 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:38.937036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:38.937643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:38.944584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:38.945071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:38.945516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:38.946214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:38.947202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:38.947631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:39.076351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:39.084079 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ada5447a-f2fa-48a6-aa8f-7c2430c1af40 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.151033 Oct 13 09:34:39.084648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3898/7398] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:38 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:40.107490 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:40.108050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:40.114317 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:40.114842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:40.115289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:40.115984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:40.116444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:40.116877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:40.246383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:40.254399 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30bd5be6-dd34-4c21-995b-6f1d42b22de6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.151945 Oct 13 09:34:40.254990 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3501/7399] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:40 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:41.279275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:41.279891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:41.287244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:41.287726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:41.288162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:41.288849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:41.289298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:41.289721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:41.420892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:41.428991 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32c7157b-0123-436a-a0d7-fff010127b93 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.154142 Oct 13 09:34:41.429584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3899/7400] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:41 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:42.451088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:42.451708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:42.458550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:42.459040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:42.459484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:42.460185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:42.460646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:42.461082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:42.591162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:42.598876 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba11de05-68f7-42e7-96c8-20a237c895ca tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.151772 Oct 13 09:34:42.599449 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3502/7401] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:42 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:43.622707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:43.623350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:43.630200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:43.630786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:43.631223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:43.631925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:43.632378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:43.632806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:43.760936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:43.768739 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5009b7e1-b4e8-4069-a0c7-bd56f301b134 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.150492 Oct 13 09:34:43.769320 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3900/7402] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:43 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:44.791536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:44.792162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:44.799017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:44.799514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:44.799968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:44.800674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:44.801143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:44.801584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:44.928261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:44.935984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71327964-808f-450b-b6b6-50c229333059 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.148410 Oct 13 09:34:44.936560 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3503/7403] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:44 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:45.959591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:45.960219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:45.963523 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:45.968981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:45.969471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:45.969918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:45.970657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:45.971122 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:45.971558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:45.976032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:46.106802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:46.114778 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d708cde-b215-4674-9a70-437246dfd114 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.158990 Oct 13 09:34:46.115378 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3901/7404] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:45 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:47.136845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:47.137471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:47.144210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:47.144697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:47.145143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:47.145841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:47.146301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:47.146758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:47.278211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:47.286146 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b5614eb-8434-43a8-ae44-07c6f00b02c9 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.153211 Oct 13 09:34:47.286743 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3504/7405] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:47 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:48.309735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:48.310266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:48.317238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:48.317727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:48.318174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:48.318909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:48.319369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:48.319804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:48.454656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:48.462535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0397d382-7adc-4317-9b78-875ed8cfe272 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.157321 Oct 13 09:34:48.463113 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3902/7406] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:48 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:49.485793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:49.486433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:49.489611 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:34:49.489753 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a (ip 10.222.0.23) !!! Oct 13 09:34:49.491318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:34:49.499692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:49.500224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:49.500672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:49.501377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:49.501848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:49.502277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:49.636011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:49.643886 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88e7035b-928d-4783-9fa1-9b6a74a55ed1 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.162075 Oct 13 09:34:49.644469 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3505/7407] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:49 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:50.667191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:50.667746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:50.675062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:50.675545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:50.675984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:50.676682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:50.677137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:50.677562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:50.809593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:50.817844 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9af22133-b6b4-44d0-92c2-0f6b03695417 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.155090 Oct 13 09:34:50.818441 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3903/7408] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:50 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:51.841287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:51.841916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:51.849164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:51.849653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:51.850157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:51.850929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:51.851394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:51.851829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:51.991372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:51.999155 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-962b5019-07d7-4857-9b6e-49cd6b92e420 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.162722 Oct 13 09:34:51.999724 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3506/7409] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:51 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:53.022055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:53.022682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:53.029672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:53.030157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:53.030633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:53.031335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:53.031791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:53.032221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:53.163383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:53.171658 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f31cd6ae-2564-4f34-81f9-cfc9a3709095 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.153561 Oct 13 09:34:53.172234 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3904/7410] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:53 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:54.194993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:54.195623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:54.203151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:54.203647 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:54.204098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:54.204805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:54.205270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:54.205709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:54.331021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:54.339457 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a1c19be9-95d9-42b4-bd7b-508dfe67653c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.148064 Oct 13 09:34:54.340047 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3507/7411] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:54 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:55.364046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:55.364663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:55.371570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:55.372069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:55.372490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:55.373176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:55.373627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:55.374050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:55.501977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:55.510335 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fb436bf0-48f4-4439-b376-52cdec5b7fb4 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.150174 Oct 13 09:34:55.510935 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3905/7412] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:55 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:56.533213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:56.533838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:56.541415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:56.541908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:56.542356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:56.543087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:56.543584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:56.544057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:56.676593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:56.684330 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-81b45ad5-7160-4a8a-9a86-542ac211f132 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.155089 Oct 13 09:34:56.684909 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3508/7413] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:56 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:57.707585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:57.708204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:57.715724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:57.716212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:57.716651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:57.717347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:57.717804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:57.718237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:57.847662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:57.855700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab950a78-0c6e-46ae-9f91-908894e28e6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1520 microversion: 2.1 time: 0.152057 Oct 13 09:34:57.856281 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3906/7414] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:57 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:34:58.671779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:34:58.681729 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:58.682223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:58.682698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:58.694486 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Creating event network-vif-unplugged:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h2-858384-11 Oct 13 09:34:58.699831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] Instance c2511456-ad8a-4666-9030-23f9a1da0e7a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:34:58.710980 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c69e310c-952f-41d7-b7d8-2f1780b228ed req-5b375108-988c-40ba-9f74-a1271d2c36ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042933 Oct 13 09:34:58.712249 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3509/7415] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:34:58.878550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:34:58.879213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:34:58.886096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:58.886604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:58.887051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:58.887759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:34:58.888223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:34:58.888657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:34:59.028006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:34:59.036161 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36d53254-8d97-41da-b9ba-c68c60972ff6 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1519 microversion: 2.1 time: 0.161597 Oct 13 09:34:59.036761 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3907/7416] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:34:58 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:00.060966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:00.061679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:00.067896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:00.068392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:00.068844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:00.069551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:00.070022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:00.070495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:00.074466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:00.199359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:00.207133 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5de53824-11e9-43dd-aa73-5b61bfff6756 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1517 microversion: 2.1 time: 0.151421 Oct 13 09:35:00.207711 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3510/7417] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:00 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:00.742934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:00.753168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:00.753640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:00.754069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:00.766094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Creating event network-changed:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h2-858384-11 Oct 13 09:35:00.771333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] Instance c2511456-ad8a-4666-9030-23f9a1da0e7a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:35:00.783004 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d542d976-e836-4e68-a756-919c63ed6251 req-becfec16-79f0-4b15-86ee-a42e8843bd42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043675 Oct 13 09:35:00.783601 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3908/7418] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:01.231551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:01.232184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:01.239029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:01.239540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:01.239999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:01.240715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:01.241183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:01.241641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:01.370739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:01.378453 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d62d52e6-efde-495e-b59c-4333e3acc2e0 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1517 microversion: 2.1 time: 0.151791 Oct 13 09:35:01.379028 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3511/7419] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:01 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:02.402789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:02.403496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:02.409711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.410265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.410798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.411502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.411959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.412387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.549185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:02.557606 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9a4aabd7-0d1a-442e-8b3d-51ea059a2990 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1514 microversion: 2.1 time: 0.160070 Oct 13 09:35:02.558194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3909/7420] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:02 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:02.580879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:02.581525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:02.589029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.589519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.589965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.590702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.591166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.591605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.663560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c5c0507-3efc-48cf-a73e-0ebeab1434df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "POST /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a/action" status: 204 len: 0 microversion: 2.1 time: 0.086497 Oct 13 09:35:02.664342 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3512/7421] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:35:02 2022] POST /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:35:02.673520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:02.674242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:02.695835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.696602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.697261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.697986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:02.698471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:02.699088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:02.834617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:02.844208 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e20cde8-8c82-4d53-a372-441ddca4106c tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1514 microversion: 2.1 time: 0.174957 Oct 13 09:35:02.844799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3910/7422] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:02 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:03.869110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:03.869837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:03.876797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:03.877289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:03.877738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:03.878470 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:03.878940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:03.879380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:04.005726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:04.014309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7028a6dd-e4cf-4d58-84d6-d5c7eff5bb7f tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1514 microversion: 2.1 time: 0.150188 Oct 13 09:35:04.015112 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3513/7423] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:03 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:04.200804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "name": "network-vif-plugged", "status": "completed", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:04.214827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:04.215636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:04.216075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:04.228163 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] Creating event network-vif-plugged:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h2-858384-11 Oct 13 09:35:04.235676 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9be5ef8c-2eba-4b58-892c-99c21ed110db req-4fed310a-6370-477c-8e10-fa827660d330 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038778 Oct 13 09:35:04.236656 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3911/7424] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:05.038042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.038788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.046199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.046746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.047203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.047918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.048385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.048824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.179003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:05.187328 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f646341-38fa-4645-865d-342b0ac355df tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1506 microversion: 2.1 time: 0.153296 Oct 13 09:35:05.187918 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3514/7425] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:05 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:05.209940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.210664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.217569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.218055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.218524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.219214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.219667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.220092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.349786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:05.358427 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef5ff615-0d31-4cce-b634-859b6dc0ff3d tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1506 microversion: 2.1 time: 0.152773 Oct 13 09:35:05.359005 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3912/7426] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:05 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:05.379781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.380482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.386297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.386818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.387266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.387961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.388423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.388852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.515569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:05.523274 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-01dd5223-510e-492c-91be-837561591d6a tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1506 microversion: 2.1 time: 0.147296 Oct 13 09:35:05.523844 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3515/7427] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:05 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:05.544679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.545214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.551319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.551743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.552185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.552880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.553340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.553770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.579197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:35:05.652053 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0587145-688e-4cf6-8995-3f27ee2a41f7 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 204 len: 0 microversion: 2.1 time: 0.111009 Oct 13 09:35:05.652666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3913/7428] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:35:05 2022] DELETE /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:35:05.669593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.670106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.676157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.676656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.677110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.677821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.678458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.678831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.704909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:35:05.749740 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.compute.api [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Instance is already in deleting state, ignoring this request Oct 13 09:35:05.750615 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3976d64b-21c5-4379-a495-ef3c38538c36 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 204 len: 0 microversion: 2.1 time: 0.085009 Oct 13 09:35:05.751181 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3516/7429] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:35:05 2022] DELETE /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:35:05.759869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:05.760581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:05.766440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.766919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.767360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.768055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:05.768509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:05.768940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:05.906105 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:05.913900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d8c0e55-6aee-4492-a318-c2ddb87d7fce tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1512 microversion: 2.1 time: 0.158392 Oct 13 09:35:05.914981 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3914/7430] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:05 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:06.937132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:06.937789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:06.945305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:06.945842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:06.946857 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:06.947564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:06.948037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:06.948475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:07.080056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d59d4115204901b6f0022ad633b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc98fc92024e7cbe9e5edc0707e252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:07.087859 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6eccbb0b-5b15-4d9f-aaf4-28ce2fcd477e tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 200 len: 1512 microversion: 2.1 time: 0.154620 Oct 13 09:35:07.088431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3517/7431] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:06 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:35:07.660035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2511456-ad8a-4666-9030-23f9a1da0e7a", "name": "network-vif-deleted", "tag": "c6a6fe93-4530-4313-9551-342ba4581046"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:07.672425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:07.672996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:07.673454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:07.687307 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] Creating event network-vif-deleted:c6a6fe93-4530-4313-9551-342ba4581046 for instance c2511456-ad8a-4666-9030-23f9a1da0e7a on n-h2-858384-11 Oct 13 09:35:07.692202 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7ef9bea9-c117-4d60-8896-12bf542e5a58 req-607fc161-a1d3-4182-b3bc-d45f641dbc15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Oct 13 09:35:07.692792 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3915/7432] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:08.110524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:08.111153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: c2511456-ad8a-4666-9030-23f9a1da0e7a] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:08.118284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.118815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.119263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.120010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.120474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.120913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.134419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] HTTP exception thrown: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Request method failure captured: Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a HTTP/1.1 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9tqR4h4N1aHwsxTgXCbnILUxoQLU84nhXYn2i2BAzFbv9e9S6hcpXnU3EO5N3-SwZuB0q5P0jbb9HDHX-1EWNaI53KOH0vr2gnM9w60u5jMwu1mdH6NBYvBrgrEd37R5jqa4Y0XSf3megYbMJVVwfv8T1JCzlIo8-cpekZ4htCtMcU Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 60d59d4115204901b6f0022ad633b2e8 Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'c2511456-ad8a-4666-9030-23f9a1da0e7a'} Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.136618 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Returning 404 to user: Instance c2511456-ad8a-4666-9030-23f9a1da0e7a could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d77361e-4960-462f-9419-1a5ed5a58ef8 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a" status: 404 len: 111 microversion: 2.1 time: 0.031553 Oct 13 09:35:08.140716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3518/7433] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:08 2022] GET /compute/v2.1/servers/c2511456-ad8a-4666-9030-23f9a1da0e7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:35:08.148317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7e016c70-edfe-4385-b951-a6623f232617 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '.version_select at 0x7f537abb64c0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:08.169091 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7e016c70-edfe-4385-b951-a6623f232617 tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86925746" status: 202 len: 0 microversion: 2.1 time: 0.025012 Oct 13 09:35:08.169669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3916/7434] 10.222.0.23 () {58 vars in 1215 bytes} [Thu Oct 13 09:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86925746 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:35:08.774497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:08.775017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:08.781447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.781954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.782489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.783146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.783622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.784066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.798292 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] HTTP exception thrown: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Request method failure captured: Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be HTTP/1.1 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9tqR4h4N1aHwsxTgXCbnILUxoQLU84nhXYn2i2BAzFbv9e9S6hcpXnU3EO5N3-SwZuB0q5P0jbb9HDHX-1EWNaI53KOH0vr2gnM9w60u5jMwu1mdH6NBYvBrgrEd37R5jqa4Y0XSf3megYbMJVVwfv8T1JCzlIo8-cpekZ4htCtMcU Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 60d59d4115204901b6f0022ad633b2e8 Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '50619289-b512-4a2c-b211-34dc8b4500be'} Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:35:08.799921 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Returning 404 to user: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:35:08.804414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dfd93823-1c6e-4910-9a8d-d31fea3f64af tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 404 len: 111 microversion: 2.1 time: 0.031004 Oct 13 09:35:08.805289 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3519/7435] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:35:08 2022] DELETE /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:35:08.812101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:08.813068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] [instance: 50619289-b512-4a2c-b211-34dc8b4500be] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:08.820173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.820735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.821246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.822017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:08.823116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:08.823626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:08.837149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] HTTP exception thrown: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Request method failure captured: Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be HTTP/1.1 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9tqR4h4N1aHwsxTgXCbnILUxoQLU84nhXYn2i2BAzFbv9e9S6hcpXnU3EO5N3-SwZuB0q5P0jbb9HDHX-1EWNaI53KOH0vr2gnM9w60u5jMwu1mdH6NBYvBrgrEd37R5jqa4Y0XSf3megYbMJVVwfv8T1JCzlIo8-cpekZ4htCtMcU Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ebc98fc92024e7cbe9e5edc0707e252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4ebc98fc92024e7cbe9e5edc0707e252 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-338200969 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 60d59d4115204901b6f0022ad633b2e8 Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerDiskConfigTestJSON-338200969-project Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '50619289-b512-4a2c-b211-34dc8b4500be'} Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:35:08.839631 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] Returning 404 to user: Instance 50619289-b512-4a2c-b211-34dc8b4500be could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd755dd6-e119-4b1e-aeb5-f6be3409febc tempest-ServerDiskConfigTestJSON-338200969 tempest-ServerDiskConfigTestJSON-338200969-project] 10.222.0.23 "GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be" status: 404 len: 111 microversion: 2.1 time: 0.036171 Oct 13 09:35:08.844388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3917/7436] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:08 2022] GET /compute/v2.1/servers/50619289-b512-4a2c-b211-34dc8b4500be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:35:17.372759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-08250811-25d9-4dc5-8c4c-7fdc04b1e104 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: .version_select at 0x7f5376094670>, body: {"keypair": {"name": "tempest-keypair-507031397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSEBogkSQY1Qgv/lHJPIqdUX5tJkZ3KTkwVZgYM6xgZslERhS3nd07N3alIoMD41KWWqYNUTk9pG6KxfF1GrVD/TSOvfxLgBFqVsDhlteAey3acm+2fZQnUgWhj2oD+wg=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:17.389646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-08250811-25d9-4dc5-8c4c-7fdc04b1e104 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:35:17.395284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-08250811-25d9-4dc5-8c4c-7fdc04b1e104 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:35:17.427004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-08250811-25d9-4dc5-8c4c-7fdc04b1e104 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191618 Oct 13 09:35:17.427607 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3520/7437] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:35:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:18.778221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-288923551", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c5844fa-dbd6-43bf-904d-bd3d3f0f634e"}], "security_groups": [{"name": "tempest-securitygroup--1719476033"}], "key_name": "tempest-keypair-507031397", "user_data": "}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:18.787876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:18.828952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:18.885630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] validate_networks() for [('8c5844fa-dbd6-43bf-904d-bd3d3f0f634e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:35:19.258973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:35:19.260512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:35:19.261009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:35:19.261464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:35:19.261890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:35:19.270988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:19.271471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:19.271937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:19.272693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:19.273148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:19.273608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:19.290925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:35:19.296152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:35:19.308502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:35:19.310915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:35:19.358082 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-30e0bb03-f608-41be-9ca1-77bb6bbb0cb6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.584773 Oct 13 09:35:19.359987 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3918/7438] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:35:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:35:19.367703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:19.373097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d4274295-5f55-400a-8236-34215c1429d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:19.373935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d4274295-5f55-400a-8236-34215c1429d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:19.436099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d4274295-5f55-400a-8236-34215c1429d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:19.444204 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d4274295-5f55-400a-8236-34215c1429d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1237 microversion: 2.1 time: 0.078160 Oct 13 09:35:19.445261 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3521/7439] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:19 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:20.469018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:20.469668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:20.476647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:20.477257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:20.477715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:20.478442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:20.478900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:20.479327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:20.544934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:20.552724 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d940331-072c-435f-8fba-485d86958d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1289 microversion: 2.1 time: 0.088428 Oct 13 09:35:20.553451 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3919/7440] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:20 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:21.577223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:21.578214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:21.581074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:21.586898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:21.587424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:21.589798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:21.590777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:21.591256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:21.591704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:21.817959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:21.826456 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5bec98cc-4802-476e-bd63-a71fd5f0f8dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.253406 Oct 13 09:35:21.827042 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3522/7441] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:21 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:22.146446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:22.158333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:22.158957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:22.159469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:22.174192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] Creating event network-changed:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h2-858384-11 Oct 13 09:35:22.182374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-69bcf522-a974-4cb8-83e5-4fbfbe8005b3 req-ceffba30-5790-4773-8cca-a3a5ce0dc601 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040273 Oct 13 09:35:22.183417 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3920/7442] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:22.849033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:22.850374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:22.857425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:22.857951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:22.858475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:22.859191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:22.859716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:22.860220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:22.993218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:23.001518 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3032497-503e-4c68-a91e-2a51a3dbed6d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.156394 Oct 13 09:35:23.002087 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3523/7443] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:22 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:24.025249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:24.025961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:24.032247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:24.032742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:24.033186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:24.033881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:24.034337 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:24.034792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:24.171963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:24.179744 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a45b6ab6-8430-4853-8ef9-606f9cf00c34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.159611 Oct 13 09:35:24.180328 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3921/7444] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:24 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:25.201650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:25.202270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:25.209126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:25.209622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:25.210066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:25.210798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:25.211260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:25.211697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:25.336625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:25.344354 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1ce8cfdb-825a-4188-852e-9afb1574df6e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.146666 Oct 13 09:35:25.344929 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3524/7445] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:25 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:35:26.366532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:26.367157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:26.374483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:26.374971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:26.375415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:26.376111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:26.376573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:26.377001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:26.512400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:26.520109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd2ade0b-a73d-4d8f-a0fd-ff5888e23428 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.157479 Oct 13 09:35:26.520692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3922/7446] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:26 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:27.542621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:27.543239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:27.550126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:27.550650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:27.551099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:27.551799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:27.552265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:27.552703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:27.677930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:27.685781 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-20cc353d-1065-4dcc-b4ea-ac63d170b9f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.147132 Oct 13 09:35:27.686351 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3525/7447] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:27 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:28.278026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "name": "network-vif-plugged", "status": "completed", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:28.288745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:28.289235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:28.289673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:28.301540 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] Creating event network-vif-plugged:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h2-858384-11 Oct 13 09:35:28.306499 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-07bb4c93-970d-477b-ac5b-2b0282ad01de req-4113e2ec-46f8-4655-94ab-c857ca1bbed0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Oct 13 09:35:28.307094 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3923/7448] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:28.709159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:28.709747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:28.716549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:28.717039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:28.717485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:28.718188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:28.718684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:28.719121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:28.845356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:28.853537 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-91aec9de-91ea-4b49-92d4-a05beac48fa2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1363 microversion: 2.1 time: 0.147961 Oct 13 09:35:28.854100 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3526/7449] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:28 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:29.873106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:29.874826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:29.880230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:29.881223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:29.891112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:29.891587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:29.892021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:29.892719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:29.893170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:29.893595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:30.037847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:35:30.045746 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1ca9d8ed-980b-4170-affd-cfbdf14defac tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1550 microversion: 2.1 time: 0.173619 Oct 13 09:35:30.046320 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3924/7450] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:35:29 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:35:30.067947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:35:30.068459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:35:30.071460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:35:30.076724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:30.077218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:30.077728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:30.078377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:30.078888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:30.079320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:30.158759 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df5b3a86-cfb3-483a-860b-26505bb8beb9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094650 Oct 13 09:35:30.159357 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3527/7451] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:35:30 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:35:31.375078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:35:31.385236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:35:31.385718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:35:31.386152 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:35:31.397371 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] Creating event network-changed:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h2-858384-11 Oct 13 09:35:31.402617 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-470b8516-08b0-4b8a-9bc9-0d3957b403af req-16fe1c72-fa93-428b-9e09-0dbbfbd64052 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Oct 13 09:35:31.403211 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3925/7452] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:36:36.104353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=11 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:36.105922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:36.112002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:36.112656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:36.119398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.119899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.120352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.121058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.121526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.121966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.253552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:36.261309 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4439d059-fc68-480e-986b-7e84e9fe6215 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.159457 Oct 13 09:36:36.261880 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3528/7453] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:36 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:36.282212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:36.282975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:36.288209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:36.288908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:36.297388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.297870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.298301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.299011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.299467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.299895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.428355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:36.436099 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ae869379-9cb8-4c12-99e6-a0dc35cd1434 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.156748 Oct 13 09:36:36.436669 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3926/7454] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:36 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:36.458388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:36.459006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:36.465041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.465533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.465982 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.466715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.467191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.467630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.593905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:36.601857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a395278a-f13b-45b0-a72e-6b30e25b96f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.147444 Oct 13 09:36:36.602731 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3529/7455] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:36 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:36.624953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:36.627239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:36.633727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.634212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.634671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.635387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.635835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.636259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.665008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:36.670594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Old instance type m1.heat2, new instance type m1.heat {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:36:36.678431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:36:36.678846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:36:36.679321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:36:36.679730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:36:36.680141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:36:36.743159 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c1910f0-d868-46f9-9173-6c40d716d625 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/action" status: 202 len: 0 microversion: 2.1 time: 0.122018 Oct 13 09:36:36.743700 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3927/7456] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:36:36 2022] POST /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:36:36.752068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:36.752701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:36.758859 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.760777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.760777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.760777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:36.761102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:36.761451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:36.900308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:36.908947 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0fc18d6-e3d5-4cbe-8e46-4648723fbbb5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1678 microversion: 2.1 time: 0.160919 Oct 13 09:36:36.909531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3530/7457] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:36 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:37.932673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:37.933245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:37.941501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:37.941984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:37.942442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:37.943146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:37.943601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:37.944031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:38.076963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:38.084887 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4f868df-b391-49c7-b0f0-9bc740d3be20 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1678 microversion: 2.1 time: 0.156291 Oct 13 09:36:38.085490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3928/7458] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:37 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:39.108551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:39.109179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:39.116440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:39.116937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:39.117391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:39.118095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:39.118660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:39.119102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:39.251704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:39.259438 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a892199-fcdd-48c2-969c-29ec48eafdc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.155074 Oct 13 09:36:39.260017 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3531/7459] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:39 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:40.283473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:40.284093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:40.290999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:40.291479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:40.291918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:40.292610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:40.293067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:40.293495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:40.424230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:40.432128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61d1d2b9-04a5-4ade-9127-0cc1f03ccccf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.153160 Oct 13 09:36:40.432702 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3929/7460] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:40 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:41.455868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:41.456503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:41.462509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:41.463004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:41.463454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:41.464154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:41.464653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:41.465094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:41.592005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:41.600394 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4b5c432-16bb-445f-8c0e-1f9cab28a8bb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.149291 Oct 13 09:36:41.600980 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3532/7461] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:41 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:42.624096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:42.624699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:42.631889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:42.632371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:42.632807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:42.633503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:42.633955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:42.634378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:42.767358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:42.775073 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7d3f9ba-ed8f-493c-9bc1-81f32ce09d3f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.155326 Oct 13 09:36:42.775648 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3930/7462] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:42 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:43.797832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:43.798475 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:43.805258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:43.805749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:43.806192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:43.806914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:43.807380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:43.807818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:43.936242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:43.943929 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df7d816d-3beb-4a93-b157-8340e4923d52 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.150055 Oct 13 09:36:43.944530 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3533/7463] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:43 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:44.967260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:44.967806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:44.974603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:44.975084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:44.975514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:44.976202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:44.976658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:44.977110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:45.104231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:45.112292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b03d6f11-ee07-44ad-8514-782bc6d0a4ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.149059 Oct 13 09:36:45.112870 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3931/7464] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:44 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:46.134708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:46.135368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:46.142854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:46.143349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:46.143795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:46.144511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:46.144978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:46.145415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:46.274323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:46.282776 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3e6aed6-2bd7-440d-b688-dbd0fa5e02ff tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.151934 Oct 13 09:36:46.283345 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3534/7465] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:46 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:47.305075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:47.305700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:47.312811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:47.313301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:47.313745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:47.314478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:47.314942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:47.315376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:47.448042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:47.456387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-583f68db-eb35-4e3b-bc38-fbdfb9845220 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.155215 Oct 13 09:36:47.456971 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3932/7466] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:47 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:48.480361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:48.481377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:48.489679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:48.490173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:48.490648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:48.491360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:48.491824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:48.492258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:48.625473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:48.633245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-db6d9bee-d25b-47e7-acd8-6b3e54f0c118 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.156843 Oct 13 09:36:48.633854 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3535/7467] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:48 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:49.656557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:49.657176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:49.663977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:49.664454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:49.664887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:49.665570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:49.666024 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:49.666468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:49.794020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:49.802233 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4add419f-2eea-415c-bcc6-57cf65c222ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1683 microversion: 2.1 time: 0.149626 Oct 13 09:36:49.802830 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3933/7468] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:49 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:50.825363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:50.825970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:50.833419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:50.833916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:50.834365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:50.835092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:50.835644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:50.836086 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:51.032753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "name": "network-vif-unplugged", "status": "completed", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:51.033834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:51.043711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:51.044321 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:51.044851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:51.048416 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2297a254-d526-4c6c-b514-d600fd7d77dd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1682 microversion: 2.1 time: 0.226887 Oct 13 09:36:51.057543 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Creating event network-vif-unplugged:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h1-858384-11 Oct 13 09:36:51.063408 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3536/7469] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:50 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:51.063794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] Instance f4939860-227f-44b3-b5ae-22b5803366de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:36:51.074867 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-11761e35-f153-423d-a71b-c86be25fe4a6 req-5701f233-c817-492a-b686-57900d802d5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046397 Oct 13 09:36:51.075474 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3934/7470] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:36:52.073022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:52.073576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:52.081204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:52.081728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:52.082209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:52.083060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:52.083583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:52.084023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:52.210451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:52.218234 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84566140-d16f-44c1-8231-aa88bbe9e9ca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1680 microversion: 2.1 time: 0.149764 Oct 13 09:36:52.218897 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3537/7471] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:52 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:53.091399 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:53.101352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:53.101830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:53.102264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:53.114561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Creating event network-changed:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h1-858384-11 Oct 13 09:36:53.119769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] Instance f4939860-227f-44b3-b5ae-22b5803366de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:36:53.130180 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-07dfe5b5-013a-4879-b36d-608b2074ad56 req-392ad082-97af-477e-8bbb-e7d328e3fd10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Oct 13 09:36:53.130802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3935/7472] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:36:53.243466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:53.244687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:53.254232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:53.255054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:53.255691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:53.256598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:53.257369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:53.257973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:53.541201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:53.549666 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a49dbdd9-372f-4161-87da-3f22fb4b81c9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1680 microversion: 2.1 time: 0.311392 Oct 13 09:36:53.550257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3538/7473] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:53 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1680 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:54.574156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:54.574896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:54.581131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.581554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.581995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.582722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.583182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.583609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.718382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:54.726827 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fafd9c1c-ea81-4146-843a-ba277207e2f4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1677 microversion: 2.1 time: 0.157732 Oct 13 09:36:54.727410 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3936/7474] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:54 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:54.749910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:54.750504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:54.757346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.757843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.758296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.759045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.759512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.759956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.817212 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4c8c5a67-bb4d-447e-8476-d28e78bb7169 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/action" status: 204 len: 0 microversion: 2.1 time: 0.071018 Oct 13 09:36:54.817856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3539/7475] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:36:54 2022] POST /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:36:54.826765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:54.827392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:54.833666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.834061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.834617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.835644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:54.836141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:54.836610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:54.975517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:54.983764 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23b6ffb6-8d4f-4392-a69b-a49791e3e2d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1677 microversion: 2.1 time: 0.161603 Oct 13 09:36:54.984459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3937/7476] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:54 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:56.007604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:56.008265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:56.017644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.018138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.018611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.019325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.020356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.020800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.164968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:56.174972 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8d55872b-467f-47e6-8534-c60acb9c5ba3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.171669 Oct 13 09:36:56.176285 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3540/7477] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:56 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:56.198649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:56.199281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:56.206870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.207355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.207792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.208496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.208957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.209387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.271121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "name": "network-vif-plugged", "status": "completed", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:56.282825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.283675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.283960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.303446 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] Creating event network-vif-plugged:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h1-858384-11 Oct 13 09:36:56.309646 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-7591453a-1a83-4a19-841b-5c6e145574ff req-1cd34537-e28a-4b38-bf93-a1377e001287 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042648 Oct 13 09:36:56.310384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3541/7478] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:36:56.346182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:56.354095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-14a37598-8f2b-44dc-9e4a-0ccffe466d78 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.159414 Oct 13 09:36:56.354705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3938/7479] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:56 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:56.377088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:56.377795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:56.383938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.384424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.384865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.385759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.386222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.386682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.514963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:56.523230 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-324f12f6-2891-45dd-81a0-2d86d6f68ada tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1669 microversion: 2.1 time: 0.150348 Oct 13 09:36:56.523800 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3542/7480] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:56 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:56.545724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:56.546225 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:56.552291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.552774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.553207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.553900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.554351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.554803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.579561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:36:56.652382 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-93217124-b390-4e24-9dbb-86463f13c2e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 204 len: 0 microversion: 2.1 time: 0.110114 Oct 13 09:36:56.653025 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3939/7481] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:36:56 2022] DELETE /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:36:56.661736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:56.662357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:56.668334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.668823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.669268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.669964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:56.670459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:56.670904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:56.799952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:56.807675 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-60af3b11-803e-49cc-983f-b2dcd12564d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1675 microversion: 2.1 time: 0.149807 Oct 13 09:36:56.808241 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3543/7482] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:56 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:57.832253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:57.832960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:57.839941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:57.840428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:57.840869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:57.841565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:57.842022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:57.842475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:57.847330 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:57.976474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:57.985187 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4fcf5110-7d64-4219-ba39-b7c212dc2533 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 200 len: 1675 microversion: 2.1 time: 0.157337 Oct 13 09:36:57.985774 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3940/7483] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:57 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:36:58.793211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4939860-227f-44b3-b5ae-22b5803366de", "name": "network-vif-deleted", "tag": "b560d468-7aab-4989-b273-b1fd54766a8b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:58.807345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:58.807927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:58.808644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:58.813316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:36:58.823963 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] Creating event network-vif-deleted:b560d468-7aab-4989-b273-b1fd54766a8b for instance f4939860-227f-44b3-b5ae-22b5803366de on n-h1-858384-11 Oct 13 09:36:58.830756 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-695b4aba-e778-44d0-8d24-095977d210ad req-80fdecc5-3ecd-47da-8a7a-e23aea552f25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041602 Oct 13 09:36:58.831774 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3544/7484] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:36:59.009307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:59.009929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:59.017771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.018273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.018730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.019442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.019900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.020328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.034803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de HTTP/1.1 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'f4939860-227f-44b3-b5ae-22b5803366de'} Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:36:59.036501 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0a702d83-29bc-4783-87ed-59493726a9a9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 404 len: 111 microversion: 2.1 time: 0.033270 Oct 13 09:36:59.040918 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3941/7485] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:59 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:36:59.053570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:59.054286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:59.063119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.063623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.064072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.064780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.065242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.065684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.081818 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de HTTP/1.1 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f4939860-227f-44b3-b5ae-22b5803366de'} Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:36:59.083533 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e34d6788-30c3-4bcb-8d13-79c56b30dfc0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 404 len: 111 microversion: 2.1 time: 0.035704 Oct 13 09:36:59.087748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3545/7486] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:59 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:36:59.134013 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1055024067", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8c5844fa-dbd6-43bf-904d-bd3d3f0f634e"}], "security_groups": [{"name": "tempest-securitygroup--1719476033"}], "key_name": "tempest-keypair-507031397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:36:59.237625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] validate_networks() for [('8c5844fa-dbd6-43bf-904d-bd3d3f0f634e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:36:59.617269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:36:59.617905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:36:59.618393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:36:59.618839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:36:59.619262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:36:59.628671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.629160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.629839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.630655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:36:59.631269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:36:59.632015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:36:59.651683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:36:59.657471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:36:59.669684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:36:59.672045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:36:59.720019 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-591abe5b-4a73-4eb4-80c5-f4bd4b5749ba tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.588930 Oct 13 09:36:59.727228 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3942/7487] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:36:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:36:59.732221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-02898bc2-c43a-43c6-8730-8a4fd3ec597b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:36:59.732853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-02898bc2-c43a-43c6-8730-8a4fd3ec597b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:36:59.808360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-02898bc2-c43a-43c6-8730-8a4fd3ec597b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:36:59.817775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-02898bc2-c43a-43c6-8730-8a4fd3ec597b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1238 microversion: 2.1 time: 0.089668 Oct 13 09:36:59.818531 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3546/7488] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:36:59 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:37:00.841635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:00.842264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:00.853782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:00.854279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:00.854764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:00.855485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:00.856196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:00.856625 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:00.926623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:00.934808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c2175460-cea9-4892-9df2-71b4d735da9d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1308 microversion: 2.1 time: 0.097350 Oct 13 09:37:00.935643 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3943/7489] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:00 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:01.958589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:01.959215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:01.966388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:01.966916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:01.967369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:01.968078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:01.968543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:01.968983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:02.155423 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:02.163833 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a347f5fc-8d55-434f-8068-5d298f1080d5 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.209195 Oct 13 09:37:02.164400 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3547/7490] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:01 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:02.293612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:37:02.305410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:02.305905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:02.306599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:02.317669 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] Creating event network-changed:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h2-858384-11 Oct 13 09:37:02.323197 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2c71ace5-5cd9-4f3f-b12c-085bd2df564a req-e8670fed-1f9b-4b19-9b56-8daff0fe9061 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034525 Oct 13 09:37:02.323799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3944/7491] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:37:03.188604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:03.189236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:03.196225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:03.196720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:03.197171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:03.197871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:03.198329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:03.198788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:03.332723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:03.340512 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00ddee30-00ed-42e5-95d9-3fe342dadefb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.156477 Oct 13 09:37:03.341088 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3548/7492] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:03 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:04.365159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:04.365903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:04.372131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:04.372613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:04.373052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:04.373748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:04.374203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:04.374665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:04.506557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:04.514395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-563ecd6c-6fad-43b1-8755-9ade00158bee tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.154406 Oct 13 09:37:04.514986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3945/7493] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:04 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:05.538953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:05.539578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:05.546433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:05.546940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:05.547384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:05.548081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:05.548542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:05.548980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:05.673473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:05.681194 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-350600e6-3e26-46f9-b601-76138d43ee28 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.146212 Oct 13 09:37:05.681765 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3549/7494] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:05 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:06.703998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:06.704617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:06.707511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:37:06.713179 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:06.713706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:06.714146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:06.714875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:06.715329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:06.715753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:07.084584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:07.092423 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c46bfcb-24fb-47c4-baf3-fb3f1fe8c4e3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.392500 Oct 13 09:37:07.093011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3946/7495] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:06 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:08.114803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:08.115357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:08.118244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=47 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:37:08.123929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:08.124439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:08.125382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:08.126095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:08.126602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:08.127092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:08.259333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:08.267207 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a3993e7a-4e06-4963-9fa9-53f743914286 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.156378 Oct 13 09:37:08.268191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3550/7496] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:08 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:08.725887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "name": "network-vif-plugged", "status": "completed", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:37:08.737335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:08.737914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:08.738587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:08.754626 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] Creating event network-vif-plugged:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h2-858384-11 Oct 13 09:37:08.759965 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-40ee37cd-b74b-4f14-b5d3-5d5fd8f6a2bc req-e86331cb-d594-460a-9685-5ef2da822e4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038057 Oct 13 09:37:08.760873 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3947/7497] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:37:09.290494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:09.291127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:09.298453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:09.298899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:09.299345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:09.300039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:09.300501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:09.300936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:09.430752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:09.439286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e029c719-258b-4b13-9b97-3bcb1e80d778 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1364 microversion: 2.1 time: 0.152610 Oct 13 09:37:09.439881 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3551/7498] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:09 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:10.463395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:10.464173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:10.466185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:37:10.466927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:37:10.474570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:10.475049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:10.475486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:10.476182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:10.476638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:10.477063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:10.603534 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:37:10.612214 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0e2789e9-aa93-4dbd-ad8e-a2161420efd7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1551 microversion: 2.1 time: 0.153159 Oct 13 09:37:10.612800 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3948/7499] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:37:10 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:37:10.635104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:37:10.635613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:37:10.637464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:37:10.643369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:10.643870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:10.644326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:10.645034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:10.645502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:10.645940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:10.724081 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-75df7f6d-d4f8-4b20-9230-8dc816d004bc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093134 Oct 13 09:37:10.724688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3552/7500] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:37:10 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:37:11.941641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:37:11.951765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:37:11.952240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:37:11.952670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:37:11.964578 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] Creating event network-changed:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h2-858384-11 Oct 13 09:37:11.969917 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d7515218-9b3c-47f9-847c-41dee9b57cdc req-43cd540e-3292-4b15-86e5-1356cfe70bee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Oct 13 09:37:11.970970 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3949/7501] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:13.651527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:13.652337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=37 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:13.656648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:13.664092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:13.664586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:13.665030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:13.686860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Going to try to stop instance {{(pid=127031) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 09:38:13.728320 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3f070ac4-5c85-46dd-b4d6-ed800b587927 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action" status: 202 len: 0 microversion: 2.1 time: 0.079002 Oct 13 09:38:13.728915 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3553/7502] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:38:13 2022] POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:38:13.743927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:13.745235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:13.748834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:13.749945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=38 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:13.758637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:13.759126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:13.759565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:13.760270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:13.760722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:13.761144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:13.944236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:13.952013 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc9b99e3-7056-490b-8d85-58327f7dbc83 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.218378 Oct 13 09:38:13.952597 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3950/7503] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:13 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:38:14.977474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:14.978364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:14.984836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:14.985335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:14.985787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:14.986517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:14.986983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:14.987424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:15.174999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:15.183264 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8eb6a7c2-ab0c-4e3e-893b-4425c3c76010 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.211552 Oct 13 09:38:15.183847 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3554/7504] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:14 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:16.207608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:16.208157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:16.215162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:16.215641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:16.216077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:16.216769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:16.217218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:16.217645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:16.292163 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:38:16.292406 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:38:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f (ip 10.222.0.23) !!! Oct 13 09:38:16.347948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:16.356454 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-806b74f5-368c-44bd-9bbc-7058934bf99c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.152665 Oct 13 09:38:16.357041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3951/7505] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:16 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:17.380029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:17.380657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:17.384586 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:38:17.384732 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:38:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f (ip 10.222.0.23) !!! Oct 13 09:38:17.390999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:17.391488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:17.391946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:17.392654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:17.393123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:17.393564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:17.519212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:17.526982 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5efaee85-1e6f-4efe-86e8-35739d4edb48 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.150976 Oct 13 09:38:17.527562 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3555/7506] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:17 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:18.549850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:18.550494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:18.557284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:18.557768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:18.558204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:18.558924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:18.559376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:18.559800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:18.689595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:18.697883 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-49c6aef6-0f07-4e77-af10-79c033032526 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.152009 Oct 13 09:38:18.698478 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3952/7507] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:18 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:19.720131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:19.720757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:19.728293 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:19.728791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:19.729242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:19.729946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:19.730432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:19.730877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:19.855878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:19.863876 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3d5805d-4591-4097-afde-2db2df1387d4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.147731 Oct 13 09:38:19.864451 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3556/7508] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:19 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:20.886786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:20.887404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:20.894212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:20.894725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:20.895169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:20.895866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:20.896324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:20.896752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:21.022345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:21.030840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b6f3b3d-c5df-4546-9a97-b910e56fc1fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.147959 Oct 13 09:38:21.031454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3953/7509] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:20 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:22.055434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:22.056067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:22.062940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:22.063438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:22.063888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:22.064595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:22.065064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:22.065504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:22.197244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:22.205154 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-deea3a79-c8cd-4edc-903d-b6c67ab70058 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.154418 Oct 13 09:38:22.205753 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3557/7510] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:22 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:23.228832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:23.229452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:23.236512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:23.236993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:23.237436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:23.238132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:23.238629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:23.239061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:23.372758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:23.380596 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a92795c-6cac-4c2c-83d5-55caa323034d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.156363 Oct 13 09:38:23.381180 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3954/7511] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:23 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:24.402963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:24.403593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:24.410618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.411067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.411520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.412229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.412703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.413145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.542469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:24.550286 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab504341-4a40-4854-ac7d-d294dcae2c77 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1657 microversion: 2.1 time: 0.151296 Oct 13 09:38:24.550905 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3558/7512] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:24 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:24.574514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:24.576814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:24.583698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.584183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.584626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.585318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.585765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.586210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.614639 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:24.619907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Old instance type m1.heat2, new instance type m1.heat {{(pid=127030) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:38:24.626664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:38:24.627090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:38:24.627574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:38:24.627986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:38:24.628400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:38:24.692782 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-96993a80-3d87-4b45-b39d-c1a1a8f9a1e1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action" status: 202 len: 0 microversion: 2.1 time: 0.122209 Oct 13 09:38:24.694030 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3955/7513] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:38:24 2022] POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:38:24.701275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:24.701881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:24.707887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.708379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.708825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.709518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:24.709984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:24.710428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:24.849500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:24.858935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66e6b1b9-1589-43ce-8fd0-b4e3b1e07564 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.161402 Oct 13 09:38:24.859652 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3559/7514] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:24 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:38:25.883329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:25.883880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:25.890898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:25.891441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:25.891887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:25.892599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:25.893061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:25.893495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:26.042672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:26.050692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e2bae073-c0bd-4ef7-ba5e-f6eee16701f7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1680 microversion: 2.1 time: 0.172209 Oct 13 09:38:26.051369 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3956/7515] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:25 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:27.075421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:27.076047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:27.082844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:27.083340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:27.083795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:27.084496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:27.084960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:27.085400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:27.213040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:27.220710 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-63c1f98b-5357-4d51-a5da-9d316cc24a82 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1685 microversion: 2.1 time: 0.149916 Oct 13 09:38:27.221280 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3560/7516] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:27 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:28.244489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:28.245129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:28.251899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:28.252378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:28.252815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:28.253501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:28.253954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:28.254377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:28.385383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:28.393477 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c3d061a6-33f4-46f9-b74c-c334b4fb9795 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1685 microversion: 2.1 time: 0.152878 Oct 13 09:38:28.394068 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3957/7517] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:28 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:29.035101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "name": "network-vif-unplugged", "status": "completed", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:29.046132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:29.046761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:29.047368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:29.060505 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Creating event network-vif-unplugged:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h1-858384-11 Oct 13 09:38:29.066049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:38:29.078025 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6c0d1412-65dd-44d8-9c97-a3dce1e88f35 req-c8e6e068-bcbc-4083-80cd-e755cc5ee72c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046479 Oct 13 09:38:29.078684 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3561/7518] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:29.415677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:29.416922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:29.423923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:29.424509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:29.425054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:29.425883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:29.426628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:29.427220 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:29.565026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:29.573442 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-08f03809-0214-4f07-87e8-a6e309152db2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1684 microversion: 2.1 time: 0.161602 Oct 13 09:38:29.574047 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3958/7519] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:29 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:30.597540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:30.598255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:30.605874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:30.606661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:30.607115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:30.607813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:30.608277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:30.608714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:30.735258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:30.743209 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8f05328-2b90-46c4-a621-c732495c188c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1682 microversion: 2.1 time: 0.149900 Oct 13 09:38:30.743794 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3562/7520] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:30 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:31.113006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:31.123236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:31.123715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:31.124144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:31.137354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Creating event network-changed:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h1-858384-11 Oct 13 09:38:31.143055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:38:31.154994 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-fcffb7c3-735b-4d2e-b949-b275348946d8 req-51eea6a5-2f54-4c93-b45c-aff49f42ee70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045711 Oct 13 09:38:31.162570 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3959/7521] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:31.766796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:31.767433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:31.774139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:31.774673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:31.775128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:31.775836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:31.776305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:31.776752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:32.047486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:32.055238 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dccd0c89-e437-4555-81a6-b307b9bd592c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1678 microversion: 2.1 time: 0.292332 Oct 13 09:38:32.055818 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3563/7522] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:31 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:32.079421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:32.080056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:32.086209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:32.086749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:32.087198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:32.088390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:32.088844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:32.089274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:32.148710 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7227cf46-3af3-42e7-8645-b20c3b9e1e79 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action" status: 204 len: 0 microversion: 2.1 time: 0.073849 Oct 13 09:38:32.149362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3960/7523] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:38:32 2022] POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:38:32.158006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:32.158815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:32.164966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:32.165847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:32.166714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:32.167522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:32.168156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:32.168702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:32.712598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:32.721784 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0fd7873f-e663-43e5-859c-bb70bba739ef tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1678 microversion: 2.1 time: 0.567731 Oct 13 09:38:32.722483 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3564/7524] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:32 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1678 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:33.746151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:33.746863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:33.753258 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:33.753745 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:33.754192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:33.754933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:33.755390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:33.755820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:33.891452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:33.899283 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e4a9b084-0b85-466b-8310-faefcb8de945 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1657 microversion: 2.1 time: 0.158262 Oct 13 09:38:33.899863 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3961/7525] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:33 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:38:33.923967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:33.924768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:33.931594 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:33.932118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:33.932566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:33.933271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:33.933734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:33.934169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:34.063126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:34.070778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c942604-fb5b-4509-8332-32684cffc0c2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1657 microversion: 2.1 time: 0.151186 Oct 13 09:38:34.071345 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3565/7526] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:33 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:34.093833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:34.099913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:34.100404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:34.100854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:34.123217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Going to try to start instance {{(pid=127030) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 09:38:34.164911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b1a5309d-88a5-40f3-bef0-baa91464d0cb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action" status: 202 len: 0 microversion: 2.1 time: 0.074865 Oct 13 09:38:34.165523 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3962/7527] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:38:34 2022] POST /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:38:34.174797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:34.175425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:34.182528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:34.183034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:34.183486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:34.185005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:34.185485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:34.185924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:34.402517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:34.410482 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a0d3f4d-209c-407f-9e24-ad78de85b41b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1666 microversion: 2.1 time: 0.240133 Oct 13 09:38:34.411260 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3566/7528] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:34 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1666 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:34.947942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "name": "network-vif-plugged", "status": "completed", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:34.957902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:34.958389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:34.958925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:34.973722 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] Creating event network-vif-plugged:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h1-858384-11 Oct 13 09:38:34.978633 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-16a66236-cd32-4c0e-9ce9-2cbe6f009775 req-b539829d-0950-4e24-819d-61c0350b8064 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097344 Oct 13 09:38:34.979225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3963/7529] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:38:35.434792 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:35.435567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:35.442573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.443055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.443508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.444249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.444716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.445155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.640946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:35.648933 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83d139ba-9700-4645-b072-353576442539 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1670 microversion: 2.1 time: 0.218700 Oct 13 09:38:35.649522 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3567/7530] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:35 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:35.672092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:35.672763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:35.679149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.679644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.680100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.680799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.681261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.682363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.686558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:35.709472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:38:35.786935 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b69ba643-f3ae-44e0-88c0-64090108c029 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 204 len: 0 microversion: 2.1 time: 0.118752 Oct 13 09:38:35.787774 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3964/7531] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:38:35 2022] DELETE /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:38:35.798000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:35.798673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:35.805073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.805575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.806032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.807429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:35.807899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:35.808376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:35.948825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:35.952574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:35.957476 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bb5ce4c0-3e16-409d-a6f6-8a0eb2707b8d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1676 microversion: 2.1 time: 0.164579 Oct 13 09:38:35.958248 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3568/7532] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:35 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:38:36.982729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:36.983432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:36.990137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:36.990645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:36.991084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:36.991773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:36.992224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:36.992646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:37.123563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:37.132313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c1177ad5-9986-4549-bf74-cc392c6c4128 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1676 microversion: 2.1 time: 0.154549 Oct 13 09:38:37.132897 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3965/7533] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:36 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:37.892194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d7d6d-dfb9-4040-8c3b-357e83492b5f", "name": "network-vif-deleted", "tag": "ae9fee74-61ec-4550-8a1d-c1c6944d0228"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:37.904281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:37.904781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:37.905236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:37.918272 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] Creating event network-vif-deleted:ae9fee74-61ec-4550-8a1d-c1c6944d0228 for instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f on n-h1-858384-11 Oct 13 09:38:37.923161 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-c9e39079-d34e-4095-b558-bc0cc4a2074c req-e7c812c9-9aa3-481e-be01-a68ae8a2f635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 Oct 13 09:38:37.923940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3569/7534] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:38.156456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:38.157029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:38.165161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:38.166303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:38.166879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:38.167470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:38.167936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:38.168366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:38.199938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:38.200429 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:38.200869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:38.201485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lazy-loading 'fault' on Instance uuid a28d7d6d-dfb9-4040-8c3b-357e83492b5f {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:38:38.246905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:38.255395 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc24d6d5-78c0-43a8-8363-d574e46a3cdc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 200 len: 1328 microversion: 2.1 time: 0.102906 Oct 13 09:38:38.267044 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3966/7535] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:38 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:39.280170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:39.280885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:39.287081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.287576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.288027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.288730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.289196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.289636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.303356 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f HTTP/1.1 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'a28d7d6d-dfb9-4040-8c3b-357e83492b5f'} Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:38:39.304934 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f8974b9c-27eb-4cf8-8e13-1ce28584d6d7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 404 len: 111 microversion: 2.1 time: 0.031457 Oct 13 09:38:39.309984 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3570/7536] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:39 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:38:39.322228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:39.322867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:39.329738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.330218 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.330686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.331375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.331827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.332256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.345318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f HTTP/1.1 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a28d7d6d-dfb9-4040-8c3b-357e83492b5f'} Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:38:39.346979 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c9e29c38-88bb-4b09-bbf9-ec8a81a35baf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 404 len: 111 microversion: 2.1 time: 0.030057 Oct 13 09:38:39.351752 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3967/7537] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:39 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:38:39.397013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-191481167", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8c5844fa-dbd6-43bf-904d-bd3d3f0f634e"}], "security_groups": [{"name": "tempest-securitygroup--1719476033"}], "key_name": "tempest-keypair-507031397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:39.501643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] validate_networks() for [('8c5844fa-dbd6-43bf-904d-bd3d3f0f634e', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:38:39.911017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:38:39.911458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:38:39.911949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:38:39.912374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:38:39.912802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:38:39.922016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.922551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.923007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.923744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:39.924214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:39.924652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:39.943766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:38:39.949139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:38:39.961258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:38:39.964078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:38:40.010084 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0a6606a-814a-482b-a217-a2ffe2ce3135 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.616445 Oct 13 09:38:40.010775 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3571/7538] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:38:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:38:40.021935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e1d00e7-87fc-410f-8d8b-0e7f1c0a6f35 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:40.022593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e1d00e7-87fc-410f-8d8b-0e7f1c0a6f35 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:40.079628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e1d00e7-87fc-410f-8d8b-0e7f1c0a6f35 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:40.086730 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e1d00e7-87fc-410f-8d8b-0e7f1c0a6f35 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1237 microversion: 2.1 time: 0.068596 Oct 13 09:38:40.087305 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3968/7539] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:40 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:41.111397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:41.112027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:41.118926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:41.119430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:41.119888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:41.120620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:41.121078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:41.121526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:41.226966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:41.235581 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21409e39-ad56-4ba2-b382-fe33b394b796 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1295 microversion: 2.1 time: 0.129267 Oct 13 09:38:41.236157 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3572/7540] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:41 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:42.258730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:42.259431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:42.267359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:42.267853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:42.268306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:42.269017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:42.269480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:42.269914 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:42.352507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:42.371561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:42.372397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:42.373129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:42.388558 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] Creating event network-changed:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h1-858384-11 Oct 13 09:38:42.393706 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ca17b006-4f8c-42db-8505-12e1aa6b173f req-b1602d8d-edbb-47d2-b316-a50bb6d43ba3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048014 Oct 13 09:38:42.394732 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3573/7541] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:42.419868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:42.427916 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-37db5044-3cf0-426b-8733-2cdaf0de8b59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1363 microversion: 2.1 time: 0.173104 Oct 13 09:38:42.428737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3969/7542] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:42 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:43.453936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:43.454683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:43.460944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:43.461436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:43.461879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:43.463292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:43.463757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:43.464192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:43.642440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:43.650862 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d2bf8612-be4c-4f13-b33f-f6eae5c326b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1363 microversion: 2.1 time: 0.201539 Oct 13 09:38:43.651431 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3574/7543] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:43 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:44.673184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:44.673806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:44.676743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:44.681881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:44.682370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:44.682836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:44.683541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:44.683999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:44.684430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:44.817157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:44.825152 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5a21ee91-ec0a-479a-8a74-1180fb790d75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1363 microversion: 2.1 time: 0.155890 Oct 13 09:38:44.825731 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3970/7544] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:44 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:45.849059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:45.849660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:45.852552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:38:45.858768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:45.859263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:45.859716 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:45.860411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:45.860876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:45.861312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:45.990965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:45.999402 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e68f7626-ae97-43b2-a1c6-419df75c14f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1363 microversion: 2.1 time: 0.154291 Oct 13 09:38:45.999969 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3575/7545] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:45 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:46.878985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "name": "network-vif-plugged", "status": "completed", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:46.890197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:46.890714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:46.891155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:46.902292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] Creating event network-vif-plugged:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h1-858384-11 Oct 13 09:38:46.907628 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a3962a69-1005-4efb-b257-7fd023a6bc49 req-6c656082-a19d-4107-b05f-e16e0e3a67fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032425 Oct 13 09:38:46.908243 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3971/7546] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:47.022240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:47.022898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:47.029747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:47.030294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:47.030724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:47.031439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:47.031906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:47.032338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:47.164491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:47.172639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b7d537a8-47cd-45a2-8b3a-828a5ef70a33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1363 microversion: 2.1 time: 0.154305 Oct 13 09:38:47.173216 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3576/7547] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:47 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:48.197492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:48.198202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:48.204470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:48.204950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:48.205419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:48.206115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:48.206599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:48.207035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:48.339452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:38:48.347444 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40ee781e-0680-4ab4-a8e6-e9dd7fd4adb4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1551 microversion: 2.1 time: 0.155207 Oct 13 09:38:48.348018 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3972/7548] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:38:48 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:38:48.370767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:38:48.371270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:38:48.377955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:48.378479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:48.378928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:48.379622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:48.380084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:48.380515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:48.454971 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-450e5889-4aa1-4a2e-b2e3-b48803894c75 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088036 Oct 13 09:38:48.455705 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3577/7549] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:38:48 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:38:49.380277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:38:49.389638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:38:49.390120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:38:49.390676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:38:49.401888 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] Creating event network-changed:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h1-858384-11 Oct 13 09:38:49.406900 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6876ec09-348d-4de0-b27b-d0fe0cc024bf req-e6ca02b0-7f7d-4722-9b09-ecf754398fd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031617 Oct 13 09:38:49.407692 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3973/7550] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:39:22.264550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.265324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.266117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=5 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.266817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=36 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.271318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:22.273597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:22.281988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:22.282505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:22.282956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:22.283653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:22.284113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:22.284548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:22.312205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:22.317527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:39:22.324149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:39:22.324610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:39:22.325096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:39:22.325519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:39:22.325938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:39:22.389573 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c8e2c626-f5d3-4341-bb6a-9ac7f6f58a74 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/action" status: 202 len: 0 microversion: 2.1 time: 0.126767 Oct 13 09:39:22.390184 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3578/7551] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:39:22 2022] POST /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:39:22.399888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:22.400689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:22.403073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.403973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.404609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:22.411080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:22.411568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:22.412038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:22.412753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:22.413210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:22.413686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:22.578469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:22.586308 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad485fbc-7975-4bfa-9aee-ef5bdd72ccb1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1679 microversion: 2.1 time: 0.191613 Oct 13 09:39:22.587427 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3974/7552] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:22 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:39:23.610659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:23.611276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:23.617189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:23.617679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:23.618790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:23.619485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:23.619948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:23.620380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:23.837862 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:23.845599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3819dc6f-9cdf-4ef9-8c3f-6f5fca0a37b0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1679 microversion: 2.1 time: 0.240103 Oct 13 09:39:23.846204 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3579/7553] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:23 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:24.869574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:24.870149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:24.877231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:24.877714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:24.878153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:24.878878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:24.879339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:24.879775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:25.006935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:25.014781 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e05ec90-e9b7-48b9-a696-e6496d2ccd38 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.149658 Oct 13 09:39:25.015363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3975/7554] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:24 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:26.037746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:26.038532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:26.045588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:26.046120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:26.046597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:26.047327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:26.047786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:26.048221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:26.177945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:26.186233 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4e53ec2-1303-4f47-ac7b-e8622ecdf153 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.152483 Oct 13 09:39:26.186838 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3580/7555] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:26 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:27.209678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:27.210341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:27.217692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:27.218181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:27.218664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:27.219369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:27.219833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:27.220272 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:27.352543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:27.360660 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f89a9568-6a23-4c93-8a27-978e5a24adb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.154904 Oct 13 09:39:27.361241 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3976/7556] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:27 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:28.387353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:28.388013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:28.394844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:28.395339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:28.395790 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:28.396494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:28.396963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:28.397405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:28.525403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:28.533516 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-789232c4-f524-4d03-867d-1024247923fe tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.150096 Oct 13 09:39:28.534082 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3581/7557] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:28 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:29.557806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:29.558444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:29.565246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:29.565726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:29.566159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:29.566900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:29.567347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:29.567772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:29.696881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:29.704612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f5e9d0be-afd6-42b9-9d9c-2cf486cd7905 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.151343 Oct 13 09:39:29.705194 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3977/7558] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:29 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:30.727010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:30.727632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:30.734703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:30.735224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:30.735673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:30.736374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:30.736841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:30.737276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:30.863453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:30.871684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-221f9fc6-0740-4483-990f-417bcc239a18 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.148557 Oct 13 09:39:30.872254 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3582/7559] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:30 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:31.895165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:31.895787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:31.902675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:31.903164 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:31.903605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:31.904302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:31.904763 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:31.905196 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:32.035721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:32.043564 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1d05397-f8cb-4eab-a235-ce12fb7a4c06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.152306 Oct 13 09:39:32.044150 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3978/7560] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:31 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:33.066837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:33.067473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:33.074588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:33.075087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:33.075541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:33.076249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:33.076727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:33.077161 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:33.206597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:33.214797 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94178826-290f-415f-8d90-e2d0840bca44 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.151337 Oct 13 09:39:33.215363 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3583/7561] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:33 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:34.238626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:34.239243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:34.246775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:34.247265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:34.247709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:34.248410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:34.248871 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:34.249308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:34.377197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:34.384932 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6def6ac2-1b54-4d45-a4a3-f150f62d1473 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.150299 Oct 13 09:39:34.385504 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3979/7562] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:34 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:35.408851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:35.409488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:35.416459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:35.416965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:35.417504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:35.418226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:35.418725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:35.419174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:35.598056 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:35.605899 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-27da6894-9b80-4934-a67e-cad29950286f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.201103 Oct 13 09:39:35.606505 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3584/7563] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:35 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:36.629190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:36.629813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:36.637329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:36.637813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:36.638253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:36.638983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:36.639439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:36.639869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:36.772983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:36.781350 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9b98be43-20c2-4970-81e2-b3b4583cdacc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.156110 Oct 13 09:39:36.781933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3980/7564] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:36 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:37.804830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:37.805469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:37.812848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:37.813350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:37.813805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:37.814580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:37.815054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:37.815496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:37.950542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:37.958444 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-59f6ce98-a689-4483-804c-0e10149d6bf4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.157544 Oct 13 09:39:37.959045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3585/7565] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:37 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:38.982587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:38.983185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:38.990014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:38.990872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:38.991308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:38.991998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:38.992450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:38.992874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:39.124732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:39.132411 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cbba8e51-32c9-42c4-b80c-d054670fdd1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.154575 Oct 13 09:39:39.132986 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3981/7566] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:38 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:40.155503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:40.156125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:40.162498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:40.162989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:40.163436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:40.164127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:40.164589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:40.165023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:40.290079 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:40.298348 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-070aff16-a11b-40f1-9812-74819b0e9430 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1684 microversion: 2.1 time: 0.146728 Oct 13 09:39:40.298883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3586/7567] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:40 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:41.321093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:41.321711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:41.329077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:41.329562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:41.330000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:41.330804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:41.331263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:41.331693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:41.466142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:41.474499 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-042c3f52-2267-4a18-9be1-28a4aa01acd6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1683 microversion: 2.1 time: 0.157275 Oct 13 09:39:41.475090 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3982/7568] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:41 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:41.653865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "name": "network-vif-unplugged", "status": "completed", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:41.663269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:41.663761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:41.664202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:41.680419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Creating event network-vif-unplugged:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h2-858384-11 Oct 13 09:39:41.686468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:39:41.698255 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ad2b70b8-d8b6-4539-be87-2f681792d6b0 req-caa4151e-4fc2-463c-97ed-b62ef5da7dd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113881 Oct 13 09:39:41.700054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3587/7569] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:39:42.499312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:42.499992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:42.506890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:42.507357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:42.507822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:42.508519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:42.508968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:42.509392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:42.655515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:42.663677 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-68c1b1d5-2080-4422-a3c6-1546feb41add tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1683 microversion: 2.1 time: 0.168560 Oct 13 09:39:42.664445 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3983/7570] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:42 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:43.686971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:43.687681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:43.694817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:43.695292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:43.695738 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:43.696634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:43.697105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:43.697545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:43.718922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:43.729057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:43.729545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:43.729987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:43.745858 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Creating event network-changed:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h2-858384-11 Oct 13 09:39:43.751442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:39:43.762538 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c0f24c23-17a4-4bb4-91cb-42b1ce970006 req-483b64fd-0382-44a9-89e5-34cb9a34f4af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047753 Oct 13 09:39:43.763175 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3984/7571] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:39:43.877624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:43.885387 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ce44f21-6cb0-4013-92a8-8c88474545c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1681 microversion: 2.1 time: 0.202748 Oct 13 09:39:43.885964 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3588/7572] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:43 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:44.910423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:44.911158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:44.917328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:44.918346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:44.918811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:44.919506 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:44.919963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:44.920392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:45.052486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:45.061140 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-557d31dd-b70c-401f-8a3c-149b722518da tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1681 microversion: 2.1 time: 0.156000 Oct 13 09:39:45.061719 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3985/7573] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:44 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:46.083585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:46.084219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:46.091408 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.091903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.092402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.093095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.093568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.094010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.224082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:46.231893 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8314e361-d3bc-48d7-babc-81c7fa2cd1d1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1678 microversion: 2.1 time: 0.152330 Oct 13 09:39:46.232717 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3589/7574] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:46 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:46.255408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:46.255948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:46.263415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.263887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.264323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.265004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.265454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.265902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.302088 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.302590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.303028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.303783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.304232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.304659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.325432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:39:46.330588 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:39:46.428978 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-45443a0d-85c3-46e8-9342-95f10dbfdd06 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/action" status: 202 len: 0 microversion: 2.1 time: 0.177293 Oct 13 09:39:46.429838 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3986/7575] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:39:46 2022] POST /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:39:46.439043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:46.439679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:46.445959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.446502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.446960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.447669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:46.448227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:46.448669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:46.642651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:46.650623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d307c0d0-5c0e-4785-98ec-58f9c4e4ef60 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1677 microversion: 2.1 time: 0.215759 Oct 13 09:39:46.651196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3590/7576] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:46 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:47.675724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:47.676427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:47.682570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:47.683049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:47.683972 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:47.684652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:47.685108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:47.685529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:47.814388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:47.817968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:47.823377 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-faf67ffc-9a29-418a-98a7-674a3cf662f6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1677 microversion: 2.1 time: 0.152846 Oct 13 09:39:47.823952 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3987/7577] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:47 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:48.846344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:48.847000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:48.854397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:48.854923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:48.855402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:48.856117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:48.856591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:48.857336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:49.004734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:49.013524 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-73546e69-04a6-4607-b91c-0ba19811c948 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1677 microversion: 2.1 time: 0.170929 Oct 13 09:39:49.022584 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3591/7578] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:48 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:50.040911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:50.040911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:50.050661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:50.051153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:50.051586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:50.052289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:50.052742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:50.053165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:50.072917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:50.085049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:50.085565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:50.086003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:50.098101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Creating event network-changed:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h1-858384-11 Oct 13 09:39:50.103914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:39:50.115748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-7207b744-02fa-4d2b-b3c6-108dd7d0fba6 req-5cf62e37-82ec-4f21-b364-a5be21509703 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047310 Oct 13 09:39:50.116387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3592/7579] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:39:50.201418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:50.210622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a5d79aa4-4d1e-48ac-9eb2-10aaf8add06c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1677 microversion: 2.1 time: 0.177227 Oct 13 09:39:50.211419 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3988/7580] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:50 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:51.234887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:51.235519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:51.241723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:51.242220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:51.242692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:51.243388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:51.243850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:51.244281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:51.374162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:51.377725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:51.382836 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c7201305-093b-4869-99b6-df9ec46765f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1677 microversion: 2.1 time: 0.153402 Oct 13 09:39:51.383419 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3593/7581] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:51 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:52.408038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:52.408815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:52.413699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:52.419952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.420737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.421182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.421953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.422424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.422861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.558790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:52.566663 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-297de75b-e245-4bca-b24c-79dc7e93de34 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1670 microversion: 2.1 time: 0.163569 Oct 13 09:39:52.567248 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3989/7582] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:52 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:52.589133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:52.590484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:52.593368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=37 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:52.599712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.600203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.600649 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.601351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.601811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.602245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.734978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:52.742774 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-33bb4d27-5ad9-4521-87d9-81443ce397b2 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1670 microversion: 2.1 time: 0.157466 Oct 13 09:39:52.743354 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3594/7583] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:52 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:52.765596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:52.766208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:52.772243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.772720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.773154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.773839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.774293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.774749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.906985 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:52.914640 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-924bc647-9a45-4623-8f76-88308648b13c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1670 microversion: 2.1 time: 0.153535 Oct 13 09:39:52.915232 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3990/7584] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:52 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:39:52.937193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:52.937721 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:52.943584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.944072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.944524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.945219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:52.945681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:52.946118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:52.970681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:39:53.050106 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5c67e98d-d2b0-4dde-aa5e-759354194531 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 204 len: 0 microversion: 2.1 time: 0.116978 Oct 13 09:39:53.051051 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3595/7585] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:39:52 2022] DELETE /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:39:53.060642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:53.061271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:53.067618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:53.068126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:53.068561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:53.069260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:53.069712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:53.070141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:53.203341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:53.211122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8a0bc7e5-8bf7-4934-9821-c654bf21e77c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1676 microversion: 2.1 time: 0.155761 Oct 13 09:39:53.211707 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3991/7586] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:53 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:54.235248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:54.235976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:54.242935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:54.243435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:54.243891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:54.244595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:54.245064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:54.246002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:54.445373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:54.453821 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a431ecc-4fc8-4ec6-aa7f-dd79c4aca4f3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1676 microversion: 2.1 time: 0.223155 Oct 13 09:39:54.454426 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3596/7587] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:54 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:55.470517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83fa5b-cd4b-4728-927d-659a68cc8f7e", "name": "network-vif-deleted", "tag": "50e5f255-a083-4bde-a21e-2cb755e9618a"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:55.477492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:55.478686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:55.482836 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:55.484781 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:55.485481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:55.490266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:55.491065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:55.492496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:55.493433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:55.494072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:55.494687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:55.500507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] Creating event network-vif-deleted:50e5f255-a083-4bde-a21e-2cb755e9618a for instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e on n-h1-858384-11 Oct 13 09:39:55.507178 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5018e5b2-1ae0-4bae-9b11-45068dabc070 req-b5c39234-11ce-4673-a1a5-276e3f5a93bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040248 Oct 13 09:39:55.508522 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3992/7588] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:39:55.568552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:55.577528 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-824261d7-e951-4c21-9417-66f1e77f9612 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 200 len: 1608 microversion: 2.1 time: 0.104641 Oct 13 09:39:55.578681 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3597/7589] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:55 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 1608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:56.599468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:39:56.604543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:56.605404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:56.612453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:56.612936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:56.613372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:56.614067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:56.614545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:56.614975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:56.628695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e HTTP/1.1 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ce83fa5b-cd4b-4728-927d-659a68cc8f7e'} Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:39:56.630317 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11f913a7-1a93-43b1-a9a4-a2a414736d54 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 404 len: 111 microversion: 2.1 time: 0.034046 Oct 13 09:39:56.635210 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3993/7590] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:56 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:39:56.647141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:56.647776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:56.654692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:56.655193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:56.655686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:56.656394 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:56.656866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:56.657309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:56.670806 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e HTTP/1.1 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ce83fa5b-cd4b-4728-927d-659a68cc8f7e'} Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:39:56.672473 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e57c04a1-f55d-4d3a-9f5d-98cd23f7da7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 404 len: 111 microversion: 2.1 time: 0.030691 Oct 13 09:39:56.677667 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3598/7591] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:56 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:39:56.722888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-376522301", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "8c5844fa-dbd6-43bf-904d-bd3d3f0f634e"}], "security_groups": [{"name": "tempest-securitygroup--1719476033"}], "key_name": "tempest-keypair-507031397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:56.826573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] validate_networks() for [('8c5844fa-dbd6-43bf-904d-bd3d3f0f634e', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:39:57.253442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:39:57.253810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:39:57.254378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:39:57.254820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:39:57.255242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:39:57.264881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:57.265379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:57.265937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:57.266917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:57.267407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:57.268266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:57.286188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:39:57.291484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:39:57.304610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:39:57.306956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:39:57.353588 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43212cb3-5c8a-4f2e-b869-eb871fb9c779 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.634533 Oct 13 09:39:57.354231 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3994/7592] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:39:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:39:57.366496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a49ce98-4ab0-441c-b4f6-7616d98092ea tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:57.367152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a49ce98-4ab0-441c-b4f6-7616d98092ea tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:57.421389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8a49ce98-4ab0-441c-b4f6-7616d98092ea tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:57.429282 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a49ce98-4ab0-441c-b4f6-7616d98092ea tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1237 microversion: 2.1 time: 0.066759 Oct 13 09:39:57.429849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3599/7593] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:57 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:58.453186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:58.453999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:58.461371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:58.461863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:58.462300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:58.463219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:58.463671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:58.464160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:58.531769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:58.539716 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-854a5046-5253-4ce2-a06e-3cc2ae5b7cb0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1295 microversion: 2.1 time: 0.091494 Oct 13 09:39:58.540325 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3995/7594] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:58 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:39:59.564373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:39:59.565003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:39:59.571888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:59.572388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:59.572843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:59.573562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:59.574030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:59.575063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:59.751387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:39:59.763481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:39:59.764243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:39:59.764680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:39:59.775953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] Creating event network-changed:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:39:59.781042 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d10bf28a-bc17-4900-8f4d-a7c27c750906 req-7d6778d7-bb29-4792-8a8d-54d84441cb04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034505 Oct 13 09:39:59.781859 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3996/7595] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:39:59.825098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:39:59.833912 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-af731a37-c2ff-4b04-b06b-fefd0a789363 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.273438 Oct 13 09:39:59.834532 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3600/7596] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:39:59 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:00.858887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:00.859597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:00.865898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:00.866387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:00.866850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:00.867545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:00.868012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:00.868445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:00.999355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:01.007192 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b142323b-62bc-4eff-9fc9-c0282547cce6 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.153808 Oct 13 09:40:01.007781 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3997/7597] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:00 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:02.031385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:02.032005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:02.038854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:02.039351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:02.039804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:02.040503 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:02.040969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:02.041403 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:02.171697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:02.179383 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b6323de2-87e2-495a-90a2-bf0126e9f86f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.152449 Oct 13 09:40:02.179985 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3601/7598] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:02 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:03.202583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:03.203207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:03.209170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:03.209658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:03.210096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:03.210999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:03.211461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:03.211885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:03.345826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:03.353609 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-706e6770-8103-4f4b-a9f8-64da6a5dd755 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.155240 Oct 13 09:40:03.354386 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3998/7599] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:03 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:04.378118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:04.378774 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:04.385712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:04.386203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:04.386707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:04.387389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:04.387855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:04.388290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:04.517249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:04.524945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aeae4df2-47d0-421c-a093-5c19a7d193f9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.151284 Oct 13 09:40:04.525519 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3602/7600] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:04 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:05.163864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-plugged", "status": "completed", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:40:05.174453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:05.174938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:05.175376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:05.187630 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] Creating event network-vif-plugged:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:40:05.192544 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-651b021f-50ec-409a-8280-0f980c074dc4 req-4f6ba198-2a6e-4dc7-8119-918ca421b5a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032414 Oct 13 09:40:05.193322 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 3999/7601] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:40:05.548057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:05.548588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:05.555481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:05.555972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:05.556417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:05.557117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:05.557579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:05.558015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:05.688496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:05.696178 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fa19e3f0-85bf-4c7a-bb4f-43dacb1abd57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1363 microversion: 2.1 time: 0.152161 Oct 13 09:40:05.696745 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3603/7602] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:05 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:06.721398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:06.722098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:06.728237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:06.728717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:06.729148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:06.729830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:06.730278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:06.730727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:06.865185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:06.873009 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f745a2c-50f3-4670-974f-cabdcd486560 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1551 microversion: 2.1 time: 0.157314 Oct 13 09:40:06.873594 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4000/7603] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:06 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:06.897026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:06.897527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:06.904332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:06.904819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:06.905330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:06.906026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:06.906516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:06.906975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:06.981093 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21f1e62c-b13f-42f9-bf40-8cc0a9506ec3 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087933 Oct 13 09:40:06.981693 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3604/7604] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:40:06 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:40:07.905007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:40:07.915241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:07.916364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:07.919378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:07.920016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:07.920443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:07.934702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] Creating event network-changed:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:40:07.940973 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-97a56108-f4cb-43ee-85fd-f10e7f23b86c req-e949f13e-e66a-4a39-9c1c-9aea23e6beba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040059 Oct 13 09:40:07.942189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4001/7605] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:40:42.176012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:42.178201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:42.178921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:42.183605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:42.184236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:42.192727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:42.193342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:42.193803 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:42.194556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:42.195033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:42.195481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:42.326024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:42.334489 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69e7be7d-b23b-480c-9c0c-44be6f15b324 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1670 microversion: 2.1 time: 0.159381 Oct 13 09:40:42.335069 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3605/7606] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:42 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:42.354647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:42.355464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=60 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:42.361181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ce9b558-3971-44e2-81ba-6e9b4b241685"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:40:42.363633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:42.371010 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:42.371499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:42.371991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:42.372688 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:42.373156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:42.373577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:42.611763 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eeedc9ef-a26b-4d2c-b882-e1ed62107f68 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258579 Oct 13 09:40:42.612407 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4002/7607] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:40:42 2022] POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:40:53.322769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:40:53.325010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:53.328784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:53.329430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:53.334564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:53.335065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:53.335519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:53.336238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:53.336706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:53.337145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:53.368067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:53.373420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:40:53.380388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:40:53.380824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:40:53.381342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:40:53.381771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:40:53.382189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:40:53.443851 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0630ba65-25f3-4463-9900-74ec298d4966 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/action" status: 202 len: 0 microversion: 2.1 time: 0.125746 Oct 13 09:40:53.444463 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3606/7608] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:40:53 2022] POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:40:53.453154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:53.453953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:53.456973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:53.457946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:40:53.463678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:53.464162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:53.464606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:53.465306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:53.465762 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:53.466185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:53.624807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:53.633182 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e35a8c2-4bb8-418b-9dd9-ec85f439deb8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1725 microversion: 2.1 time: 0.184322 Oct 13 09:40:53.633756 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4003/7609] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:53 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:54.657669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:54.658885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:54.664948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:54.665449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:54.665900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:54.666645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:54.667112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:54.667552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:54.827623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:54.837102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ebf13a2e-704c-4bfe-b79d-9480afeddb04 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1725 microversion: 2.1 time: 0.184189 Oct 13 09:40:54.837689 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3607/7610] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:54 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:55.860677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:55.861284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:55.868232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:55.868783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:55.869275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:55.870034 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:55.870520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:55.870975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:56.003392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:56.012200 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5156a95-aeda-40eb-b436-6da33f5cd15e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.155795 Oct 13 09:40:56.012782 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4004/7611] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:55 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:57.035342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:57.035960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:57.042961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:57.043455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:57.043907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:57.044611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:57.045406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:57.045507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:57.173466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:57.182200 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-148b5786-58ed-4178-a0e0-4da929f548fd tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.150690 Oct 13 09:40:57.183011 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3608/7612] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:57 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:58.206513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:58.207155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:58.214071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:58.214611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:58.215074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:58.215760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:58.216208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:58.216629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:58.347722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:58.356059 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9c7cabc-b84b-4539-9b53-7623c7a9ec8c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.154018 Oct 13 09:40:58.356636 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4005/7613] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:58 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:40:59.379338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:40:59.379965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:40:59.386794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:59.387289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:59.387736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:59.388455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:40:59.388903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:40:59.389340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:40:59.519300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:40:59.527515 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-72123b92-fc6d-45c7-9548-7c674457d864 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.152069 Oct 13 09:40:59.528099 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3609/7614] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:40:59 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:00.551247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:00.551852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:00.558667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:00.559142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:00.559610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:00.560312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:00.560750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:00.561171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:00.691267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:00.699506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-adbcaff5-ddfb-46a7-b46e-e6589862899e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.152702 Oct 13 09:41:00.700101 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4006/7615] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:00 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:01.722770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:01.723402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:01.730300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:01.730830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:01.731287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:01.731990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:01.732462 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:01.733226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:01.857998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:01.866901 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2eb78a72-113a-44e2-b752-d9e876e64d9e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.148117 Oct 13 09:41:01.867724 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3610/7616] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:01 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:02.890333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:02.891004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:02.897983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:02.898494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:02.898931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:02.899619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:02.900070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:02.900493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:03.027302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:03.035754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76b4569c-76d9-47b3-aa36-2a10ae40ddb7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.149345 Oct 13 09:41:03.036363 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4007/7617] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:02 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:04.058904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:04.059541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:04.066972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:04.067466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:04.067917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:04.068622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:04.069089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:04.069531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:04.203426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:04.211736 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f95ce4e3-f09d-4f44-8371-f182dfb0b106 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.156721 Oct 13 09:41:04.212314 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3611/7618] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:04 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:05.235100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:05.235716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:05.242734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:05.243213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:05.243653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:05.244368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:05.244824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:05.245255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:05.377441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:05.385639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7133a2e-6ec1-4d38-b2f4-705df742b4ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.154766 Oct 13 09:41:05.386216 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4008/7619] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:05 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:06.409751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:06.410373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:06.417249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:06.417773 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:06.418222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:06.418949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:06.419414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:06.419848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:06.551769 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:06.560032 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1d8076f3-e073-4c14-9ff9-d6e4df2809be tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.154774 Oct 13 09:41:06.560638 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3612/7620] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:06 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:07.583158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:07.583729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:07.590653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:07.591139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:07.591577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:07.592271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:07.592726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:07.593154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:07.721405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:07.729877 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-61bcfac7-ffa0-4002-82ae-b1ee876d2cab tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.150674 Oct 13 09:41:07.730676 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4009/7621] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:07 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:08.753914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:08.754571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:08.761389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:08.761881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:08.762323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:08.763047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:08.763510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:08.763942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:08.897983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:08.906283 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fffb57f9-d870-42d8-b178-cf0c3340dc47 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.157068 Oct 13 09:41:08.906891 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3613/7622] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:08 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:09.930394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:09.931050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:09.937800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:09.938279 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:09.938753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:09.939451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:09.939909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:09.940364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:10.072162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:10.080905 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9ffcc92-3a3b-4d99-b399-0fcd73372ee4 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.154555 Oct 13 09:41:10.081516 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4010/7623] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:09 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:11.105014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:11.105673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:11.112010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:11.113004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:11.113453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:11.114155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:11.114648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:11.115091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:11.240210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:11.248561 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-24698c41-b4fd-4f07-b151-4c1d0ea0c8ec tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.147763 Oct 13 09:41:11.249138 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3614/7624] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:11 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:12.271788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:12.272405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:12.279430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:12.279913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:12.280359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:12.281084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:12.281539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:12.281965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:12.412291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:12.420863 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-929795d1-3dff-4505-bb91-e686047d549f tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.152975 Oct 13 09:41:12.421827 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4011/7625] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:12 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:13.444728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:13.445338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:13.452197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:13.452689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:13.453137 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:13.453842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:13.454302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:13.454762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:13.585033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:13.593326 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7eee8585-0b28-4f2b-9917-4cf010728c21 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1730 microversion: 2.1 time: 0.153069 Oct 13 09:41:13.593905 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3615/7626] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:13 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:41:14.616857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:14.617470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:14.624265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:14.624748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:14.625182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:14.625874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:14.626324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:14.626775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:14.753704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-unplugged", "status": "completed", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:14.764918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:14.765616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:14.766061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:14.777107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:14.782304 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Creating event network-vif-unplugged:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h2-858384-11 Oct 13 09:41:14.786126 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfde57ae-e73d-4cb5-a664-800423070a17 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1729 microversion: 2.1 time: 0.173132 Oct 13 09:41:14.786757 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4012/7627] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:14 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:41:14.795415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:41:14.808941 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-399a32b9-ae77-48eb-9770-fb599d28678c req-13091ae3-dc36-4568-a92d-b4cbb661bc23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059320 Oct 13 09:41:14.809545 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3616/7628] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:15.810154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:15.810734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:15.818135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:15.818653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:15.819094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:15.819786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:15.820239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:15.820663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:15.955652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:15.971489 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67344af1-601f-443f-8f5e-17d1ce8ab444 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.165296 Oct 13 09:41:15.972102 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4013/7629] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:15 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:16.834468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:16.843979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:16.844467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:16.844910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:16.856871 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Creating event network-changed:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h2-858384-11 Oct 13 09:41:16.862359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:41:16.874059 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-266edabc-c6c1-4ab0-b5c1-bf414a685b0c req-9a384323-9ca6-48d2-83c2-0d2f3c5fe200 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044772 Oct 13 09:41:16.874881 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3617/7630] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:16.995619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:16.996235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:17.003571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:17.004098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:17.004680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:17.005392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:17.005849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:17.006274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:17.152573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:17.162037 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d2f39310-8d86-4ff4-a556-cf4df3319037 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.170438 Oct 13 09:41:17.162913 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4014/7631] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:16 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:18.186073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:18.186817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:18.194710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:18.195220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:18.195673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:18.196392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:18.196868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:18.197311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:18.329368 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:18.337763 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8c656a0a-c5d2-4d73-9174-6e218f33c16d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.155977 Oct 13 09:41:18.338438 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3618/7632] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:18 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:19.361491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:19.362143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:19.368768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:19.369248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:19.369684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:19.370383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:19.370866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:19.371298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:19.511586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:19.522853 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7573ead-9471-4584-8747-c30883eab786 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.165185 Oct 13 09:41:19.523475 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4015/7633] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:19 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:20.544882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:20.546090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:20.553417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:20.553910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:20.554356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:20.555083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:20.555548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:20.555980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:20.688311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:20.697195 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-82693572-6e59-4cca-8c58-2a6a30f6e5e0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.156132 Oct 13 09:41:20.697783 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3619/7634] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:20 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:21.720250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:21.720925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:21.728348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:21.728834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:21.729274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:21.729968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:21.730440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:21.730873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:21.857451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:21.866646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2edf3ddb-a5cc-4682-8b8c-6118622975b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.150320 Oct 13 09:41:21.867228 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4016/7635] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:21 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:22.889388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:22.890007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:22.896778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:22.897264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:22.897709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:22.898484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:22.898882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:22.899357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:23.025149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:23.033620 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2f8e53c8-fa85-4034-818a-2d9236fb0cf8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.148066 Oct 13 09:41:23.034254 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3620/7636] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:22 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:24.056860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:24.057480 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:24.060188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=29 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:24.065484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:24.065969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:24.066431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:24.067130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:24.067586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:24.068012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:24.072137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=85 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:24.200563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:24.209063 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b19f0c10-0931-4834-bb08-48801ccf3515 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.156167 Oct 13 09:41:24.209640 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4017/7637] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:24 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:25.232519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:25.233401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:25.236372 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=35 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:25.241842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:25.242337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:25.242847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:25.243551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:25.244029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:25.244474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:25.248645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:25.373941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:25.382623 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1593b962-7b1b-4d76-9527-276969c8d456 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.153978 Oct 13 09:41:25.383190 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3621/7638] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:25 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:26.406041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:26.406677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:26.413629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:26.414106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:26.414650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:26.415333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:26.415787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:26.416240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:26.547962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:26.556703 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d786aa6-68fe-4992-9185-b0e7334984b9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.154543 Oct 13 09:41:26.557290 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4018/7639] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:26 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:27.580007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:27.581188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:27.588024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:27.588514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:27.588961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:27.589653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:27.590114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:27.590581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:27.722141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:27.730612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bd49c10a-8db1-46c9-bffa-8982dc477d59 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.154438 Oct 13 09:41:27.731195 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3622/7640] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:27 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:28.754168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:28.754814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:28.761486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:28.761958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:28.762391 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:28.763101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:28.763552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:28.763973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:28.899392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:28.907653 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-39f63904-3555-471c-89f7-0f8798e0a09e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1727 microversion: 2.1 time: 0.157918 Oct 13 09:41:28.908226 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4019/7641] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:28 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:29.931051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:29.931687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:29.938622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:29.939124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:29.939570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:29.940772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:29.941238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:29.941679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.084324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:30.092857 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2220f10e-c7ce-457c-9dcd-387fa250a253 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1724 microversion: 2.1 time: 0.165655 Oct 13 09:41:30.093447 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3623/7642] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:29 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:30.115685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:30.116238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:30.123040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.123526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.123969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.124669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.125124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.125557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.165416 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.165894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.166328 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.167075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.167526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.167945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.188595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:41:30.194462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Getting quotas for user 45e45eaaa80948b3b69f2c9bd1bc96b2 and project aa6502ca0d3e4f34a38b6ac94f70e4c7. Resources: {'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:41:30.294996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b14f628-ea35-4c28-8c42-518e7904d5e9 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/action" status: 202 len: 0 microversion: 2.1 time: 0.182977 Oct 13 09:41:30.295614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4020/7643] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:41:30 2022] POST /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:41:30.304762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:30.305385 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:30.312030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.312535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.312987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.313801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:30.314339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:30.314809 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:30.512945 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:30.521575 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-51d325b3-2f47-4bab-9df1-49991488bdf0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.221323 Oct 13 09:41:30.522159 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3624/7644] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:30 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:31.545653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:31.546355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:31.554555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:31.555035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:31.555469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:31.556156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:31.556606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:31.557028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:31.692309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:31.700641 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21122482-a98a-4f79-ab18-447661ca77ed tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.159570 Oct 13 09:41:31.701220 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4021/7645] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:31 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:31.988816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-plugged", "status": "completed", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:32.000712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:32.001212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:32.002083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:32.014257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Creating event network-vif-plugged:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h2-858384-11 Oct 13 09:41:32.019658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:41:32.032607 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-9c864466-b62e-4d55-92a3-9bb67c24b74c req-ad9bf87e-81b0-45f5-8033-76669dd20c00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047866 Oct 13 09:41:32.033528 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3625/7646] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:32.725592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:32.726249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:32.732366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:32.733114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:32.733554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:32.734248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:32.734727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:32.735159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:32.862589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:32.870907 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a27a2fbe-b144-46b7-94fb-2ad14fe41c31 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.150186 Oct 13 09:41:32.871484 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4022/7647] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:32 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:33.894936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:33.895646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:33.902812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:33.903303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:33.903748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:33.904455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:33.904918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:33.905352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:34.052026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:34.061009 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-97a610e8-41f3-4fe8-b5d8-652ffc0bced7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.170828 Oct 13 09:41:34.061613 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3626/7648] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:33 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:41:35.083973 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:35.084592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:35.091375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:35.091851 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:35.092289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:35.092982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:35.093547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:35.093869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:35.225802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:35.234329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7626533-5d70-4c64-94cc-1683992ded33 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.154197 Oct 13 09:41:35.234933 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4023/7649] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:35 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:35.994615 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-unplugged", "status": "completed", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:36.007362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:36.008127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:36.008578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:36.021994 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Creating event network-vif-unplugged:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:41:36.033978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:41:36.051894 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d42d2141-a3b0-41ba-b0d2-9b51b834cab4 req-dce67558-ecab-4145-a103-c63a7f5d5083 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062095 Oct 13 09:41:36.052579 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3627/7650] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:36.257655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:36.258277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:36.265464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:36.266147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:36.266791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:36.267679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:36.269831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:36.270356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:36.495937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:36.505057 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9c7b5fe8-42e1-4d55-9765-a266957f3782 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.251304 Oct 13 09:41:36.505763 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4024/7651] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:36 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:37.526837 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:41:37.527378 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:41:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 (ip 10.222.0.23) !!! Oct 13 09:41:37.532177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:37.532894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:37.540604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:37.541110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:37.541561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:37.542271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:37.542770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:37.543209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:37.677376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:37.686293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4ef5f651-11d7-4caf-a1e0-2731f3997cdf tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.161839 Oct 13 09:41:37.686892 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3628/7652] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:37 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:38.083675 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:38.088772 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:41:38.088934 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 09:41:38.097561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:38.098042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:38.098508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:38.110692 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Creating event network-changed:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:41:38.116597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127030) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:41:38.128329 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a1e4d446-7ea1-43ca-a860-45aa7b4ca898 req-6181d762-54c9-4520-98b6-6f1546d2087e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047670 Oct 13 09:41:38.128950 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4025/7653] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:38.710573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:38.711243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:38.718205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:38.718869 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:38.719389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:38.720123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:38.720604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:38.721608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:38.859906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:38.869792 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-47a69316-3a5d-4b6b-abac-855e36506bca tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.164478 Oct 13 09:41:38.870385 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3629/7654] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:38 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:39.893504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:39.894205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:39.901326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:39.901807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:39.902239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:39.902948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:39.903397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:39.903818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:40.046841 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:40.056128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9c0ea98-030d-44ae-a5bb-a3277fd475b8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.166847 Oct 13 09:41:40.056724 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4026/7655] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:39 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:41.079784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:41.080474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:41.086531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:41.087021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:41.087465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:41.088170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:41.088630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:41.089067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:41.220380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:41.229317 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7993241d-e86b-4f88-928c-b613d39c377b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.153804 Oct 13 09:41:41.229893 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3630/7656] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:41 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:42.253952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:42.254650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:42.256627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:42.262847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:42.263150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:42.263590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:42.264283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:42.264730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:42.265150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:42.393665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:42.402392 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8335c602-10f4-4426-98fd-4183d3c36a4b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.152843 Oct 13 09:41:42.402998 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4027/7657] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:42 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:43.425378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:43.426007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:43.432871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:43.433369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:43.433821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:43.434552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:43.435024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:43.435467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:43.563486 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:43.572254 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f0a2fea5-babc-4aa0-a4c0-247570369c7d tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.150720 Oct 13 09:41:43.572825 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3631/7658] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:43 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:44.596473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:44.597120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:44.604190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:44.604672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:44.605111 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:44.605807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:44.606263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:44.606720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:44.737447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:44.745669 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aea25c72-83f2-4ebb-8a20-be7f04a0dafb tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.153764 Oct 13 09:41:44.746255 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4028/7659] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:44 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:45.769443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:45.770014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:45.776954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:45.777463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:45.777909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:45.778644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:45.779106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:45.779538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:45.906269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:45.914501 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5840f4d-a7bf-4741-ab18-14c53287135e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.149692 Oct 13 09:41:45.915074 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3632/7660] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:45 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:46.937120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:46.938235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:46.945924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:46.946424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:46.946888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:46.947592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:46.948052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:46.948485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:47.076581 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:47.085302 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fbb281cd-4b3c-49b4-bc6d-58e537d9f28e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.152174 Oct 13 09:41:47.085881 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4029/7661] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:46 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:48.109309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:48.109935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:48.117538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:48.118060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:48.118532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:48.119229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:48.119694 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:48.120131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:48.253212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:48.261415 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c76d99f-b8cd-444f-99e9-f2aaa4a4966e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1723 microversion: 2.1 time: 0.156300 Oct 13 09:41:48.261994 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3633/7662] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:48 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:49.283808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:49.284452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:49.291233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.291708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.292141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.292830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.293280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.293703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.429333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:49.439561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-11ab0bf2-1620-47b7-bd98-5d76cf74521e tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1716 microversion: 2.1 time: 0.159259 Oct 13 09:41:49.446556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4030/7663] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:49 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:49.461434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:49.461984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:49.468838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.469337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.469784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.470513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.471508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.472007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.604801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:49.615931 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c6364cab-f677-47be-b0d9-b5e466668e57 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1716 microversion: 2.1 time: 0.157775 Oct 13 09:41:49.616714 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3634/7664] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:49 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:49.639270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:49.640022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:49.647856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.648570 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.649043 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.650333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.651492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.651923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.657025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:49.795679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:49.804534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c92fa1b-4e21-44c4-be54-ab247016bc08 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1716 microversion: 2.1 time: 0.169217 Oct 13 09:41:49.805144 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4031/7665] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:49 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:49.826349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:49.826885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:49.834166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.834948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.835755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.837042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.837580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.838068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.864489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:41:49.943101 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-acd4af96-7643-488f-865e-26d77bcbd0c0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 204 len: 0 microversion: 2.1 time: 0.120218 Oct 13 09:41:49.944317 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3635/7666] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:41:49 2022] DELETE /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:41:49.953261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:49.953881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:49.960511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.960992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.961426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:49.962154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:49.962645 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:49.963068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:50.092070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:50.100470 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-404dc2a3-822a-40c7-ae2b-52e85a972d25 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1722 microversion: 2.1 time: 0.151537 Oct 13 09:41:50.101052 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4032/7667] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:49 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:41:51.124529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:51.125234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:51.131978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:51.132468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:51.132915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:51.133610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:51.134069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:51.134531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:51.265310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:51.267702 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:51.274793 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74b7158c-53cf-49be-a630-cc9f26653d97 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1722 microversion: 2.1 time: 0.154523 Oct 13 09:41:51.275370 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3636/7668] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:51 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:51.575326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-plugged", "status": "completed", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:51.587333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:51.587333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:51.587946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:51.602487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] Creating event network-vif-plugged:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:41:51.607673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e6476124-4be3-4366-966c-28f84100117f req-4b356c0b-5c87-423e-8659-76eb447f5cd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Oct 13 09:41:51.608954 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4033/7669] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:52.300813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:52.301797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:52.310581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:52.311226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:52.311959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:52.312813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:52.313396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:52.313976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:52.378849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:52.388027 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d1a301f6-3777-418d-93ce-a12d7bfb45a8 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1654 microversion: 2.1 time: 0.091654 Oct 13 09:41:52.388740 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3637/7670] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:52 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1654 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:52.515976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f3e20-09f0-4d0f-8fb8-55917c8409f0", "name": "network-vif-deleted", "tag": "d32694a3-093f-4414-ab79-5f4a7d177445"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:41:52.531199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:52.532128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:52.532767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:52.546148 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] Creating event network-vif-deleted:d32694a3-093f-4414-ab79-5f4a7d177445 for instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 on n-h1-858384-11 Oct 13 09:41:52.551909 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a608c973-1956-4dd8-bc22-fa8cbdbd3790 req-c341a4d9-91d8-4c69-bf35-52ab969b5593 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112287 Oct 13 09:41:52.552790 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4034/7671] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:41:53.412974 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:53.413875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:53.421123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:53.421623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:53.422081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:53.424121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:53.424603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:53.425048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:53.490455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:53.499062 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cdc25310-9bcb-418b-b6e0-69175838a891 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1368 microversion: 2.1 time: 0.090844 Oct 13 09:41:53.499645 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3638/7672] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:53 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:54.524487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:54.525118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:54.527137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:54.533943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:54.534456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:54.534896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:54.535606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:54.536075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:54.536488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:54.600725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:54.609337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ef3544c-4203-436a-8fc0-91d292bb764c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1368 microversion: 2.1 time: 0.090167 Oct 13 09:41:54.609908 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4035/7673] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:54 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:41:55.632685 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:55.633388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:55.636305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:41:55.641856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:55.642959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:55.643429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:55.644157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:55.644626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:55.645067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:55.711623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:55.719999 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-38897dce-fb6c-44a3-bf68-c1e23601fc0c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1368 microversion: 2.1 time: 0.091351 Oct 13 09:41:55.720688 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3639/7674] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:55 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:56.743219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:56.743766 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:56.750500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:56.750976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:56.751439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:56.752126 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:56.752622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:56.753044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:56.783951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:56.784418 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:56.784848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:56.785280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lazy-loading 'fault' on Instance uuid b27f3e20-09f0-4d0f-8fb8-55917c8409f0 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:41:56.825042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e45eaaa80948b3b69f2c9bd1bc96b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6502ca0d3e4f34a38b6ac94f70e4c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:41:56.834259 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b91f6886-93b5-4335-bffd-df9761106c1c tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 200 len: 1373 microversion: 2.1 time: 0.095005 Oct 13 09:41:56.835073 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4036/7675] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:56 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:41:57.859525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:57.860202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:57.867641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:57.868126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:57.868576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:57.869278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:57.869747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:57.870188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:57.883360 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 HTTP/1.1 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b27f3e20-09f0-4d0f-8fb8-55917c8409f0'} Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:41:57.885013 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98373df9-b023-4028-adda-75ed20c5b895 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 404 len: 111 microversion: 2.1 time: 0.031070 Oct 13 09:41:57.889989 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3640/7676] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:41:57 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:41:58.001596 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:41:58.003842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:41:58.010809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:58.011293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:58.011734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:58.012424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:41:58.012880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:41:58.013305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:41:58.026097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-volume_attachments HTTP/1.1 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': 'b27f3e20-09f0-4d0f-8fb8-55917c8409f0'} Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:41:58.027827 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09e6fa02-a898-4587-b09c-b3e0081422b1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031732 Oct 13 09:41:58.031759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4037/7677] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:41:57 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.351688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.352205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.359610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.360110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.360564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.361280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.361746 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.362187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.375652 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 HTTP/1.1 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b27f3e20-09f0-4d0f-8fb8-55917c8409f0'} Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.377222 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54b433a4-adf0-49a0-aae2-eefbb18172f1 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 404 len: 111 microversion: 2.1 time: 0.030869 Oct 13 09:42:01.381375 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3641/7678] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:01 2022] DELETE /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.387117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.387767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: b27f3e20-09f0-4d0f-8fb8-55917c8409f0] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.395086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.395573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.396014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.396707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.397165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.397593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.411529 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 HTTP/1.1 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'b27f3e20-09f0-4d0f-8fb8-55917c8409f0'} Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.413090 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance b27f3e20-09f0-4d0f-8fb8-55917c8409f0 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76661615-5f4f-413f-bf75-ecf176f4d0e7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0" status: 404 len: 111 microversion: 2.1 time: 0.031244 Oct 13 09:42:01.417420 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4038/7679] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:01 2022] GET /compute/v2.1/servers/b27f3e20-09f0-4d0f-8fb8-55917c8409f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.422867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.423377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.429771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.430278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.430757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.431489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.431965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.432407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.448363 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e HTTP/1.1 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'ce83fa5b-cd4b-4728-927d-659a68cc8f7e'} Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.449975 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7a588f87-281a-4d68-85ba-8d98055ebd37 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 404 len: 111 microversion: 2.1 time: 0.032472 Oct 13 09:42:01.453922 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3642/7680] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:01 2022] DELETE /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.461595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.462245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: ce83fa5b-cd4b-4728-927d-659a68cc8f7e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.468752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.469240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.469678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.470620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.470913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.471338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.486250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e HTTP/1.1 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'ce83fa5b-cd4b-4728-927d-659a68cc8f7e'} Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.487842 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance ce83fa5b-cd4b-4728-927d-659a68cc8f7e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b7ddd05-3fef-4bb8-af5b-8dfc279be0d0 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e" status: 404 len: 111 microversion: 2.1 time: 0.031611 Oct 13 09:42:01.492650 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4039/7681] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:01 2022] GET /compute/v2.1/servers/ce83fa5b-cd4b-4728-927d-659a68cc8f7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.498741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.499335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.506116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.506741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.507374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.508130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.508604 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.509045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.523438 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f HTTP/1.1 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'a28d7d6d-dfb9-4040-8c3b-357e83492b5f'} Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.525019 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ac22e833-6ff1-498a-97d6-80ab081b478b tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 404 len: 111 microversion: 2.1 time: 0.031709 Oct 13 09:42:01.528991 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3643/7682] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:01 2022] DELETE /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.535204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.535892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: a28d7d6d-dfb9-4040-8c3b-357e83492b5f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.542101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.542611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.543051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.543744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.544193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.544612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.558157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f HTTP/1.1 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'a28d7d6d-dfb9-4040-8c3b-357e83492b5f'} Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.559716 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance a28d7d6d-dfb9-4040-8c3b-357e83492b5f could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-82fd3179-049f-4c63-9a02-aefe338b69fc tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f" status: 404 len: 111 microversion: 2.1 time: 0.029835 Oct 13 09:42:01.565533 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4040/7683] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:01 2022] GET /compute/v2.1/servers/a28d7d6d-dfb9-4040-8c3b-357e83492b5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.570162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.570710 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.583136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.583666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.585089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.585816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.586282 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.586757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.600532 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de HTTP/1.1 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f4939860-227f-44b3-b5ae-22b5803366de'} Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.602102 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-525bbb59-201b-475e-b8b7-62df0d84ac51 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 404 len: 111 microversion: 2.1 time: 0.037265 Oct 13 09:42:01.606149 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3644/7684] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:01 2022] DELETE /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:42:01.612281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.612894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] [instance: f4939860-227f-44b3-b5ae-22b5803366de] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:01.618929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.619405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.619839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.620530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:01.620980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:01.621401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:01.637379 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] HTTP exception thrown: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Request method failure captured: Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de HTTP/1.1 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9vVelzPtB5TWi6FGyrl1pViDdFuA_ngyoaWDrrn1EpQSpWSEK2BzDU6lyMDbieHP8SO2qngGwl6UYiXeJB0Z5U10hw6WlqDKjroQ92rotrvL1l_hBwHg0vjvkztQVjaZeXoOkvnw_cNur681BVl8o4C0ew3xZeTBpa-Y8_NhHFDN_s Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa6502ca0d3e4f34a38b6ac94f70e4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: aa6502ca0d3e4f34a38b6ac94f70e4c7 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServerActionsTestJSON-1871464313 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 45e45eaaa80948b3b69f2c9bd1bc96b2 Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServerActionsTestJSON-1871464313-project Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'f4939860-227f-44b3-b5ae-22b5803366de'} Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:01.638953 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Returning 404 to user: Instance f4939860-227f-44b3-b5ae-22b5803366de could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b4be6cb8-f738-4151-8c83-ec11234715a7 tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de" status: 404 len: 111 microversion: 2.1 time: 0.032221 Oct 13 09:42:01.643612 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4041/7685] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:01 2022] GET /compute/v2.1/servers/f4939860-227f-44b3-b5ae-22b5803366de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:01.649893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-49e726a0-fb09-4306-ae9c-2764b6ffa57a tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] Calling method '.version_select at 0x7f53756963a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:01.673308 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-49e726a0-fb09-4306-ae9c-2764b6ffa57a tempest-ServerActionsTestJSON-1871464313 tempest-ServerActionsTestJSON-1871464313-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507031397" status: 202 len: 0 microversion: 2.1 time: 0.027316 Oct 13 09:42:01.673888 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3645/7686] 10.222.0.23 () {58 vars in 1218 bytes} [Thu Oct 13 09:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507031397 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:42:10.903322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-403917534", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "c163b815-2d8c-4ca2-8253-a5779ca989ac"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:10.959667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] validate_networks() for [('c163b815-2d8c-4ca2-8253-a5779ca989ac', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:42:11.337120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:42:11.337555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:42:11.338039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:42:11.338585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:42:11.339551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:42:11.349090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:11.349578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:11.350019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:11.350787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:11.351246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:11.351678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:11.368528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Getting quotas for project 4d81d0573bc04a5b8c4741abd2e0d51c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:42:11.373730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Getting quotas for user 1767733af0174d6d840fa4f5378b715d and project 4d81d0573bc04a5b8c4741abd2e0d51c. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:42:11.386577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:42:11.388859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:42:11.434498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-faabd893-3ec7-45e2-b60a-e49960c1940e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653160 Oct 13 09:42:11.435116 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4042/7687] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:42:11.447003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-801d044d-1d81-43f6-bbab-ecf54ddc2b5e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:11.447631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-801d044d-1d81-43f6-bbab-ecf54ddc2b5e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:11.502205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-801d044d-1d81-43f6-bbab-ecf54ddc2b5e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:11.511198 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-801d044d-1d81-43f6-bbab-ecf54ddc2b5e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1216 microversion: 2.1 time: 0.068191 Oct 13 09:42:11.511859 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3646/7688] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:11 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:12.533790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:12.535603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:12.542945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:12.543430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:12.544058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:12.544767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:12.545392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:12.545822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:12.661033 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:12.676005 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-35d28e0c-595a-4516-8f23-aa142de62a63 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1276 microversion: 2.1 time: 0.145626 Oct 13 09:42:12.677329 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4043/7689] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:12 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:13.700828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:13.701498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:13.703796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=29 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:13.711283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:13.712225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:13.713009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:13.713891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:13.714912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:13.715557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:13.860089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:13.869704 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-611d6a7c-c59b-4209-9fe0-97e3468b3638 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1316 microversion: 2.1 time: 0.172758 Oct 13 09:42:13.870922 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3647/7690] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:13 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:14.259205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44b45da-e33b-4be4-a1cf-ac3985f0f5d1", "tag": "bc6edaec-dde3-4de5-8d61-4865cb7629d2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:14.271617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:14.272276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:14.272822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:14.285800 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] Creating event network-changed:bc6edaec-dde3-4de5-8d61-4865cb7629d2 for instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 on n-h1-858384-11 Oct 13 09:42:14.295392 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-65f9304d-bc47-4de0-bb98-ed8fedf66ea7 req-e31ac876-b073-4a81-a8a2-5ae0f0044bf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037793 Oct 13 09:42:14.296137 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4044/7691] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:42:14.892944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:14.893717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:14.901345 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:14.901841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:14.902290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:14.903029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:14.903497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:14.904066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:15.029896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:15.037775 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0a170ff7-eea1-4800-85b6-31849c8ca5bc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1316 microversion: 2.1 time: 0.148802 Oct 13 09:42:15.038352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3648/7692] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:14 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:16.061859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:16.062601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:16.068915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:16.069405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:16.069846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:16.070580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:16.071046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:16.071478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:16.201029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:16.209306 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-894ee19b-60a2-48c0-92a1-b572a92e41dc tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1316 microversion: 2.1 time: 0.152581 Oct 13 09:42:16.209883 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4045/7693] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:16 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:17.232377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:17.232926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:17.240597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:17.241101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:17.241554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:17.242261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:17.242753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:17.243197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:17.376001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:17.383778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0615a4a1-e2fe-47f0-b17b-8b03b23ae416 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1316 microversion: 2.1 time: 0.155397 Oct 13 09:42:17.384360 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3649/7694] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:17 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:17.766866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44b45da-e33b-4be4-a1cf-ac3985f0f5d1", "name": "network-vif-plugged", "status": "completed", "tag": "bc6edaec-dde3-4de5-8d61-4865cb7629d2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:17.777838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:17.778344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:17.778874 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:17.790707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] Creating event network-vif-plugged:bc6edaec-dde3-4de5-8d61-4865cb7629d2 for instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 on n-h1-858384-11 Oct 13 09:42:17.795561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0cdb1fd6-36d1-428b-990f-4e1332202f3f req-8209d9a8-2bee-482d-82aa-93b22920e3ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Oct 13 09:42:17.796157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4046/7695] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:42:18.406518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:18.407144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:18.414655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:18.415152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:18.415603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:18.416307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:18.416779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:18.417216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:18.547342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:18.555621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-356ccbbc-6376-45bc-818b-febc534105d4 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1316 microversion: 2.1 time: 0.153025 Oct 13 09:42:18.556205 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3650/7696] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:18 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:19.579597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:19.580303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:19.586518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:19.587022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:19.587447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:19.588236 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:19.588591 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:19.589017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:19.720626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:19.723485 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=62 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:19.730145 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7cf2bdaa-859d-4b65-bb3e-56548a2926c8 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.155730 Oct 13 09:42:19.730758 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4047/7697] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:19 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:19.791166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1509557103", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "c163b815-2d8c-4ca2-8253-a5779ca989ac"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:19.844066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] validate_networks() for [('c163b815-2d8c-4ca2-8253-a5779ca989ac', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:42:20.203897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:42:20.204331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:42:20.204818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:42:20.205237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:42:20.205686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:42:20.214956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:20.215451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:20.215897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:20.216626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:20.217087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:20.217520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:20.234038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Getting quotas for project 4d81d0573bc04a5b8c4741abd2e0d51c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:42:20.239233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Getting quotas for user 1767733af0174d6d840fa4f5378b715d and project 4d81d0573bc04a5b8c4741abd2e0d51c. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:42:20.251219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:42:20.254030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:42:20.298887 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6f1fdba1-548f-437a-8473-a1a278c4c375 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511588 Oct 13 09:42:20.299545 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3651/7698] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:42:20.310752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-91fbcc8e-8bd7-4b4f-88b4-2170315c7bb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:20.311365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-91fbcc8e-8bd7-4b4f-88b4-2170315c7bb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:20.363916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-91fbcc8e-8bd7-4b4f-88b4-2170315c7bb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:20.371731 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-91fbcc8e-8bd7-4b4f-88b4-2170315c7bb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1217 microversion: 2.1 time: 0.065035 Oct 13 09:42:20.372317 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4048/7699] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:20 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:21.399692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:21.400276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:21.407158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:21.407946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:21.408400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:21.409882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:21.410253 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:21.410705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:21.493829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:21.501877 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-93728891-4434-4392-8992-27f088827c0b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1287 microversion: 2.1 time: 0.110798 Oct 13 09:42:21.503230 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3652/7700] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:21 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:22.525058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:22.525736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:22.531741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:22.533300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:22.533806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:22.534638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:22.535356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:22.536004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:22.536432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:22.679083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:22.688048 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7d415ce0-47c1-48fd-8d40-e15d020517ab tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.166982 Oct 13 09:42:22.688639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4049/7701] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:22 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:22.732090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b67d2a4-9d95-4417-b385-3f69e76134d1", "tag": "eda2b2ab-6aa0-4e14-a122-367687186a26"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:22.745107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:22.745611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:22.746065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:22.757780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] Creating event network-changed:eda2b2ab-6aa0-4e14-a122-367687186a26 for instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 on n-h2-858384-11 Oct 13 09:42:22.762749 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-cf85c2c3-03a4-4576-83f2-01189d47a963 req-e5e98c29-6798-4a88-9876-18b370017eaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034532 Oct 13 09:42:22.763357 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3653/7702] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:42:23.711180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:23.711832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:23.719157 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:23.719644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:23.720083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:23.720791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:23.721253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:23.721707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:23.851943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:23.860085 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f505255d-1af7-47c0-b7a5-fded92903bc1 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.152901 Oct 13 09:42:23.860674 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4050/7703] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:23 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:24.884178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:24.884884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:24.891010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:24.891501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:24.891946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:24.892642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:24.893102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:24.893538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:25.061660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:25.069345 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a394363e-87e8-49e4-be2e-7e08463034ec tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.190400 Oct 13 09:42:25.069910 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3654/7704] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:24 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:26.091698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:26.092343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:26.095065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:26.100878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:26.101359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:26.101797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:26.102512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:26.102968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:26.103392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:26.231810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:26.240327 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23468c1a-742b-4061-81de-96600ca4104b tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.152552 Oct 13 09:42:26.240895 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4051/7705] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:26 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:27.263359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:27.263996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:27.266822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:27.272261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:27.272762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:27.273213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:27.273925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:27.274426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:27.274875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:27.400342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:27.408935 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64ffc8d8-14e7-4e19-9773-a51790a89422 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.149650 Oct 13 09:42:27.409504 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3655/7706] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:27 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:28.431990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:28.432604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:28.439306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:28.439792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:28.440229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:28.440922 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:28.441370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:28.441870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:28.574102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:28.581840 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7d64fdb-4c52-43aa-a405-64ed38ea4657 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.153763 Oct 13 09:42:28.582432 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4052/7707] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:28 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:29.604081 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:29.604708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:29.611770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:29.612264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:29.612714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:29.613909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:29.614380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:29.614854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:29.749701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:29.757993 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fca4240-3f77-4413-b200-e1645baa676d tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.157842 Oct 13 09:42:29.758596 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3656/7708] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:29 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:30.419178 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b67d2a4-9d95-4417-b385-3f69e76134d1", "name": "network-vif-plugged", "status": "completed", "tag": "eda2b2ab-6aa0-4e14-a122-367687186a26"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:30.425058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=8 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:30.432284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:30.432764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:30.433194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:30.445477 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] Creating event network-vif-plugged:eda2b2ab-6aa0-4e14-a122-367687186a26 for instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 on n-h2-858384-11 Oct 13 09:42:30.451330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-437bbc66-9c86-419b-b499-0239a5b2690e req-1d3bcd05-1563-4433-9fd1-e12c4cc3ea1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Oct 13 09:42:30.451937 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4053/7709] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:42:30.779889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:30.780545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:30.782447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:30.783211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:30.789704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:30.790199 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:30.790671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:30.791371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:30.791835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:30.792268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:30.920177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:30.928393 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-68e82243-1586-4018-a303-a89f8229b5a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.152368 Oct 13 09:42:30.928964 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3657/7710] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:30 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:42:31.951820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:31.952550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:31.959507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:31.959994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:31.960436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:31.961133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:31.961612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:31.962021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:32.093872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:32.102338 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-105872eb-8924-4a12-9de0-b693897b87db tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1317 microversion: 2.1 time: 0.154987 Oct 13 09:42:32.102960 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4054/7711] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:31 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:33.125211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:33.125846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:33.132967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.133467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.133919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.134660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.135141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.135586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.261592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:33.269791 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d214e5bb-4a3d-4524-b292-008c6288db15 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1507 microversion: 2.1 time: 0.148046 Oct 13 09:42:33.270357 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3658/7712] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:33 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:33.292014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:33.292544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:33.299371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.299823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.300260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.300946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.301394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.301815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.326250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:42:33.400639 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6fbfa61a-89b9-4e8e-83ec-37cfe3d5b3a7 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 204 len: 0 microversion: 2.1 time: 0.112245 Oct 13 09:42:33.401238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4055/7713] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:33 2022] DELETE /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:42:33.411384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:33.412430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:33.418346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.418871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.419321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.420022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:33.420489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:33.420926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:33.546387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:33.554128 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30170bc4-01c0-4e6e-b711-a949adeffb8e tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1513 microversion: 2.1 time: 0.148728 Oct 13 09:42:33.554674 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3659/7714] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:33 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:34.579606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:34.580317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:34.587308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:34.587792 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:34.588232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:34.588933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:34.589384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:34.589814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:34.726333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:34.734370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1a1e02e-29fc-468f-ab59-4c3d5cdff73c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1513 microversion: 2.1 time: 0.159153 Oct 13 09:42:34.734991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4056/7715] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:34 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:35.358888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b67d2a4-9d95-4417-b385-3f69e76134d1", "name": "network-vif-deleted", "tag": "eda2b2ab-6aa0-4e14-a122-367687186a26"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:35.373265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:35.373822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:35.374911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:35.388549 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] Creating event network-vif-deleted:eda2b2ab-6aa0-4e14-a122-367687186a26 for instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 on n-h2-858384-11 Oct 13 09:42:35.396325 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-6d2f360e-00aa-49f0-8245-c165fe666e05 req-d9db78f2-050f-49ee-99c9-12df45f6303b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042324 Oct 13 09:42:35.397412 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3660/7716] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:42:35.758995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:35.759593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:35.766682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:35.767189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:35.767623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:35.768312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:35.768788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:35.769211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:35.800996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:35.801386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:35.801816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:35.802261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lazy-loading 'fault' on Instance uuid 8b67d2a4-9d95-4417-b385-3f69e76134d1 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:42:35.844163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:35.852394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76dcb11e-a0d7-430c-9923-9e0facdf92cf tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 200 len: 1307 microversion: 2.1 time: 0.097286 Oct 13 09:42:35.852952 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4057/7717] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:35 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:36.877588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:36.878302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:36.885069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:36.885561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:36.886009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:36.886743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:36.887211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:36.887648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:36.901432 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 HTTP/1.1 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8b67d2a4-9d95-4417-b385-3f69e76134d1'} Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:36.903119 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 404 to user: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-11fd586a-5883-4089-a95b-519a03416c7f tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 404 len: 111 microversion: 2.1 time: 0.032152 Oct 13 09:42:36.909211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3661/7718] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:36 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:36.913958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:36.914641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:36.921554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:36.922041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:36.922513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:36.923207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:36.923665 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:36.924096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.052170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.059966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-afc48f9f-c055-495e-87c8-1a6cc492a164 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.149793 Oct 13 09:42:37.060541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4058/7719] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:36 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:37.082449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:37.084674 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 02023528-45e0-432b-a689-a502c4218e6d] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.090192 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/02023528-45e0-432b-a689-a502c4218e6d/action HTTP/1.1 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 32 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: {"resize": {"flavorRef": "452"}} Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '02023528-45e0-432b-a689-a502c4218e6d', 'body': {'resize': {'flavorRef': '452'}}} Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:37.091821 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 404 to user: Instance 02023528-45e0-432b-a689-a502c4218e6d could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-100b18e3-aba2-4b7d-be48-93d0fae38fc6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "POST /compute/v2.1/servers/02023528-45e0-432b-a689-a502c4218e6d/action" status: 404 len: 111 microversion: 2.1 time: 0.015279 Oct 13 09:42:37.096335 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3662/7720] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:42:37 2022] POST /compute/v2.1/servers/02023528-45e0-432b-a689-a502c4218e6d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:37.102274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:37.102935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.109191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.109678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.110118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.110840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.111300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.111735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.243716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.251761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f8801894-799a-4886-8bd4-77c6205d2850 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.153824 Oct 13 09:42:37.252347 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4059/7721] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:37 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:37.275138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:37.275767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.282624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.283126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.283582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.284287 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.285384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.285848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.413682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.421517 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f7d85c3-9659-4274-9a90-6daa00589094 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.150255 Oct 13 09:42:37.422081 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3663/7722] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:37 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:37.443885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1a102e21-caf9-4f42-97c0-9ea4dffedd58"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:37.446106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.452508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.453029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.453476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.454176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.454666 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.455096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.495114 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.500390 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: request: POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action HTTP/1.1 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 65 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: {"resize": {"flavorRef": "1a102e21-caf9-4f42-97c0-9ea4dffedd58"}} Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: exception: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': 'f44b45da-e33b-4be4-a1cf-ac3985f0f5d1', 'body': {'resize': {'flavorRef': '1a102e21-caf9-4f42-97c0-9ea4dffedd58'}}} Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:37.502308 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 400 to user: Flavor 1a102e21-caf9-4f42-97c0-9ea4dffedd58 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cc0ca11-cdce-4d2e-bf3e-a0dcaa37d398 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action" status: 400 len: 107 microversion: 2.1 time: 0.064369 Oct 13 09:42:37.507331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4060/7723] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:42:37 2022] POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:42:37.513319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:37.513951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.520595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.521094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.521578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.522286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.522786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.523232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.654382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.662340 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c5246285-f617-497f-b8ce-341eb7a4806c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.152840 Oct 13 09:42:37.662950 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3664/7724] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:37 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:37.684925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:37.685545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.692030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.692511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.692948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.693638 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.694144 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.694548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.822899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:37.830751 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-236b68a0-1ac4-4fa9-b08a-15e83feaa649 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.149786 Oct 13 09:42:37.831322 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4061/7725] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:37 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:37.852583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffdaf7b2-ca0e-4b78-8851-c5929a4529d9 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffdaf7b2-ca0e-4b78-8851-c5929a4529d9 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: request: POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action HTTP/1.1 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 29 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: {"resize": {"flavorRef": ""}} Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f44b45da-e33b-4be4-a1cf-ac3985f0f5d1', 'body': {'resize': {'flavorRef': ''}}} Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise error Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi '' Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.856209 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffdaf7b2-ca0e-4b78-8851-c5929a4529d9 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ffdaf7b2-ca0e-4b78-8851-c5929a4529d9 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action" status: 400 len: 113 microversion: 2.1 time: 0.009151 Oct 13 09:42:37.861245 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3665/7726] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:42:37 2022] POST /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 13 09:42:37.866307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:37.866948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:37.872801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.873281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.873754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:37.874473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:37.874929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:37.875356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.009442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:38.017276 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f9fd24d-8fc2-4404-bf24-27ed095a9330 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1505 microversion: 2.1 time: 0.155215 Oct 13 09:42:38.017852 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4062/7727] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:37 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:38.043522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:38.044091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:38.053771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.054269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.054758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.055466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.055934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.056375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.070010 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 HTTP/1.1 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '8b67d2a4-9d95-4417-b385-3f69e76134d1'} Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:38.071607 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 404 to user: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52fa6678-fef8-4056-8c23-99e451f3c7f6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 404 len: 111 microversion: 2.1 time: 0.034241 Oct 13 09:42:38.076307 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3666/7728] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:38 2022] DELETE /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:38.082426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:38.083056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: 8b67d2a4-9d95-4417-b385-3f69e76134d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:38.089003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.089518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.089962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.090692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.091146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.091573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.105452 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 HTTP/1.1 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '8b67d2a4-9d95-4417-b385-3f69e76134d1'} Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:38.107057 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 404 to user: Instance 8b67d2a4-9d95-4417-b385-3f69e76134d1 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dd7af269-93f6-44a2-8ecc-311054276b57 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1" status: 404 len: 111 microversion: 2.1 time: 0.029914 Oct 13 09:42:38.112304 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4063/7729] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:38 2022] GET /compute/v2.1/servers/8b67d2a4-9d95-4417-b385-3f69e76134d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:42:38.117532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:38.118043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:38.124017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.124507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.124957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.125657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.126122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.126608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.150984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:42:38.184749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:38.227749 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8402b866-94d9-48ce-b975-1464db61ebb6 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 204 len: 0 microversion: 2.1 time: 0.114206 Oct 13 09:42:38.228806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3667/7730] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:42:38 2022] DELETE /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 13 09:42:38.237840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:38.238530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:38.244520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.245005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.245448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.246145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:38.246636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:38.247071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:38.375604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:38.383447 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-06c0311e-4335-4b93-9a54-2501bbfb2379 tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1511 microversion: 2.1 time: 0.150106 Oct 13 09:42:38.384021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4064/7731] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:38 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:39.406667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:39.407407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:39.414847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:39.415340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:39.415783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:39.416759 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:39.417224 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:39.417660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:39.544283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1767733af0174d6d840fa4f5378b715d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d81d0573bc04a5b8c4741abd2e0d51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:42:39.552172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-65cc6077-32d8-4466-81f8-6bd49c4f269c tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 200 len: 1511 microversion: 2.1 time: 0.149876 Oct 13 09:42:39.552745 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3668/7732] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:39 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:42:40.018860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44b45da-e33b-4be4-a1cf-ac3985f0f5d1", "name": "network-vif-deleted", "tag": "bc6edaec-dde3-4de5-8d61-4865cb7629d2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:42:40.036498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:40.037430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:40.037876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:40.042477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:42:40.052417 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] Creating event network-vif-deleted:bc6edaec-dde3-4de5-8d61-4865cb7629d2 for instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 on n-h1-858384-11 Oct 13 09:42:40.063353 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d4cac27c-89b5-4c61-96e0-5cecc459403c req-436ee011-1df4-46fc-9d27-c4b15cc2ad39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048859 Oct 13 09:42:40.064296 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4065/7733] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:42:40.575084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:42:40.575640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] [instance: f44b45da-e33b-4be4-a1cf-ac3985f0f5d1] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:42:40.581978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:40.582508 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:40.582961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:40.583660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:42:40.584122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:42:40.584557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:42:40.598203 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] HTTP exception thrown: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Request method failure captured: Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 HTTP/1.1 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR91yq1fw710TvQVLzUzlMNUaFZVCYgndKbH442ATLdTMgH8b8elSWnxjXwHDRQ4T5L9Z228vp0kuX8O2_SZZKEFN-9HDmf-cnnfmHcfe4IJ8N4GZ-owEV3dv_q4Qp4_HTC5EWJHgbO6oHspoeojSVjoM-dKFb1jYvq3LO0I7fh4v2A8 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4d81d0573bc04a5b8c4741abd2e0d51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4d81d0573bc04a5b8c4741abd2e0d51c Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1756170658 Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1767733af0174d6d840fa4f5378b715d Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-ServersNegativeTestJSON-1756170658-project Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f44b45da-e33b-4be4-a1cf-ac3985f0f5d1'} Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:42:40.599865 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] Returning 404 to user: Instance f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-148dad9f-def5-46c4-b02b-a7fa3b1b146a tempest-ServersNegativeTestJSON-1756170658 tempest-ServersNegativeTestJSON-1756170658-project] 10.222.0.23 "GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1" status: 404 len: 111 microversion: 2.1 time: 0.030229 Oct 13 09:42:40.604765 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3669/7734] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:42:40 2022] GET /compute/v2.1/servers/f44b45da-e33b-4be4-a1cf-ac3985f0f5d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:43:12.600174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:12.820464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e46702ea-4f1e-422f-93c2-a832d22936f4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: .version_select at 0x7f5375dbdc10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2042840918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUeFV4/LyLdtPkwFa5mycqQsmrIh+DWBBX7241taas7XOEZZR0d6//N9UQFWdTsk8jW5C5m7if7LpF+8x/+sLCLU/+xAZNyM4JmMAUGdsXds/yVl0lqezAD+xl0Sl3trQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:12.836644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e46702ea-4f1e-422f-93c2-a832d22936f4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:43:12.842222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-e46702ea-4f1e-422f-93c2-a832d22936f4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:43:12.884107 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e46702ea-4f1e-422f-93c2-a832d22936f4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.290176 Oct 13 09:43:12.884951 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4066/7735] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:43:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:12.943119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-159177006", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2042840918", "networks": [{"uuid": "1eb0a310-2048-42cc-9775-c4112f0800de"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:12.954586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:12.955265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:13.008847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] validate_networks() for [('1eb0a310-2048-42cc-9775-c4112f0800de', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:43:13.413337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:43:13.413772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:43:13.414260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:43:13.414735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:43:13.415157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:43:13.425960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:13.426479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:13.426927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:13.427658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:13.428119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:13.428555 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:13.445321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:43:13.450701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:43:13.462849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:43:13.465139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:43:13.511037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c33de05-1e9d-47c5-87f0-c5765169edb5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571829 Oct 13 09:43:13.511864 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3670/7736] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:43:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:43:13.522925 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-aa3a8d8e-76bb-402b-9f97-918e6afb33ca tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:13.523782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-aa3a8d8e-76bb-402b-9f97-918e6afb33ca tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:13.682433 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-aa3a8d8e-76bb-402b-9f97-918e6afb33ca tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:13.690843 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-aa3a8d8e-76bb-402b-9f97-918e6afb33ca tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1262 microversion: 2.1 time: 0.171411 Oct 13 09:43:13.691409 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4067/7737] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:13 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:14.716990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:14.717736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:14.727496 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:14.728337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:14.729369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:14.730318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:14.731091 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:14.731737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:14.888328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:14.898073 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-67c429f3-d233-4e94-974c-ba54219a0ee6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1320 microversion: 2.1 time: 0.186877 Oct 13 09:43:14.898721 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3671/7738] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:14 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:15.927701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:15.928975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:15.938564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:15.939443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:15.940048 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:15.940960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:15.941600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:15.942185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:15.946538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760280cc-35c9-4070-b7ff-9163e5272665", "tag": "36869a8d-3566-4106-a7f7-e3b3ab99f9a0"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:15.993007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:15.994554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:15.995263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:16.022889 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] Creating event network-changed:36869a8d-3566-4106-a7f7-e3b3ab99f9a0 for instance 760280cc-35c9-4070-b7ff-9163e5272665 on n-h1-858384-11 Oct 13 09:43:16.035938 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-74f19571-6691-4144-937d-9704f356bde4 req-bf688788-636c-4ec6-b98e-d86c2e01b02b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105744 Oct 13 09:43:16.036718 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3672/7739] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:16.202582 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:16.212430 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fdb0a116-0e8a-4b2c-8753-e156c56044df tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.290066 Oct 13 09:43:16.213763 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4068/7740] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:15 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:17.238328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:17.239705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:17.246766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:17.247268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:17.247717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:17.248441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:17.248912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:17.249349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:17.394070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:17.401828 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f5fa94d-fe9b-466a-b312-97eb4eac0768 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.168953 Oct 13 09:43:17.402389 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3673/7741] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:17 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:18.423958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:18.424673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:18.433021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:18.433601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:18.434119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:18.434941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:18.435475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:18.435984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:18.597563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:18.607128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4883bf69-aa28-4a78-9316-b10875d1fbf0 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.187160 Oct 13 09:43:18.608639 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4069/7742] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:18 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:19.632126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:19.632908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:19.640599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:19.641130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:19.641583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:19.642300 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:19.642819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:19.643263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:19.768396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:19.776136 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc2f9628-391b-4154-9e63-cb060465007a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.148608 Oct 13 09:43:19.776716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3674/7743] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:19 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:20.799297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:20.799853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:20.806736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:20.807226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:20.807670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:20.808362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:20.808830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:20.809241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:20.935698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:20.944081 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-226b9386-677d-4811-b6bc-5ffbd8fefe4e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.148793 Oct 13 09:43:20.944666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4070/7744] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:20 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:21.966477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:21.967237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:21.974951 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:21.975453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:21.975905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:21.976626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:21.977249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:21.977699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:22.020759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760280cc-35c9-4070-b7ff-9163e5272665", "name": "network-vif-plugged", "status": "completed", "tag": "36869a8d-3566-4106-a7f7-e3b3ab99f9a0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:22.031967 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:22.032461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:22.032945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:22.048475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] Creating event network-vif-plugged:36869a8d-3566-4106-a7f7-e3b3ab99f9a0 for instance 760280cc-35c9-4070-b7ff-9163e5272665 on n-h1-858384-11 Oct 13 09:43:22.053757 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3f13fcfa-2902-4364-91ee-0a7818c610b8 req-7b97d514-18fd-4572-8674-9d7d9db05394 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037985 Oct 13 09:43:22.054817 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4071/7745] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:43:22.124328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:22.135780 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98e3176d-1106-4c27-9f98-45f8cc42138c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1362 microversion: 2.1 time: 0.173283 Oct 13 09:43:22.136387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3675/7746] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:21 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:23.161146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:23.162528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:23.168865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:23.169352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:23.169837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:23.170513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:23.171082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:23.171567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:23.305271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:23.313102 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-28abf5ff-66a0-450d-a462-a3c1b83e9a8d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1554 microversion: 2.1 time: 0.157351 Oct 13 09:43:23.313689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4072/7747] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:23 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:23.336421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:23.337041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:23.343812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:23.344303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:23.344747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:23.345444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:23.345906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:23.346340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:23.434612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:23.457103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:23.475140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:23.482778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8dd91073-7f27-4dc1-9250-70fe52f0f8f6 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1554 microversion: 2.1 time: 0.150347 Oct 13 09:43:23.483346 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3676/7748] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:23 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:25.136345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d1201fe-4a94-4e4c-8b64-c46a019af664"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:25.138789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:25.140755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:25.147335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:25.147822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:25.148260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:25.148954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:25.149406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:25.149833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:25.388207 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ab1ad96a-2242-4ce4-b254-830cd70fa8d2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255628 Oct 13 09:43:25.388828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4073/7749] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:43:25 2022] POST /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:36.102967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:36.103518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:36.106428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:36.107201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:36.115612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:36.116112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:36.116566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:36.117275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:36.117735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:36.118169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:36.198265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'services' on Instance uuid 760280cc-35c9-4070-b7ff-9163e5272665 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:43:36.275421 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0079c2dd-0f74-4714-ae7a-c02701cdbe89 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments/0d1201fe-4a94-4e4c-8b64-c46a019af664" status: 202 len: 0 microversion: 2.1 time: 0.175818 Oct 13 09:43:36.276031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3677/7750] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:43:36 2022] DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments/0d1201fe-4a94-4e4c-8b64-c46a019af664 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:43:36.285434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:36.287854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:36.294938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:36.296000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:43:36.297890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:36.298557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:36.299176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:36.299888 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:36.300406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:36.301028 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:36.342986 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-90af472b-0afe-4a23-b31c-34d3e22917ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061875 Oct 13 09:43:36.343584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4074/7751] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:36 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:37.355518 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:37.357886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:37.365447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:37.365969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:37.366432 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:37.367142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:37.367607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:37.368042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:37.401281 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dfb9e8db-048e-450b-acc1-2c22eb022c59 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050113 Oct 13 09:43:37.401849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3678/7752] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:37 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:38.413310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:38.415593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:38.422579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:38.423069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:38.423517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:38.424224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:38.424676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:38.425103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:38.456498 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-38fe078b-457e-450a-a93e-d92c4515c085 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047210 Oct 13 09:43:38.457080 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4075/7753] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:38 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:39.468904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:39.471184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:39.478737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:39.479237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:39.479690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:39.480397 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:39.480871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:39.481310 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:39.510796 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-350b5583-0c55-46bf-ba09-4264a144be35 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Oct 13 09:43:39.511593 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3679/7754] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:39 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:40.523682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:40.525856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:40.532804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:40.533291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:40.533738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:40.534460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:40.534916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:40.535343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:40.565974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f49863de-09a8-4ea8-8922-0120d3c857f2 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046750 Oct 13 09:43:40.566571 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4076/7755] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:40 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:41.578456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:41.580630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:41.586912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:41.587309 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:41.588151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:41.588924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:41.590067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:41.590581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:41.621572 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-868bb5da-1923-40cd-9b76-5dc8f4b20003 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047443 Oct 13 09:43:41.622151 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3680/7756] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:43:41 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:43:41.633003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:41.633501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:41.640376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:41.640858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:41.641299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:41.641995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:41.642482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:41.642916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:41.719932 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance 760280cc-35c9-4070-b7ff-9163e5272665 is not attached to volume 0d1201fe-4a94-4e4c-8b64-c46a019af664 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: request: DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments/0d1201fe-4a94-4e4c-8b64-c46a019af664 HTTP/1.1 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 760280cc-35c9-4070-b7ff-9163e5272665 is not attached to volume 0d1201fe-4a94-4e4c-8b64-c46a019af664 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'server_id': '760280cc-35c9-4070-b7ff-9163e5272665', 'id': '0d1201fe-4a94-4e4c-8b64-c46a019af664'} Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0d1201fe-4a94-4e4c-8b64-c46a019af664. Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760280cc-35c9-4070-b7ff-9163e5272665 is not attached to volume 0d1201fe-4a94-4e4c-8b64-c46a019af664 Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:43:41.731323 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760280cc-35c9-4070-b7ff-9163e5272665 is not attached to volume 0d1201fe-4a94-4e4c-8b64-c46a019af664 Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance 760280cc-35c9-4070-b7ff-9163e5272665 is not attached to volume 0d1201fe-4a94-4e4c-8b64-c46a019af664 {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1a322596-1cb9-4647-bc50-c36698241f4b tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments/0d1201fe-4a94-4e4c-8b64-c46a019af664" status: 404 len: 154 microversion: 2.1 time: 0.104050 Oct 13 09:43:41.736503 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4077/7757] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:43:41 2022] DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665/os-volume_attachments/0d1201fe-4a94-4e4c-8b64-c46a019af664 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:43:45.078213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:45.078802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:45.086349 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:45.086905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:45.087353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:45.088076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:45.088676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:45.088937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:45.116129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:43:45.195427 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-98ecff82-6cd9-4cb1-8582-0a918919fdd8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 204 len: 0 microversion: 2.1 time: 0.120822 Oct 13 09:43:45.196012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3681/7758] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:43:45 2022] DELETE /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:43:45.204984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:45.205610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:45.213384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:45.213815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:45.214259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:45.215041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:45.215500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:45.215934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:45.347192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:45.355815 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62f79977-1a3a-413b-b13b-268b5f548a2a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1560 microversion: 2.1 time: 0.155192 Oct 13 09:43:45.356388 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4078/7759] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:45 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:43:46.379847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:46.380589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:46.387417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:46.387907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:46.388356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:46.389049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:46.389524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:46.389938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:46.521544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:46.529205 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c89dff08-a689-48f5-97fe-33314aa5db7d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1560 microversion: 2.1 time: 0.153686 Oct 13 09:43:46.529777 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3682/7760] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:46 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:47.267958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760280cc-35c9-4070-b7ff-9163e5272665", "name": "network-vif-deleted", "tag": "36869a8d-3566-4106-a7f7-e3b3ab99f9a0"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:47.282146 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:47.282776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:47.283212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:47.297169 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] Creating event network-vif-deleted:36869a8d-3566-4106-a7f7-e3b3ab99f9a0 for instance 760280cc-35c9-4070-b7ff-9163e5272665 on n-h1-858384-11 Oct 13 09:43:47.303516 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-01444dda-2394-402d-9746-c8c3a1e8c56c req-8f7e9df3-8f41-442c-ae81-4564d07818b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039094 Oct 13 09:43:47.304460 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4079/7761] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:47.553123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:47.553644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:47.560450 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:47.560936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:47.561378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:47.562073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:47.562566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:47.563003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:47.593375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:47.593865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:47.594313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:47.594796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'fault' on Instance uuid 760280cc-35c9-4070-b7ff-9163e5272665 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:43:47.635463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:47.644364 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1652a6f6-af42-43fa-a940-d2282ac1b315 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 200 len: 1352 microversion: 2.1 time: 0.095796 Oct 13 09:43:47.645121 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3683/7762] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:47 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:48.668994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:48.669726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 760280cc-35c9-4070-b7ff-9163e5272665] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:48.676005 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:48.676483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:48.676945 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:48.677636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:48.678087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:48.678546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:48.691602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 HTTP/1.1 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '760280cc-35c9-4070-b7ff-9163e5272665'} Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:48.693214 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance 760280cc-35c9-4070-b7ff-9163e5272665 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-653aebc8-635d-4c97-89ce-b791c89a0497 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665" status: 404 len: 111 microversion: 2.1 time: 0.030786 Oct 13 09:43:48.698332 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4080/7763] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:48 2022] GET /compute/v2.1/servers/760280cc-35c9-4070-b7ff-9163e5272665 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:43:48.703442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afa8cf61-8a5c-4093-96c1-56a41db64ac3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '.version_select at 0x7f537a9b0940>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:48.724579 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afa8cf61-8a5c-4093-96c1-56a41db64ac3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2042840918" status: 202 len: 0 microversion: 2.1 time: 0.024931 Oct 13 09:43:48.725167 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3684/7764] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Oct 13 09:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2042840918 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:43:48.739919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20994c97-0906-4d49-9ba6-974e021b980e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: .version_select at 0x7f5375dbdee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-779312748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi/jc2uD1pC+spnWUnusUzDEgg1gGj1wwcO06+2kdsZAPpfFpT7U98weWEwLPcwPNnyV7OmhHaImkcSVnTmlkA/pDfOvj0Iqa6w9ngWh1HxlgjENj6J7RGwDjGGQlJ9Ug=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:48.755031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-20994c97-0906-4d49-9ba6-974e021b980e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:43:48.760162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-20994c97-0906-4d49-9ba6-974e021b980e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:43:48.783101 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20994c97-0906-4d49-9ba6-974e021b980e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047106 Oct 13 09:43:48.783687 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4081/7765] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:43:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:48.832202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-957407170", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-779312748", "networks": [{"uuid": "1eb0a310-2048-42cc-9775-c4112f0800de"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:48.884620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] validate_networks() for [('1eb0a310-2048-42cc-9775-c4112f0800de', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:43:49.285523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:43:49.285954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:43:49.286458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:43:49.286879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:43:49.287327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:43:49.296058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:49.296546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:49.296988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:49.297714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:49.298172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:49.298636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:49.315771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:43:49.321568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:43:49.333543 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:43:49.335901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:43:49.382150 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad306bef-6e44-4a70-a17c-d42a8b72a190 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553834 Oct 13 09:43:49.382838 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3685/7766] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:43:49.393875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eee26d0b-42b9-4689-af20-571591c0c49e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:49.394748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eee26d0b-42b9-4689-af20-571591c0c49e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:49.450780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eee26d0b-42b9-4689-af20-571591c0c49e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:49.458838 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eee26d0b-42b9-4689-af20-571591c0c49e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1261 microversion: 2.1 time: 0.068817 Oct 13 09:43:49.459404 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4082/7767] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:49 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:43:50.482380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:50.483046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:50.494178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:50.495026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:50.495482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:50.496405 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:50.497024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:50.497460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:50.562017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:50.575707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1745af5-0661-41aa-9965-8a30725cee66 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1321 microversion: 2.1 time: 0.097706 Oct 13 09:43:50.576968 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3686/7768] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:50 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:51.600290 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:51.600905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:51.607997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:51.608483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:51.609158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:51.610049 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:51.610528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:51.610956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:52.055368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:52.063095 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-76191268-4ac1-4ed5-9eb2-7daad3c1bd39 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.467452 Oct 13 09:43:52.063689 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4083/7769] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:51 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:52.150904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909e52ce-c041-493b-9938-defd1c911bd4", "tag": "687fb6db-7716-45db-98fe-9c9d3b424d58"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:52.162324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:52.163144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:52.163592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:52.174721 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] Creating event network-changed:687fb6db-7716-45db-98fe-9c9d3b424d58 for instance 909e52ce-c041-493b-9938-defd1c911bd4 on n-h1-858384-11 Oct 13 09:43:52.181613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1eac5ce6-984e-4968-896b-2d50dd636e16 req-4fa5b3d8-7c96-47b1-aaa7-ddb2f003cca8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034570 Oct 13 09:43:52.182295 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3687/7770] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:53.086073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:53.086715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:53.093562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:53.094041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:53.094505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:53.095228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:53.095684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:53.096110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:53.221313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:53.229707 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-53bcf608-56a0-4f0e-b84d-7ba997164f80 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.148046 Oct 13 09:43:53.230323 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4084/7771] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:53 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:54.253473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:54.254176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:54.261098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:54.261588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:54.262032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:54.262765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:54.263231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:54.263665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:54.393289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:54.400984 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-55024b33-347a-42e6-aa60-1a8e08b6d3c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.152565 Oct 13 09:43:54.401559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3688/7772] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:54 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:55.424007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:55.424626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:55.432379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:55.432860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:55.433295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:55.433984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:55.434448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:55.434944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:55.571284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:55.578950 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb0c973b-08f9-4561-a7b0-88af3fd94c05 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.158818 Oct 13 09:43:55.579541 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4085/7773] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:55 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:56.601341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:56.601972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:56.609235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:56.609732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:56.610190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:56.610921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:56.611411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:56.611833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:56.738143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:56.745758 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4784d1a5-d25b-4c14-a5ab-3c8a863d33d4 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.148402 Oct 13 09:43:56.746325 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3689/7774] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:56 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:57.767706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:57.768316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:57.776133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:57.776610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:57.777130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:57.777816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:57.778264 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:57.778707 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:57.905893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:57.914252 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ddd9be6-3e5e-412f-9629-f5170a12df76 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.150492 Oct 13 09:43:57.914860 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4086/7775] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:57 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:43:58.184138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909e52ce-c041-493b-9938-defd1c911bd4", "name": "network-vif-plugged", "status": "completed", "tag": "687fb6db-7716-45db-98fe-9c9d3b424d58"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:43:58.194146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:58.194668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:58.195120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:58.205714 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] Creating event network-vif-plugged:687fb6db-7716-45db-98fe-9c9d3b424d58 for instance 909e52ce-c041-493b-9938-defd1c911bd4 on n-h1-858384-11 Oct 13 09:43:58.211370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d13f9c0d-4b47-45a1-ab9d-d92d21db8fcf req-adab161c-9b08-442c-990c-0d6c65d46645 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092006 Oct 13 09:43:58.212012 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3690/7776] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:43:58.936868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:43:58.937543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:43:58.944350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:58.944824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:58.945259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:58.945943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:43:58.946390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:43:58.946848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:43:59.073586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:43:59.081313 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d8944e7b-1246-404f-b312-e6b39fec84cd tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1361 microversion: 2.1 time: 0.148418 Oct 13 09:43:59.081896 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4087/7777] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:43:58 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:00.103466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:00.104176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:00.108515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:00.109494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:00.117083 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:00.117583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:00.118036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:00.118784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:00.119255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:00.119696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:00.246315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:00.254132 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ba7cbd01-37e8-4683-9299-b0260b5e9a4a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1554 microversion: 2.1 time: 0.152556 Oct 13 09:44:00.254764 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3691/7778] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:00 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:00.275782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:00.276400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:00.278395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:00.284598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:00.285069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:00.286002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:00.286722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:00.287174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:00.287597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:00.414924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:00.422632 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05114aa8-5628-4fe3-abcd-199c3f722625 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1554 microversion: 2.1 time: 0.150665 Oct 13 09:44:00.423218 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4088/7779] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:00 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:01.905572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df5f0644-e645-4ba0-8684-de1e6542af19"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:01.908097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:01.915435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:01.915934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:01.916390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:01.917124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:01.917645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:01.918127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:02.138207 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:02.157860 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8a9cd5c3-1322-4b03-ae74-273ec1ad7604 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256179 Oct 13 09:44:02.158816 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3692/7780] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:44:01 2022] POST /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:12.859606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:12.860125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:12.862349 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:12.863149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=70 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:12.869802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:12.870277 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:12.870756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:12.871439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:12.871882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:12.872300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:12.951263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'services' on Instance uuid 909e52ce-c041-493b-9938-defd1c911bd4 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:44:13.020381 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-85ab9348-7012-44b5-a7b6-0407ecaccc01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments/df5f0644-e645-4ba0-8684-de1e6542af19" status: 202 len: 0 microversion: 2.1 time: 0.164973 Oct 13 09:44:13.021129 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4089/7781] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:44:12 2022] DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments/df5f0644-e645-4ba0-8684-de1e6542af19 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:44:13.030169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:13.032684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:13.035313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:13.035990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:13.042241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:13.042765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:13.043213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:13.043932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:13.044390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:13.044860 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:13.078252 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-70fba142-b57a-403d-8395-f7d4e4dfceb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052609 Oct 13 09:44:13.078829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3693/7782] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:13 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:44:14.092411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:14.095981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:14.104188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:14.104827 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:14.105336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:14.106154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:14.106651 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:14.107065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:14.139950 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5968b090-e3af-43a2-936c-439ddc27cd5a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052748 Oct 13 09:44:14.140532 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4090/7783] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:14 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:15.153179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:15.155392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:15.162527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:15.163021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:15.163466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:15.164165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:15.164623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:15.165059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:15.195138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c0b99de-02c2-46e9-b9d4-e2beff650cc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Oct 13 09:44:15.195716 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3694/7784] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:15 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:44:16.207609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:16.210472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:16.217411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:16.217889 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:16.218318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:16.219056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:16.219501 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:16.219921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:16.252401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8d2fc3ef-4010-4a52-b33a-dd4d7b087f1c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Oct 13 09:44:16.252963 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4091/7785] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:16 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:17.265454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:17.267583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:17.274618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:17.275114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:17.275563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:17.276266 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:17.276753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:17.277192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:17.307284 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b53e2122-41d1-42a0-a6b6-d052d734f270 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Oct 13 09:44:17.307856 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3695/7786] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:17 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:18.319844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:18.321970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:18.328834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:18.329320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:18.329764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:18.330590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:18.331051 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:18.331478 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:18.360534 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2d6e72c-a005-4315-8ac6-0fb31b4d610a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044849 Oct 13 09:44:18.361097 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4092/7787] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:18 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:44:18.372297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:18.372831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:18.379645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:18.380138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:18.380588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:18.381858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:18.382321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:18.382804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:18.458777 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance 909e52ce-c041-493b-9938-defd1c911bd4 is not attached to volume df5f0644-e645-4ba0-8684-de1e6542af19 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments/df5f0644-e645-4ba0-8684-de1e6542af19 HTTP/1.1 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 909e52ce-c041-493b-9938-defd1c911bd4 is not attached to volume df5f0644-e645-4ba0-8684-de1e6542af19 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '909e52ce-c041-493b-9938-defd1c911bd4', 'id': 'df5f0644-e645-4ba0-8684-de1e6542af19'} Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id df5f0644-e645-4ba0-8684-de1e6542af19. Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909e52ce-c041-493b-9938-defd1c911bd4 is not attached to volume df5f0644-e645-4ba0-8684-de1e6542af19 Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:18.461286 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909e52ce-c041-493b-9938-defd1c911bd4 is not attached to volume df5f0644-e645-4ba0-8684-de1e6542af19 Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance 909e52ce-c041-493b-9938-defd1c911bd4 is not attached to volume df5f0644-e645-4ba0-8684-de1e6542af19 {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-eb9a7bf4-3e71-4378-9118-a2053c824921 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments/df5f0644-e645-4ba0-8684-de1e6542af19" status: 404 len: 154 microversion: 2.1 time: 0.094511 Oct 13 09:44:18.466257 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3696/7788] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:44:18 2022] DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4/os-volume_attachments/df5f0644-e645-4ba0-8684-de1e6542af19 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:44:21.816913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:21.817510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:21.825102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:21.825590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:21.826037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:21.826767 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:21.827223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:21.827701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:21.854722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:44:21.935153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f01895c0-7315-42ae-b50f-af66311f6106 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 204 len: 0 microversion: 2.1 time: 0.121833 Oct 13 09:44:21.936022 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4093/7789] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:44:21 2022] DELETE /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:44:21.945989 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:21.946767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:21.954680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:21.955311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:21.955870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:21.956701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:21.957568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:21.958262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:22.104001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:22.112264 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a92e6377-7564-4822-9145-344439978180 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1560 microversion: 2.1 time: 0.170634 Oct 13 09:44:22.112772 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3697/7790] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:21 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:23.136604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:23.137362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:23.144347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:23.144831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:23.145270 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:23.145964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:23.146430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:23.147369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:23.280519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:23.288902 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-348724a1-80d7-42f7-a0c9-3893b96908e1 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1560 microversion: 2.1 time: 0.156581 Oct 13 09:44:23.289476 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4094/7791] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:23 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:23.968135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909e52ce-c041-493b-9938-defd1c911bd4", "name": "network-vif-deleted", "tag": "687fb6db-7716-45db-98fe-9c9d3b424d58"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:23.979007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:23.979505 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:23.979948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:23.993044 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] Creating event network-vif-deleted:687fb6db-7716-45db-98fe-9c9d3b424d58 for instance 909e52ce-c041-493b-9938-defd1c911bd4 on n-h1-858384-11 Oct 13 09:44:23.999848 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2d59c361-cce4-4cb2-90a6-35e9dc59333a req-ee37f412-13e5-45ef-8fce-44e018544e13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035386 Oct 13 09:44:24.000471 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3698/7792] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:24.311943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:24.312492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:24.319486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:24.319974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:24.320414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:24.321119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:24.321575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:24.322001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:24.353334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:24.353821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:24.354259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:24.354733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'fault' on Instance uuid 909e52ce-c041-493b-9938-defd1c911bd4 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:44:24.400542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:24.409856 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31448823-c7cf-46ce-9889-128b1d3e4e01 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 200 len: 1351 microversion: 2.1 time: 0.101355 Oct 13 09:44:24.410651 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4095/7793] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:24 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:25.435333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:25.436105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: 909e52ce-c041-493b-9938-defd1c911bd4] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:25.442381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:25.442906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:25.443380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:25.444670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:25.445138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:25.445579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:25.459896 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 HTTP/1.1 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '909e52ce-c041-493b-9938-defd1c911bd4'} Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:25.461550 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance 909e52ce-c041-493b-9938-defd1c911bd4 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6073bbce-df77-4928-9f25-a0fee7570a62 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4" status: 404 len: 111 microversion: 2.1 time: 0.032927 Oct 13 09:44:25.466353 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3699/7794] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:25 2022] GET /compute/v2.1/servers/909e52ce-c041-493b-9938-defd1c911bd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:44:25.472052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3717fd5d-2835-42b9-891a-0aa5342ee861 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '.version_select at 0x7f5375c25700>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:25.492575 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3717fd5d-2835-42b9-891a-0aa5342ee861 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-779312748" status: 202 len: 0 microversion: 2.1 time: 0.024337 Oct 13 09:44:25.493157 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4096/7795] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-779312748 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:44:25.509805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5e0ffd28-b56a-4980-b570-458727fa8971 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: .version_select at 0x7f5376c685e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-617862073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHytJCZgU+y4a0mCJUWznEIVg+JJN5RweFVQiAdI9mKnwVLZfkNw1FQloczGXHqjSOfxflAm7QCKGjcuGPlZwpIu4lz22Iiy81OfrRoy85F+Pkp7z3dmMWYQUbf88BHdBg=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:25.524916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5e0ffd28-b56a-4980-b570-458727fa8971 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:44:25.533670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-5e0ffd28-b56a-4980-b570-458727fa8971 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:44:25.556834 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5e0ffd28-b56a-4980-b570-458727fa8971 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052256 Oct 13 09:44:25.557446 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3700/7796] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:44:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:25.608403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2008692585", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-617862073", "networks": [{"uuid": "1eb0a310-2048-42cc-9775-c4112f0800de"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:25.660789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] validate_networks() for [('1eb0a310-2048-42cc-9775-c4112f0800de', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:44:26.040404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:44:26.040959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:44:26.041450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:44:26.041879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:44:26.042301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:44:26.051554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:26.052036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:26.052471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:26.053718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:26.054167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:26.054615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:26.072103 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:44:26.077182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Getting quotas for user ccccf0c607b54363a7da08ddb6617667 and project d9034b9c2dc64015812aa42f2b36ab4d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:44:26.089147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:44:26.091594 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:44:26.136337 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:44:27.143550 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 57676. Oct 13 09:44:27.147959 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b7ab5ae-afe2-465b-9f4e-f78ed7b7ae21 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543473 Oct 13 09:44:27.148617 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4097/7797] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:44:27.160727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e0f7c8e2-bdce-4e87-b329-259d2a02121e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:27.161353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e0f7c8e2-bdce-4e87-b329-259d2a02121e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:27.215722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e0f7c8e2-bdce-4e87-b329-259d2a02121e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:27.226109 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e0f7c8e2-bdce-4e87-b329-259d2a02121e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1262 microversion: 2.1 time: 0.070069 Oct 13 09:44:27.226751 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3701/7798] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:27 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:28.249933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:28.250576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:28.257901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:28.258385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:28.258846 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:28.259536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:28.259986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:28.260405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:28.340504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:28.348817 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-eda6bf9b-11dc-4c01-a6a6-66fe70602a90 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1320 microversion: 2.1 time: 0.103532 Oct 13 09:44:28.349517 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4098/7799] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:28 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1320 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:29.372165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:29.372856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:29.380400 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:29.381437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:29.381898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:29.382655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:29.383122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:29.383563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:29.461378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b", "tag": "fbeaa876-3a5a-4d7d-987d-7f912a032f87"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:29.475658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:29.476138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:29.476575 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:29.489266 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] Creating event network-changed:fbeaa876-3a5a-4d7d-987d-7f912a032f87 for instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b on n-h1-858384-11 Oct 13 09:44:29.494357 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0bef918e-531b-4557-aeff-26f6d2d78a3b req-109cad70-21c5-4ee0-a5fc-91a29afe2563 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037571 Oct 13 09:44:29.495373 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4099/7800] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:44:29.519335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:29.528575 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3d95d0c3-317d-4cac-b6d0-d025e133827f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.160391 Oct 13 09:44:29.529196 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3702/7801] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:29 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:30.552611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:30.553368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:30.559580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:30.560065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:30.560494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:30.561174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:30.561619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:30.562036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:30.691427 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:30.702111 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-766be42b-5c6a-4f03-aad6-efad780ff73d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.154086 Oct 13 09:44:30.702943 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4100/7802] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:30 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:31.725734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:31.726357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:31.733471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:31.733961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:31.734764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:31.735463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:31.735923 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:31.736358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:31.866580 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:31.874184 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bbe72081-7b65-4685-9386-56ce9e742933 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.152883 Oct 13 09:44:31.874788 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3703/7803] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:31 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:32.897448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:32.898061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:32.904139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:32.904623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:32.905063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:32.905758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:32.906207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:32.906655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:33.031450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:33.039848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9f38588f-5f05-4798-8cf5-16d04cca170c tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.147125 Oct 13 09:44:33.040423 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4101/7804] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:32 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:34.062624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:34.063254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:34.070198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:34.070734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:34.071188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:34.071891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:34.072356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:34.072801 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:34.202640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:34.211083 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e37485d4-2da0-4c69-8cc9-9b891e9fb941 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.152598 Oct 13 09:44:34.211697 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3704/7805] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:34 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:35.233915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:35.234815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:35.242202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:35.242713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:35.243150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:35.243840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:35.244295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:35.244724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:35.375834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:35.383506 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a19de257-7dea-479e-914c-2c2ba3ff1633 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.153479 Oct 13 09:44:35.384072 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4102/7806] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:35 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:36.320670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b", "name": "network-vif-plugged", "status": "completed", "tag": "fbeaa876-3a5a-4d7d-987d-7f912a032f87"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:36.332871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:36.333986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:36.334473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:36.347718 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] Creating event network-vif-plugged:fbeaa876-3a5a-4d7d-987d-7f912a032f87 for instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b on n-h1-858384-11 Oct 13 09:44:36.352875 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-04582085-428f-44a1-ae09-cbf07e13fec7 req-f4ce650c-7de0-40a0-88e8-68a6e69f03cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036743 Oct 13 09:44:36.353477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3705/7807] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:36.405624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:36.406346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:36.408393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:36.409204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:36.415959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:36.416472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:36.416913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:36.417621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:36.418079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:36.418542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:36.834309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:36.842014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-05b635a5-d5f2-41a2-b6d4-73f8bd223fb3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1362 microversion: 2.1 time: 0.440332 Oct 13 09:44:36.842610 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4103/7808] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:36 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:37.868301 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:37.869011 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:37.870997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:37.877264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:37.877763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:37.878212 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:37.878942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:37.879410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:37.879848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:38.008613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:38.016333 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-77583980-f5c7-4051-9e46-c85470a14c9d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1554 microversion: 2.1 time: 0.152997 Oct 13 09:44:38.016945 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3706/7809] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:37 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:38.038941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:38.039685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:38.046620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:38.047112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:38.047559 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:38.048263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:38.048723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:38.049156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:38.175193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:38.183597 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-156f2791-074c-4309-96ca-134d678f45ab tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1554 microversion: 2.1 time: 0.148759 Oct 13 09:44:38.184171 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4104/7810] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:38 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:44:39.671592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52cf9a0d-aa21-4c2f-9707-f5570737d0ab"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:44:39.673925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:39.681232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:39.681727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:39.682179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:39.682918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:39.683384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:39.683821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:39.914224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4b88ddc5-b6d8-4389-a633-6408a441d41d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "POST /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246348 Oct 13 09:44:39.914823 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3707/7811] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:44:39 2022] POST /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:50.620273 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:50.620765 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:50.623656 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:50.624317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:50.630040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:50.630550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:50.630991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:50.631681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:50.632134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:50.632562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:50.718175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'services' on Instance uuid b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:44:50.788218 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04e4f642-cf16-4cb3-9dba-c6c90c7b744f tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments/52cf9a0d-aa21-4c2f-9707-f5570737d0ab" status: 202 len: 0 microversion: 2.1 time: 0.171737 Oct 13 09:44:50.788828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4105/7812] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:44:50 2022] DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments/52cf9a0d-aa21-4c2f-9707-f5570737d0ab => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:44:50.795391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:50.796184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:44:50.800411 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:50.803002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:50.811337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:50.811838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:50.812315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:50.813029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:50.813499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:50.813940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:50.844979 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c10b4bba-3dca-49b8-9621-64148c9cddc5 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051545 Oct 13 09:44:50.845549 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3708/7813] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:50 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:51.858811 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:51.861392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:51.867723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:51.868213 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:51.868655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:51.869356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:51.869809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:51.870238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:51.901545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a2b77bf9-338c-46b2-813b-86c348bfaa93 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048117 Oct 13 09:44:51.902121 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4106/7814] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:51 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:52.913937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:52.916217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:52.923178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:52.923669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:52.924115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:52.924816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:52.925279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:52.925715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:52.956170 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8388ff95-a0b1-4fb1-beb6-fc918b316b64 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Oct 13 09:44:52.956738 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3709/7815] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:52 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:53.969470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:53.971659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:53.979128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:53.979608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:53.980041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:53.980732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:53.981180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:53.981598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:54.010993 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2e4be028-ac91-4232-ab03-4c32e63d2c2e tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Oct 13 09:44:54.011555 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4107/7816] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:53 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:55.023599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:55.026071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:55.033092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:55.033520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:55.034002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:55.034762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:55.035402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:55.035837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:55.066934 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ff551aa2-43e3-409b-9b04-8dbbc50098c9 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Oct 13 09:44:55.067508 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3710/7817] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:55 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:44:56.079471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:56.081712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:56.088536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:56.089021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:56.089456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:56.090150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:56.090623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:56.091045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:56.119996 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1fe1330c-8165-4073-95ca-9c412c3a981a tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044624 Oct 13 09:44:56.120553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4108/7818] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:44:56 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:44:56.131960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:56.132512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:56.139275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:56.139772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:56.140222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:56.140929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:56.141396 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:56.141834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:56.215832 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b is not attached to volume 52cf9a0d-aa21-4c2f-9707-f5570737d0ab Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments/52cf9a0d-aa21-4c2f-9707-f5570737d0ab HTTP/1.1 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b is not attached to volume 52cf9a0d-aa21-4c2f-9707-f5570737d0ab Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b', 'id': '52cf9a0d-aa21-4c2f-9707-f5570737d0ab'} Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 52cf9a0d-aa21-4c2f-9707-f5570737d0ab. Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b is not attached to volume 52cf9a0d-aa21-4c2f-9707-f5570737d0ab Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:44:56.217491 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b is not attached to volume 52cf9a0d-aa21-4c2f-9707-f5570737d0ab Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b is not attached to volume 52cf9a0d-aa21-4c2f-9707-f5570737d0ab {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1005fdcf-b21b-40b4-bd49-5291870c8abb tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments/52cf9a0d-aa21-4c2f-9707-f5570737d0ab" status: 404 len: 154 microversion: 2.1 time: 0.091730 Oct 13 09:44:56.221730 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3711/7819] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:44:56 2022] DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b/os-volume_attachments/52cf9a0d-aa21-4c2f-9707-f5570737d0ab => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:44:59.568934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:59.569441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:59.576959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:59.577446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:59.577887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:59.578617 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:59.579073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:59.579500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:59.605392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:44:59.682767 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c8e6dde5-eeeb-44d1-9e3f-a5e9c60e554d tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 204 len: 0 microversion: 2.1 time: 0.117516 Oct 13 09:44:59.683367 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4109/7820] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:44:59 2022] DELETE /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:44:59.693663 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:44:59.694371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:44:59.702465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:59.702965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:59.703414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:59.704144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:44:59.704607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:44:59.705043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:44:59.835088 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:44:59.843138 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c5f8c04-5121-4c8e-8cdd-476aea1954ad tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1560 microversion: 2.1 time: 0.154723 Oct 13 09:44:59.843713 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3712/7821] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:44:59 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:00.866319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:00.866965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:00.873927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:00.874424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:00.874862 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:00.875551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:00.875999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:00.876420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:01.003121 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:01.011337 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ad6d783d-ee1a-47a7-8a4a-728368f81af8 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1560 microversion: 2.1 time: 0.149408 Oct 13 09:45:01.011909 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4110/7822] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:00 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:01.736616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b", "name": "network-vif-deleted", "tag": "fbeaa876-3a5a-4d7d-987d-7f912a032f87"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:01.751804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:01.752298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:01.752743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:01.768293 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] Creating event network-vif-deleted:fbeaa876-3a5a-4d7d-987d-7f912a032f87 for instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b on n-h1-858384-11 Oct 13 09:45:01.774983 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-50579cda-f1f2-4e4a-b67e-10929045467d req-e2dcea13-c5b2-4efc-bc17-90801dee1b80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043262 Oct 13 09:45:01.775603 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3713/7823] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:45:02.035161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:02.035709 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:02.042512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:02.042999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:02.043438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:02.044137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:02.044593 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:02.045017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:02.077717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:02.078193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:02.078660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:02.079109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lazy-loading 'fault' on Instance uuid b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:45:02.120442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccccf0c607b54363a7da08ddb6617667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9034b9c2dc64015812aa42f2b36ab4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:02.128246 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-32d6bb72-2d16-4f76-bda9-01b722a64669 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 200 len: 1352 microversion: 2.1 time: 0.097414 Oct 13 09:45:02.128823 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4111/7824] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:02 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:03.152541 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:03.153257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] [instance: b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:03.160366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:03.160858 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:03.161330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:03.162035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:03.162529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:03.162970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:03.176187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] HTTP exception thrown: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Request method failure captured: Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b HTTP/1.1 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR92ru0w2Yx6V6CIQteNql0pCvTFHvK9aSprzSdlVHb6roYLuwPV-aYQ_g70eH9znde_0o3gKiLfhszzxC1lzpospOEYxdP2jOawpOpOIwqG7ThabzAh_mDgGyx8eoyBD5osmzCuSESwWSLVb9Xxu17g9fHQN5t7DZw_jnp67ocWB1bY Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9034b9c2dc64015812aa42f2b36ab4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: d9034b9c2dc64015812aa42f2b36ab4d Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1115955423 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: ccccf0c607b54363a7da08ddb6617667 Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestEncryptedCinderVolumes-1115955423-project Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b'} Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:45:03.177816 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Returning 404 to user: Instance b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2d26a43b-f514-4736-8e70-c02e7cad13a3 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b" status: 404 len: 111 microversion: 2.1 time: 0.030973 Oct 13 09:45:03.182600 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3714/7825] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:03 2022] GET /compute/v2.1/servers/b6d50bda-38ff-48f0-b4ba-e6b86cf46b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:45:03.187749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7b1cc7c9-c987-4fbe-9850-c578b2407643 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] Calling method '.version_select at 0x7f53764c1820>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:03.207884 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7b1cc7c9-c987-4fbe-9850-c578b2407643 tempest-TestEncryptedCinderVolumes-1115955423 tempest-TestEncryptedCinderVolumes-1115955423-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-617862073" status: 202 len: 0 microversion: 2.1 time: 0.023861 Oct 13 09:45:03.209130 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4112/7826] 10.222.0.23 () {58 vars in 1275 bytes} [Thu Oct 13 09:45:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-617862073 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:45:29.465690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f711ca06-b041-49b9-bb18-a16e9b5970ae tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: .version_select at 0x7f5375272e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1285621296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJWqSCbwqfH0trO2tZWQGIyWcBUJVn6IjUKUYgIWZ2AdWgLwcpSC9zQ76/vRTheFtk5W85CJCb4TQ+nmtHiRLlFL0qOzfw7R54tgTKFUZC0LaB9Mg2uWT9nhPkrYNRhaA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:29.471874 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:29.472768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:29.485561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f711ca06-b041-49b9-bb18-a16e9b5970ae tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for project 45b222403aa3499284a2529cf16304f7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:45:29.494880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-f711ca06-b041-49b9-bb18-a16e9b5970ae tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for user 24efc012b2e140dc92d3281b53dacf48 and project 45b222403aa3499284a2529cf16304f7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:45:29.520978 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f711ca06-b041-49b9-bb18-a16e9b5970ae tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059720 Oct 13 09:45:29.521849 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3715/7827] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:45:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:45:29.570747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:29.571502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:29.575436 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-685840813", "imageRef": "bd83a980-897d-4723-8cd1-dba2c72503fa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1285621296", "networks": [{"uuid": "da43a990-14d5-4daa-b251-71b9ab2a1b43"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:29.628848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] validate_networks() for [('da43a990-14d5-4daa-b251-71b9ab2a1b43', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:45:30.098752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:45:30.099176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:45:30.099647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:45:30.100058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:45:30.100469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:45:30.109227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:30.109711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:30.110432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:30.111165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:30.111622 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:30.112054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:30.129735 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for project 45b222403aa3499284a2529cf16304f7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:45:30.134959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for user 24efc012b2e140dc92d3281b53dacf48 and project 45b222403aa3499284a2529cf16304f7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:45:30.148300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:45:30.150551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd83a980-897d-4723-8cd1-dba2c72503fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:45:30.203431 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-713f93fd-6732-4ae4-a7f4-03cdfc4e5952 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634667 Oct 13 09:45:30.213023 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4113/7828] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:45:30.218590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-212da826-8c8e-4956-8561-3277b6331d2f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:30.219360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-212da826-8c8e-4956-8561-3277b6331d2f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:30.275021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-212da826-8c8e-4956-8561-3277b6331d2f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:30.281804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-212da826-8c8e-4956-8561-3277b6331d2f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1258 microversion: 2.1 time: 0.067298 Oct 13 09:45:30.282421 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3716/7829] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:30 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:31.305278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:31.305909 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:31.313850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:31.314341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:31.314814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:31.315517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:31.315981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:31.316409 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:31.397008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:31.405438 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9078c1d-b112-4ae2-baf9-d1cf2d62f8d8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1316 microversion: 2.1 time: 0.104610 Oct 13 09:45:31.406034 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4114/7830] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:31 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:32.429104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:32.429780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:32.437489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:32.438061 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:32.438565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:32.439288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:32.439936 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:32.440545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:32.622057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:32.634163 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6731560d-2e5f-4afe-899f-13105497d57b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.209392 Oct 13 09:45:32.636294 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3717/7831] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:32 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:33.663641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:33.664676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:33.671806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:33.672353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:33.673070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:33.674304 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:33.675017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:33.675518 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:33.814551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:33.823390 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b61d1921-8989-48ce-be29-c43937527de0 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.164487 Oct 13 09:45:33.823899 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4115/7832] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:33 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:34.845289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:34.845825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:34.853323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:34.853828 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:34.854276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:34.855027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:34.855489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:34.855925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:35.000440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:35.009809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d868c36a-5809-45d7-a6cd-fba5f0db8f3b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.168345 Oct 13 09:45:35.010477 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3718/7833] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:34 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:36.034650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:36.035564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:36.043026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:36.043512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:36.043956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:36.044824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:36.045476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:36.046154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:36.190857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:36.198700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58c8b2b5-71b6-460e-b873-2764d745cd47 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.168971 Oct 13 09:45:36.207481 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4116/7834] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:36 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:37.221660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:37.222318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:37.229499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:37.230131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:37.230603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:37.231379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:37.231852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:37.232667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:37.376242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:37.384934 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37d99133-6633-492b-8e8d-72bb01262141 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.167794 Oct 13 09:45:37.385743 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3719/7835] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:37 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:38.409129 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:38.409772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:38.417403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:38.417885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:38.418316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:38.419055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:38.419505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:38.419931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:38.561848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:38.571259 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3a96fc77-a4ba-43ee-8529-bf8a3a71ebb6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.165933 Oct 13 09:45:38.571858 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4117/7836] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:38 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:39.594829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:39.595461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:39.603670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:39.604172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:39.604622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:39.605340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:39.605813 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:39.606256 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:39.741880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:39.749609 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b00b71a2-9751-48bd-9047-e97565e5b5c3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.158653 Oct 13 09:45:39.750193 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3720/7837] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:39 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:39.877422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:39.891398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:39.891917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:39.892360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:39.905811 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] Creating event network-changed:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:45:39.911075 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-88d2fa81-cf96-46cf-93cb-344a71a9cc83 req-c179fdd8-b3f9-49c9-bcbd-38b9c60fc7bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039118 Oct 13 09:45:39.912225 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4118/7838] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:45:40.773670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:40.774280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:40.776473 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:40.781756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:40.782255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:40.782744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:40.783449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:40.783918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:40.784359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:40.910321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:40.918127 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09e7dc9b-d4dd-447f-8903-267fe4219461 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.148946 Oct 13 09:45:40.918728 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3721/7839] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:40 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:41.940718 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:41.942041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:41.944037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:41.944712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:45:41.951897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:41.952383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:41.952828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:41.953532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:41.953991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:41.954442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:42.084511 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:42.092224 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0f0eae5e-bbc5-4b49-ac26-58e9305e77f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.155852 Oct 13 09:45:42.092801 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4119/7840] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:41 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:43.115482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:43.116111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:43.123127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:43.123625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:43.124074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:43.124779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:43.125248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:43.125683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:43.258733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:43.266370 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7110780c-67cb-44fc-a63a-12e356d64c70 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.154888 Oct 13 09:45:43.266965 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3722/7841] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:43 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:44.289680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:44.290299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:44.297367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:44.297799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:44.298237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:44.298963 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:44.299422 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:44.299856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:44.433565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:44.441808 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ac30ccce-efd3-4c1c-9fa9-df8872f73b60 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.156121 Oct 13 09:45:44.442397 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4120/7842] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:44 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:45.464268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:45.464895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:45.471707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:45.472203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:45.472656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:45.473364 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:45.473833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:45.474273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:45.605021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:45.613455 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-efeb9f59-2a7e-4361-8959-9c3c165bf90d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.152762 Oct 13 09:45:45.614045 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3723/7843] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:45 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:46.636131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:46.636752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:46.643615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:46.644101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:46.644543 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:46.645241 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:46.645697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:46.646232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:46.667917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "name": "network-vif-plugged", "status": "completed", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:46.679638 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:46.680429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:46.681821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:46.693752 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] Creating event network-vif-plugged:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:45:46.699016 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4d5a8582-bf9c-4a75-97fa-2dc1805837dc req-9f4650fb-059e-44cb-8074-46c0dffcdc71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Oct 13 09:45:46.700001 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3724/7844] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:45:46.805388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:46.813357 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce4081a0-58ce-4804-b1cf-a1fc84213784 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.181193 Oct 13 09:45:46.814145 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4121/7845] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:46 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:47.838005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:47.838758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:47.846048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:47.846576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:47.847028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:47.848335 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:47.848796 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:47.849228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:47.983022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:47.993245 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-22cbaa7a-a231-4ac9-974e-fb79f95b6fea tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1358 microversion: 2.1 time: 0.160554 Oct 13 09:45:47.993826 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3725/7846] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:47 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:49.016181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:49.016800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:49.023748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.024231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.024673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.025371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.025823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.026252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.154244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:49.162020 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48dca971-1c39-47c1-bf55-226fb3357f74 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1548 microversion: 2.1 time: 0.149804 Oct 13 09:45:49.162619 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4122/7847] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:49 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:49.184501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:49.185120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:49.192407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.192898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.193344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.194040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.194551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.194985 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.321616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:49.329480 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df4aa7ca-aa2e-42cd-843f-96f271d9cd38 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1548 microversion: 2.1 time: 0.148831 Oct 13 09:45:49.330057 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3726/7848] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:49 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:49.350705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:49.355471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:49.356247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Searching by: {'deleted': False, 'project_id': '45b222403aa3499284a2529cf16304f7'} {{(pid=127030) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 09:45:49.361758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.362237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.362714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.364020 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.364475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.364903 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.388519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.multi_cell_list [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127030) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 09:45:49.414502 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8b487a2a-b713-46ca-9934-eb714015a818 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067669 Oct 13 09:45:49.415080 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4123/7849] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 09:45:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:45:49.427074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:45:49.427695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:49.433657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.434145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.434629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.435326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:49.435786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:49.436220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:49.560453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:45:49.568129 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3340eeac-0673-4eda-b3da-94233bee1608 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1548 microversion: 2.1 time: 0.145479 Oct 13 09:45:49.568698 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3727/7850] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:45:49 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:45:51.108712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b97a64e6-0182-425a-93c3-77eb5362436b"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:45:51.111389 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:45:51.118212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:51.118732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:51.119173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:51.119866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:45:51.120318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:45:51.120746 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:45:51.355883 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e61effa5-954a-433f-9b74-2d2038ce2cd8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250815 Oct 13 09:45:51.356497 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4124/7851] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:45:51 2022] POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:46:04.373966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:46:04.374622 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:46:04.377591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:46:04.378297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=62 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:46:04.384263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:04.384758 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:04.385204 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:04.385902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:04.386362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:04.386824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:04.520167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:46:04.528357 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f311812-d64c-4b0a-b16e-7c8f008e6a14 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1594 microversion: 2.1 time: 0.158231 Oct 13 09:46:04.528933 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3728/7852] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:46:04 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:46:06.154986 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:46:06.162960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:46:06.163754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:46:06.164333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:46:06.170799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:06.171443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:06.171948 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:06.186987 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] Creating event network-changed:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:46:06.193111 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3d82ff08-df4c-4394-84b9-a272cc7d76ef req-7aae6325-bf1d-4768-8035-7aecc3114bd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042256 Oct 13 09:46:06.193904 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4125/7853] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:46:07.184273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1169516614"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:46:07.184941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:46:07.192607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:07.193112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:07.193566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:07.194308 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:07.194863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:07.195337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:07.325248 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Adding security group 2e9cc45b-5170-47e6-9a1a-f08c2b32e69f to port 0cb6598f-4444-4b01-888b-a50e36fb27d4 Oct 13 09:46:07.638611 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a01f7dd9-a56c-451d-afdd-4fae82743d11 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action" status: 202 len: 0 microversion: 2.1 time: 0.457467 Oct 13 09:46:07.642541 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3729/7854] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:46:07 2022] POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:46:07.647655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:46:07.648365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:46:07.655269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:07.655766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:07.656211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:07.656915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:07.658377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:07.659034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:07.824700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:46:07.834996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:46:07.836548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:46:07.837074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:46:07.837515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:46:07.847560 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7fcd7711-47f0-49fd-a115-330ed86428c4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1760 microversion: 2.1 time: 0.203893 Oct 13 09:46:07.852332 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] Creating event network-changed:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:46:07.859385 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3730/7855] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:46:07 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1760 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:46:07.869544 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8296edcf-8153-4022-858c-66c7f5671561 req-8cf1e1b2-98f5-4989-a327-18858713d96e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225711 Oct 13 09:46:07.870357 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4126/7856] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:47:45.265556 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 09:47:45.266587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:47:45.267354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:47:45.268667 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:47:45.268806 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action (ip 10.222.0.23) !!! Oct 13 09:47:45.271490 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 09:47:45.271629 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action (ip 10.222.0.23) !!! Oct 13 09:47:45.282143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:47:45.284439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:47:45.297160 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:45.297656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:45.298102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:45.298976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:45.299447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:45.299884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:45.374910 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0c6e2101-bd2f-46c3-b7b7-b956cc344c5b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action" status: 202 len: 0 microversion: 2.1 time: 0.110784 Oct 13 09:47:45.375940 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3731/7857] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:47:45 2022] POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:47:45.382754 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:47:45.383905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:47:45.384777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:47:45.386619 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 09:47:45.386798 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 (ip 10.222.0.23) !!! Oct 13 09:47:45.393750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:47:45.394752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:47:45.404007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:45.404496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:45.404938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:45.405646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:45.406107 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:45.406572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:45.651730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:47:45.660158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fea6daa6-bb23-4503-9b5a-df3ea8b68571 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1762 microversion: 2.1 time: 0.279867 Oct 13 09:47:45.660749 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4127/7858] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:47:45 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1762 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:47:46.685366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:47:46.686090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:47:46.693443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:46.693963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:46.694417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:46.695134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:47:46.696097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:47:46.696540 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:47:46.699994 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58196. Oct 13 09:47:46.839947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:47:46.848232 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bf59703a-16b5-4068-aaad-a03a8ea2c475 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1760 microversion: 2.1 time: 0.168762 Oct 13 09:47:46.848807 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3732/7859] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:47:46 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:48:59.904560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:48:59.905322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:48:59.909684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1169516614"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:48:59.910222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:48:59.919902 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:48:59.920803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:48:59.921265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:48:59.922210 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:48:59.922768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:48:59.923253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:48:59.929130 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58216. Oct 13 09:49:00.100027 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.network.security_group_api [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Removing security group 2e9cc45b-5170-47e6-9a1a-f08c2b32e69f from port 0cb6598f-4444-4b01-888b-a50e36fb27d4 Oct 13 09:49:00.403131 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-092015d5-4bb2-4425-b622-6e68ef186555 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action" status: 202 len: 0 microversion: 2.1 time: 0.502136 Oct 13 09:49:00.407213 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4128/7860] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:48:59 2022] POST /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:49:00.409971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:00.410805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:00.496559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:00.506906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:00.507402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:00.507844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:00.520260 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] Creating event network-changed:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:49:00.525441 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-29393f41-8800-4405-853e-1f1a938e1aa3 req-1f3d510e-3007-41a7-8a42-990cc204c7b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117239 Oct 13 09:49:00.526470 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3733/7861] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:02.130654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:02.131170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:02.137663 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:02.138147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:02.138614 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:02.139314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:02.139768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:02.140194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:02.220182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lazy-loading 'services' on Instance uuid 149a1996-53ba-4313-ab5c-87574ca4ac64 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:49:02.289735 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [0bfc7e2f-10b6-4c07-a6cd-c73cd219581e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:49:02.541657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:02.552134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:02.552625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:02.553065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:02.565693 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] Creating event network-changed:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:49:02.570856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-453ea245-aa4c-416c-bd4a-0ef86d3117f1 req-ff4f7775-e335-4bd5-9b1f-898023108b9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 Oct 13 09:49:02.571557 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3734/7862] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:49:03.296819 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [0bfc7e2f-10b6-4c07-a6cd-c73cd219581e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58250. Oct 13 09:49:03.300487 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2d62bb15-976c-468e-864d-9a37a80a5c0f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments/b97a64e6-0182-425a-93c3-77eb5362436b" status: 202 len: 0 microversion: 2.1 time: 1.174827 Oct 13 09:49:03.301091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4129/7863] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:49:02 2022] DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments/b97a64e6-0182-425a-93c3-77eb5362436b => generated 0 bytes in 1176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:49:03.309976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:03.312481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:03.318967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:03.319474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:03.319931 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:03.320654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:03.321155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:03.321610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:03.352389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-21b28edb-ecb8-441e-a5ff-b537d2f69e3a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Oct 13 09:49:03.352953 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3735/7864] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:03 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:04.367798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:04.370165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:04.378123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:04.378654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:04.379099 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:04.379798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:04.380252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:04.380681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:04.409531 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-50ee89fe-285d-4d22-9abf-71b05bce85f4 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046994 Oct 13 09:49:04.410108 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4130/7865] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:04 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:05.421402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:05.423804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:05.430689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:05.431191 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:05.431645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:05.432354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:05.432823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:05.433748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:05.464629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c4ee916f-1c93-4f52-bbeb-ee1c333270b2 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Oct 13 09:49:05.465209 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3736/7866] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:05 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:06.477372 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:06.479715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:06.487609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:06.488091 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:06.488525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:06.489219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:06.489676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:06.490100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:06.519097 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6444f6ac-0038-41f5-8cad-2fa4e2b5360b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Oct 13 09:49:06.519668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4131/7867] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:06 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:07.531903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:07.534173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:07.541459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:07.542008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:07.543004 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:07.543880 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:07.544355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:07.544834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:07.577202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-25b012ab-460f-4b8c-8cec-5617c7dd5327 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049508 Oct 13 09:49:07.577806 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3737/7868] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:07 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:08.589747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:08.592012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:08.598998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:08.599486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:08.599934 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:08.600637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:08.601093 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:08.601525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:08.634172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-edf56a46-723b-45e1-aaa7-0699f0cc14c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048361 Oct 13 09:49:08.634767 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4132/7869] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:49:08 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:49:08.646126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:08.646671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:08.653856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:08.654383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:08.654856 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:08.655593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:08.656053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:08.656484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:08.831942 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] HTTP exception thrown: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 is not attached to volume b97a64e6-0182-425a-93c3-77eb5362436b Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Request method failure captured: Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments/b97a64e6-0182-425a-93c3-77eb5362436b HTTP/1.1 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR94q7Phf5qjjLfKhcVsYTJ5U0nTLnaHjOPCIHoGhS8HaL1n3Ugr0TtbaI68V7ueLwWJa3sQ2HuzCp5ElyH5zU6NkuOZRyNYBypPwsxS_LUH41Of-joRiibJKNcrrnKHhNYudPz_N3KBbiwrVhIOcYV8KVusTNUCGQpcqQW4WNCGZWbI Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b222403aa3499284a2529cf16304f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 24efc012b2e140dc92d3281b53dacf48 Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 is not attached to volume b97a64e6-0182-425a-93c3-77eb5362436b Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': '149a1996-53ba-4313-ab5c-87574ca4ac64', 'id': 'b97a64e6-0182-425a-93c3-77eb5362436b'} Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b97a64e6-0182-425a-93c3-77eb5362436b. Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 is not attached to volume b97a64e6-0182-425a-93c3-77eb5362436b Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:49:08.833567 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 is not attached to volume b97a64e6-0182-425a-93c3-77eb5362436b Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Returning 404 to user: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 is not attached to volume b97a64e6-0182-425a-93c3-77eb5362436b {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f82a8013-2c59-4a36-bb8a-40ccc5f89f8d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments/b97a64e6-0182-425a-93c3-77eb5362436b" status: 404 len: 154 microversion: 2.1 time: 0.192944 Oct 13 09:49:08.838147 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3738/7870] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:49:08 2022] DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64/os-volume_attachments/b97a64e6-0182-425a-93c3-77eb5362436b => generated 154 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:49:12.088737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:12.089863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:12.096654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:12.097135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:12.097574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:12.098267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:12.098752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:12.099182 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:12.125748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:49:12.208368 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f52d0d32-41b5-4552-9baa-e2b8059395e1 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 204 len: 0 microversion: 2.1 time: 0.123190 Oct 13 09:49:12.209065 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4133/7871] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:49:12 2022] DELETE /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:49:12.218829 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:12.219451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:12.226611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:12.227210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:12.227719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:12.228492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:12.229044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:12.229544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:12.362348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:12.370302 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-363dc33f-690f-4f1c-830b-492803424b78 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1554 microversion: 2.1 time: 0.156008 Oct 13 09:49:12.370916 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3739/7872] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:12 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:13.393809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:13.394530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:13.401261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:13.401808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:13.402250 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:13.402958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:13.403410 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:13.403828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:13.533759 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:13.541495 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dda573c9-09f6-4305-b919-1c6bf6e1df4e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1554 microversion: 2.1 time: 0.151987 Oct 13 09:49:13.542569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4134/7873] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:13 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:14.233832 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149a1996-53ba-4313-ab5c-87574ca4ac64", "name": "network-vif-deleted", "tag": "0cb6598f-4444-4b01-888b-a50e36fb27d4"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:14.246354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:14.246876 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:14.247319 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:14.259183 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] Creating event network-vif-deleted:0cb6598f-4444-4b01-888b-a50e36fb27d4 for instance 149a1996-53ba-4313-ab5c-87574ca4ac64 on n-h1-858384-11 Oct 13 09:49:14.264630 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-98dc0a3a-3fef-409f-b296-ee017e5d308e req-2a429779-3303-45a0-af8d-38a4832bad69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034767 Oct 13 09:49:14.266261 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3740/7874] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:14.565447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:14.566145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:14.573502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:14.574684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:14.575193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:14.575976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:14.576508 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:14.577025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:14.610808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:14.611298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:14.612002 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:14.612453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lazy-loading 'fault' on Instance uuid 149a1996-53ba-4313-ab5c-87574ca4ac64 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:49:14.663245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:14.671953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25f48ec0-3941-440d-8c66-0bef21015a2b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 200 len: 1348 microversion: 2.1 time: 0.110784 Oct 13 09:49:14.673247 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4135/7875] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:14 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:15.696893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:15.697639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: 149a1996-53ba-4313-ab5c-87574ca4ac64] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:15.704387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:15.704887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:15.705346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:15.706049 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:15.706553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:15.706995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:15.720778 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] HTTP exception thrown: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Request method failure captured: Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 HTTP/1.1 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR94q7Phf5qjjLfKhcVsYTJ5U0nTLnaHjOPCIHoGhS8HaL1n3Ugr0TtbaI68V7ueLwWJa3sQ2HuzCp5ElyH5zU6NkuOZRyNYBypPwsxS_LUH41Of-joRiibJKNcrrnKHhNYudPz_N3KBbiwrVhIOcYV8KVusTNUCGQpcqQW4WNCGZWbI Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b222403aa3499284a2529cf16304f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 24efc012b2e140dc92d3281b53dacf48 Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '149a1996-53ba-4313-ab5c-87574ca4ac64'} Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:49:15.722418 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Returning 404 to user: Instance 149a1996-53ba-4313-ab5c-87574ca4ac64 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-de398000-eb37-4897-94d7-8a72f94c98f3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64" status: 404 len: 111 microversion: 2.1 time: 0.032028 Oct 13 09:49:15.728116 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3741/7876] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:15 2022] GET /compute/v2.1/servers/149a1996-53ba-4313-ab5c-87574ca4ac64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:49:15.732777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc166c67-912e-4b94-a95d-8380751d564a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '.version_select at 0x7f5375cc1160>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:15.755984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc166c67-912e-4b94-a95d-8380751d564a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1285621296" status: 202 len: 0 microversion: 2.1 time: 0.027154 Oct 13 09:49:15.756553 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4136/7877] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 09:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1285621296 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:49:24.817054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9013f44-c439-4af9-9218-15a0de376315 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: .version_select at 0x7f537525f310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1462351834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOrQZjBerOnm/4z0zLyuREe8PmRn4lPNHKB8rQlfXmvGILaap4L4x+lVmIA2qIGE0PrNm+QNkoQ/a1oSYdqox56gC2Lr55Q0mGOYNVnZrTHCBkgFJ7dTP09WmDVXsmNKA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:24.832885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e9013f44-c439-4af9-9218-15a0de376315 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for project 45b222403aa3499284a2529cf16304f7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:49:24.837908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-e9013f44-c439-4af9-9218-15a0de376315 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for user 24efc012b2e140dc92d3281b53dacf48 and project 45b222403aa3499284a2529cf16304f7. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:49:24.863262 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9013f44-c439-4af9-9218-15a0de376315 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050159 Oct 13 09:49:24.863863 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3742/7878] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:49:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:24.913514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:24.918311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-109666375", "imageRef": "c7f80b47-63f1-4e25-849c-1b52ec233ca4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1462351834", "networks": [{"uuid": "da43a990-14d5-4daa-b251-71b9ab2a1b43"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:24.970872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] validate_networks() for [('da43a990-14d5-4daa-b251-71b9ab2a1b43', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:49:25.336240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:49:25.336694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:49:25.337171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:49:25.337577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:49:25.337984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:49:25.347695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:25.348172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:25.348604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:25.349336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:25.349773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:25.350198 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:25.367883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for project 45b222403aa3499284a2529cf16304f7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:49:25.373058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Getting quotas for user 24efc012b2e140dc92d3281b53dacf48 and project 45b222403aa3499284a2529cf16304f7. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:49:25.384964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:49:25.387686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f80b47-63f1-4e25-849c-1b52ec233ca4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:49:25.398606 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:49:25.398755 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:49:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 13 09:49:25.437366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ba60b2b-9665-4095-a7d0-9e5ea87cc79c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525588 Oct 13 09:49:25.438045 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4137/7879] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:49:25.450157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16d43016-9402-4269-ab85-5f852a922a1d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:25.450894 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16d43016-9402-4269-ab85-5f852a922a1d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:25.506018 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16d43016-9402-4269-ab85-5f852a922a1d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:25.513549 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16d43016-9402-4269-ab85-5f852a922a1d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1258 microversion: 2.1 time: 0.068502 Oct 13 09:49:25.514126 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3743/7880] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:25 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:49:26.539309 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:26.540586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:26.548324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:26.548819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:26.549256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:26.549956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:26.550419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:26.551437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:26.616996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:26.626174 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d74ac508-10bc-4505-b2a0-185a185c172a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1318 microversion: 2.1 time: 0.093006 Oct 13 09:49:26.626968 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4138/7881] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:26 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:27.650247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:27.651843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:27.654571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=38 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:27.663946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:27.664374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:27.664988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:27.665728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:27.666202 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:27.667213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:27.816270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:27.824692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e8ebf804-6423-44da-b486-04b530624eb8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.179194 Oct 13 09:49:27.825275 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3744/7882] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:27 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:28.848226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:28.848840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:28.856301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:28.856780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:28.857217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:28.857908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:28.858362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:28.858815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:29.003360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:29.011401 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-800941f4-f1f4-45b9-85c0-7a9199569c5c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.166991 Oct 13 09:49:29.011997 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4139/7883] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:28 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:30.035215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:30.035830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:30.043337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:30.043835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:30.044281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:30.044996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:30.045460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:30.045896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:30.190323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:30.198633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-96551c86-d681-49bd-82cf-c3fb13fee9ad tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.167135 Oct 13 09:49:30.199229 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3745/7884] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:30 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:31.222732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:31.223954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:31.227235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:31.234267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:31.234791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:31.235232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:31.235942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:31.236402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:31.237083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:31.377402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:31.385561 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-886cc2ac-00bd-43c5-b27c-b4995e3ea6fa tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.168143 Oct 13 09:49:31.393673 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4140/7885] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:31 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:32.409597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:32.410219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:32.413108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:32.418983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:32.419484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:32.419930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:32.420651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:32.421120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:32.421551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:32.566605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:32.575633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9b1edef1-1a5d-45d2-a91d-0bf1fbaca2c6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.169970 Oct 13 09:49:32.586861 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3746/7886] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:32 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:33.598158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:33.598826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:33.605853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:33.606335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:33.606819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:33.607512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:33.607969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:33.608397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:33.745327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:33.753365 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc51db4d-6303-4c71-a54f-14698773fe6a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.159217 Oct 13 09:49:33.754091 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4141/7887] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:33 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:34.776141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:34.776851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:34.783698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:34.784187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:34.784629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:34.785324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:34.785782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:34.786213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:34.914233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:34.921966 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6c55f49-398f-4e9a-8599-376df6a2cb97 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.149691 Oct 13 09:49:34.922569 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3747/7888] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:34 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:35.945384 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:35.945997 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:35.949275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:35.949978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:35.955791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:35.956274 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:35.956713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:35.957408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:35.957865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:35.958292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:36.089254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:36.097032 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-64449f46-d5e1-457e-a177-113af4730275 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.155596 Oct 13 09:49:36.097614 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4142/7889] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:35 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:37.123468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:37.124119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:37.126063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:37.132299 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:37.132799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:37.133258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:37.133970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:37.134468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:37.134917 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:37.262370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:37.270068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ea5d4bc-1952-42d4-8c56-e0a491c0de67 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.150583 Oct 13 09:49:37.270681 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3748/7890] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:37 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:38.149044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:38.160403 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:38.160940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:38.161462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:38.173017 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] Creating event network-changed:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:49:38.177923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-029e5c24-cdd7-4fac-b7ff-c0484616a922 req-cc3d1e87-ea36-4f67-881d-ae59a9f90a03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Oct 13 09:49:38.178542 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4143/7891] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:49:38.293737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:38.294362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:38.301294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:38.301789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:38.302236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:38.302967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:38.303430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:38.303864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:38.515963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:38.523671 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9c02f43e-921b-4d5d-907d-a60f6d280154 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.234345 Oct 13 09:49:38.524258 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3749/7892] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:38 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:39.548819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:39.549531 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:39.555773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:39.556263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:39.556705 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:39.557396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:39.558548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:39.558984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:39.685551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:39.693255 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5dbf531-7502-4a11-90c3-f261b916c6cf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.149650 Oct 13 09:49:39.693856 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4144/7893] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:39 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:40.715662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:40.716291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:40.722927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:40.723426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:40.723941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:40.724665 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:40.725134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:40.725575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:40.921065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:40.928734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4e212d1a-28e0-4337-ae97-a2bff9fc6a43 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.217462 Oct 13 09:49:40.929314 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3750/7894] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:40 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:41.950073 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:41.950714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:41.957519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:41.957998 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:41.958457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:41.959150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:41.959632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:41.960058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:42.093553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:42.101507 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-098d796e-66c1-42da-af56-d7ff055d1de5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.155415 Oct 13 09:49:42.102089 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4145/7895] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:41 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:43.125376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:43.126002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:43.132895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:43.133389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:43.133839 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:43.134576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:43.135046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:43.135487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:43.266482 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:43.274196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-99a6c06b-1ce5-4eea-a42a-be3e130953b5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.152766 Oct 13 09:49:43.274795 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3751/7896] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:43 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:44.295748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:44.296294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:44.303265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:44.303743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:44.304173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:44.304868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:44.305318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:44.305742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:44.439453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:44.448799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a1a7c03a-0d42-4bdf-88f6-5ba30d7d53fe tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.156896 Oct 13 09:49:44.449946 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4146/7897] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:44 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:44.513183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "name": "network-vif-plugged", "status": "completed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:44.522732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:44.523218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:44.523656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:44.534677 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] Creating event network-vif-plugged:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:49:44.539611 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d891de35-f5be-4492-938e-7b8ec1b3d7a6 req-4ba12210-199c-416f-b3b8-80496ef3d867 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104100 Oct 13 09:49:44.540187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3752/7898] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:45.474602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:45.475230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:45.484269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:45.484764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:45.485207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:45.485908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:45.486369 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:45.487086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:45.619473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:45.627159 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b7cba1e5-fc39-4c30-ba5c-f0ca34f5c436 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1358 microversion: 2.1 time: 0.156500 Oct 13 09:49:45.627733 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4147/7899] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:45 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:46.652076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:46.653279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:46.659472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:46.659965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:46.660415 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:46.661114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:46.661579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:46.662017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:46.790217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:46.798567 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-84f75d27-4d08-440e-901d-ff25038f5774 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1547 microversion: 2.1 time: 0.151771 Oct 13 09:49:46.799140 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3753/7900] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:46 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:46.820428 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:46.821076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:46.828125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:46.828611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:46.829056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:46.829769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:46.830240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:46.830772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:46.956989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:46.965271 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-10fbd071-a9f7-4cd5-a0c5-26e578890d81 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1547 microversion: 2.1 time: 0.148215 Oct 13 09:49:46.965857 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4148/7901] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:46 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:46.988688 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:46.994028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:46.994846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Searching by: {'deleted': False, 'project_id': '45b222403aa3499284a2529cf16304f7'} {{(pid=127031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 13 09:49:47.000122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:47.000620 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:47.001072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:47.001808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:47.002273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:47.002740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:47.029630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.multi_cell_list [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 13 09:49:47.057716 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8b168e01-a320-43f9-8e48-fde6f81b7945 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073745 Oct 13 09:49:47.058309 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3754/7902] 10.222.0.23 () {58 vars in 1125 bytes} [Thu Oct 13 09:49:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:49:47.069865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:47.070515 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:47.077008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:47.077495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:47.077936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:47.078667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:47.079131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:47.079557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:47.209214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:47.217666 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-20df247a-d71e-4e43-a56e-56ec2c261bb3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1547 microversion: 2.1 time: 0.151644 Oct 13 09:49:47.218246 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4149/7903] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:47 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:49:48.727476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16ba08cd-ac74-4fb1-9ad9-5afcd80d335e"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:49:48.729805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:48.736808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:48.737560 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:48.738014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:48.738753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:48.739227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:48.739668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:48.994337 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f56d026-dff5-4dbe-8bf2-42dfc9233e2d tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270695 Oct 13 09:49:48.995227 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3755/7904] 10.222.0.23 () {60 vars in 1323 bytes} [Thu Oct 13 09:49:48 2022] POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:49:59.757237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:49:59.757858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:49:59.761030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=19 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:59.762292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=70 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:49:59.768067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:59.768556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:59.768999 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:59.769700 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:49:59.770158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:49:59.770623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:49:59.896562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:49:59.905343 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4037819c-5902-4a35-88b8-a10250d85d24 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1593 microversion: 2.1 time: 0.152062 Oct 13 09:49:59.905924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4150/7905] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:49:59 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:01.785811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:50:01.796149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:01.797329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=19 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:01.798244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:01.800644 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:01.801192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:01.801612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:01.814966 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] Creating event network-changed:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:50:01.820641 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-2518a3da-ca94-483b-9162-46f835990d23 req-491e433d-b267-4ba5-9a23-d9863d2c59b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039304 Oct 13 09:50:01.821770 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3756/7906] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:50:02.879872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1677236276"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:50:02.881530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:02.890314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:02.891080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:02.891689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:02.892598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:02.893215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:02.894306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:03.029463 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.network.security_group_api [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Adding security group fa83201f-0c8f-4818-a5c6-c0cfa2834cf4 to port d20aebbb-2570-4d07-afb5-aef3b33f3145 Oct 13 09:50:03.337189 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-239fd986-d400-4fd8-9249-56d1c5e7f578 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action" status: 202 len: 0 microversion: 2.1 time: 0.462567 Oct 13 09:50:03.337822 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4151/7907] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:50:02 2022] POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:50:03.349073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:03.349791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:03.356952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:03.357477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:03.357933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:03.358682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:03.359154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:03.359817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:03.512404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:03.521622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5d5abe6-b095-4848-a2de-256596606009 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1759 microversion: 2.1 time: 0.179214 Oct 13 09:50:03.522211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3757/7908] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:03 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:03.836190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:50:03.846537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:03.846755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:03.847219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:03.859011 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] Creating event network-changed:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:50:03.864228 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-97723171-a07e-4777-8a49-433f6da7dee9 req-28e0fc9c-17d0-4084-bde5-f0663bb97d1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032147 Oct 13 09:50:03.864897 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4152/7909] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:50:51.657775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:51.658542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=8 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:51.704777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:50:51.707133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:51.713029 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:51.713553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:51.714010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:51.714747 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:51.715217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:51.715656 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:51.791997 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b77351e-a419-40b7-9676-980c049ac91b tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action" status: 202 len: 0 microversion: 2.1 time: 0.138969 Oct 13 09:50:51.792629 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3758/7910] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:50:51 2022] POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:50:51.799219 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:50:51.800315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:51.801047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:50:51.805089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:51.805799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:51.812817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:51.813307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:51.813753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:51.814482 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:51.814955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:51.815383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:51.971231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:51.981686 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7419f45-df73-412a-b44e-642562dac8a6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1751 microversion: 2.1 time: 0.181989 Oct 13 09:50:51.982296 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4153/7911] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:51 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:50:53.006457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:53.007174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:53.013323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:53.013816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:53.014271 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:53.015502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:53.015967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:53.016406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:53.168544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:53.176801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7c43171f-63f1-4fcc-9f1e-46507937ced7 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.175684 Oct 13 09:50:53.177378 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3759/7912] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:52 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:54.200082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:54.200736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:54.208678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:54.209159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:54.209626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:54.210326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:54.210814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:54.211242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:54.217135 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58594. Oct 13 09:50:54.366907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:54.375839 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7114a6d2-347b-48f7-a76e-71de373efc64 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.179633 Oct 13 09:50:54.376430 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4154/7913] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:54 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:55.399517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:55.400139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:55.406946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:55.407459 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:55.407902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:55.408595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:55.409052 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:55.409481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:55.549360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:55.557734 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7bed323c-2e7a-4444-b408-8c77b27d9c99 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.162073 Oct 13 09:50:55.558300 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3760/7914] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:55 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:56.581939 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:56.582579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:56.589447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:56.589900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:56.590329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:56.591044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:56.591493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:56.591917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:56.736397 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:56.745106 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-87f24ebe-3b16-4dc5-aae2-8affb5640880 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.167595 Oct 13 09:50:56.745734 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4155/7915] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:56 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:57.768724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:57.769342 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:57.776218 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:57.776726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:57.777152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:57.777844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:57.778303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:57.778760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:57.920671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:57.929621 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-987c57db-6282-4600-969c-8649249281dd tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.164900 Oct 13 09:50:57.930184 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3761/7916] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:57 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:50:58.952346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:50:58.952978 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:50:58.959877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:58.960354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:58.960787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:58.961474 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:50:58.961920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:50:58.962343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:50:59.101898 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:50:59.110923 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bc988f09-3db9-46ce-813c-3d4263d1773a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.162440 Oct 13 09:50:59.111505 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4156/7917] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:50:58 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:51:00.133767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:51:00.134386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:51:00.141920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:00.142418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:00.142871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:00.143565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:00.144022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:00.144453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:00.281588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:51:00.289902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6726b378-8888-4aae-accd-e3113c754f4a tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.159942 Oct 13 09:51:00.290428 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3762/7918] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:51:00 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:51:01.313044 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:51:01.313679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:51:01.320305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:01.320784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:01.321217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:01.321910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:01.322360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:01.322806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:01.470780 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:51:01.479168 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-62ca60da-a41a-4ec4-b03c-b09b4df8e012 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.170135 Oct 13 09:51:01.479746 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4157/7919] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:51:01 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:51:02.502971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:51:02.503599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:51:02.510627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:02.511125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:02.511578 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:02.512318 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:02.512784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:02.513227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:02.662645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:51:02.671377 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5b6c306-0a1d-48e0-96db-87be81f5299e tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1756 microversion: 2.1 time: 0.172371 Oct 13 09:51:02.671958 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3763/7920] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:51:02 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:51:03.695180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:51:03.695795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:51:03.703286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:03.703771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:03.704205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:03.704896 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:51:03.705350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:51:03.705776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:51:03.845291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:51:03.853480 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e671ce1f-79f1-451d-9d80-04d9b870bf1f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1759 microversion: 2.1 time: 0.162364 Oct 13 09:51:03.854059 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4158/7921] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:51:03 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:07.022321 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:52:07.022856 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action (ip 10.222.0.23) !!! Oct 13 09:52:07.023528 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:52:07.023696 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 09:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action (ip 10.222.0.23) !!! Oct 13 09:52:07.024800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:07.025559 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:07.030627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1677236276"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:07.031174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:07.044096 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:07.044593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:07.045041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:07.045737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:07.046200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:07.046657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:07.171027 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.network.security_group_api [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Removing security group fa83201f-0c8f-4818-a5c6-c0cfa2834cf4 from port d20aebbb-2570-4d07-afb5-aef3b33f3145 Oct 13 09:52:07.469657 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cb724d95-58fd-4219-aba9-d64df9a80cac tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action" status: 202 len: 0 microversion: 2.1 time: 0.449136 Oct 13 09:52:07.470581 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3764/7922] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:52:07 2022] POST /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:52:07.477153 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 09:52:07.477623 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 09:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 09:52:07.479830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:07.480855 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:07.603215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:07.613061 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:07.613558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:07.614719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:07.628172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] Creating event network-changed:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:52:07.634185 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-ce517a9b-9e8e-4097-849a-e84239a180e5 req-8c57409f-490d-4612-97bf-a5b521b6a834 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160199 Oct 13 09:52:07.635096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4159/7923] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:52:09.190242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:09.190806 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:09.197387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:09.197886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:09.198337 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:09.199072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:09.199547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:09.199980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:09.283082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lazy-loading 'services' on Instance uuid e9fd091e-df0b-4c55-a000-4f68ecd9b1ed {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:52:09.355981 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3188c5c4-1b1c-4183-ac16-8f9ca6ca5e3f tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments/16ba08cd-ac74-4fb1-9ad9-5afcd80d335e" status: 202 len: 0 microversion: 2.1 time: 0.170544 Oct 13 09:52:09.356748 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3765/7924] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:52:09 2022] DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments/16ba08cd-ac74-4fb1-9ad9-5afcd80d335e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:52:09.371268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:09.375108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:09.385539 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:09.386174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:09.386758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:09.387713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:09.388284 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:09.388878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:09.428616 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-48b7a115-babd-40e1-a8df-87d64b2d1013 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064918 Oct 13 09:52:09.429472 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4160/7925] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:09 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:09.650280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:09.660146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:09.660646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:09.661119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:09.672651 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] Creating event network-changed:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:52:09.678995 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-10c41ffb-15ad-4d03-a807-07b28e0d7684 req-f11a7654-fb3f-48f6-8569-6ef51f67df5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Oct 13 09:52:09.680170 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3766/7926] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:10.441323 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:10.443641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:10.450437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:10.450936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:10.451376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:10.452072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:10.452525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:10.452955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:10.483061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7089d36-b58d-4ba1-837e-090dfcd876dc tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Oct 13 09:52:10.483917 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4161/7927] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:10 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:11.498601 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:11.500924 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:11.508728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:11.509227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:11.509672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:11.510383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:11.510863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:11.511295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:11.543657 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-df23d215-be60-490d-ba21-1a04789430f6 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050138 Oct 13 09:52:11.544254 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3767/7928] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:11 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:12.556398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:12.558761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:12.565875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:12.566359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:12.566820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:12.567545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:12.567995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:12.568419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:12.600014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8c5aad4c-9847-4e95-b54d-907038e41552 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Oct 13 09:52:12.600680 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4162/7929] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:12 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:13.612678 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:13.614919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:13.622521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:13.623020 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:13.623476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:13.624187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:13.624657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:13.625101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:13.654866 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b090eea7-7768-4172-ac6d-b8d02dd9695c tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Oct 13 09:52:13.655444 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3768/7930] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:13 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:14.667232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:14.669408 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:14.676305 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:14.676791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:14.677230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:14.678633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:14.678915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:14.679339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:14.708043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5cc6c97a-3a22-41fe-ad6a-290ffe8ed8ee tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044807 Oct 13 09:52:14.708606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4163/7931] 10.222.0.23 () {58 vars in 1302 bytes} [Thu Oct 13 09:52:14 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 13 09:52:14.719042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:14.719561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:14.726288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:14.726818 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:14.727268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:14.727963 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:14.728420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:14.728854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:14.804419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] HTTP exception thrown: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed is not attached to volume 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Request method failure captured: Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: request: DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments/16ba08cd-ac74-4fb1-9ad9-5afcd80d335e HTTP/1.1 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR94q7Phf5qjjLfKhcVsYTJ5U0nTLnaHjOPCIHoGhS8HaL1n3Ugr0TtbaI68V7ueLwWJa3sQ2HuzCp5ElyH5zU6NkuOZRyNYBypPwsxS_LUH41Of-joRiibJKNcrrnKHhNYudPz_N3KBbiwrVhIOcYV8KVusTNUCGQpcqQW4WNCGZWbI Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b222403aa3499284a2529cf16304f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 24efc012b2e140dc92d3281b53dacf48 Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed is not attached to volume 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'server_id': 'e9fd091e-df0b-4c55-a000-4f68ecd9b1ed', 'id': '16ba08cd-ac74-4fb1-9ad9-5afcd80d335e'} Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e. Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed is not attached to volume 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:52:14.806014 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed is not attached to volume 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Returning 404 to user: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed is not attached to volume 16ba08cd-ac74-4fb1-9ad9-5afcd80d335e {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-323051e3-99ad-48d3-9d91-1961506657e3 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments/16ba08cd-ac74-4fb1-9ad9-5afcd80d335e" status: 404 len: 154 microversion: 2.1 time: 0.092438 Oct 13 09:52:14.811932 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3769/7932] 10.222.0.23 () {58 vars in 1416 bytes} [Thu Oct 13 09:52:14 2022] DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed/os-volume_attachments/16ba08cd-ac74-4fb1-9ad9-5afcd80d335e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:52:18.059396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:18.059977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:18.067359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:18.067856 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:18.068302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:18.069015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:18.069471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:18.069901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:18.096722 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:52:18.176434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0b31a1e0-cc82-4c74-a1ae-ef889b6c60c5 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 204 len: 0 microversion: 2.1 time: 0.120748 Oct 13 09:52:18.177021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4164/7933] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:52:18 2022] DELETE /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:52:18.186966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:18.187596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:18.194898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:18.195390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:18.195852 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:18.196534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:18.196994 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:18.197426 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:18.331768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:18.340419 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-533c36ae-8d9a-43f4-b28a-9aab36499c44 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1553 microversion: 2.1 time: 0.158934 Oct 13 09:52:18.341282 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3770/7934] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:18 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:19.365232 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:19.366219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:19.374719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:19.375202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:19.375672 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:19.376374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:19.376824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:19.377244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:19.505790 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:19.514153 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7f892987-098d-41dc-9bf1-b408c3aa3044 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1553 microversion: 2.1 time: 0.153916 Oct 13 09:52:19.515532 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4165/7935] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:19 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:20.537371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:20.538016 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:20.544896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:20.545391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:20.545836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:20.546569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:20.547033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:20.547466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:20.748347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24efc012b2e140dc92d3281b53dacf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b222403aa3499284a2529cf16304f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:20.761296 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ca1ba385-dc23-4802-8c1f-b4f795851ec8 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 200 len: 1553 microversion: 2.1 time: 0.227822 Oct 13 09:52:20.762876 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3771/7936] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:20 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:52:20.805679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fd091e-df0b-4c55-a000-4f68ecd9b1ed", "name": "network-vif-deleted", "tag": "d20aebbb-2570-4d07-afb5-aef3b33f3145"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:20.816833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:20.817313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:20.817778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:20.830956 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] Creating event network-vif-deleted:d20aebbb-2570-4d07-afb5-aef3b33f3145 for instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed on n-h2-858384-11 Oct 13 09:52:20.835786 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-fda360c6-89dd-4855-a7a6-ac18436b9863 req-74133255-0e9f-43f2-89ac-cc548b328b47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034602 Oct 13 09:52:20.836454 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4166/7937] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:52:21.785306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:21.785932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] [instance: e9fd091e-df0b-4c55-a000-4f68ecd9b1ed] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:21.792842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:21.793340 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:21.793791 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:21.794532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:21.794999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:21.795438 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:21.808733 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] HTTP exception thrown: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Request method failure captured: Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed HTTP/1.1 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR94q7Phf5qjjLfKhcVsYTJ5U0nTLnaHjOPCIHoGhS8HaL1n3Ugr0TtbaI68V7ueLwWJa3sQ2HuzCp5ElyH5zU6NkuOZRyNYBypPwsxS_LUH41Of-joRiibJKNcrrnKHhNYudPz_N3KBbiwrVhIOcYV8KVusTNUCGQpcqQW4WNCGZWbI Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b222403aa3499284a2529cf16304f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b222403aa3499284a2529cf16304f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 45b222403aa3499284a2529cf16304f7 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302536466 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 24efc012b2e140dc92d3281b53dacf48 Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestMinimumBasicScenario-1302536466-project Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'e9fd091e-df0b-4c55-a000-4f68ecd9b1ed'} Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:52:21.810257 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Returning 404 to user: Instance e9fd091e-df0b-4c55-a000-4f68ecd9b1ed could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7bb50a0-8521-4e6e-8d75-dc0dfc96fe17 tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed" status: 404 len: 111 microversion: 2.1 time: 0.030403 Oct 13 09:52:21.815779 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3772/7938] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:21 2022] GET /compute/v2.1/servers/e9fd091e-df0b-4c55-a000-4f68ecd9b1ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:52:21.822240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9025d731-18e0-4772-9c35-728ba2c75faf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] Calling method '.version_select at 0x7f53756ad8b0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:21.846120 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9025d731-18e0-4772-9c35-728ba2c75faf tempest-TestMinimumBasicScenario-1302536466 tempest-TestMinimumBasicScenario-1302536466-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1462351834" status: 202 len: 0 microversion: 2.1 time: 0.029318 Oct 13 09:52:21.846667 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4167/7939] 10.222.0.23 () {58 vars in 1272 bytes} [Thu Oct 13 09:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1462351834 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:52:30.848436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3440dada-5f41-4048-a58b-43d9a9de8089 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: .version_select at 0x7f53741e9e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-307684457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEKKAgDKIVp52uwO8eA6mnYQHNTDSksSUDBlPNteLH7EQNbM2d1rw6FC3YOC5d+zlgHFGCSoTvFEhR1mX8TquPh81I0KgF834VvSpggrIb7VvuF45wgPRMXeuM4neG7vA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:30.867821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3440dada-5f41-4048-a58b-43d9a9de8089 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:52:30.872838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3440dada-5f41-4048-a58b-43d9a9de8089 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:52:30.900435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3440dada-5f41-4048-a58b-43d9a9de8089 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.212742 Oct 13 09:52:30.901048 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3773/7940] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:52:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:36.616310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:36.617449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:36.622674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1682498115", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "14e27469-8807-4d44-a89c-05d9f4998652"}], "key_name": "tempest-TestNetworkAdvancedServerOps-307684457", "security_groups": [{"name": "tempest-secgroup-smoke-218420852"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:36.753165 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] validate_networks() for [('14e27469-8807-4d44-a89c-05d9f4998652', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:52:37.326564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:52:37.326996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:52:37.327662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:52:37.327890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:52:37.328354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:52:37.337758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:37.338252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:37.338724 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:37.339448 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:37.339905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:37.340335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:37.368255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:52:37.377097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:52:37.397247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:52:37.400713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:52:37.458796 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 09:52:38.467135 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [13ae6ba2-2b4a-4717-9843-14bb67bf3c9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58878. Oct 13 09:52:38.471622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd7a5879-5e24-4067-9709-efe7ef79bffb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.857348 Oct 13 09:52:38.472293 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4168/7941] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:52:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:52:38.482713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:38.487494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c64c6eb2-8cfc-4472-9fac-893c5126672e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:38.488113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c64c6eb2-8cfc-4472-9fac-893c5126672e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:38.496844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:38.570071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c64c6eb2-8cfc-4472-9fac-893c5126672e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:38.582375 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c64c6eb2-8cfc-4472-9fac-893c5126672e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1266 microversion: 2.1 time: 0.101668 Oct 13 09:52:38.583960 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3774/7942] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:38 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:39.606935 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:39.607576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:39.618680 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:39.619150 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:39.619586 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:39.620303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:39.621067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:39.621542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:39.685558 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:39.694370 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-89786ff4-4466-4a06-9863-40f783070fbd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1318 microversion: 2.1 time: 0.092211 Oct 13 09:52:39.703469 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4169/7943] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:39 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:40.718130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:40.718907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:40.725969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:40.726484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:40.726934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:40.727631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:40.728100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:40.728537 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:40.861092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:40.872131 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-824f9280-225b-4f70-80da-ba8ab739e386 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.158149 Oct 13 09:52:40.881451 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3775/7944] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:40 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:41.101207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a78fe48-72e1-4ed9-929e-9b19cff3b194", "tag": "5ddb2551-2c4d-4e7a-9e3e-27088d5daa49"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:41.114087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:41.115493 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:41.116155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:41.128848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] Creating event network-changed:5ddb2551-2c4d-4e7a-9e3e-27088d5daa49 for instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 on n-h1-858384-11 Oct 13 09:52:41.133995 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-50b57f4f-3dac-46e9-a8c4-714790344d5e req-d8554ea7-52ad-4e1a-b8c7-d1051f1166f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037146 Oct 13 09:52:41.134802 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4170/7945] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:41.895833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:41.896409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:41.903467 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:41.903972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:41.904436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:41.905151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:41.905652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:41.906121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:42.039891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:42.047673 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f6adeb93-1690-420c-9917-3b88d0314406 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.155861 Oct 13 09:52:42.048243 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3776/7946] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:41 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:43.072844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:43.073668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:43.079905 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:43.080380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:43.080814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:43.081499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:43.081952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:43.082374 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:43.216355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:43.224514 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ef633a8a-3e3f-402c-9796-b43e2c572280 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.156995 Oct 13 09:52:43.225100 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4171/7947] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:43 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:44.248471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:44.249104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:44.255940 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:44.256446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:44.256898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:44.257613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:44.258082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:44.258552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:44.392006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:44.400297 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7f3b7066-b04a-42cf-8a63-538e44a49b03 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.155834 Oct 13 09:52:44.400868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3777/7948] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:44 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:45.422994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:45.423597 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:45.430536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:45.431022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:45.431465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:45.432155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:45.432615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:45.433039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:45.564231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:45.572485 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7ec5858-a4f9-4a52-947b-4978f428b1ea tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.153420 Oct 13 09:52:45.573067 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4172/7949] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:45 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:52:46.311236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a78fe48-72e1-4ed9-929e-9b19cff3b194", "name": "network-vif-plugged", "status": "completed", "tag": "5ddb2551-2c4d-4e7a-9e3e-27088d5daa49"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:46.323789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:46.324584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:46.325014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:46.335897 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] Creating event network-vif-plugged:5ddb2551-2c4d-4e7a-9e3e-27088d5daa49 for instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 on n-h1-858384-11 Oct 13 09:52:46.341098 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1ad43534-e234-483f-9fac-092045651025 req-824dee32-18c1-432f-bf8a-df8f8d175812 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Oct 13 09:52:46.341887 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3778/7950] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:52:46.595650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:46.596269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:46.603760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:46.604246 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:46.604695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:46.605401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:46.605893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:46.606325 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:46.735585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:46.743545 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2a218e1e-2a74-49a8-8f6f-439d3051a3c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1391 microversion: 2.1 time: 0.151816 Oct 13 09:52:46.744123 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4173/7951] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:46 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:47.767444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:47.768154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:47.775347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:47.775837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:47.776284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:47.777010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:47.777481 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:47.777915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:47.905767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:47.913945 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7da85136-6d1e-488c-bd56-5e60d338e639 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1563 microversion: 2.1 time: 0.151369 Oct 13 09:52:47.914538 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3779/7952] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:47 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:47.936393 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:47.937004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:47.939045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:47.939850 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:47.946457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:47.946937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:47.947368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:47.948055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:47.948503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:47.948926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:48.113815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:48.122984 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ae231d3-c1d4-45fc-b6ad-f402d904c775 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1563 microversion: 2.1 time: 0.190448 Oct 13 09:52:48.123567 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4174/7953] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:47 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:52:50.009691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:52:50.010764 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:52:50.010954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a78fe48-72e1-4ed9-929e-9b19cff3b194", "tag": "5ddb2551-2c4d-4e7a-9e3e-27088d5daa49"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:52:50.015800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:52:50.023135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:50.023691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:50.024110 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:50.024609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:50.025487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:50.026236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:50.027314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:52:50.027947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:52:50.028768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:52:50.046892 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] Creating event network-changed:5ddb2551-2c4d-4e7a-9e3e-27088d5daa49 for instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 on n-h1-858384-11 Oct 13 09:52:50.052254 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5099e066-b80a-4688-a1fd-e75da413495e req-9269f863-a384-4e3e-b78d-818d59c1c4a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045713 Oct 13 09:52:50.054700 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4175/7954] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:52:50.175590 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:52:50.183907 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe94dd30-5485-4280-9958-ce4d16e071e3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1563 microversion: 2.1 time: 0.179809 Oct 13 09:52:50.185035 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3780/7955] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:52:50 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:13.430740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:13.431488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:13.435693 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:13.437938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:13.445018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:13.445499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:13.445937 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:13.446661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:13.447117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:13.447548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:13.501583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-069fe090-26e3-4426-8fe2-2b3c7c58d22b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action" status: 200 len: 24554 microversion: 2.1 time: 0.073419 Oct 13 09:53:13.503549 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4176/7956] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:53:13 2022] POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action => generated 24554 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:53:19.901361 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:19.901981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:19.904060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=15 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:19.904926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=32 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:19.910390 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:19.910921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:19.911386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:19.912073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:19.912539 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:19.912973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:20.245280 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bedd16a-46c9-4994-9ba8-8b521edb3f4c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action" status: 202 len: 0 microversion: 2.1 time: 0.347741 Oct 13 09:53:20.245827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3781/7957] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:53:19 2022] POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:53:20.254740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:20.255458 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:20.263411 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:20.263912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:20.264396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:20.265147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:20.265604 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:20.266141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:20.398771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:20.408038 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e1b00c9c-7794-4f9c-9693-72ce25be026f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1685 microversion: 2.1 time: 0.157698 Oct 13 09:53:20.408637 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4177/7958] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:20 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:21.435206 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:21.435921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:21.442164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:21.442706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:21.443157 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:21.443861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:21.444327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:21.444767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:21.576896 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:21.584745 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2ab08e19-64f3-47ca-975e-ced122df3f70 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1665 microversion: 2.1 time: 0.155415 Oct 13 09:53:21.585307 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3782/7959] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:21 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:22.679286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:22.681952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:22.689629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.690115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.690587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.691289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.691743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.692172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.746362 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d44f5390-9c07-4b03-8c17-5bece7822d1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action" status: 200 len: 32632 microversion: 2.1 time: 0.070897 Oct 13 09:53:22.747036 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4178/7960] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:53:22 2022] POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action => generated 32632 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:53:22.759434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:22.759993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:22.766969 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.767472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.767925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.768633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.769102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.769548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.837174 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6d3f1099-8f05-4a3a-a24c-e5d5fed50953 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action" status: 202 len: 0 microversion: 2.1 time: 0.082059 Oct 13 09:53:22.839281 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3783/7961] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:53:22 2022] POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:53:22.850794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:22.851419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:22.859260 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.859773 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.860208 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.861169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:22.861623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:22.862075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:22.996941 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:23.004799 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-43c457fd-a192-4187-a652-39710679884d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1672 microversion: 2.1 time: 0.158507 Oct 13 09:53:23.005378 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4179/7962] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:22 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:24.031002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:24.031633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:24.037888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:24.038442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:24.038925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:24.039642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:24.040112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:24.040557 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:24.169497 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:24.177313 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e7487bde-09e4-4ffa-8fd4-0df8ef7866fd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1680 microversion: 2.1 time: 0.151583 Oct 13 09:53:24.177883 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3784/7963] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:24 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:53:24.274917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:24.277159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:24.284971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:24.285402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:24.285847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:24.286567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:24.287026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:24.287453 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:24.338305 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d76664c9-f96f-4cb9-b83d-dba2e2db7ab9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action" status: 200 len: 36513 microversion: 2.1 time: 0.067224 Oct 13 09:53:24.338983 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4180/7964] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:53:24 2022] POST /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194/action => generated 36513 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:53:25.396153 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:25.400359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:25.403138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a78fe48-72e1-4ed9-929e-9b19cff3b194", "tag": "5ddb2551-2c4d-4e7a-9e3e-27088d5daa49"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:25.407885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:25.408648 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:25.409111 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:25.410491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:25.410970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:25.411882 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:25.414175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:25.414981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:25.415491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:25.427172 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] Creating event network-changed:5ddb2551-2c4d-4e7a-9e3e-27088d5daa49 for instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 on n-h1-858384-11 Oct 13 09:53:25.433729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3d74b6c9-e7f4-4d23-8d7b-de7198b8343d req-0db493be-b4b9-4a91-bb9c-fae80e9b5fcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035553 Oct 13 09:53:25.434345 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4181/7965] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:53:25.438054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:53:25.527936 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1021347-30bb-40f4-b10f-5d0d2eefe6b6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 204 len: 0 microversion: 2.1 time: 0.134678 Oct 13 09:53:25.529210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3785/7966] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:53:25 2022] DELETE /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:53:25.538921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:25.539741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:25.547133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:25.547713 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:25.548287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:25.549065 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:25.549600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:25.550104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:25.710015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:25.718210 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b804b8ca-62c6-42e8-803a-dd2b3b199a79 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1686 microversion: 2.1 time: 0.183764 Oct 13 09:53:25.718851 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4182/7967] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:25 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:53:26.743847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:26.744562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:26.754680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:26.755176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:26.755623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:26.756327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:26.756795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:26.757232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:26.890500 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:26.898196 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cc399fbe-c658-4182-aff7-46c54716d06a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1686 microversion: 2.1 time: 0.158725 Oct 13 09:53:26.899384 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3786/7968] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:26 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:27.556571 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a78fe48-72e1-4ed9-929e-9b19cff3b194", "name": "network-vif-deleted", "tag": "5ddb2551-2c4d-4e7a-9e3e-27088d5daa49"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:27.573662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:27.574387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:27.575085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:27.587641 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] Creating event network-vif-deleted:5ddb2551-2c4d-4e7a-9e3e-27088d5daa49 for instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 on n-h1-858384-11 Oct 13 09:53:27.592428 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-96b5d4ea-7b4a-4f89-9ed5-0fd8192083a1 req-13ea6407-d748-45f1-ac9e-8246a5c0d451 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041183 Oct 13 09:53:27.593116 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4183/7969] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:53:27.921788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:27.922546 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:27.930167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:27.930720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:27.931369 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:27.932090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:27.933484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:27.933939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:27.981696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:27.982194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:27.982675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:27.983123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lazy-loading 'fault' on Instance uuid 4a78fe48-72e1-4ed9-929e-9b19cff3b194 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:53:28.025128 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:28.035029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6b8475ca-538e-4cd7-88e5-187e3092129b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 200 len: 1356 microversion: 2.1 time: 0.117152 Oct 13 09:53:28.035610 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3787/7970] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:27 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:29.060398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:29.061096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 4a78fe48-72e1-4ed9-929e-9b19cff3b194] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:29.067265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:29.067743 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:29.068180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:29.068866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:29.069316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:29.069737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:29.083366 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] HTTP exception thrown: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Request method failure captured: Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 HTTP/1.1 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9_eW89kJaVIlWNlfqSHux1_P1-xWc49o6L6_F9Go8gzmPmDDxkxSPPDjyBB1-BRpv2IPUEKS3WkNX4nE6GF96KjmYRz3QIx70LapKQGnD2MJNqgCJE9Mid71KLeL-HybEFd4WmJH34ktA-SfFESeggDPFAIXg67j7GBYde5uG_reZ0 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1c02a3a59bcb42eabf2e07cf85e71015 Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '4a78fe48-72e1-4ed9-929e-9b19cff3b194'} Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:53:29.084970 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Returning 404 to user: Instance 4a78fe48-72e1-4ed9-929e-9b19cff3b194 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-db4f33f0-e039-4e8f-9d90-6ee51e95447a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194" status: 404 len: 111 microversion: 2.1 time: 0.031344 Oct 13 09:53:29.091554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4184/7971] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:29 2022] GET /compute/v2.1/servers/4a78fe48-72e1-4ed9-929e-9b19cff3b194 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:53:32.448089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-288d1758-73ce-4b9b-a401-ccd7eb597fff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '.version_select at 0x7f53741f90d0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:32.470806 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-288d1758-73ce-4b9b-a401-ccd7eb597fff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-307684457" status: 202 len: 0 microversion: 2.1 time: 0.027000 Oct 13 09:53:32.471865 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3788/7972] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Oct 13 09:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-307684457 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:53:32.497465 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb612dab-0a38-4211-9315-e9a78a931cb7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: .version_select at 0x7f537543c550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-26234897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMbxC9oGTa66rBYboXE1IyOlZrTd8hGLWr8zwOjSmYDJ+CUu/TuK1CjlLHcKelJ279BcyMVwm48FtwO0d5eZn+lc/V+cDed4I9xGsEIUk5v+2OuLJnkLHwNAYSsdg1FBQ=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:32.515316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cb612dab-0a38-4211-9315-e9a78a931cb7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:53:32.522760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-cb612dab-0a38-4211-9315-e9a78a931cb7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:53:32.547417 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb612dab-0a38-4211-9315-e9a78a931cb7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054115 Oct 13 09:53:32.548146 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4185/7973] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:53:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:53:37.980370 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1423413487", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f1c9ff94-eb45-497f-8008-2db09e9e7372"}], "key_name": "tempest-TestNetworkAdvancedServerOps-26234897", "security_groups": [{"name": "tempest-secgroup-smoke-1442545846"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:38.033227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:38.107162 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] validate_networks() for [('f1c9ff94-eb45-497f-8008-2db09e9e7372', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:53:38.589250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:53:38.590845 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:53:38.591339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:53:38.591767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:53:38.592193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:53:38.602119 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:38.602653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:38.603103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:38.603846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:38.604311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:38.604743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:38.625608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:53:38.637591 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:53:38.665023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:53:38.667956 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:53:38.721140 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ffe1ddc9-6c5d-467d-b687-623982094f81 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745711 Oct 13 09:53:38.721805 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3789/7974] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:53:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:53:38.736085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1a0535e1-5e3e-4383-940b-f415f7a4a575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:38.736809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1a0535e1-5e3e-4383-940b-f415f7a4a575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:38.798364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1a0535e1-5e3e-4383-940b-f415f7a4a575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:38.807158 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1a0535e1-5e3e-4383-940b-f415f7a4a575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1265 microversion: 2.1 time: 0.076225 Oct 13 09:53:38.819264 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4186/7975] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:38 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:39.831723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:39.832353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:39.840770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:39.841680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:39.842366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:39.843439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:39.844158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:39.844865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:39.937288 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:39.945414 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-88599fb1-2c36-4a7e-9ca5-a5b21285e575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1335 microversion: 2.1 time: 0.117825 Oct 13 09:53:39.945960 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3790/7976] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:39 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:40.969039 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:40.969601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:40.972609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:40.978807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:40.979566 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:40.980239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:40.981185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:40.981857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:40.982527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:41.160045 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:41.169595 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6f017e94-5e92-40a8-814a-f17f7ae10b93 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.204427 Oct 13 09:53:41.170217 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4187/7977] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:40 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:41.626999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db94959c-446d-40b5-8e66-3205a9804d05", "tag": "2f23981b-c29a-47bc-88c6-95c6c2966742"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:41.638388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:41.639205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:41.639654 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:41.652687 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] Creating event network-changed:2f23981b-c29a-47bc-88c6-95c6c2966742 for instance db94959c-446d-40b5-8e66-3205a9804d05 on n-h1-858384-11 Oct 13 09:53:41.663924 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-49e29b60-8283-4a81-839d-7e874f69f74a req-94f419b5-8f87-44b7-bd7d-f417ca49d4ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041701 Oct 13 09:53:41.664757 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3791/7978] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:53:42.194191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:42.194813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:42.201849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:42.202353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:42.202962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:42.203661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:42.204118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:42.204549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:42.334929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:42.342590 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0008d9a6-6995-4c5d-84e3-f31c8649baef tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.152335 Oct 13 09:53:42.343164 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4188/7979] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:42 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:43.366938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:43.367643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:43.373720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:43.374213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:43.374692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:43.375389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:43.375851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:43.376284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:43.506775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:43.515172 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5b16a4f4-1309-46a3-b4f6-1e371d94ac6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.153400 Oct 13 09:53:43.515742 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3792/7980] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:43 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:44.537378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:44.537995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:44.541431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:44.546696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:44.547184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:44.547626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:44.548338 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:44.548795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:44.549222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:44.688822 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:44.698599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-59b52867-6944-4dad-93e8-957a05d09710 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.165133 Oct 13 09:53:44.699216 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4189/7981] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:44 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:45.721363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:45.721897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:45.729413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:45.729938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:45.730391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:45.731127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:45.731611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:45.732047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:45.868399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:45.876376 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-baf8900d-286c-4385-a1a1-d3957edbfaac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.159006 Oct 13 09:53:45.876947 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3793/7982] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:45 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:46.628183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db94959c-446d-40b5-8e66-3205a9804d05", "name": "network-vif-plugged", "status": "completed", "tag": "2f23981b-c29a-47bc-88c6-95c6c2966742"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:46.639907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:46.640401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:46.640828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:46.651927 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] Creating event network-vif-plugged:2f23981b-c29a-47bc-88c6-95c6c2966742 for instance db94959c-446d-40b5-8e66-3205a9804d05 on n-h1-858384-11 Oct 13 09:53:46.656695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-865aba12-c28a-4046-a5c4-0db0e59982d4 req-a0d5b3b3-f92c-4a62-bac9-22228ac6cb7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Oct 13 09:53:46.657507 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4190/7983] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:53:46.898948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:46.899643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:46.906399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:46.906990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:46.907446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:46.908167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:46.908636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:46.909076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:47.046143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:47.054040 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b32faf6c-1351-4e61-8823-802676eba769 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1391 microversion: 2.1 time: 0.158994 Oct 13 09:53:47.055187 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3794/7984] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:46 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:48.078674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:48.079383 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:48.087143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:48.087634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:48.088095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:48.088795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:48.089252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:48.089684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:48.222541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:48.230491 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc669764-d528-4f26-b05b-69cd4dababde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1563 microversion: 2.1 time: 0.157428 Oct 13 09:53:48.231076 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4191/7985] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:48 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:48.253661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:48.254315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:48.261723 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:48.262226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:48.262707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:48.263422 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:48.263901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:48.264339 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:48.473017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:48.481183 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-effb3c52-bba9-4cd5-bdad-26b0ca4b243e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1563 microversion: 2.1 time: 0.231407 Oct 13 09:53:48.481802 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3795/7986] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:48 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:53:50.079813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:53:50.080431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:53:50.082326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db94959c-446d-40b5-8e66-3205a9804d05", "tag": "2f23981b-c29a-47bc-88c6-95c6c2966742"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:53:50.084500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:50.088053 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:50.088768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:50.090581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:53:50.091471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:50.092613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:50.092987 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:50.094062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:50.094628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:50.095177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:50.098726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:53:50.099235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:53:50.099887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:53:50.113844 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] Creating event network-changed:2f23981b-c29a-47bc-88c6-95c6c2966742 for instance db94959c-446d-40b5-8e66-3205a9804d05 on n-h1-858384-11 Oct 13 09:53:50.119874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-b9c02da1-2b35-4fa2-9682-269057377702 req-a74d3571-1ff5-490f-9f09-5c6d0584fefb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041285 Oct 13 09:53:50.120516 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3796/7987] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:53:50.243630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:53:50.251981 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4f1c5c2-3179-437b-9b95-bc17bd4ed2c9 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1563 microversion: 2.1 time: 0.176475 Oct 13 09:53:50.253011 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4192/7988] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:53:50 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:13.502881 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=36 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:54:13.507471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:54:13.509725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:13.517576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:13.518067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:13.518542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:13.519242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:13.519707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:13.520142 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:13.571902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9a00af04-bd5f-4142-9d27-3fab6f7c37ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action" status: 200 len: 24573 microversion: 2.1 time: 0.071561 Oct 13 09:54:13.572538 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3797/7989] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:54:13 2022] POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:54:19.947507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:54:19.949801 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:19.952367 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:54:19.953180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:54:19.958734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:19.959221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:19.959650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:19.960334 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:19.960784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:19.961206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:20.033893 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8f998a6f-c7c8-4f2e-90a1-4688f1fbdc7f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action" status: 202 len: 0 microversion: 2.1 time: 0.090828 Oct 13 09:54:20.034666 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4193/7990] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:54:19 2022] POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:54:20.043811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:20.044680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:20.052215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:20.053383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:20.053927 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:20.054692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:20.055165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:20.055619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:20.356243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:20.364373 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7be41347-8482-4f3e-a34a-94a6d6773355 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1674 microversion: 2.1 time: 0.325058 Oct 13 09:54:20.365042 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3798/7991] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:20 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1674 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:21.389525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:21.390231 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:21.397031 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:21.397505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:21.397938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:21.398652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:21.399098 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:21.399517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:21.578545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:21.586278 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-72d67d49-e5b7-47ba-bffb-cd2207c04060 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.201949 Oct 13 09:54:21.586871 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4194/7992] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:21 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:22.609278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:22.610167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:22.617732 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:22.618231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:22.618713 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:22.619425 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:22.619895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:22.620343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:22.755331 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:22.763187 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea9d83f2-43e4-4f37-a022-56635229f3c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.157983 Oct 13 09:54:22.763782 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3799/7993] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:22 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:23.789327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:23.789946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:23.796920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:23.797402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:23.797840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:23.798561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:23.799016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:23.799443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:23.931626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:23.939341 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04352873-ed67-4bae-aea0-1a20b9a6262c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.154575 Oct 13 09:54:23.939913 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4195/7994] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:23 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:24.962163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:24.962825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:24.970059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:24.970596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:24.971046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:24.971778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:24.972242 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:24.972675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:25.104451 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:25.112685 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f4a4a4ce-695b-40f6-8726-82a121602c9f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.154416 Oct 13 09:54:25.113269 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3800/7995] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:24 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:26.136936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:26.137580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:26.144263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:26.144742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:26.145174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:26.145892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:26.146375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:26.146826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:26.274461 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:26.282205 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-36ac8c76-928c-4840-8502-e696420eab18 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.149275 Oct 13 09:54:26.282799 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4196/7996] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:26 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:27.306501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:27.307051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:27.313782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:27.314275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:27.314751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:27.315453 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:27.315916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:27.316355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:27.448861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:27.456628 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-516a3a36-e140-4c44-9555-72df8247d26a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.154832 Oct 13 09:54:27.457204 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3801/7997] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:27 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:28.481261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:28.481885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:28.489554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:28.490041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:28.490528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:28.491234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:28.491681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:28.492101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:28.633125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:28.640842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3c716b9e-8c9d-419a-bf4e-76bea866d6e6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.163621 Oct 13 09:54:28.641406 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4197/7998] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:28 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:29.665023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:29.665651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:29.672629 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:29.673126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:29.673581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:29.674297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:29.674793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:29.675233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:29.803658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:29.811431 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1a1edd11-34cb-42d4-81cf-d61d77cd9c87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.150966 Oct 13 09:54:29.812009 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3802/7999] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:29 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:30.835828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:30.836475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:30.843172 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:30.843648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:30.844080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:30.844764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:30.845211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:30.845633 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:30.973845 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:30.981570 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-532e3c88-3807-4476-9e8b-3821a648ccf7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1679 microversion: 2.1 time: 0.150287 Oct 13 09:54:30.982133 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4198/8000] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:30 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:32.005026 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:54:32.005658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:32.012562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:32.013062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:32.013515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:32.014221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:32.014725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:32.015174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:32.149657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:54:32.157435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e238618-e836-4488-b2af-a07e3ffa413f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1682 microversion: 2.1 time: 0.156392 Oct 13 09:54:32.158014 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3803/8001] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:54:31 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:54:56.344007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:54:56.346201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:54:56.349565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=12 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:54:56.350243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:54:56.356601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:56.357078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:56.357512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:56.358202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:54:56.358731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:54:56.359154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:54:56.582253 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-957e0e4f-b50a-478a-bd5d-1800825bd9ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action" status: 200 len: 69136 microversion: 2.1 time: 0.242097 Oct 13 09:54:56.582968 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4199/8002] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:54:56 2022] POST /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05/action => generated 69136 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:55:03.848217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:03.848749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:03.851641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=15 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:03.852471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=40 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:03.865670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:03.866383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:03.866863 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:03.867582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:03.868050 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:03.868488 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:03.895023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:55:03.924649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db94959c-446d-40b5-8e66-3205a9804d05", "tag": "2f23981b-c29a-47bc-88c6-95c6c2966742"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:03.936753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:03.937553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:03.938064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:03.949658 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] Creating event network-changed:2f23981b-c29a-47bc-88c6-95c6c2966742 for instance db94959c-446d-40b5-8e66-3205a9804d05 on n-h1-858384-11 Oct 13 09:55:03.955603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-7556eb55-b54d-414f-a644-831f0e12270b req-9de9f685-ebf6-402a-b5ec-f8397ce2647b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100511 Oct 13 09:55:03.956606 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4200/8003] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:55:03.980613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-233a3de6-7a12-44f0-b2f4-4c1b0f1702cb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 204 len: 0 microversion: 2.1 time: 0.136202 Oct 13 09:55:03.981512 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3804/8004] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:55:03 2022] DELETE /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:55:03.993120 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:03.993946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:04.001716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:04.002313 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:04.002860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:04.003649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:04.004184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:04.004739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:04.149699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:04.157537 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b2a2f9f5-9aae-4305-853f-4eb5a3fc8c21 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1688 microversion: 2.1 time: 0.169444 Oct 13 09:55:04.158308 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4201/8005] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:03 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:05.181910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:05.182670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:05.189402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:05.189903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:05.190355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:05.191093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:05.191561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:05.192005 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:05.357816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:05.365934 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b82834c-f71c-4f33-a20e-e1b9818337d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 200 len: 1688 microversion: 2.1 time: 0.188459 Oct 13 09:55:05.366534 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3805/8006] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:05 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:05.970849 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db94959c-446d-40b5-8e66-3205a9804d05", "name": "network-vif-deleted", "tag": "2f23981b-c29a-47bc-88c6-95c6c2966742"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:05.981824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:05.982302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:05.982806 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:05.995048 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] Creating event network-vif-deleted:2f23981b-c29a-47bc-88c6-95c6c2966742 for instance db94959c-446d-40b5-8e66-3205a9804d05 on n-h1-858384-11 Oct 13 09:55:06.000625 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-75028ece-b190-4442-bb06-115666e91019 req-859e142b-489e-4500-9ee9-7f909d22cbdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Oct 13 09:55:06.001238 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4202/8007] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:55:06.390964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:06.391587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: db94959c-446d-40b5-8e66-3205a9804d05] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:06.399237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:06.399739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:06.400188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:06.400899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:06.401363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:06.401798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:06.417047 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] HTTP exception thrown: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Request method failure captured: Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 HTTP/1.1 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9_eW89kJaVIlWNlfqSHux1_P1-xWc49o6L6_F9Go8gzmPmDDxkxSPPDjyBB1-BRpv2IPUEKS3WkNX4nE6GF96KjmYRz3QIx70LapKQGnD2MJNqgCJE9Mid71KLeL-HybEFd4WmJH34ktA-SfFESeggDPFAIXg67j7GBYde5uG_reZ0 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1c02a3a59bcb42eabf2e07cf85e71015 Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'db94959c-446d-40b5-8e66-3205a9804d05'} Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:55:06.418700 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Returning 404 to user: Instance db94959c-446d-40b5-8e66-3205a9804d05 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c8bfd23-ce82-414a-ab9c-66572b3e1f09 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05" status: 404 len: 111 microversion: 2.1 time: 0.033844 Oct 13 09:55:06.424661 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3806/8008] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:06 2022] GET /compute/v2.1/servers/db94959c-446d-40b5-8e66-3205a9804d05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 13 09:55:09.744981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f2317967-2f57-4acb-a352-2391efdc7bce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '.version_select at 0x7f53756afc10>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:09.765277 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f2317967-2f57-4acb-a352-2391efdc7bce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-26234897" status: 202 len: 0 microversion: 2.1 time: 0.026487 Oct 13 09:55:09.766172 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4203/8009] 10.222.0.23 () {58 vars in 1278 bytes} [Thu Oct 13 09:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-26234897 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 13 09:55:09.793660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ad722766-f8db-4be7-84e5-45515dc21cf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: .version_select at 0x7f53754ae1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-182382664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2J7trn8zvaFnjjKWaqHcxyCS8yCAQXhyzUEoAjdCvrkRKO5vLkrcBA8ghgJbm218/lI5NpZi4eHRuT9NKa5F8+wByBAO1tFhheufMUkAE3S+GEKPtDP/rKPGBmgszXJQ=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:09.814329 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad722766-f8db-4be7-84e5-45515dc21cf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:55:09.819551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-ad722766-f8db-4be7-84e5-45515dc21cf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:55:09.842735 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ad722766-f8db-4be7-84e5-45515dc21cf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053061 Oct 13 09:55:09.843355 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3807/8010] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:55:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:55:15.608499 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-385700545", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "f6d38e31-4931-4f10-96c3-577daff9cfd3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-182382664", "security_groups": [{"name": "tempest-secgroup-smoke-1801842477"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:15.725471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] validate_networks() for [('f6d38e31-4931-4f10-96c3-577daff9cfd3', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:55:15.987858 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=14 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:16.192202 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:55:16.193310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:55:16.193670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:55:16.194076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:55:16.194516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:55:16.206278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:16.207336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:16.208800 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:16.210090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:16.211083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:16.211831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:16.237864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:55:16.244280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:55:16.258368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:55:16.261142 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:55:16.314394 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4bcf38bc-70cd-44e0-b9f2-c5cd205eed0e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710610 Oct 13 09:55:16.315276 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4204/8011] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:55:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:55:16.326697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aff45f03-feb7-4c6c-81fc-14eaeda81a22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:16.328043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aff45f03-feb7-4c6c-81fc-14eaeda81a22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:16.406995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:16.426359 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aff45f03-feb7-4c6c-81fc-14eaeda81a22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:16.434731 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aff45f03-feb7-4c6c-81fc-14eaeda81a22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1265 microversion: 2.1 time: 0.111906 Oct 13 09:55:16.435885 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3808/8012] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:16 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:17.458342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:17.458904 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:17.468514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:17.469544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:17.470199 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:17.471173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:17.471643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:17.472081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:17.543585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:17.554021 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-09afcbdf-03af-4ee8-b699-87eba956c60f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1269 microversion: 2.1 time: 0.098960 Oct 13 09:55:17.555098 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4205/8013] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:17 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:55:18.577585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:18.578236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:18.585888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:18.587460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:18.588347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:18.589521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:18.590236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:18.590926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:18.665676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:18.673526 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-100e3565-085b-4710-a3a9-06870340a145 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1323 microversion: 2.1 time: 0.100097 Oct 13 09:55:18.674111 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3809/8014] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:18 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:19.697341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:19.698077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:19.704868 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:19.705347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:19.705779 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:19.706547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:19.706994 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:19.707417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:19.845209 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:19.853903 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d9592af9-e4a3-4702-aab8-9dbe0a4dc686 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.160669 Oct 13 09:55:19.854618 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4206/8015] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:19 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:19.958995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:19.969631 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:19.970134 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:19.970619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:19.982688 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] Creating event network-changed:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h2-858384-11 Oct 13 09:55:19.987933 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-80c2f0f6-a378-4d48-85dd-71c2bf5cb8ef req-382b0f40-7302-44dc-a9d1-d4f3e3ded599 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033358 Oct 13 09:55:19.988539 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3810/8016] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:55:20.878001 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:20.878691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:20.885445 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:20.885931 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:20.886371 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:20.887089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:20.887545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:20.887977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:21.020830 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:21.031216 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-94e563a4-4828-44fb-9b31-577c8751b149 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.157063 Oct 13 09:55:21.031814 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4207/8017] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:20 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:22.056510 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:22.057255 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:22.063521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:22.064013 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:22.064464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:22.065164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:22.065625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:22.066059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:22.197082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:22.204815 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6eeb12b6-d929-4e9b-8d6a-a14d566c98cc tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.154187 Oct 13 09:55:22.205387 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3811/8018] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:22 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:23.227981 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:23.228595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:23.235690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:23.236168 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:23.236598 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:23.237286 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:23.237736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:23.238156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:23.367315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:23.375023 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b888af3-4431-4944-a6b4-6431b2d5c319 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.151616 Oct 13 09:55:23.375589 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4208/8019] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:23 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:24.398552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:24.399194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:24.406166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:24.406698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:24.407155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:24.407891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:24.408366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:24.408810 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:24.542696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:24.550361 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aaba2b97-6fb4-4253-8f61-fcb285e09372 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.156319 Oct 13 09:55:24.550960 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3812/8020] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:24 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:25.573070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:25.573690 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:25.580703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:25.581183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:25.581618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:25.582710 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:25.582821 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:25.583224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:25.717438 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:25.725761 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5bc5d67-d3ee-43e9-ade8-ef406a743a47 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.156651 Oct 13 09:55:25.726331 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4209/8021] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:25 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:26.212515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "name": "network-vif-plugged", "status": "completed", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:26.221930 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:26.222437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:26.222883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:26.234079 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] Creating event network-vif-plugged:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h2-858384-11 Oct 13 09:55:26.239958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-f8207d8c-71ce-4a6a-a9a1-2a9e017d27a0 req-40d8877b-5665-4710-bcc6-b5bb9610e1be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096945 Oct 13 09:55:26.240495 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3813/8022] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:55:26.749201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:26.749750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:26.751678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:26.752351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:26.753991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:26.760929 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:26.761407 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:26.761842 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:26.762562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:26.763011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:26.763440 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:26.893607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:26.901806 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e60d85c-3303-4f24-95bf-ce8d7fd9366c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1391 microversion: 2.1 time: 0.156615 Oct 13 09:55:26.902383 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4210/8023] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:26 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:27.921611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:55:27.927491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:27.928209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:27.935624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:27.936132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:27.936585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:27.937297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:27.937766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:27.938209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:28.070445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:28.078225 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e9aca3e2-dc94-48d9-a04b-25d7ba73930c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1562 microversion: 2.1 time: 0.157665 Oct 13 09:55:28.078832 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3814/8024] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:27 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:28.100723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:28.101340 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:28.108696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:28.109183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:28.109890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:28.110618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:28.111075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:28.111507 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:28.247219 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:28.254999 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d5001c3a-8cef-4ef6-90bc-7a83f06770ab tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1562 microversion: 2.1 time: 0.158211 Oct 13 09:55:28.255575 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4211/8025] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:28 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:55:29.808853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:55:29.810070 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:55:29.811657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:55:29.817672 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:29.818435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:29.819094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:29.819999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:29.820471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:29.820912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:29.823853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:55:29.824413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:55:29.825068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:55:29.837475 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] Creating event network-changed:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h2-858384-11 Oct 13 09:55:29.843035 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-291560cc-754d-4d13-b69e-145fda0a9ac7 req-8f5853bb-0cde-463a-808f-cdc41ed645ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035316 Oct 13 09:55:29.843996 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4212/8026] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:55:30.039247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:55:30.049054 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2c36b92b-f5f1-4750-b097-9224adeccd1b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1562 microversion: 2.1 time: 0.243958 Oct 13 09:55:30.050007 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3815/8027] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:55:29 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:03.339177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:03.341444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:03.343619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=5 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:03.344261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=46 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:03.351620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:03.352112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:03.352560 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:03.353293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:03.353753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:03.354195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:03.428307 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-733cdf05-024c-4384-a018-dd0be9bb148a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action" status: 200 len: 24564 microversion: 2.1 time: 0.093598 Oct 13 09:56:03.429183 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4213/8028] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:56:03 2022] POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action => generated 24564 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:56:33.844180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:33.845012 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:33.849548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:33.851915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:33.859610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:33.860110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:33.860562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:33.861267 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:33.861735 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:33.862176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:33.901952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:33.907725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Old instance type m1.heat2, new instance type m1.heat {{(pid=127031) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 13 09:56:33.914838 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:56:33.915277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:56:33.915770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:56:33.916193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:56:33.916618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:56:33.978134 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ea11edc0-5a77-4f43-bd51-1ad98f427b88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action" status: 202 len: 0 microversion: 2.1 time: 0.135786 Oct 13 09:56:33.978835 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3816/8029] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:56:33 2022] POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:56:33.987958 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:33.988787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:33.992133 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:33.993038 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=4 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:56:33.998527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:33.999070 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:33.999517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:34.000221 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:34.000676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:34.001108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:34.145086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:34.153631 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f2042e1-957b-4382-bcfd-d95139ac196c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1690 microversion: 2.1 time: 0.170282 Oct 13 09:56:34.154207 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4214/8030] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:33 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:35.180611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:35.181196 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:35.188519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:35.188889 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:35.189343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:35.190067 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:35.190561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:35.191057 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:35.320074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:35.327803 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5da39415-855b-4160-a634-913aa402ff87 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1690 microversion: 2.1 time: 0.152894 Oct 13 09:56:35.328383 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3817/8031] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:35 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:36.350741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:36.351387 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:36.358257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:36.358768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:36.359464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:36.360156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:36.360611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:36.361037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:36.490729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:36.498642 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e680de17-dc0b-4471-88b1-536adb5e654f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.151891 Oct 13 09:56:36.499220 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4215/8032] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:36 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:37.522807 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:37.523456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:37.530433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:37.530947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:37.531402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:37.532117 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:37.532595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:37.533035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:37.668964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:37.676953 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4552af64-89b3-43d1-a83f-79570d00d414 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.158697 Oct 13 09:56:37.677571 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3818/8033] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:37 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:38.700725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:38.701376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:38.708901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:38.709381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:38.709818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:38.710547 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:38.711003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:38.711432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:38.842242 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:38.850562 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-cb522420-c6e3-46a6-80cb-bde973152acd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.153760 Oct 13 09:56:38.851305 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4216/8034] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:38 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:39.874087 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:39.874737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:39.881599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:39.882105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:39.882599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:39.883315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:39.883789 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:39.884236 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:40.012223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:40.020060 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16176b9e-5323-461c-a439-620b52c46fac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.150012 Oct 13 09:56:40.021177 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3819/8035] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:39 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:41.043776 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:41.044378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:41.051452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:41.052423 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:41.052853 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:41.053542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:41.053993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:41.054430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:41.185292 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:41.193554 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4f9fd6b8-18a7-47f1-b32c-2974147c698a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.153701 Oct 13 09:56:41.194128 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4217/8036] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:41 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:42.216478 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:42.217100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:42.223899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:42.224389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:42.224834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:42.225550 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:42.225997 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:42.226463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:42.359752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:42.368017 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7ca17117-c280-4745-8707-ae000f7b6bf8 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.155492 Oct 13 09:56:42.368588 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3820/8037] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:42 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:43.390824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:43.391443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:43.398742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:43.399217 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:43.399652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:43.400335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:43.400783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:43.401203 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:43.532234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:43.539997 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e8065e80-af55-4b40-a499-61f75c5254cd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.153159 Oct 13 09:56:43.540569 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4218/8038] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:43 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:44.563480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:44.564102 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:44.571093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:44.571584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:44.572030 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:44.572731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:44.573192 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:44.573628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:44.708908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:44.716786 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-317ca475-0107-4e58-ad66-27ca39ec19c0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.157345 Oct 13 09:56:44.717370 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3821/8039] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:44 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:45.739895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:45.740498 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:45.747487 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:45.747975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:45.748420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:45.749123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:45.749580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:45.750014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:46.153247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:46.161122 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-23623458-79cd-4553-9674-0b11914e6daa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.425172 Oct 13 09:56:46.161710 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4219/8040] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:45 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:47.184920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:47.185554 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:47.192563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:47.193059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:47.193509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:47.194468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:47.194949 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:47.195389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:47.324203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:47.331957 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-890a4096-9029-48ff-a6ff-ab06a603cb8a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1695 microversion: 2.1 time: 0.151153 Oct 13 09:56:47.333333 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3822/8041] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:47 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:48.355085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:48.355712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:48.362775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:48.363262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:48.363701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:48.364885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:48.365336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:48.365761 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:48.584799 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:48.593142 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-424df498-b5e0-4891-85b1-9a91b242e744 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1694 microversion: 2.1 time: 0.241736 Oct 13 09:56:48.594364 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4220/8042] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:48 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:48.663010 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "name": "network-vif-unplugged", "status": "completed", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:48.673999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:48.674623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:48.675093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:48.688787 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Creating event network-vif-unplugged:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h1-858384-11 Oct 13 09:56:48.694179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] Instance 78940a63-4da1-466d-9c8c-908519145270 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:56:48.705058 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1f0632c9-bd08-4fe1-bfa4-0d02dfeb868a req-ed40649c-df80-4c26-9164-5977e068a918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046483 Oct 13 09:56:48.705668 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3823/8043] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:56:49.617207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:49.618520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:49.625532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:49.626130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:49.626616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:49.627326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:49.627786 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:49.628247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:49.771134 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:49.778936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c80be666-3b52-4634-b873-0c80990f53d0 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1694 microversion: 2.1 time: 0.165702 Oct 13 09:56:49.779584 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4221/8044] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:49 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:50.732332 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:50.743167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:50.743671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:50.744131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:50.756493 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Creating event network-changed:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h1-858384-11 Oct 13 09:56:50.761816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] Instance 78940a63-4da1-466d-9c8c-908519145270 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:56:50.772465 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-09c64f15-982c-4c18-89ab-94424d68cae2 req-90378cc9-d68e-4577-8ef0-256c9fbde155 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044957 Oct 13 09:56:50.773095 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3824/8045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:56:50.800957 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:50.802064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:50.809336 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:50.809826 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:50.810267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:50.811014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:50.811468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:50.811899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:51.024455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:51.032389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-238d3f3b-dbfb-4799-b5af-fe2813763f78 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1692 microversion: 2.1 time: 0.235198 Oct 13 09:56:51.033285 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4222/8046] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:50 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:52.059028 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:52.059753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:52.065964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.066502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.067608 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.068321 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.068794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.069241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.198727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:52.206727 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ffe7debd-071f-477a-95aa-a643a5f54a23 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1689 microversion: 2.1 time: 0.152856 Oct 13 09:56:52.207304 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3825/8047] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:52 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:52.229079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:52.229642 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:52.236876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.237365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.237807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.238551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.239789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.240224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.298389 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c501749a-9541-490c-a607-4ff920de5678 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action" status: 204 len: 0 microversion: 2.1 time: 0.072952 Oct 13 09:56:52.298994 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4223/8048] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:56:52 2022] POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:56:52.307935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:52.308562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:52.314634 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.315133 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.315575 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.316283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.317374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.317817 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.531728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:52.540372 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-269673bf-9b20-457d-b916-3879bef3ca74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1689 microversion: 2.1 time: 0.236444 Oct 13 09:56:52.540982 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3826/8049] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:52 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:52.563867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:52.564504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:52.570742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.571223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.571662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.572356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:52.572807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:52.573256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:52.718285 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:52.726862 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0d381275-f4c5-47b7-9f10-fe3ff7f12f66 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1689 microversion: 2.1 time: 0.167242 Oct 13 09:56:52.727444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4224/8050] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:52 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:56:53.521737 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "name": "network-vif-plugged", "status": "completed", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:56:53.533035 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:53.533642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:53.534201 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:53.560117 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Creating event network-vif-plugged:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h1-858384-11 Oct 13 09:56:53.565996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] Instance 78940a63-4da1-466d-9c8c-908519145270 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-11', 'n-h2-858384-11'} {{(pid=127031) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 13 09:56:53.577641 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-64f1aded-adb2-4801-b05c-c04311562fb3 req-b2f5a403-2a30-4379-911b-d8ed5f15608e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060166 Oct 13 09:56:53.579024 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3827/8051] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:56:53.751092 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:56:53.751689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:56:53.758682 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:53.759167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:53.759613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:53.760361 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:56:53.760782 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:56:53.761197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:56:53.901344 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:56:53.909203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe6bf8c3-e69c-445a-960e-848d71b15eff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1681 microversion: 2.1 time: 0.161968 Oct 13 09:56:53.909772 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4225/8052] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:56:53 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:16.090314 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=28 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:16.091131 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:16.096586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:16.098888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:16.107374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:16.107868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:16.108315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:16.109275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:16.109739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:16.110175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:16.163319 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f55b153-2b40-48e4-ac2a-5e1e5c9adccb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action" status: 200 len: 24573 microversion: 2.1 time: 0.074809 Oct 13 09:57:16.163975 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3828/8053] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:57:16 2022] POST /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:57:23.146163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:23.146733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:23.149302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=24 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:23.150154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:23.158725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:23.159214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:23.159653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:23.160355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:23.161491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:23.161491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:23.190809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:57:23.207587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:23.221263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:23.221760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:23.222210 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:23.234627 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] Creating event network-changed:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h1-858384-11 Oct 13 09:57:23.239846 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-dc6c91e5-6581-4518-998e-e1aeb3ad0272 req-8075e0c3-6ce6-4b81-bd43-8dc28fd7e9d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094844 Oct 13 09:57:23.241141 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3829/8054] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:23.278167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f1357b49-31a0-477b-b479-db2f2db7adac tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 204 len: 0 microversion: 2.1 time: 0.135291 Oct 13 09:57:23.282383 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4226/8055] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:57:23 2022] DELETE /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:57:23.289297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:23.290078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:23.296324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:23.296821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:23.297275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:23.297987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:23.298519 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:23.298966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:23.438078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:23.446119 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b259cf4f-15a9-4aaa-932e-aea085a0f230 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1687 microversion: 2.1 time: 0.162172 Oct 13 09:57:23.446735 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3830/8056] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:23 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:57:24.470296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:24.471148 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:24.477715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:24.478206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:24.478679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:24.479385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:24.479873 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:24.480300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:24.721194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:24.730966 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b9c402af-12f5-4393-9053-a781b4a28bff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 200 len: 1687 microversion: 2.1 time: 0.265053 Oct 13 09:57:24.732433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4227/8057] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:24 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 1687 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:25.254784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78940a63-4da1-466d-9c8c-908519145270", "name": "network-vif-deleted", "tag": "abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:25.265680 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:25.266140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:25.266616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:25.277636 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] Creating event network-vif-deleted:abe5e9d6-b771-4ffc-aa77-adf6f1e4d9e7 for instance 78940a63-4da1-466d-9c8c-908519145270 on n-h1-858384-11 Oct 13 09:57:25.282684 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-d31c2f38-9afc-41ec-928c-47950c75b76f req-e052a751-8334-467e-be72-c04742d2fd72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Oct 13 09:57:25.283283 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3831/8058] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:25.756011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:25.756623 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 78940a63-4da1-466d-9c8c-908519145270] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:25.763486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:25.763964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:25.764396 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:25.765079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:25.765528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:25.765947 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:25.779871 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] HTTP exception thrown: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Request method failure captured: Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 HTTP/1.1 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9_eW89kJaVIlWNlfqSHux1_P1-xWc49o6L6_F9Go8gzmPmDDxkxSPPDjyBB1-BRpv2IPUEKS3WkNX4nE6GF96KjmYRz3QIx70LapKQGnD2MJNqgCJE9Mid71KLeL-HybEFd4WmJH34ktA-SfFESeggDPFAIXg67j7GBYde5uG_reZ0 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1c02a3a59bcb42eabf2e07cf85e71015 Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '78940a63-4da1-466d-9c8c-908519145270'} Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:57:25.781516 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Returning 404 to user: Instance 78940a63-4da1-466d-9c8c-908519145270 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-236e7102-1f86-42de-9284-32c668e8af25 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270" status: 404 len: 111 microversion: 2.1 time: 0.030845 Oct 13 09:57:25.787695 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4228/8059] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:25 2022] GET /compute/v2.1/servers/78940a63-4da1-466d-9c8c-908519145270 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:57:29.062926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d82795e9-94db-43e0-9544-03875c31ddb6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '.version_select at 0x7f5375f9f820>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:29.084448 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d82795e9-94db-43e0-9544-03875c31ddb6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-182382664" status: 202 len: 0 microversion: 2.1 time: 0.026298 Oct 13 09:57:29.085237 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3832/8060] 10.222.0.23 () {58 vars in 1281 bytes} [Thu Oct 13 09:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-182382664 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:57:29.109017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-44f351e2-2d8d-4850-924a-23b2fe11905e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: .version_select at 0x7f5375848f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1991534272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIOnWgaeOodjJJK7blLXDnY0OdSN6HS6fUrilvMI0h3MKMmo8uN2zluZAwa0dlyzq2g8s1WH+elSgVexBrnoB11XL+ErS1u5b5/HFGumGAUpUDlCLhad+7dnRBBI/Xn1w=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:29.125624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-44f351e2-2d8d-4850-924a-23b2fe11905e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:57:29.132008 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-44f351e2-2d8d-4850-924a-23b2fe11905e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:57:29.155175 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-44f351e2-2d8d-4850-924a-23b2fe11905e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050279 Oct 13 09:57:29.155762 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4229/8061] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:57:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:34.926913 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-934387854", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "894c38b0-21f4-4bd2-b715-555bbe0ea010"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1991534272", "security_groups": [{"name": "tempest-secgroup-smoke-2039907793"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:35.080592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] validate_networks() for [('894c38b0-21f4-4bd2-b715-555bbe0ea010', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:57:35.271706 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=14 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:35.473116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:57:35.473556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:57:35.474238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:57:35.474691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:57:35.475122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:57:35.484283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:35.484781 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:35.485229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:35.485960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:35.486449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:35.486891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:35.506170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:57:35.511449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:57:35.525048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:57:35.527584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:57:35.575622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0d1c9e15-c4de-48c9-8417-aff763b58766 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654384 Oct 13 09:57:35.576950 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3833/8062] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:57:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 13 09:57:35.588365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70531a94-19f5-4615-b762-2cc34132637f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:35.589584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70531a94-19f5-4615-b762-2cc34132637f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:35.659457 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70531a94-19f5-4615-b762-2cc34132637f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:35.666616 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70531a94-19f5-4615-b762-2cc34132637f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1266 microversion: 2.1 time: 0.082130 Oct 13 09:57:35.667396 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4230/8063] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:35 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:57:36.693003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:36.695816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:36.745775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:36.746304 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:36.747072 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:36.748027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:36.748666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:36.749276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:36.843583 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:36.852633 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a87837c-9443-4df4-aee0-86bbec7f0d4a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1336 microversion: 2.1 time: 0.166949 Oct 13 09:57:36.853290 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3834/8064] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:36 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:37.877156 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:37.877646 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:37.880138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:37.889381 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:37.889880 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:37.890470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:37.891081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:37.891721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:37.892352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:38.037641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:38.045775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-31eb3bd5-7e73-479b-a580-85a682f22980 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.172740 Oct 13 09:57:38.046353 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4231/8065] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:37 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:38.189155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afd7aa3-7797-4b3d-9a53-7474fd07b335", "tag": "f99d7174-7cf8-4e55-8651-e9a0d5c30cf5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:38.201992 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:38.202439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:38.202883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:38.215622 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] Creating event network-changed:f99d7174-7cf8-4e55-8651-e9a0d5c30cf5 for instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 on n-h1-858384-11 Oct 13 09:57:38.220729 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-36ab2f20-bff3-4bec-b871-bb7bd3a51416 req-71fc1fdc-8b47-4bdf-98a3-34d5decf9072 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035486 Oct 13 09:57:38.221687 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3835/8066] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:39.069042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:39.069649 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:39.076768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:39.077456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:39.077891 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:39.078634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:39.079086 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:39.079509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:39.213343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:39.221141 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4ec5cab2-12bb-4560-b568-beae021d1a6c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.156522 Oct 13 09:57:39.221706 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4232/8067] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:39 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:40.245531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:40.246241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:40.252474 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:40.252965 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:40.253409 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:40.254104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:40.254593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:40.255031 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:40.388145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:40.396545 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-9dac3d6f-979f-4993-a104-5badf3d59696 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.156229 Oct 13 09:57:40.397125 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3836/8068] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:40 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:41.418835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:41.419432 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:41.426327 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:41.427476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:41.427910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:41.428686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:41.429139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:41.429563 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:41.571475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:41.579603 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6b6fbebe-dab8-425c-8aa8-5a027d97498d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.164857 Oct 13 09:57:41.580192 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4233/8069] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:41 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:42.603477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:42.604098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:42.611163 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:42.611652 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:42.612105 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:42.612802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:42.613263 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:42.613700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:42.745831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:42.753682 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e9d7255-9803-4e47-9ab2-bf1a86e2f56b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.154168 Oct 13 09:57:42.754264 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3837/8070] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:42 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:43.724608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afd7aa3-7797-4b3d-9a53-7474fd07b335", "name": "network-vif-plugged", "status": "completed", "tag": "f99d7174-7cf8-4e55-8651-e9a0d5c30cf5"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:43.735315 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:43.735882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:43.736301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:43.748203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] Creating event network-vif-plugged:f99d7174-7cf8-4e55-8651-e9a0d5c30cf5 for instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 on n-h1-858384-11 Oct 13 09:57:43.753094 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-d58a87a6-b2b6-485d-894e-c99ce9832ff3 req-2d40a1d0-258c-47dd-8153-381d3c1ebbf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032139 Oct 13 09:57:43.753759 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4234/8071] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:43.776379 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:43.777693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:43.785414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:43.785920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:43.786377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:43.787122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:43.787595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:43.788038 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:43.984548 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:43.992338 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8ae7e353-4206-440d-b17e-77105413da84 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1392 microversion: 2.1 time: 0.220619 Oct 13 09:57:43.992914 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3838/8072] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:43 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:45.017689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:45.019112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:45.028188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:45.028684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:45.029155 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:45.029916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:45.030671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:45.031375 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:45.164655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:45.172496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1e60af4b-d7da-4b4f-9646-810dce036998 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1564 microversion: 2.1 time: 0.160394 Oct 13 09:57:45.173096 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4235/8073] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:45 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:45.195573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:45.196205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:45.203275 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:45.203771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:45.204226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:45.204988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:45.205464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:45.205911 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:45.339248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:45.346931 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ace74dff-8a61-4113-a135-7d2b3c127d30 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1564 microversion: 2.1 time: 0.155289 Oct 13 09:57:45.347506 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3839/8074] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:45 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:57:46.958228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:57:46.958876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:57:46.960146 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afd7aa3-7797-4b3d-9a53-7474fd07b335", "tag": "f99d7174-7cf8-4e55-8651-e9a0d5c30cf5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:57:46.964115 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:46.968380 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:46.969097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:46.970642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:57:46.971916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:46.972415 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:46.972886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:46.973605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:46.974060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:46.974549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:46.976589 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:57:46.977217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:57:46.977671 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:57:46.991943 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] Creating event network-changed:f99d7174-7cf8-4e55-8651-e9a0d5c30cf5 for instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 on n-h1-858384-11 Oct 13 09:57:46.997807 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-41d7e4bd-34e8-476e-b90b-bde00c887ffd req-8ff6ab00-913e-4996-a358-a183e00216e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048156 Oct 13 09:57:46.999009 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3840/8075] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:57:47.125546 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:57:47.138264 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-af7a7371-ed92-4163-9f43-24064fefb789 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1564 microversion: 2.1 time: 0.190210 Oct 13 09:57:47.139961 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4236/8076] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:57:46 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1564 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:10.396516 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:58:10.398898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:10.401433 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=36 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:58:10.407736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:10.408235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:10.408684 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:10.409393 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:10.409855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:10.410292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:10.462037 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d4273bba-baed-4c5f-971e-575c1cd2ae13 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action" status: 200 len: 24565 microversion: 2.1 time: 0.071476 Oct 13 09:58:10.462709 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3841/8077] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:58:10 2022] POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:58:16.878335 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:58:16.881113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:58:16.881908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:58:16.888160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:16.888643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:16.889077 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:16.911610 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Going to try to stop instance {{(pid=127030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 13 09:58:16.952450 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c4e852b6-c0b6-4643-b6dc-adf11d45a327 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action" status: 202 len: 0 microversion: 2.1 time: 0.078144 Oct 13 09:58:16.953054 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4237/8078] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:58:16 2022] POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:58:16.962024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:16.963365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:16.970651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:16.971155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:16.971611 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:16.972330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:16.972795 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:16.973240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:17.114873 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:17.122770 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-46a58838-621e-4662-9339-44f011adc034 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.165263 Oct 13 09:58:17.123339 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3842/8079] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:16 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:18.148214 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:18.148910 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:18.155097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:18.155577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:18.156014 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:18.156703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:18.157154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:18.157580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:18.286333 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:18.294150 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-21b7d172-7fdc-4e87-b596-53df97dd7320 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.151715 Oct 13 09:58:18.294695 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4238/8080] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:18 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:19.318574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:19.319149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:19.326755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:19.327248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:19.327698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:19.328402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:19.328865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:19.329302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:19.456961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:19.464967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-899cc007-a774-4c6b-960f-8f10c9e42efa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.151179 Oct 13 09:58:19.465600 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3843/8081] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:19 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:20.490302 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:20.490983 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:20.497940 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:20.498434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:20.498877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:20.499568 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:20.500050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:20.500473 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:20.628714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:20.637157 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7c5f4931-cf1e-4ecf-b597-05b9bcb396c5 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.151234 Oct 13 09:58:20.637729 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4239/8082] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:20 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:21.660875 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:21.661532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:21.668466 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:21.668957 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:21.669406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:21.670110 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:21.670602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:21.671044 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:21.802883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:21.810645 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c918de3a-e1ae-4c65-9706-518bc0e2b1f1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.154339 Oct 13 09:58:21.811224 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3844/8083] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:21 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:22.833587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:22.834187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:22.841027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:22.841504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:22.841944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:22.842643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:22.843097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:22.843517 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:22.978602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:22.986536 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0cc07ae0-0e37-4e86-ab0f-649512e8c5bd tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.156908 Oct 13 09:58:22.987112 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4240/8084] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:22 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:24.009915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:24.010502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:24.017446 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:24.017946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:24.018420 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:24.019149 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:24.019621 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:24.020709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:24.155703 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:24.163660 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d218c6dc-0f42-4e29-8a76-62faef31ef88 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.157789 Oct 13 09:58:24.164247 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3845/8085] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:24 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:25.187377 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:25.187992 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:25.194748 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:25.195223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:25.195654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:25.196342 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:25.196788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:25.197211 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:25.325953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:25.334318 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c6018c7c-93af-44bc-9177-ccbc3c4c8974 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.150849 Oct 13 09:58:25.334928 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4241/8086] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:25 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:26.357756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:26.358382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:26.366125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:26.366642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:26.367094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:26.367786 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:26.368280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:26.368717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:26.496797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:26.504774 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f42adb1-6e8e-4fe8-a29c-86d0342dc102 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1693 microversion: 2.1 time: 0.151043 Oct 13 09:58:26.505385 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3846/8087] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:26 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:27.528154 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:27.528768 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:27.536187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:27.536660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:27.537097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:27.537777 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:27.538227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:27.538673 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:27.670730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:27.678936 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9a06751-bb1a-4e36-a62d-59aa97145c1d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1670 microversion: 2.1 time: 0.154744 Oct 13 09:58:27.679531 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4242/8088] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:27 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:28.771799 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:58:28.774024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:28.781022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:28.781517 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:28.781966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:28.782765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:28.783231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:28.783670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:28.834738 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-45daad2f-fdf9-486d-8b19-3b2c0532ec1f tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action" status: 200 len: 35872 microversion: 2.1 time: 0.066660 Oct 13 09:58:28.835628 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3847/8089] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:58:28 2022] POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action => generated 35872 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:58:28.847312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:58:28.854235 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:28.854747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:28.855188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:28.877358 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Going to try to start instance {{(pid=127030) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 13 09:58:28.918416 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ee6e1aaf-65b0-461b-88bd-5f8b764153c7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action" status: 202 len: 0 microversion: 2.1 time: 0.074822 Oct 13 09:58:28.919125 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4243/8090] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:58:28 2022] POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:58:28.928664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:28.929391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:28.936893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:28.937391 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:28.937853 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:28.938595 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:28.939063 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:28.939504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:29.159933 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:29.168394 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2f7f5a2-dce3-427a-b2aa-1efc8265dfb2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1679 microversion: 2.1 time: 0.244479 Oct 13 09:58:29.168976 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3848/8091] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:28 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:58:30.194664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:58:30.195368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:30.201555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:30.202037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:30.202509 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:30.203200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:30.203648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:30.204074 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:30.338226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:58:30.346014 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9dad573f-0ebd-464e-9cb1-35b513dcd955 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1683 microversion: 2.1 time: 0.156660 Oct 13 09:58:30.346642 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4244/8092] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:58:30 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:58:54.532912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:58:54.535826 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:58:54.538528 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=17 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:58:54.539203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=44 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:58:54.546328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:54.546861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:54.547316 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:54.548032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:58:54.548531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:58:54.548980 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:58:54.602173 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-52a84d24-f311-4b2d-add7-4ef589b5a009 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action" status: 200 len: 60431 microversion: 2.1 time: 0.073227 Oct 13 09:58:54.602850 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3849/8093] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 09:58:54 2022] POST /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335/action => generated 60431 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 09:59:01.592087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:01.592647 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:01.594417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afd7aa3-7797-4b3d-9a53-7474fd07b335", "tag": "f99d7174-7cf8-4e55-8651-e9a0d5c30cf5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:01.595324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=16 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:01.596138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:01.601901 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:01.602267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:01.602749 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:01.603621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:01.603949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:01.604405 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:01.609141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:01.610006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:01.610693 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:01.621761 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] Creating event network-changed:f99d7174-7cf8-4e55-8651-e9a0d5c30cf5 for instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 on n-h1-858384-11 Oct 13 09:59:01.627086 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-7c2b785a-fb34-4eeb-86bf-3ee832269f07 req-6df41342-d542-46b8-8735-53b1b976ab51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036984 Oct 13 09:59:01.628426 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3850/8094] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:59:01.635229 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 09:59:01.721775 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d0cc5d9-4e25-41a1-a586-bc8d1b290e60 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 204 len: 0 microversion: 2.1 time: 0.133445 Oct 13 09:59:01.722303 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4245/8095] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 09:59:01 2022] DELETE /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 09:59:01.731871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:01.732606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:01.740165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:01.740677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:01.741129 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:01.742065 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:01.742572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:01.743021 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:01.903804 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:01.911874 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4a2ec32b-0a8e-4acf-8d4d-eade66c24d76 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1689 microversion: 2.1 time: 0.184779 Oct 13 09:59:01.912462 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3851/8096] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:01 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:02.936280 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:02.936977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:02.944464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:02.944942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:02.945373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:02.946056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:02.946626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:02.947054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:03.084341 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:03.092132 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54d72c81-80d1-4b5e-ba41-ceee0facc55c tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1689 microversion: 2.1 time: 0.160094 Oct 13 09:59:03.092705 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4246/8097] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:02 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:03.911273 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afd7aa3-7797-4b3d-9a53-7474fd07b335", "name": "network-vif-deleted", "tag": "f99d7174-7cf8-4e55-8651-e9a0d5c30cf5"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:03.921794 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:03.922291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:03.922768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:03.934809 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] Creating event network-vif-deleted:f99d7174-7cf8-4e55-8651-e9a0d5c30cf5 for instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 on n-h1-858384-11 Oct 13 09:59:03.939890 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-37024a68-44c4-489e-94ae-68a8077ef3e2 req-ffe0e277-32b2-4b98-b956-fba9a9499ab8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032409 Oct 13 09:59:03.940592 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3852/8098] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:59:04.115249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:04.115864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:04.123332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:04.123754 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:04.124184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:04.124869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:04.125318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:04.125740 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:04.156245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:04.156714 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:04.157143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:04.157585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lazy-loading 'fault' on Instance uuid 0afd7aa3-7797-4b3d-9a53-7474fd07b335 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 09:59:04.200071 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:04.208675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c25feb6b-6608-4ec2-b2b4-46d9e7ec84c6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 200 len: 1356 microversion: 2.1 time: 0.097210 Oct 13 09:59:04.209444 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4247/8099] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:04 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 1356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:05.235499 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:05.236220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 0afd7aa3-7797-4b3d-9a53-7474fd07b335] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:05.243054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:05.243552 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:05.244007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:05.244715 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:05.245187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:05.245662 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:05.259063 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] HTTP exception thrown: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Request method failure captured: Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 HTTP/1.1 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR9_eW89kJaVIlWNlfqSHux1_P1-xWc49o6L6_F9Go8gzmPmDDxkxSPPDjyBB1-BRpv2IPUEKS3WkNX4nE6GF96KjmYRz3QIx70LapKQGnD2MJNqgCJE9Mid71KLeL-HybEFd4WmJH34ktA-SfFESeggDPFAIXg67j7GBYde5uG_reZ0 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 1c02a3a59bcb42eabf2e07cf85e71015 Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '0afd7aa3-7797-4b3d-9a53-7474fd07b335'} Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:59:05.260712 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Returning 404 to user: Instance 0afd7aa3-7797-4b3d-9a53-7474fd07b335 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a5ab74c2-0a7d-4b36-83c6-c804730c89ed tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335" status: 404 len: 111 microversion: 2.1 time: 0.032262 Oct 13 09:59:05.266378 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3853/8100] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:05 2022] GET /compute/v2.1/servers/0afd7aa3-7797-4b3d-9a53-7474fd07b335 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 09:59:08.574918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fd09bffa-5807-47c4-9a39-e4cc62eb719a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '.version_select at 0x7f5377839550>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:08.601189 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fd09bffa-5807-47c4-9a39-e4cc62eb719a tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1991534272" status: 202 len: 0 microversion: 2.1 time: 0.030185 Oct 13 09:59:08.602028 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4248/8101] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Oct 13 09:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1991534272 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 09:59:08.632991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a2d0e81c-8ae9-4119-aa51-ed87d5e49886 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: .version_select at 0x7f5375f9f700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2102423344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhkXWhHynet6aXkshzCVDf3jc6lK26EKtwEFa/nZDdb+UXQoofqSbe5fn2M3xKSQRGMOuyJLymXTDT/bWZ6TPEUaXH76+UotDAsI8pGFB+vBKeBL0TkMq5YEFFoXnFjLg=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:08.655388 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a2d0e81c-8ae9-4119-aa51-ed87d5e49886 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:59:08.661606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-a2d0e81c-8ae9-4119-aa51-ed87d5e49886 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:59:08.685986 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a2d0e81c-8ae9-4119-aa51-ed87d5e49886 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057644 Oct 13 09:59:08.686732 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3854/8102] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 09:59:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:59:13.982599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2003139113", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "networks": [{"uuid": "6e2afebb-87cc-4bd5-8835-b55b08ba6bf0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2102423344", "security_groups": [{"name": "tempest-secgroup-smoke-299714144"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:14.096298 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] validate_networks() for [('6e2afebb-87cc-4bd5-8835-b55b08ba6bf0', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 09:59:14.204537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:14.543817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 09:59:14.544248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 09:59:14.544716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 09:59:14.545329 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 09:59:14.545741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 09:59:14.557059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:14.558042 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:14.558545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:14.559545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:14.560012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:14.560441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:14.584557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 09:59:14.590554 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Getting quotas for user 1c02a3a59bcb42eabf2e07cf85e71015 and project 4ced1a345fc5474ca48216fe1365326d. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 09:59:14.605347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 09:59:14.608278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 09:59:14.657043 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-429fcc9b-7cb2-4aa7-b56f-602bff8981eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.679462 Oct 13 09:59:14.657718 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4249/8103] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 09:59:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 09:59:14.675959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0f1b0764-f29b-4de8-86fa-68165b5c0e12 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:14.676582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0f1b0764-f29b-4de8-86fa-68165b5c0e12 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:14.756983 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0f1b0764-f29b-4de8-86fa-68165b5c0e12 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:14.764418 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0f1b0764-f29b-4de8-86fa-68165b5c0e12 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1267 microversion: 2.1 time: 0.093435 Oct 13 09:59:14.767559 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3855/8104] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:14 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:15.789737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:15.790555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:15.798993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:15.799813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:15.800601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:15.802143 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:15.802832 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:15.803467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:15.873197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:15.881675 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e424e39-2f64-44e2-a677-c80dcdcf2575 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1327 microversion: 2.1 time: 0.096156 Oct 13 09:59:15.896303 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4250/8105] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:15 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:16.907284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:16.908866 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:16.911895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=16 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:16.919514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:16.920138 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:16.920668 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:16.921465 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:16.927333 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:16.928169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:17.154972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:17.164869 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-69af5f2c-9c57-4885-867c-0af13c295dd1 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.261530 Oct 13 09:59:17.166049 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3856/8106] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:16 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:17.484195 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502328d-2d23-4092-b7dc-05f2799a450e", "tag": "8ae366ad-9185-44b4-acfd-fa508bd08bf6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:17.500175 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:17.501139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:17.501878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:17.514474 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] Creating event network-changed:8ae366ad-9185-44b4-acfd-fa508bd08bf6 for instance 7502328d-2d23-4092-b7dc-05f2799a450e on n-h2-858384-11 Oct 13 09:59:17.520031 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-150a2960-3ac5-4156-bee2-1de446c93bea req-d1da79fa-0927-47ac-9ce5-d5ce7c0999be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041353 Oct 13 09:59:17.521026 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4251/8107] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:59:18.188487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:18.189113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:18.196107 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:18.196605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:18.197058 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:18.197766 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:18.198235 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:18.198709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:18.334002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:18.341748 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-92ff4fa8-063f-4f9c-9123-f39fd2a0bbdf tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.157269 Oct 13 09:59:18.342316 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3857/8108] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:18 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:19.366193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:19.366953 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:19.373138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:19.373619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:19.374060 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:19.374793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:19.375247 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:19.375676 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:19.505259 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:19.512876 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-905fcb2a-110d-455c-81a4-94a82e8113c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.152378 Oct 13 09:59:19.513991 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4252/8109] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:19 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 09:59:20.535895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:20.536464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:20.543338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:20.543837 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:20.544292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:20.545000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:20.545469 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:20.545901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:20.718821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:20.727084 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-94cff3f4-c01a-4e56-a34a-f0788184ec22 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.195292 Oct 13 09:59:20.727670 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3858/8110] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:20 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:21.750612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:21.751226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:21.758017 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:21.758529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:21.758969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:21.759659 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:21.760112 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:21.760535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:21.943171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:21.951149 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-793f0e56-bb9c-4500-adad-3cf362c13bde tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.204513 Oct 13 09:59:21.951835 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4253/8111] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:21 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:22.974877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:22.975428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:22.982740 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:22.983240 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:22.983953 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:22.984658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:22.985123 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:22.985561 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:23.117787 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:23.125567 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-601f33f5-4a17-4b7b-9435-74941edba460 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.155274 Oct 13 09:59:23.126170 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3859/8112] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:22 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:23.509527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502328d-2d23-4092-b7dc-05f2799a450e", "name": "network-vif-plugged", "status": "completed", "tag": "8ae366ad-9185-44b4-acfd-fa508bd08bf6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:23.525697 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:23.526798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:23.527464 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:23.539757 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] Creating event network-vif-plugged:8ae366ad-9185-44b4-acfd-fa508bd08bf6 for instance 7502328d-2d23-4092-b7dc-05f2799a450e on n-h2-858384-11 Oct 13 09:59:23.545274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8c0a3d98-afea-4338-a7cf-acba9938c57b req-4fc29a6a-8ce2-4591-a573-b4483bce4040 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041117 Oct 13 09:59:23.545950 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4254/8113] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 09:59:24.147623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:24.148239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:24.155099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:24.155588 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:24.156059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:24.156733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:24.157193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:24.157628 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:24.285570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:24.293471 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c1d13c7d-7c47-4243-a6bc-731a86ea2917 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1392 microversion: 2.1 time: 0.149785 Oct 13 09:59:24.294056 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3860/8114] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:24 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:25.319189 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:25.319894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:25.322300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:25.322991 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:25.328919 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:25.329402 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:25.329839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:25.330562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:25.331016 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:25.331444 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:25.460549 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:25.468250 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9466d369-1904-4de8-afda-1c88646d2d3e tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1563 microversion: 2.1 time: 0.154079 Oct 13 09:59:25.468828 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4255/8115] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:25 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:25.491434 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:25.492116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:25.494195 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:25.495861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 09:59:25.502051 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:25.502612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:25.503062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:25.503763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:25.504228 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:25.505205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:25.637778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:25.645610 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d28340e0-c6d0-471e-81b4-4937d06b2f49 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1563 microversion: 2.1 time: 0.158877 Oct 13 09:59:25.646185 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3861/8116] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:25 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 09:59:27.488271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 09:59:27.489864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 09:59:27.490522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502328d-2d23-4092-b7dc-05f2799a450e", "tag": "8ae366ad-9185-44b4-acfd-fa508bd08bf6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 09:59:27.497053 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:27.497540 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:27.498109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:27.499132 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:27.499803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:27.501025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 09:59:27.501201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:27.501527 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 09:59:27.502184 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 09:59:27.513967 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] Creating event network-changed:8ae366ad-9185-44b4-acfd-fa508bd08bf6 for instance 7502328d-2d23-4092-b7dc-05f2799a450e on n-h2-858384-11 Oct 13 09:59:27.519389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-4a78adb2-a71f-4407-b4d7-0139080b3343 req-e6f9ea42-2d32-41dd-86a0-91bc69c694b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033786 Oct 13 09:59:27.520388 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3862/8117] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 09:59:27.642730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 09:59:27.651336 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5ed10422-f0ff-4eb4-b57f-c219c854a1ff tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1563 microversion: 2.1 time: 0.167855 Oct 13 09:59:27.653117 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4256/8118] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 09:59:27 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:00.941952 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:00.943357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=38 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:00.947641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:00.949948 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:00.957097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:00.957587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:00.958037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:00.958788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:00.959254 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:00.959692 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:01.029340 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-66385cbf-eacc-455f-9e45-49c68534a1f3 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action" status: 200 len: 24571 microversion: 2.1 time: 0.089297 Oct 13 10:00:01.030258 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3863/8119] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:00:00 2022] POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 10:00:31.233527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:31.234288 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=36 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:31.238254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:31.238804 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:31.246712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:31.247194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:31.247629 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:31.248316 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:31.248769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:31.249193 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:31.271942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lazy-loading 'flavor' on Instance uuid 7502328d-2d23-4092-b7dc-05f2799a450e {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:00:31.335857 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-04656d7c-df62-4cab-8a53-4813ca4908eb tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action" status: 202 len: 0 microversion: 2.1 time: 0.104285 Oct 13 10:00:31.336593 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4257/8120] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:00:31 2022] POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:00:31.345599 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:31.346269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:31.349315 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:31.349999 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:31.356525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:31.357113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:31.357579 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:31.358581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:31.359059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:31.359506 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:31.496704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:31.504631 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e951c2e3-47ee-4da2-b5d6-4454bcae72ce tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1689 microversion: 2.1 time: 0.163587 Oct 13 10:00:31.505210 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3864/8121] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:31 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:32.530075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:32.530825 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:32.537063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:32.537537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:32.538669 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:32.539355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:32.539818 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:32.540227 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:32.675612 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:32.683344 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-40bc01f3-a9ed-4e8b-a93f-a4e32e42edf6 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1689 microversion: 2.1 time: 0.158643 Oct 13 10:00:32.683913 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4258/8122] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:32 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:33.708036 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:33.708700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:33.716460 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:33.716959 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:33.717414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:33.718121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:33.718630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:33.719074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:33.847986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:33.856297 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-187ab13e-eb9f-47ba-b704-1cc4b2bf67b7 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1672 microversion: 2.1 time: 0.152246 Oct 13 10:00:33.856868 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3865/8123] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:33 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:34.950644 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:34.952828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:34.960366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:34.960852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:34.961287 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:34.961979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:34.962456 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:34.962885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:35.023644 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4ead0414-b8ca-4f7d-8855-99a9df5e2959 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action" status: 200 len: 38386 microversion: 2.1 time: 0.076831 Oct 13 10:00:35.024408 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4259/8124] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:00:34 2022] POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action => generated 38386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 10:00:35.036130 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:35.036683 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:35.043623 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:35.044126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:35.044584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:35.045406 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:35.045750 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:35.046193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:35.115435 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-70a32945-4619-4fbe-8184-827245b20f56 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action" status: 202 len: 0 microversion: 2.1 time: 0.083071 Oct 13 10:00:35.116342 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3866/8125] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:00:35 2022] POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:00:35.125530 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:35.126234 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:35.135081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:35.135923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:35.136363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:35.137063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:35.137516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:35.137942 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:35.278861 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:35.286693 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c74db067-d502-480f-b3c3-2d399e35b956 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1678 microversion: 2.1 time: 0.165374 Oct 13 10:00:35.287274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4260/8126] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:35 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:36.311926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:36.312551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:36.318855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:36.319347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:36.319793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:36.320489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:36.320950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:36.321387 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:36.454327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:36.462819 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f64bf2cf-4043-4929-9c95-3e7779ef614d tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1678 microversion: 2.1 time: 0.156184 Oct 13 10:00:36.463405 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3867/8127] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:36 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:37.486382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:37.487089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:37.495265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:37.495756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:37.496197 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:37.496897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:37.497352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:37.497785 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:37.627009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:37.634781 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5d3d71ca-2bfc-4b0d-a69d-1462928f41d4 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1681 microversion: 2.1 time: 0.152582 Oct 13 10:00:37.635350 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4261/8128] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:37 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:37.733114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:37.735690 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:37.742646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:37.743150 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:37.743607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:37.744344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:37.744816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:37.745262 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:37.806425 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e5ea860f-c88c-4007-a1b3-897363232e62 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action" status: 200 len: 38386 microversion: 2.1 time: 0.077209 Oct 13 10:00:37.807056 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3868/8129] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:00:37 2022] POST /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e/action => generated 38386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 13 10:00:39.047550 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:39.048046 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:39.055054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:39.055536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:39.055968 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:39.056660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:39.057300 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:39.057727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:39.084686 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 10:00:39.113449 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7502328d-2d23-4092-b7dc-05f2799a450e", "tag": "8ae366ad-9185-44b4-acfd-fa508bd08bf6"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:39.125103 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:39.125535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:39.126040 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:39.137123 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] Creating event network-changed:8ae366ad-9185-44b4-acfd-fa508bd08bf6 for instance 7502328d-2d23-4092-b7dc-05f2799a450e on n-h2-858384-11 Oct 13 10:00:39.142919 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1eb45329-dbae-42cf-ad08-a4d5b1c8f4ca req-48b76abb-3486-4512-99b5-24d267c94444 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096360 Oct 13 10:00:39.143731 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3869/8130] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:00:39.164520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-268185c2-9842-4387-9045-e368d36b0f37 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 204 len: 0 microversion: 2.1 time: 0.120565 Oct 13 10:00:39.165109 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4262/8131] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 10:00:39 2022] DELETE /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 10:00:39.173890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:39.174762 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:39.181351 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:39.181943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:39.182504 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:39.183297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:39.183842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:39.184373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:39.333918 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:39.342426 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-78e55eed-77c1-4591-a123-cc2cb0395273 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1687 microversion: 2.1 time: 0.172778 Oct 13 10:00:39.343019 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3870/8132] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:39 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:00:40.369149 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:40.369848 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:40.376664 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:40.377141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:40.377576 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:40.378262 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:40.378747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:40.379170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:40.510933 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:40.518833 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58744ecc-02fd-4173-8c8a-30dc62abf3c2 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1687 microversion: 2.1 time: 0.154520 Oct 13 10:00:40.519415 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4263/8133] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:40 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:41.542802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:41.543443 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:41.551429 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:41.551946 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:41.552457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:41.553682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:41.554156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:41.554775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:41.586809 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7502328d-2d23-4092-b7dc-05f2799a450e", "name": "network-vif-deleted", "tag": "8ae366ad-9185-44b4-acfd-fa508bd08bf6"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:41.597354 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:41.597760 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:41.598188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:41.604990 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:00:41.605190 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e (ip 10.222.0.23) !!! Oct 13 10:00:41.621120 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] Creating event network-vif-deleted:8ae366ad-9185-44b4-acfd-fa508bd08bf6 for instance 7502328d-2d23-4092-b7dc-05f2799a450e on n-h2-858384-11 Oct 13 10:00:41.626981 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c02a3a59bcb42eabf2e07cf85e71015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ced1a345fc5474ca48216fe1365326d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:41.628344 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3d737604-daad-468f-9ad9-b9d484bb1135 req-dade91c7-4e3d-4d15-9dc9-15aa62ccf125 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045124 Oct 13 10:00:41.628961 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4264/8134] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:00:41.636035 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3fd12945-2349-4ebe-9926-b8d7ccca772b tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 200 len: 1502 microversion: 2.1 time: 0.097265 Oct 13 10:00:41.636643 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3871/8135] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:41 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 1502 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:42.659944 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:42.660648 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] [instance: 7502328d-2d23-4092-b7dc-05f2799a450e] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:42.667469 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:42.667952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:42.668392 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:42.669083 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:42.669538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:42.669962 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:42.683748 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] HTTP exception thrown: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Request method failure captured: Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e HTTP/1.1 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR9_eW89kJaVIlWNlfqSHux1_P1-xWc49o6L6_F9Go8gzmPmDDxkxSPPDjyBB1-BRpv2IPUEKS3WkNX4nE6GF96KjmYRz3QIx70LapKQGnD2MJNqgCJE9Mid71KLeL-HybEFd4WmJH34ktA-SfFESeggDPFAIXg67j7GBYde5uG_reZ0 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4ced1a345fc5474ca48216fe1365326d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 4ced1a345fc5474ca48216fe1365326d Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-58151046 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: 1c02a3a59bcb42eabf2e07cf85e71015 Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestNetworkAdvancedServerOps-58151046-project Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '7502328d-2d23-4092-b7dc-05f2799a450e'} Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:00:42.685378 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Returning 404 to user: Instance 7502328d-2d23-4092-b7dc-05f2799a450e could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc0e9665-8152-4b64-b212-ef6fd11927fa tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e" status: 404 len: 111 microversion: 2.1 time: 0.032033 Oct 13 10:00:42.690471 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4265/8136] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:42 2022] GET /compute/v2.1/servers/7502328d-2d23-4092-b7dc-05f2799a450e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 10:00:45.634441 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a5dd7ed-e728-4833-b828-0dfe80aecd74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] Calling method '.version_select at 0x7f5375faa3a0>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:45.662508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a5dd7ed-e728-4833-b828-0dfe80aecd74 tempest-TestNetworkAdvancedServerOps-58151046 tempest-TestNetworkAdvancedServerOps-58151046-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2102423344" status: 202 len: 0 microversion: 2.1 time: 0.033221 Oct 13 10:00:45.663416 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3872/8137] 10.222.0.23 () {58 vars in 1284 bytes} [Thu Oct 13 10:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2102423344 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:00:56.828681 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:56.830069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:57.008727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-caf4add2-f516-4a94-8fb0-e0e4f413d65e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'create', calling method: .version_select at 0x7f53755f2ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-167925098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHitFZ69ysZlCi8P1thfXxmZkL9gmTD8TlVG1VoDHHIJBbzSBA0AeBhrJEx/jt5CCyHScjQtVwP880sJKndwwSq/3v0NLap3wEK3bTG8ruSoCHTeHUbQVrTSzAL7Y/Zjig=="}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:57.025990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-caf4add2-f516-4a94-8fb0-e0e4f413d65e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for project 1433af93cf1945ac814682a7927a0aeb. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:00:57.032520 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-caf4add2-f516-4a94-8fb0-e0e4f413d65e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for user 44fd841258434f68a43c840ba7ded27b and project 1433af93cf1945ac814682a7927a0aeb. Resources: {'key_pairs'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:00:57.059596 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-caf4add2-f516-4a94-8fb0-e0e4f413d65e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.237717 Oct 13 10:00:57.060204 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4266/8138] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 10:00:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:00:58.076374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:58.077485 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:00:58.082614 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-3059166", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-167925098", "security_groups": [{"name": "tempest-secgroup-smoke-1326264224"}], "networks": [{"uuid": "a60571f3-5f5f-49f2-adaf-1434bf7719c5"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:00:58.187726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] validate_networks() for [('a60571f3-5f5f-49f2-adaf-1434bf7719c5', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 10:00:58.656625 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 10:00:58.657071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 10:00:58.657593 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 10:00:58.658024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 10:00:58.658689 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 10:00:58.669520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:58.670032 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:58.670515 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:58.671270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:58.671748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:58.672189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:58.694066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for project 1433af93cf1945ac814682a7927a0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:00:58.699348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for user 44fd841258434f68a43c840ba7ded27b and project 1433af93cf1945ac814682a7927a0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:00:58.712250 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 10:00:58.714619 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 10:00:58.763739 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8dfecfce-d6b7-414a-a854-169d4c3bb95d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689163 Oct 13 10:00:58.770313 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3873/8139] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 10:00:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 10:00:58.777450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9e4c16b9-01a0-4217-ac29-bfae5985232d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:58.778170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9e4c16b9-01a0-4217-ac29-bfae5985232d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:58.856556 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9e4c16b9-01a0-4217-ac29-bfae5985232d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:58.863977 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9e4c16b9-01a0-4217-ac29-bfae5985232d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1243 microversion: 2.1 time: 0.091431 Oct 13 10:00:58.874714 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4267/8140] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:58 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:00:59.889127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:00:59.889778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:00:59.898664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:59.899227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:59.899529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:59.900298 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:00:59.900978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:00:59.901472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:00:59.977078 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:00:59.985627 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2a2eb220-2ee8-42d3-b1ad-af5c8e90a09c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1295 microversion: 2.1 time: 0.101444 Oct 13 10:01:00.001031 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3874/8141] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:00:59 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:01.009222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:01.009828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:01.020650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:01.021171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:01.022101 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:01.022838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:01.023289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:01.023716 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:01.322893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:01.333729 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-79c23aa6-64ed-4f5f-b090-0db785bb8ee1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.327723 Oct 13 10:01:01.334737 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4268/8142] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:01 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:01.815570 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:01:01.830014 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:01.830960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:01.831904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:01.847646 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] Creating event network-changed:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h1-858384-11 Oct 13 10:01:01.853450 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-e95510b0-6331-4875-a29b-ee8bb6a0ba1c req-af67ba3b-c463-497d-9fb8-348d0ad3496d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041636 Oct 13 10:01:01.854052 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3875/8143] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:01:02.357223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:02.357949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:02.365310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:02.365808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:02.366252 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:02.366990 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:02.367451 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:02.367885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:02.519394 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:02.529754 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dce18e05-bfc9-44a7-b831-f5baf756db29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.176500 Oct 13 10:01:02.543638 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4269/8144] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:02 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:03.556386 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:03.557095 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:03.563777 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:03.564281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:03.564736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:03.565444 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:03.565912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:03.566352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:03.705145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:03.713825 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09896fba-c634-421e-9247-1db21b018960 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.162538 Oct 13 10:01:03.714459 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3876/8145] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:03 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:04.737059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:04.737854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:04.745398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:04.745892 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:04.746324 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:04.747056 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:04.747577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:04.748348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:04.885184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:04.893050 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-34d5fb2b-9293-48ec-b1e5-87afdb2c853f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.160192 Oct 13 10:01:04.893634 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4270/8146] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:04 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:05.915596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:05.916219 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:05.923166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:05.923661 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:05.924113 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:05.924815 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:05.925283 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:05.925722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:06.054323 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:06.062241 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4f528187-a736-439d-8cf0-f76631ae1d0e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.151098 Oct 13 10:01:06.063827 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3877/8147] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:05 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:06.809439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "name": "network-vif-plugged", "status": "completed", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:01:06.827360 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:06.827838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:06.828269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:06.839509 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] Creating event network-vif-plugged:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h1-858384-11 Oct 13 10:01:06.844560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b8e6316c-e8d6-4d19-ab1e-5819671ca0b1 req-45eb786e-0fc7-48c1-92e2-611a2754cc72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093929 Oct 13 10:01:06.845189 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4271/8148] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:01:07.085264 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:07.085887 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:07.092720 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:07.093211 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:07.093655 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:07.094353 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:07.094843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:07.095325 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:07.227090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:07.235049 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ab04b50-14d1-430c-8ea1-4c0d6543db86 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1369 microversion: 2.1 time: 0.153897 Oct 13 10:01:07.235617 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3878/8149] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:07 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:08.259703 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:08.260414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:08.266738 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:08.267222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:08.267660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:08.268350 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:08.268803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:08.269230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:08.402052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:08.410109 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-29ca4a0b-6817-4c2f-b54e-ffed5aaae5fa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1554 microversion: 2.1 time: 0.156100 Oct 13 10:01:08.410735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4272/8150] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:08 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:08.434080 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:01:08.434907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:01:08.442165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:08.442808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:08.443958 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:08.444808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:08.445356 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:08.445871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:08.581338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:01:08.589398 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dc5736b5-8a92-4608-a4aa-1c0ae784fdaa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1554 microversion: 2.1 time: 0.159352 Oct 13 10:01:08.589981 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3879/8151] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:01:08 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:01:10.238104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:01:10.243885 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:01:10.250450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:01:10.251171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:01:10.251606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:01:10.262738 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] Creating event network-changed:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h1-858384-11 Oct 13 10:01:10.267582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-e5815d3f-c5a9-4358-a90d-562fdfecfc4c req-25d8672d-b6d8-4e37-9833-a0fc14480cb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Oct 13 10:01:10.268174 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4273/8152] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:03:05.478566 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:03:05.479791 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:03:05.480171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.481135 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.481850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.482632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.488714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:05.489269 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:05.498000 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:05.498534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:05.498996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:05.499722 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:05.500197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:05.500645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:05.528170 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lazy-loading 'flavor' on Instance uuid f4399630-2e21-4bd8-a84a-fb82883bff62 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:03:05.713939 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2946edd1-14e0-4ab6-a756-70fa102ae18e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62/action" status: 202 len: 0 microversion: 2.1 time: 0.237100 Oct 13 10:03:05.714614 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3880/8153] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:03:05 2022] POST /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:03:05.721161 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:03:05.722016 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:03:05.722606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.723504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=28 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:05.724719 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:03:05.724853 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:03:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 (ip 10.222.0.23) !!! Oct 13 10:03:05.731147 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:05.731787 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:05.742194 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:05.742723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:05.743159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:05.743887 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:05.744345 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:05.744775 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:05.876505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:05.884807 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5289c4ad-5f69-4d05-a177-5bc65c563ae7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.165535 Oct 13 10:03:05.885379 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4274/8154] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:05 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:06.909775 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:06.910526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:06.918468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:06.918961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:06.919410 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:06.920104 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:06.920566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:06.921003 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:06.928040 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59998. Oct 13 10:03:06.928845 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60000. Oct 13 10:03:07.060362 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:07.068295 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-afc26de8-b825-4cba-adf0-c820b7e24a19 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.164357 Oct 13 10:03:07.068869 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3881/8155] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:06 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:08.092529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:08.093140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:08.103233 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:08.103717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:08.104159 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:08.104863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:08.105322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:08.105753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:08.110839 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60008. Oct 13 10:03:08.113818 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60006. Oct 13 10:03:08.246626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:08.254788 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-25cc6a45-8ecf-40d7-a336-f4a42a146c8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.166308 Oct 13 10:03:08.255386 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4275/8156] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:08 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:09.278421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:09.279101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:09.285906 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:09.286726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:09.287180 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:09.287883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:09.288348 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:09.288784 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:09.419964 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:09.427799 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b020229-f928-4e54-b3e7-35b711b488ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.153301 Oct 13 10:03:09.428380 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3882/8157] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:09 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:10.451059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:10.451627 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:10.458491 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:10.458976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:10.459414 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:10.460106 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:10.460562 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:10.460989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:10.590757 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:10.598535 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e9c09dcb-72cd-4886-b56e-4589207c8abe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.151425 Oct 13 10:03:10.599117 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4276/8158] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:10 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:11.622871 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:11.623531 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:11.630366 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:11.630888 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:11.631338 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:11.632042 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:11.632511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:11.633525 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:12.076075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:12.084006 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-72200010-a88d-4422-94b7-cf86c4b774c3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.465084 Oct 13 10:03:12.084584 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3883/8159] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:11 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:13.106877 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:13.107494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:13.114737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:13.115293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:13.115741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:13.116425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:13.116875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:13.117798 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:13.252385 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:13.260770 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5aa9ebf4-4322-4806-8a03-c86a4f533668 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.157818 Oct 13 10:03:13.261352 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4277/8160] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:13 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:14.283835 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:14.284501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:14.291966 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:14.292487 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:14.292943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:14.293643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:14.294116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:14.294635 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:14.421642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:14.430102 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b8c98827-0b86-4492-8677-da25fb92619d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.149614 Oct 13 10:03:14.430712 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3884/8161] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:14 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:15.453081 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:15.453719 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:15.460564 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:15.461096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:15.461529 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:15.462215 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:15.462694 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:15.463118 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:15.879631 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:15.887355 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b0b5fc4d-6082-4610-982d-46498af80471 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.438222 Oct 13 10:03:15.887924 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4278/8162] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:15 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:16.910341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:16.910996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:16.917998 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:16.918520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:16.918973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:16.919679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:16.920145 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:16.920584 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:17.051089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:17.059456 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6e2c9ade-b2ca-4f5b-ab3e-d7495339695e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1700 microversion: 2.1 time: 0.153070 Oct 13 10:03:17.062784 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3885/8163] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:16 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:18.083275 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:18.083899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:18.091339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:18.091828 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:18.092269 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:18.092971 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:18.093431 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:18.093895 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:18.225753 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:18.233819 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5171bc65-49e8-4de7-a700-e99d7d3fdf44 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.154153 Oct 13 10:03:18.234394 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4279/8164] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:18 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:03:19.241686 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "name": "network-vif-plugged", "status": "completed", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:19.255864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:19.256597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:19.257295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:19.262069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:19.262875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:19.271066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:19.271733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:19.272289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:19.273268 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:19.273838 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:19.274364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:19.280202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] Creating event network-vif-plugged:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h1-858384-11 Oct 13 10:03:19.285970 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-63feb247-1ee8-408c-9ac6-406dd5523563 req-7b1076e1-ac6e-49ae-b1b0-c281f52eb79f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049220 Oct 13 10:03:19.287213 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3886/8165] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:03:19.449124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:19.458496 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1604b885-f7d0-4ef6-9ed9-80116e0ab0b1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.203196 Oct 13 10:03:19.458496 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4280/8166] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:19 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:03:20.485064 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:20.485944 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:20.493173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:20.493697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:20.494181 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:20.494922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:20.495392 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:20.495831 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:20.632929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:20.642681 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-54e746fc-85bb-491d-ba3f-fe22cdf391db tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.163543 Oct 13 10:03:20.643621 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3887/8167] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:20 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:21.667727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:21.668618 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:21.676608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:21.677095 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:21.677536 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:21.678243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:21.678729 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:21.679750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:21.828076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:21.837434 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a9b90a82-171e-4af2-a001-0be3a9a7da6f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.173621 Oct 13 10:03:21.850946 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4281/8168] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:21 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:22.861118 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:22.861898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:22.876039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:22.876547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:22.877001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:22.877724 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:22.878197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:22.878673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:23.017468 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:23.029302 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f098201a-5fae-4af0-b7d0-9eb750bfedfb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.172298 Oct 13 10:03:23.030115 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3888/8169] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:22 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:24.056019 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:24.056863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:24.064303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:24.064756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:24.065201 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:24.065908 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:24.066630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:24.066859 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:24.210162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:24.220274 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7829c1d6-4632-4ee2-9c34-50f993fab3f5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.168868 Oct 13 10:03:24.220864 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4282/8170] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:24 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:25.246726 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:25.248008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:25.255529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:25.257646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:25.257646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:25.257646 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:25.257979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:25.258526 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:25.409886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:25.419068 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-692ae7eb-53a8-4219-8baf-755e3d601515 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.176673 Oct 13 10:03:25.419980 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3889/8171] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:25 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:26.442240 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:26.443158 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:26.451141 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:26.451733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:26.452243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:26.453055 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:26.453569 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:26.454058 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:26.593263 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:26.602256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e7465f79-4205-446a-8947-89aa573e7ce7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.163755 Oct 13 10:03:26.602890 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4283/8172] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:26 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:27.625877 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:27.626613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:27.634247 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:27.634776 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:27.635225 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:27.635928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:27.636395 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:27.636833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:27.764520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:27.772369 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6203859a-a426-4bee-b3cf-c06a42c43372 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1695 microversion: 2.1 time: 0.150660 Oct 13 10:03:27.773485 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3890/8173] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:27 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:03:28.795727 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:28.796364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:28.803184 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:28.803671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:28.804113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:28.804802 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:28.805256 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:28.805683 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:28.934912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:28.942599 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1afa33cc-b9c7-47be-a50b-8effc881bd0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1677 microversion: 2.1 time: 0.150732 Oct 13 10:03:28.943179 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4284/8174] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:28 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:29.965127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:29.965745 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:29.972471 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:29.972970 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:29.973417 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:29.974121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:29.974624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:29.975068 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:30.114024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:30.124639 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-29526356-8ef2-4f7d-9ba0-fd2cd9ca6e6d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1677 microversion: 2.1 time: 0.163418 Oct 13 10:03:30.125229 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3891/8175] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:29 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:31.148484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:31.149135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:31.156139 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.156628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.157064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.157771 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.158228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.158677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.211491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "name": "network-vif-unplugged", "status": "completed", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:31.223101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.223101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.223334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.238824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.compute.server_external_events [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] Unable to find a host for instance f4399630-2e21-4bd8-a84a-fb82883bff62. Dropping event network-vif-unplugged {{(pid=127031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 10:03:31.240057 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-1125082d-50ea-48d9-b20b-476d5e7c64cd req-7ce44179-50e4-40a0-a0b5-c13dba09b0a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033041 Oct 13 10:03:31.240932 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3892/8176] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 13 10:03:31.304012 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:31.311794 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9826442-ed8c-448d-ad16-8b49fc7f8408 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1620 microversion: 2.1 time: 0.167737 Oct 13 10:03:31.312362 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4285/8177] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:31 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1620 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:31.334076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:31.334717 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:31.341169 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.341659 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.342106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.342842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.343306 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.343743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.387947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127031) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 10:03:31.454599 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe6b6b95-ac8d-47b1-a68d-f5d631209867 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62/action" status: 202 len: 0 microversion: 2.1 time: 0.124011 Oct 13 10:03:31.455222 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3893/8178] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:03:31 2022] POST /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:03:31.464102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:31.464711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:31.471072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.471567 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.472124 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.472834 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:31.473319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:31.473752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:31.611833 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:31.619848 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ebc68cb2-646a-44a9-aa9f-6b93bc522d8a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1628 microversion: 2.1 time: 0.160491 Oct 13 10:03:31.620429 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4286/8179] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:31 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1628 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:03:32.642884 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:32.643435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:32.651188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:32.651691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:32.652194 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:32.652934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:32.653407 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:32.653848 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:32.787367 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:32.791556 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:32.796707 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-aaa30be3-f989-46c5-bbb3-2ea77e871782 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.157939 Oct 13 10:03:32.797293 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3894/8180] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:32 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:33.694678 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:33.704123 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:33.704602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:33.705036 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:33.719087 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] Creating event network-changed:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h2-858384-11 Oct 13 10:03:33.724128 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9b48c1b1-8f44-4a2d-b416-b327498281d9 req-0bb3fae6-4366-4f69-b25d-8fb940f8d23c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087011 Oct 13 10:03:33.724732 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4287/8181] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:03:33.820920 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:33.821553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:33.829719 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:33.830233 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:33.830704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:33.831421 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:33.831893 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:33.832336 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:34.028159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:34.036344 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c43f2bf-a91b-49f2-972f-a3ecbfe1a122 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.219385 Oct 13 10:03:34.036934 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3895/8182] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:33 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:35.062489 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:35.063206 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:35.070254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:35.070794 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:35.071238 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:35.071955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:35.072417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:35.072847 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:35.236526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:35.245406 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-70df2611-f5ff-4c56-9867-7dea62d3c5bd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.188326 Oct 13 10:03:35.245995 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4288/8183] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:35 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:36.270793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:36.271424 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:36.274445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:36.281023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:36.281533 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:36.281987 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:36.282751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:36.283221 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:36.283669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:36.434297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:36.442612 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5ca43ef5-821c-4764-9154-f73099a5855b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.175768 Oct 13 10:03:36.443203 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3896/8184] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:36 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:37.466253 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:37.466943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:37.469857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=31 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:37.475959 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:37.476460 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:37.476900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:37.477616 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:37.478069 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:37.478526 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:37.481281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=87 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:03:37.621852 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:37.630803 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c3210905-c560-4dd0-a110-6926858e0072 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.168305 Oct 13 10:03:37.631744 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4289/8185] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:37 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:38.654341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:38.655116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:38.661825 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:38.662330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:38.662834 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:38.663657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:38.664136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:38.664598 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:38.809355 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:38.817878 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bef20d42-7ece-409a-b5cd-b9e021c09621 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.167447 Oct 13 10:03:38.818702 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3897/8186] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:38 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:39.842293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:39.843437 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:39.849844 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:39.850332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:39.851311 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:39.852032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:39.852471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:39.852926 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:40.005420 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:40.013453 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7893301-b967-49e5-bcd3-91bc5b3668ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.175445 Oct 13 10:03:40.014262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4290/8187] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:39 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:41.041177 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:41.041921 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:41.049089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:41.049592 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:41.050041 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:41.050788 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:41.051261 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:41.051705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:41.198624 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:41.213625 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7e440065-2536-4a84-a86e-86636f3ec44c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.172889 Oct 13 10:03:41.213625 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3898/8188] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:41 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:42.244789 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:42.246029 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:42.253911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:42.254421 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:42.254866 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:42.255577 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:42.256030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:42.256454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:42.396587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:42.404520 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b3ed19ce-1680-4fa5-84c6-df799274f4b7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.164840 Oct 13 10:03:42.405092 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4291/8189] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:42 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:43.428484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:43.429114 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:43.436198 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:43.436695 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:43.437167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:43.437855 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:43.438326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:43.438798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:43.570770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:43.578571 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fe2d4156-0f0f-4267-8ca9-2b062388c641 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.154119 Oct 13 10:03:43.579145 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3899/8190] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:43 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:44.603140 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:44.603712 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:44.611000 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:44.611484 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:44.611923 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:44.612653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:44.613102 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:44.613524 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:44.747319 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:44.755007 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e903cbc5-ebeb-43bd-abf2-ba5c0dee042f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.156618 Oct 13 10:03:44.755572 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4292/8191] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:44 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:45.777865 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:45.778452 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:45.785258 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:45.785748 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:45.786193 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:45.786909 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:45.787376 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:45.788312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:45.917108 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:45.925307 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f7ccfaec-28e2-4c00-add7-4ca718bfbc82 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.151444 Oct 13 10:03:45.925882 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3900/8192] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:45 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:46.949619 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:46.950239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:46.957054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:46.957527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:46.957960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:46.958733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:46.959185 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:46.959640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:47.095731 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:47.103974 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3025d005-d11b-4e52-9ded-cf6b65cd1c9e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.158232 Oct 13 10:03:47.104554 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4293/8193] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:46 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:48.128039 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:48.128676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:48.136140 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:48.136641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:48.137097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:48.137808 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:48.138281 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:48.138755 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:48.272464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:48.280277 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3e34bbd6-6cd9-416a-a885-d3962e81ec80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.156256 Oct 13 10:03:48.280851 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3901/8194] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:48 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:49.303854 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:49.304426 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:49.311223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:49.311698 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:49.312131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:49.312817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:49.313265 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:49.313685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:49.446592 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:49.454229 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-417af205-4535-4413-b654-835b46ad2838 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.154870 Oct 13 10:03:49.454829 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4294/8195] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:49 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:50.477289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:50.477928 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:50.485613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:50.486115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:50.486602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:50.487324 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:50.487802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:50.488248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:50.622241 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:50.627271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "name": "network-vif-plugged", "status": "completed", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:03:50.632483 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6c352189-fec1-4dae-be2a-c26968e4149e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.158447 Oct 13 10:03:50.633782 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3902/8196] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:50 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:50.638356 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:50.638872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:50.639306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:50.650473 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] Creating event network-vif-plugged:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h2-858384-11 Oct 13 10:03:50.655409 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-2fd7c632-7ccd-498e-b841-1e934e8a9034 req-347afe56-4d63-4d3d-af1d-5a221d94a935 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031864 Oct 13 10:03:50.656010 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4295/8197] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:03:51.657048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:51.657707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:51.664962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:51.665491 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:51.665943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:51.666691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:51.667165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:51.667610 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:51.798090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:51.805929 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-37eee41a-7461-4ba3-a94a-93ec24694e97 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.152930 Oct 13 10:03:51.806525 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3903/8198] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:51 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:52.831113 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:52.831810 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:52.837969 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:52.838486 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:52.838920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:52.839603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:52.840052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:52.840476 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:52.979955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:52.987912 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-16e43335-4b06-42e5-a06d-02a62f62c450 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1686 microversion: 2.1 time: 0.161956 Oct 13 10:03:52.988486 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4296/8199] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:52 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:03:54.011861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:03:54.012418 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:03:54.019260 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:54.019754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:54.020200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:54.020897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:03:54.021360 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:03:54.022439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:03:54.155639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:03:54.163421 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e046994b-fbe3-4cff-91a8-7141e1b6bd58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1673 microversion: 2.1 time: 0.155564 Oct 13 10:03:54.164001 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3904/8200] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:03:54 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:05:39.839621 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=15 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:39.843292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=17 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:39.844603 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=43 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:39.845328 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=60 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:39.847872 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:05:39.848778 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 10:05:39.851500 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:05:39.851645 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 (ip 10.222.0.23) !!! Oct 13 10:05:39.865497 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:39.866027 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:39.875548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:39.876032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:39.876471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:39.877293 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:39.877742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:39.878167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:39.904788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Going to try to terminate instance {{(pid=127030) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 10:05:39.953929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:05:39.964572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:39.965741 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:39.966771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:39.986029 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] Creating event network-changed:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h2-858384-11 Oct 13 10:05:39.993004 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-ac752ad6-43dc-4f8e-a811-6033eaec6e8c req-1b64e5cf-4e06-421e-9b8f-791afd3cea0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151359 Oct 13 10:05:39.993857 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3905/8201] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:05:39.995635 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6997b379-8854-4b06-a087-2e9da05e32f4 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 204 len: 0 microversion: 2.1 time: 0.157890 Oct 13 10:05:39.998193 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4297/8202] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 10:05:39 2022] DELETE /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 10:05:40.006925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:40.007645 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:40.014159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:40.014698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:40.015156 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:40.015870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:40.016341 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:40.016782 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:40.206148 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:05:40.214139 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-74c4d775-dc9a-4d8c-95b5-b63ef14fae7e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.211527 Oct 13 10:05:40.215707 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3906/8203] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:05:40 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:05:41.239739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:41.240449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:41.248352 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:41.248839 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:41.249276 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:41.249977 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:41.250455 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:41.250890 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:41.433912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:05:41.441605 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f9d1cb9b-0e1d-4a1f-a4ba-b51565239a98 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1679 microversion: 2.1 time: 0.206387 Oct 13 10:05:41.442177 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4298/8204] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:05:41 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:05:42.301606 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4399630-2e21-4bd8-a84a-fb82883bff62", "name": "network-vif-deleted", "tag": "a9d223c1-0fd9-48f2-8274-ca16829462b2"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:05:42.312564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:42.313055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:42.313498 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:42.325522 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] Creating event network-vif-deleted:a9d223c1-0fd9-48f2-8274-ca16829462b2 for instance f4399630-2e21-4bd8-a84a-fb82883bff62 on n-h2-858384-11 Oct 13 10:05:42.330760 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-478aa9e4-7418-40b0-aa96-56c2d2e52c23 req-1f665f24-15e3-48ae-ae9f-27da3fbdf42c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032854 Oct 13 10:05:42.331362 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3907/8205] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:05:42.464755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:42.465376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:42.471917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:42.472395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:42.472835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:42.473542 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:42.473996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:42.474441 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:42.510035 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:42.510620 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:42.511059 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:42.511505 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lazy-loading 'fault' on Instance uuid f4399630-2e21-4bd8-a84a-fb82883bff62 {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:05:42.555303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:05:42.563855 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1cf65693-0d4a-4059-9835-c1b5caf548b3 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 200 len: 1333 microversion: 2.1 time: 0.102973 Oct 13 10:05:42.564448 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4299/8206] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:05:42 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:05:43.588143 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:43.588854 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: f4399630-2e21-4bd8-a84a-fb82883bff62] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:43.595573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:43.596066 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:43.596514 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:43.597208 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:43.597673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:43.598112 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:43.612282 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] HTTP exception thrown: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Request method failure captured: Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 HTTP/1.1 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR-HTo2KQMkr3ekso_70CRQjET-ZFYJW3P8FP3mFu9esy5uqJXt8ziu96SjjzyuaSp8jK3M7BDcFfrzm7b32jd8FSZMwaTFvX4Y6tIosxkHgVAjR-TAHkX5a5Iqoqm9WBfELzaRT8HNnu2L2An8pSvvh4dDLdXSimQED5JuMvrenKeIA Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 1433af93cf1945ac814682a7927a0aeb Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestShelveInstance-1016020495 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestShelveInstance-1016020495 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 1433af93cf1945ac814682a7927a0aeb Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestShelveInstance-1016020495 Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestShelveInstance-1016020495-project Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 44fd841258434f68a43c840ba7ded27b Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestShelveInstance-1016020495-project Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'f4399630-2e21-4bd8-a84a-fb82883bff62'} Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:05:43.613919 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Returning 404 to user: Instance f4399630-2e21-4bd8-a84a-fb82883bff62 could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-09cf857c-8d91-4175-90a2-62be1cae2c36 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62" status: 404 len: 111 microversion: 2.1 time: 0.032363 Oct 13 10:05:43.620358 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3908/8207] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:05:43 2022] GET /compute/v2.1/servers/f4399630-2e21-4bd8-a84a-fb82883bff62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 10:05:43.771699 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5b765f96-5c39-477d-90fa-4a349be683df tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '.version_select at 0x7f5375875a60>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:43.801102 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5b765f96-5c39-477d-90fa-4a349be683df tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-167925098" status: 202 len: 0 microversion: 2.1 time: 0.033183 Oct 13 10:05:43.805219 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4300/8208] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 10:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-167925098 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:05:43.825698 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bb71c1b4-4fa0-4b40-a5d3-ac9bb9245403 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'create', calling method: .version_select at 0x7f537663a670>, body: {"keypair": {"name": "tempest-TestShelveInstance-771615456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXeDwTbHA6NSQ6in8Zv6Ry5lMb8l0y8fTYpcfJ2/jGGOO+NMvDXDM17vJ6mhElV00uzKbqKt+Rjjoon6yco7QK4i22JElBSBOQ9Fp9JJnnk15oBTe/mTGD5v85AFAmd2Q=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:05:43.842545 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bb71c1b4-4fa0-4b40-a5d3-ac9bb9245403 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for project 1433af93cf1945ac814682a7927a0aeb. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:05:43.847605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-bb71c1b4-4fa0-4b40-a5d3-ac9bb9245403 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for user 44fd841258434f68a43c840ba7ded27b and project 1433af93cf1945ac814682a7927a0aeb. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:05:43.874801 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bb71c1b4-4fa0-4b40-a5d3-ac9bb9245403 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053075 Oct 13 10:05:43.875410 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3909/8209] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 10:05:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:05:59.102741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1975415203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-771615456", "security_groups": [{"name": "tempest-secgroup-smoke-705597301"}], "networks": [{"uuid": "a60571f3-5f5f-49f2-adaf-1434bf7719c5"}], "block_device_mapping_v2": [{"uuid": "1ffa0d0a-7fd8-4a64-b1cc-88cd9606bb06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:05:59.115084 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:59.115726 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:59.219307 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] validate_networks() for [('a60571f3-5f5f-49f2-adaf-1434bf7719c5', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 10:05:59.635637 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 10:05:59.636097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 10:05:59.636578 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 10:05:59.636988 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 10:05:59.637897 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 10:05:59.646872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:59.647353 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:59.647788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:59.648510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:05:59.648964 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:05:59.649388 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:05:59.667037 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for project 1433af93cf1945ac814682a7927a0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:05:59.672295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Getting quotas for user 44fd841258434f68a43c840ba7ded27b and project 1433af93cf1945ac814682a7927a0aeb. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:05:59.729153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 10:05:59.731401 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ffa0d0a-7fd8-4a64-b1cc-88cd9606bb06',volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 10:05:59.857911 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f491b0c3-fa56-4588-92ea-941efa6ca64b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759130 Oct 13 10:05:59.858840 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4301/8210] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 10:05:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 10:05:59.867935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=12 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:59.868711 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=4 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:59.869358 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:05:59.873867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-018cb25d-e0e7-4383-ab5a-a2d426e5442f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:05:59.874553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-018cb25d-e0e7-4383-ab5a-a2d426e5442f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:05:59.931023 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-018cb25d-e0e7-4383-ab5a-a2d426e5442f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:05:59.939008 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-018cb25d-e0e7-4383-ab5a-a2d426e5442f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1088 microversion: 2.1 time: 0.072815 Oct 13 10:05:59.939585 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3910/8211] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:05:59 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:00.963624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:00.964548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:00.972062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:00.972545 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:00.972989 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:00.973695 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:00.974153 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:00.974607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:01.048223 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:01.057068 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-17a9ce84-4d8e-4e3c-8c07-eb3327c4a2d8 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1204 microversion: 2.1 time: 0.099682 Oct 13 10:06:01.062490 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4302/8212] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:00 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:02.080783 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:02.081389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:02.088938 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:02.089582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:02.090047 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:02.090802 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:02.091279 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:02.091725 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:02.238905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:02.248301 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1e31d941-67b7-4aa0-97a4-e852ffc3a6ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1271 microversion: 2.1 time: 0.171562 Oct 13 10:06:02.258435 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3911/8213] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:02 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:02.417961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:06:02.429537 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:02.430116 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:02.430668 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:02.442804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] Creating event network-changed:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:06:02.448582 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-0144618c-5081-4001-8eaa-b167480282b9 req-987e6444-a73b-4c15-805a-088dd62a1d3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037103 Oct 13 10:06:02.449735 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4303/8214] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:06:03.273027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:03.274565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:03.283059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:03.283641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:03.284168 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:03.284984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:03.285538 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:03.286122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:03.422984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:03.431145 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e61a7c25-4578-4408-a1c7-6c601098688c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1271 microversion: 2.1 time: 0.163065 Oct 13 10:06:03.431731 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3912/8215] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:03 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:04.454817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:04.455528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:04.462732 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:04.463222 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:04.463660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:04.464359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:04.464814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:04.465239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:04.603654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:04.612596 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c82fdeb8-f0bc-41a8-b4bd-5f26114a2678 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1271 microversion: 2.1 time: 0.162128 Oct 13 10:06:04.613180 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4304/8216] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:04 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:05.634320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:05.635172 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:05.642326 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:05.642867 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:05.643320 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:05.644034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:05.644509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:05.644950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:05.782144 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:05.790202 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1fa18bd1-beab-45bf-b6ca-76f23e09f273 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1271 microversion: 2.1 time: 0.159803 Oct 13 10:06:05.790818 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3913/8217] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:05 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:06.812829 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:06.813442 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:06.820310 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:06.820795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:06.821228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:06.821915 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:06.822362 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:06.822863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:06.955882 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:06.963613 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-834bc132-2cd7-4152-96eb-d68014a54d39 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.154751 Oct 13 10:06:06.964178 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4305/8218] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:06 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:07.987520 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:07.988127 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:07.994524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:07.995025 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:07.995477 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:07.996187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:07.997313 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:07.997761 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:08.137954 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:08.146088 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8fb74458-e83e-4fec-b54c-fa8571b5579b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.162792 Oct 13 10:06:08.146733 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3914/8219] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:07 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:09.168200 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:09.168819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:09.175174 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:09.175658 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:09.176097 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:09.176783 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:09.177237 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:09.177662 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:09.304243 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:09.312387 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58484559-75ae-494a-a1b7-67d6e15e77c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.148121 Oct 13 10:06:09.312957 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4306/8220] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:09 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:10.334603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:10.335231 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:10.337942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:06:10.343988 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:10.344492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:10.344967 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:10.345687 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:10.346183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:10.346670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:10.476962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:10.485640 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-b0a6d67b-415e-4adb-a105-a512dff127ca tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.155048 Oct 13 10:06:10.486223 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3915/8221] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:10 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:11.507373 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:11.507975 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:11.509961 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:06:11.510654 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:06:11.517996 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:11.518513 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:11.518951 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:11.519643 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:11.520094 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:11.520519 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:11.655583 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:11.664084 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7a56f48d-1d7d-4eb6-ad35-be62e1a7a0af tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.160611 Oct 13 10:06:11.664668 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4307/8222] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:11 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:12.687572 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:12.688203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:12.695027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:12.695523 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:12.695973 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:12.696673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:12.697164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:12.697607 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:12.830816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:12.838587 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-a8f41c62-0773-47ad-b102-0d4701398c2c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.155182 Oct 13 10:06:12.839176 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3916/8223] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:12 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:13.862171 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:13.862817 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:13.869538 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:13.870015 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:13.870479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:13.871163 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:13.872278 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:13.872702 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:14.001138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:14.008878 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-58a0d44a-1dcc-4b0c-bfcf-9d38d9a57ec5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.150855 Oct 13 10:06:14.009459 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4308/8224] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:13 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:15.031868 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:15.032489 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:15.039414 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:15.039912 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:15.040365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:15.041069 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:15.041532 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:15.041978 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:15.169214 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:15.176983 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7518b6d1-93eb-4c65-8964-c5d7e78379ea tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.149529 Oct 13 10:06:15.177572 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3917/8225] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:15 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:16.198605 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:16.199173 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:16.206479 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:16.206966 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:16.207404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:16.208117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:16.208557 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:16.208979 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:16.338769 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:16.347061 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c23f5907-5c49-4f9b-a272-e25facfb7259 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.152563 Oct 13 10:06:16.347633 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4309/8226] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:16 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:17.369708 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:17.370343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:17.377744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:17.378243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:17.378727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:17.379436 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:17.379907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:17.380350 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:17.510530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:17.518856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f3101d5f-0eff-4813-a7c9-f9aec66e4efb tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.153089 Oct 13 10:06:17.519435 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3918/8227] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:17 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:18.049297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "name": "network-vif-plugged", "status": "completed", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:06:18.062758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:18.063301 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:18.063736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:18.075681 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] Creating event network-vif-plugged:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:06:18.081183 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b43fca1e-46d3-4323-95d1-6ff3ed771ebf req-cd24848f-2e25-4a91-9538-fc01e193bb22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091408 Oct 13 10:06:18.081768 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4310/8228] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:06:18.541381 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:18.541929 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:18.549278 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:18.549770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:18.550217 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:18.550961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:18.551428 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:18.551864 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:18.684276 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:18.692045 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e2efffff-8070-4250-9e46-d6a932d997d2 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1259 microversion: 2.1 time: 0.154708 Oct 13 10:06:18.692615 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3919/8229] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:18 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:19.714980 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:19.715720 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:19.722840 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:19.723326 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:19.723770 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:19.724535 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:19.725040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:19.725512 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:19.854878 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:19.863466 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-5f93e15b-5dcb-40cc-97bf-5737c044e2cf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1443 microversion: 2.1 time: 0.152843 Oct 13 10:06:19.864041 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4311/8230] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:19 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:19.886383 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:06:19.887132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:06:19.893939 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:19.894464 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:19.894922 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:19.895630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:19.896101 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:19.896544 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:20.025682 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:06:20.033737 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d5779ed7-96a2-43a2-881f-f085061760d0 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1443 microversion: 2.1 time: 0.151217 Oct 13 10:06:20.034318 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3920/8231] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:06:19 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:06:21.917439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:06:21.930744 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:06:21.931040 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:06:21.931490 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:06:21.943459 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] Creating event network-changed:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:06:21.948433 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-8ccca0e0-9743-40c8-a120-ffafe4b44df2 req-521c16d0-9e45-416f-88a6-3c21b4f2db0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034843 Oct 13 10:06:21.949944 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4312/8232] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:08:18.152355 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:08:18.153283 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:08:18.154120 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=24 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:18.154901 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=60 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:18.156264 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 10:08:18.156436 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action (ip 10.222.0.23) !!! Oct 13 10:08:18.158093 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:08:18.158236 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action (ip 10.222.0.23) !!! Oct 13 10:08:18.162811 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:08:18.163357 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:18.173084 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:18.173581 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:18.174037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:18.174778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:18.175251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:18.175691 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:18.202657 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lazy-loading 'flavor' on Instance uuid 4af1c783-f546-4acf-8798-4904acd5217f {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:08:18.275185 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5bf65f37-739a-48a6-a611-39e656b9adfe tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action" status: 202 len: 0 microversion: 2.1 time: 0.124523 Oct 13 10:08:18.275903 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3921/8233] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:08:18 2022] POST /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:08:18.283865 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:08:18.283865 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:08:18.283865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:18.284635 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=56 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:18.285783 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 10:08:18.285911 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f (ip 10.222.0.23) !!! Oct 13 10:08:18.291706 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:18.292379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:18.302090 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:18.302532 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:18.303054 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:18.303755 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:18.304205 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:18.304628 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:18.436503 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:18.444688 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-67e5ce7e-981b-4ac4-a389-bd7c17ccd316 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.164304 Oct 13 10:08:18.445262 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4313/8234] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:18 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:19.472666 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:19.473382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:19.481886 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:19.482382 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:19.482861 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:19.483569 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:19.484294 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:19.484734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:19.491883 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60564. Oct 13 10:08:19.492625 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60566. Oct 13 10:08:19.621701 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:19.630050 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e55b7070-3ef5-481c-82a9-f178aa7b6f8d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.163908 Oct 13 10:08:19.630665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3922/8235] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:19 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:20.653572 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:20.654180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:20.663291 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:20.663774 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:20.664207 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:20.664906 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:20.665355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:20.665795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:20.686365 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60574. Oct 13 10:08:20.687230 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60572. Oct 13 10:08:20.803876 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:20.811624 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-684caa0c-223e-4d93-8748-20436dbc313d tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.161972 Oct 13 10:08:20.812208 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4314/8236] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:20 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:21.834476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:21.835139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:21.842009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:21.842536 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:21.842993 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:21.843699 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:21.844167 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:21.844609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:21.973132 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:21.980902 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d44f4791-339a-4d0b-9b6b-a4c119dcd969 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.150425 Oct 13 10:08:21.981478 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3923/8237] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:21 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:23.005109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:23.005725 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:23.012525 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:23.013007 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:23.013446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:23.014137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:23.014624 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:23.015050 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:23.144528 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:23.152303 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d7b57ac3-5245-4dce-affe-6b078f42c672 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.151618 Oct 13 10:08:23.152882 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4315/8238] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:22 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:08:24.174630 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:24.175190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:24.182152 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:24.182673 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:24.183122 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:24.183824 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:24.184290 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:24.184727 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:24.317188 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:24.325028 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3320e835-98d5-44a0-962b-044384dfd804 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.154478 Oct 13 10:08:24.325608 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3924/8239] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:24 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:25.348382 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:25.349025 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:25.356109 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:25.356589 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:25.357022 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:25.357723 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:25.358176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:25.358634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:25.488565 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:25.497021 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-891089f9-b859-4ede-b4af-7ac5e44f2de5 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.152002 Oct 13 10:08:25.497021 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4316/8240] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:25 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:26.520658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:26.521289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:26.528179 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:26.528670 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:26.529121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:26.529823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:26.530289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:26.530765 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:26.658897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:26.666672 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-64b588f1-91d9-421f-aa47-b5e2690254ec tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.150550 Oct 13 10:08:26.667251 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3925/8241] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:26 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:27.690521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:27.691170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:27.698057 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:27.698599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:27.699021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:27.699715 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:27.700169 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:27.700600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:27.831974 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:27.839842 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-8404f333-89f8-495e-819a-bbe72633d686 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.153896 Oct 13 10:08:27.840433 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4317/8242] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:27 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:28.863249 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:28.863879 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:28.870919 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:28.871419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:28.871870 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:28.872587 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:28.873059 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:28.873502 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:29.002573 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:29.011045 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-961d763e-f2a2-46ec-b3e2-1c0981d2d6aa tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.152085 Oct 13 10:08:29.011628 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3926/8243] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:28 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:30.033249 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:30.034137 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:30.041551 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:30.042032 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:30.042492 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:30.043187 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:30.043636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:30.044080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:30.173820 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:30.181577 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1b0c59ee-1d53-4fd9-a66a-cbf2be5c40ff tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.152348 Oct 13 10:08:30.182148 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4318/8244] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:30 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:31.205100 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:31.205731 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:31.213586 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:31.214089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:31.214597 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:31.215327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:31.215798 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:31.216239 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:31.356097 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:31.364856 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0bb43e96-b10b-433d-bdef-07fab3d782c7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.163815 Oct 13 10:08:31.365435 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3927/8245] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:31 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:32.388522 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:32.389135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:32.395924 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.396430 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.396863 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.397580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.398026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.398467 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.548294 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:32.556021 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88e5f973-5ded-4c92-9898-f7be8f3d9dbd tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1569 microversion: 2.1 time: 0.171405 Oct 13 10:08:32.556874 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4319/8246] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:32 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:32.578676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:08:32.579277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:32.587398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.587915 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.588398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.589327 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.589972 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.590439 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.594599 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "name": "network-vif-unplugged", "status": "completed", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:08:32.605104 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.605679 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.606170 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.618585 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.compute.server_external_events [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] Unable to find a host for instance 4af1c783-f546-4acf-8798-4904acd5217f. Dropping event network-vif-unplugged {{(pid=127030) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 13 10:08:32.619560 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-112158e4-8b03-4f77-90d7-5dc3ae287b95 req-1dcd39d6-038a-440c-963e-376594381c6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028864 Oct 13 10:08:32.620236 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4320/8247] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 13 10:08:32.625847 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127031) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 13 10:08:32.694705 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f75ef9eb-5a4d-4eb0-b135-18ffbaef6a99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "POST /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action" status: 202 len: 0 microversion: 2.1 time: 0.120091 Oct 13 10:08:32.695426 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3928/8248] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:08:32 2022] POST /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:08:32.705595 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:32.706212 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:32.712803 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.713289 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.713756 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.714481 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:32.714936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:32.715364 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:32.850869 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:32.858593 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-ce8a1c9a-f8b0-4631-bf05-6d7d74254a09 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1517 microversion: 2.1 time: 0.156843 Oct 13 10:08:32.859414 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4321/8249] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:32 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:33.881849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:33.882513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:33.888509 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:33.889007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:33.889455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:33.890164 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:33.890660 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:33.891109 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:34.040676 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:34.048971 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-669ab6dc-caf6-455d-bd05-f7c92d116201 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1517 microversion: 2.1 time: 0.171904 Oct 13 10:08:34.049634 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3929/8250] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:33 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:35.072067 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:35.072677 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:35.079502 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:35.079976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:35.080404 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:35.081087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:35.081652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:35.082072 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:35.224814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:35.234096 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-0ae152ee-1d36-43d1-8bec-8b6f2fc13148 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1517 microversion: 2.1 time: 0.165619 Oct 13 10:08:35.234712 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4322/8251] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:35 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:36.258979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:36.259609 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:36.266618 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:36.267125 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:36.267565 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:36.268268 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:36.268733 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:36.269171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:36.397752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:36.405629 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5f3fb999-8251-4868-972a-ea60ee9518e7 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1517 microversion: 2.1 time: 0.151123 Oct 13 10:08:36.406211 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3930/8252] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:36 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:37.428778 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:37.429398 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:37.436204 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:37.436689 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:37.437130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:37.437835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:37.438295 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:37.438750 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:37.571917 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:37.580034 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4dbc7055-656b-4736-b3d2-01468dd087ae tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1519 microversion: 2.1 time: 0.155423 Oct 13 10:08:37.580615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4323/8253] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:37 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:38.604805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:38.605534 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:38.612696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:38.613205 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:38.614265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:38.615022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:38.615501 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:38.615950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:38.750563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:38.758508 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-83449b12-7c5a-4a52-b475-c97408a0d919 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1519 microversion: 2.1 time: 0.157662 Oct 13 10:08:38.759089 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3931/8254] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:38 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:39.781752 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:39.782368 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:39.789355 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:39.789837 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:39.790271 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:39.790995 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:39.791452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:39.791881 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:39.922965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:39.931354 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-54e9d7f9-6697-4ca0-a911-a7f2148a3b0c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1519 microversion: 2.1 time: 0.153521 Oct 13 10:08:39.931939 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4324/8255] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:39 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:40.954126 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:40.954756 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:40.961793 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:40.962289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:40.962763 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:40.963472 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:40.963937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:40.964377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:41.096265 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:41.104535 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-85fd1ef8-9904-4843-9cc3-8cc06696329b tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1519 microversion: 2.1 time: 0.154213 Oct 13 10:08:41.105143 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3932/8256] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:40 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:42.128609 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:42.129741 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:42.136808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:42.137299 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:42.137736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:42.138454 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:42.138916 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:42.139339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:42.278784 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:42.287360 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fc14a02f-f2a8-430f-b12f-20bbd55b7b7a tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1519 microversion: 2.1 time: 0.162708 Oct 13 10:08:42.287967 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4325/8257] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:42 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:43.311015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:43.311640 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:43.318513 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:43.319009 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:43.319457 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:43.320182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:43.320651 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:43.321089 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:43.457494 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:43.466327 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c899eda7-c4b3-4f8f-aa13-da1ef0b221bf tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.159275 Oct 13 10:08:43.466944 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3933/8258] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:43 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:44.491131 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:44.491747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:44.498739 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:44.499224 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:44.499661 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:44.500359 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:44.500814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:44.501239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:44.635717 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:44.643583 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-fe013b24-ed4d-4a0e-98d4-b162bb5bbc63 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.156400 Oct 13 10:08:44.644152 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4326/8259] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:44 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:45.667816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:45.668402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:45.675222 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:45.675712 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:45.676155 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:45.676851 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:45.677312 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:45.677749 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:45.695401 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:45.808833 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:45.816648 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-bbfc73c9-7eea-4faf-89e1-80c0c8060f99 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.152791 Oct 13 10:08:45.817710 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3934/8260] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:45 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:46.840283 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:46.840893 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:46.847685 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:46.848167 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:46.848601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:46.849297 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:46.849751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:46.850177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:46.980180 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:46.988196 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-4e828599-82df-45e3-b93e-d93248e8a404 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.151877 Oct 13 10:08:46.988785 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4327/8261] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:46 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:48.011002 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:48.011632 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:48.018603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:48.019106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:48.019563 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:48.020751 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:48.021232 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:48.021675 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:48.152248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:48.160692 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-00757edc-86cd-48d7-b484-2f1d72aa78d1 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.153640 Oct 13 10:08:48.161302 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3935/8262] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:48 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:49.183730 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:49.184339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:49.187047 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=31 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:49.192439 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:49.192911 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:49.193339 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:49.194023 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:49.194496 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:49.194952 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:49.199030 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=87 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:49.322815 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:49.330490 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-1143c414-34e8-4a88-a518-b8ca601c8f46 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.150624 Oct 13 10:08:49.331062 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4328/8263] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:49 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:50.353377 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:50.354008 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:50.356092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:08:50.361995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:50.362524 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:50.362991 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:50.363707 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:50.364384 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:50.364844 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:50.498778 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:50.507247 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-5d7371fc-7730-4775-b80d-6b8cdf6d69ee tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.158024 Oct 13 10:08:50.507829 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3936/8264] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:50 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:51.530521 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:51.531138 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:51.537870 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:51.538348 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:51.538920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:51.539607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:51.540078 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:51.540500 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:51.672192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:51.680044 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6ca927dc-e4ea-4861-8438-d56a85c966ab tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.153609 Oct 13 10:08:51.680615 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4329/8265] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:51 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:08:52.703076 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:52.703704 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:52.711664 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:52.712165 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:52.712612 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:52.713458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:52.714075 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:52.714521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:52.734561 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "name": "network-vif-plugged", "status": "completed", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:08:52.747424 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:52.748011 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:52.748450 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:52.763160 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] Creating event network-vif-plugged:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:08:52.768765 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-431ac4b3-dfb8-42f2-93dc-9b3c40ecb029 req-af85c411-d2c6-415c-bcf0-f514df5bf89f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038251 Oct 13 10:08:52.769605 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4330/8266] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 13 10:08:52.860932 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:52.868958 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-fcdec16b-0176-4a38-91bd-bc298d5c693c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1575 microversion: 2.1 time: 0.169790 Oct 13 10:08:52.869547 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3937/8267] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:52 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:08:53.892261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:08:53.893162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:08:53.900475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:53.900970 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:53.901600 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:53.902314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:08:53.903176 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:08:53.903921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:08:54.050601 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:08:54.058977 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-2cd2c6b6-a8f7-4a32-b754-8d7ca1fe83ce tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1562 microversion: 2.1 time: 0.171087 Oct 13 10:08:54.059688 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4331/8268] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:08:53 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:07.973812 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:07.975060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=20 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:07.976108 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:10:07.976273 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f (ip 10.222.0.23) !!! Oct 13 10:10:07.976607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=7 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:07.977742 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=19 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:07.981512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:07.989760 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:10:07.989989 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 10:10:07.990771 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:08.008200 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:08.008714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:08.009173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:08.009900 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:08.010373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:08.010850 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:08.050176 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 10:10:08.065128 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:08.075954 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:08.076657 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:08.077267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:08.095162 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] Creating event network-changed:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:10:08.102328 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-1e1723ad-588b-454a-90fd-8b287a6b00e3 req-578ef0d5-8fb6-4943-ba4c-71cc3e638d31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127858 Oct 13 10:10:08.104520 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4332/8269] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:10:08.188389 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-16d9fbcb-3a0d-44d9-9e05-6b2f25ac220f tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 204 len: 0 microversion: 2.1 time: 0.216149 Oct 13 10:10:08.189432 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3938/8270] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 10:10:07 2022] DELETE /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 10:10:08.198245 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:08.199125 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:08.205701 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:08.206320 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:08.206899 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:08.207860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:08.208425 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:08.208965 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:08.356504 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:08.365330 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-3b9818a5-4233-400d-8c70-6d3a2bb52f58 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.171726 Oct 13 10:10:08.365911 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4333/8271] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:08 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:09.389334 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:09.390048 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:09.398244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:09.398996 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:09.399642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:09.400374 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:09.400842 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:09.401280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:09.551330 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:09.559770 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-71b77f43-1b79-49d2-ab64-7ffc9c38f173 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1568 microversion: 2.1 time: 0.174809 Oct 13 10:10:09.560506 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3939/8272] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:09 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:10.152912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af1c783-f546-4acf-8798-4904acd5217f", "name": "network-vif-deleted", "tag": "7070003e-e266-46ea-903e-e82753dd19c7"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:10.168674 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:10.169351 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:10.169860 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:10.181743 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] Creating event network-vif-deleted:7070003e-e266-46ea-903e-e82753dd19c7 for instance 4af1c783-f546-4acf-8798-4904acd5217f on n-h1-858384-11 Oct 13 10:10:10.187234 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-b3aa95a7-f21a-4107-9a60-3d395efb5025 req-7ab10df9-28a6-4d17-8c2d-5ee7899ef74f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Oct 13 10:10:10.187751 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4334/8273] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:10:10.583772 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:10.584404 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:10.592007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:10.592547 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:10.593006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:10.593753 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:10.594223 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:10.594697 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:10.657248 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:10.665224 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-18788fcb-e38f-4d9f-98fd-44ff8536fd74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1219 microversion: 2.1 time: 0.085465 Oct 13 10:10:10.665817 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3940/8274] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:10 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:11.688791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:11.689417 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:11.695984 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:11.696470 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:11.696907 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:11.697615 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:11.698068 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:11.698514 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:11.767751 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:11.776516 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-b152a6ba-4134-4359-a753-44f8ee57090e tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1219 microversion: 2.1 time: 0.092936 Oct 13 10:10:11.777228 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4335/8275] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:11 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:12.799797 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:12.800365 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:12.807846 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:12.808343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:12.808819 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:12.809522 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:12.809984 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:12.810442 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:12.875006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:12.883175 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-1c94dc84-b343-447f-a709-9d6b993b6e80 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1219 microversion: 2.1 time: 0.087577 Oct 13 10:10:12.883755 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3941/8276] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:12 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:13.905183 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:13.905950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:13.913257 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:13.913943 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:13.914634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:13.915376 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:13.915835 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:13.916266 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:14.240607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44fd841258434f68a43c840ba7ded27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1433af93cf1945ac814682a7927a0aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:14.249804 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-46a84b98-5452-4bbe-96b9-6da5f0d0aa74 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 200 len: 1219 microversion: 2.1 time: 0.348432 Oct 13 10:10:14.250456 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4336/8277] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:13 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 1219 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:15.273941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:15.274636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] [instance: 4af1c783-f546-4acf-8798-4904acd5217f] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:15.281950 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:15.282484 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:15.282947 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:15.283941 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:15.284147 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:15.284596 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:15.298881 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] HTTP exception thrown: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Request method failure captured: Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f HTTP/1.1 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR-HTo2KQMkr3ekso_70CRQjET-ZFYJW3P8FP3mFu9esy5uqJXt8ziu96SjjzyuaSp8jK3M7BDcFfrzm7b32jd8FSZMwaTFvX4Y6tIosxkHgVAjR-TAHkX5a5Iqoqm9WBfELzaRT8HNnu2L2An8pSvvh4dDLdXSimQED5JuMvrenKeIA Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 1433af93cf1945ac814682a7927a0aeb Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestShelveInstance-1016020495 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1433af93cf1945ac814682a7927a0aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestShelveInstance-1016020495 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 1433af93cf1945ac814682a7927a0aeb Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestShelveInstance-1016020495 Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestShelveInstance-1016020495-project Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: 44fd841258434f68a43c840ba7ded27b Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestShelveInstance-1016020495-project Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': '4af1c783-f546-4acf-8798-4904acd5217f'} Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:10:15.300768 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Returning 404 to user: Instance 4af1c783-f546-4acf-8798-4904acd5217f could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-dcadae27-d8c2-4c5d-b463-20f272b1b96c tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f" status: 404 len: 111 microversion: 2.1 time: 0.032998 Oct 13 10:10:15.306352 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3942/8278] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:15 2022] GET /compute/v2.1/servers/4af1c783-f546-4acf-8798-4904acd5217f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 10:10:15.472343 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-65b3027d-4114-4200-85fc-2d3e314f0b29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] Calling method '.version_select at 0x7f53753e4790>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:15.501608 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-65b3027d-4114-4200-85fc-2d3e314f0b29 tempest-TestShelveInstance-1016020495 tempest-TestShelveInstance-1016020495-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-771615456" status: 202 len: 0 microversion: 2.1 time: 0.033481 Oct 13 10:10:15.507556 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4337/8279] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 10:10:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-771615456 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 13 10:10:32.712175 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:32.713757 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:32.923151 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3999c822-2e30-443c-961c-86903c4e6c81 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Action: 'create', calling method: .version_select at 0x7f5375d28550>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-15031804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu3TOgiXEZo23pKsGXy8KrkXiNgWVxSz1mgk5WGcrZ3KNXKd5T+K+m4phYHbuzxI/qJRQhGY1HCYkHGNiIixnnwKorwv4NDRniqtRFjAzAlDZEpSzOqp8f7KvXrO651pA=="}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:32.939805 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3999c822-2e30-443c-961c-86903c4e6c81 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for project 7873145d7630495cbbbed49058e72132. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:10:32.945976 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-3999c822-2e30-443c-961c-86903c4e6c81 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for user b641d70f51664d36817dd32c59a30bae and project 7873145d7630495cbbbed49058e72132. Resources: {'key_pairs'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:10:32.976421 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3999c822-2e30-443c-961c-86903c4e6c81 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.269626 Oct 13 10:10:32.976983 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3943/8280] 10.222.0.23 () {60 vars in 1159 bytes} [Thu Oct 13 10:10:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:10:33.957671 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2056259111", "imageRef": "312a3023-32f8-4474-bfa0-ae0f09977375", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-15031804", "security_groups": [{"name": "tempest-secgroup-smoke-2072464284"}], "networks": [{"uuid": "f33fdd3e-0eea-4fe9-983e-dd6982a9d8cb"}]}} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:33.969281 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=22 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:33.970370 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:34.080331 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.network.neutron [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] validate_networks() for [('f33fdd3e-0eea-4fe9-983e-dd6982a9d8cb', None, None, None, None, None)] {{(pid=127030) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 10:10:34.464188 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Flavor limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 10:10:34.464606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Image limits 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 10:10:34.465082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Flavor pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 10:10:34.465494 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Image pref 0:0:0 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 10:10:34.465936 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.virt.hardware [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 10:10:34.474791 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:34.475296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:34.475733 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:34.476449 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:34.476930 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:34.477346 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:34.494808 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for project 7873145d7630495cbbbed49058e72132. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:10:34.500166 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.quota [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for user b641d70f51664d36817dd32c59a30bae and project 7873145d7630495cbbbed49058e72132. Resources: {'instances', 'cores', 'ram'} {{(pid=127030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:10:34.513076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Going to run 1 instances... {{(pid=127030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 10:10:34.515452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='312a3023-32f8-4474-bfa0-ae0f09977375',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 10:10:34.562798 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-375b8239-d12c-4957-bac1-697e6b80bbe9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.609329 Oct 13 10:10:34.563697 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4338/8281] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 10:10:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 10:10:34.576430 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f728de76-ba04-45e3-86c0-f38e8a6f3d8e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:34.577073 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f728de76-ba04-45e3-86c0-f38e8a6f3d8e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:34.652626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f728de76-ba04-45e3-86c0-f38e8a6f3d8e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:34.660266 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f728de76-ba04-45e3-86c0-f38e8a6f3d8e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1247 microversion: 2.1 time: 0.088953 Oct 13 10:10:34.661400 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3944/8282] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:34 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:35.686580 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:35.688096 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:35.701076 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:35.701721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:35.703708 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:35.704993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:35.706574 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:35.707228 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:35.780312 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:35.788257 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-7bfdc551-463a-4725-b8fc-a00dac9e4ce0 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1305 microversion: 2.1 time: 0.107949 Oct 13 10:10:35.789108 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4339/8283] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:35 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:36.812007 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:36.813700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:36.820455 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:36.820968 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:36.821389 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:36.822106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:36.822605 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:36.823043 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:37.017904 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:37.026613 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-30e1b39a-68db-4708-a72a-625190890bed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.218540 Oct 13 10:10:37.027411 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3945/8284] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:36 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:37.120608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:37.131079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:37.132162 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:37.132813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:37.144713 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] Creating event network-changed:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:10:37.149527 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-3bb38996-15c9-46c9-b6c6-2d139ef5459c req-417d287e-1cdc-4287-a9e0-3b59faacefab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033617 Oct 13 10:10:37.150127 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4340/8285] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:10:38.049402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:38.050034 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:38.057549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:38.058055 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:38.058542 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:38.059257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:38.059728 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:38.060173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:38.193566 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:38.201394 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8f3e47f4-4b81-424d-83ed-3e4fb485e51e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.156032 Oct 13 10:10:38.201972 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3946/8286] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:38 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:39.224516 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:39.225721 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:39.231883 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:39.232365 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:39.232793 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:39.233475 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:39.233920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:39.234634 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:39.366956 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:39.374640 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-9ac8c496-2282-4346-a498-8e9aa92f542e tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.155113 Oct 13 10:10:39.375213 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4341/8287] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:39 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:40.395937 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:40.396568 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:40.403942 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:40.404440 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:40.404891 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:40.405600 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:40.406074 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:40.406574 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:40.643311 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:40.651754 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0e69736e-d01d-462d-9baa-8d0a8bfc40a3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.259678 Oct 13 10:10:40.652275 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3947/8288] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:40 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:41.675684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:41.676296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:41.683606 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:41.684089 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:41.684527 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:41.685230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:41.685692 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:41.686117 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:41.871946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:41.879702 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bfc7464f-ce11-48d6-a16b-7bc27b2383fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.207965 Oct 13 10:10:41.880274 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4342/8289] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:41 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:42.903512 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:42.904171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:42.911139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:42.911641 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:42.912092 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:42.912800 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:42.913270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:42.913709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:43.041305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:43.049312 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-291a87ab-885b-467a-ba29-dc18d745af27 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.149739 Oct 13 10:10:43.049893 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3948/8290] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:42 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:10:43.280607 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "name": "network-vif-plugged", "status": "completed", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:43.291443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:43.291955 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:43.292390 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:43.307822 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] Creating event network-vif-plugged:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:10:43.312776 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-30ae8b81-90be-4ee6-804f-43624fcd9a02 req-6fcb9b49-50de-4e4b-90b0-132cada7adcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Oct 13 10:10:43.313439 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4343/8291] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:10:44.072633 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:44.073291 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:44.080243 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:44.080739 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:44.081189 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:44.081892 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:44.082354 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:44.082814 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:44.211215 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:44.218855 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-6fc34981-2126-4424-a05f-1177c57c2e78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1373 microversion: 2.1 time: 0.150221 Oct 13 10:10:44.219425 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3949/8292] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:44 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1373 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:45.239130 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:45.239819 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=6 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:45.244912 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:45.245608 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:45.252590 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:45.253063 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:45.253495 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:45.254181 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:45.254652 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:45.255075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:45.388950 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:45.396700 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-95eef3d5-aa21-44af-b8aa-7cf6386b08b8 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1558 microversion: 2.1 time: 0.159388 Oct 13 10:10:45.397804 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4344/8293] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:45 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:45.419955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:10:45.420637 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:10:45.422564 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:10:45.429229 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:45.429760 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:45.430220 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:45.430961 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:45.431437 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:45.431883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:45.565986 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:10:45.573788 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c3ec6964-a287-40cf-8734-117d170dadbc tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1558 microversion: 2.1 time: 0.157891 Oct 13 10:10:45.574368 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3950/8294] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:10:45 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:10:47.168261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:10:47.178357 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:10:47.179041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:10:47.179477 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:10:47.190849 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] Creating event network-changed:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:10:47.196521 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-c9e65564-e6ae-41ef-b30b-6b51ae188711 req-4f9b1347-c23d-4ecb-a2ea-76124ce476eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Oct 13 10:10:47.197134 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4345/8295] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:12:42.232293 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:12:42.233238 n-d-858384-11 devstack@n-api.service[127031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 13 10:12:42.233770 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:42.235060 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=36 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:42.235782 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 13 10:12:42.235941 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b/action (ip 10.222.0.23) !!! Oct 13 10:12:42.236927 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:12:42.237037 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b/action (ip 10.222.0.23) !!! Oct 13 10:12:42.242636 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1191987488"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:12:42.245033 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:12:42.255613 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:42.256116 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:42.256571 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:42.257280 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:42.258458 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:42.258910 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:42.455012 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8530ce1a-def5-4b21-b2f9-c1c23eb4bfc2 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "POST /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b/action" status: 202 len: 0 microversion: 2.1 time: 0.224512 Oct 13 10:12:42.455665 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3951/8296] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:12:42 2022] POST /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 10:12:47.918435 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:12:47.919451 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 13 10:12:47.920239 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:47.921018 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=32 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:47.996296 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "name": "network-vif-plugged", "status": "completed", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:12:48.006510 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:48.006921 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:48.007347 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:48.021673 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] Creating event network-vif-plugged:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:12:48.027812 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-9b609a6a-e8ac-4085-a434-993a105099c3 req-52a6edfe-0002-4ab4-8472-f5259dd57f61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111113 Oct 13 10:12:48.029510 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4346/8297] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:12:55.995106 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:55.995899 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:12:56.000643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1044073726", "imageRef": "b5353904-dab7-45bf-ba99-5b29b819dcef", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-15031804", "security_groups": [{"name": "tempest-secgroup-smoke-2072464284"}], "networks": [{"uuid": "f33fdd3e-0eea-4fe9-983e-dd6982a9d8cb"}]}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:12:56.029972 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e2bcebd-2660-4b8f-908d-dfd8b2933846] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 32844. Oct 13 10:12:56.030837 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c337cb-8161-41e4-938c-4584348f8d62] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 32842. Oct 13 10:12:56.113234 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.network.neutron [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] validate_networks() for [('f33fdd3e-0eea-4fe9-983e-dd6982a9d8cb', None, None, None, None, None)] {{(pid=127031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 13 10:12:56.532962 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Flavor limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 13 10:12:56.533398 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Image limits 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 13 10:12:56.533885 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Flavor pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 13 10:12:56.534303 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Image pref 0:0:0 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 13 10:12:56.534752 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.virt.hardware [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 13 10:12:56.543576 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:56.544071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:56.544521 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:56.545251 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:56.545714 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:56.546174 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:56.567602 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for project 7873145d7630495cbbbed49058e72132. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 13 10:12:56.573297 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.quota [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Getting quotas for user b641d70f51664d36817dd32c59a30bae and project 7873145d7630495cbbbed49058e72132. Resources: {'instances', 'cores', 'ram'} {{(pid=127031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 13 10:12:56.585872 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Going to run 1 instances... {{(pid=127031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 13 10:12:56.588447 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5353904-dab7-45bf-ba99-5b29b819dcef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 13 10:12:56.636294 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-cac29c72-7c42-406b-aa5f-78cfe6c30f22 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643349 Oct 13 10:12:56.636976 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3952/8298] 10.222.0.23 () {60 vars in 1147 bytes} [Thu Oct 13 10:12:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 13 10:12:56.648823 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dabbd831-aaf2-40e7-b575-e3c0e2c787d3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:12:56.649611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dabbd831-aaf2-40e7-b575-e3c0e2c787d3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:12:56.668869 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 32860. Oct 13 10:12:56.670693 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 32858. Oct 13 10:12:56.723066 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dabbd831-aaf2-40e7-b575-e3c0e2c787d3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:12:56.730719 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dabbd831-aaf2-40e7-b575-e3c0e2c787d3 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1247 microversion: 2.1 time: 0.086185 Oct 13 10:12:56.731383 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4347/8299] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:12:56 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:12:57.754658 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:12:57.755836 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:12:57.764905 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:57.765553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:57.766178 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:57.766995 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:57.767463 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:57.767903 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:57.852754 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:12:57.860828 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-04073367-aaf6-4daa-93cc-d491c97804a5 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1317 microversion: 2.1 time: 0.110391 Oct 13 10:12:57.861405 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3953/8300] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:12:57 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:12:57.903406 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "name": "network-vif-unplugged", "status": "completed", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:12:57.914696 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:57.915419 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:57.916003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:57.928521 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] Creating event network-vif-unplugged:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:12:57.934472 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-90ade155-8850-41f2-9650-613bbacd9dd5 req-fd9ddf6c-7639-4b08-b7c4-9c406e594396 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036997 Oct 13 10:12:57.935573 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4348/8301] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:12:58.884371 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:12:58.885585 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:12:58.893115 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:58.893616 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:58.894071 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:58.894823 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:12:58.895292 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:12:58.895736 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:12:59.045562 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:12:59.055302 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-3124c4ad-4680-46a2-bda1-7a066337d0e9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.175424 Oct 13 10:12:59.056083 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3954/8302] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:12:58 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:00.079085 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:00.079788 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:00.085938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:00.086472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:00.086886 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:00.087584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:00.088041 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:00.088472 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:00.230650 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:00.239777 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-d801d9fe-6fbd-4abf-8768-cbce67f6ae1c tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.165721 Oct 13 10:13:00.255160 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4349/8303] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:00 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:01.266492 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:01.267343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:01.275529 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:01.276015 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:01.276461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:01.277238 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:01.277705 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:01.278141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:01.420237 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:01.428066 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-8dbaa96d-e1a1-4247-8629-7873dddcee82 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.167042 Oct 13 10:13:01.428884 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3955/8304] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:01 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:02.450632 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:02.451255 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:02.458641 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:02.459226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:02.459734 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:02.460993 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:02.461548 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:02.462052 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:02.608190 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:02.619292 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-dc09f892-7988-4b59-8553-0da21f8259c9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.172766 Oct 13 10:13:02.620256 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4350/8305] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:02 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:03.643098 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:03.643780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:03.651650 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:03.652244 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:03.652780 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:03.653603 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:03.654136 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:03.654700 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:03.802679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:03.811329 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-0b481941-ea65-4f26-a607-728a06634bcf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.172467 Oct 13 10:13:03.811920 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3956/8306] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:03 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:04.833946 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:04.835413 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:04.843483 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:04.844062 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:04.844573 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:04.845452 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:04.845813 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:04.846244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:05.008747 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:05.017124 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-c5d339b7-8bdb-40d6-8b6c-9422f3b5f556 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.187427 Oct 13 10:13:05.017940 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4351/8307] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:04 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:06.039363 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:06.039990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:06.046908 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:06.047399 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:06.047849 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:06.048553 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:06.049017 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:06.049454 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:06.182897 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:06.190625 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-d6c1f40d-7e47-4666-ad24-e9f70bee3724 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.155213 Oct 13 10:13:06.191191 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3957/8308] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:06 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:07.214541 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:07.215186 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:07.217938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell0:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:13:07.223395 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:07.223879 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:07.224317 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:07.225009 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:07.225459 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:07.226553 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:07.361640 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:07.369340 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-a28db9b3-388a-4f0d-a739-f89347b92ed9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.159355 Oct 13 10:13:07.369906 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4352/8309] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:07 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:08.393642 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:08.394187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:08.396375 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:13:08.397141 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell0:SELECT=6 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:13:08.405227 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:08.405734 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:08.406183 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:08.406935 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:08.407402 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:08.408226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:08.636895 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:08.644729 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c85d1e9c-7353-4211-ac93-072beee6c462 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.255751 Oct 13 10:13:08.658427 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3958/8310] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:08 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:08.892314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:13:08.907366 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:08.908075 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:08.908667 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:08.921248 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] Creating event network-changed:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:13:08.926522 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a119c7e2-02c0-4d07-b43f-742e7d89ba1a req-4f12ca41-2859-408a-996c-9a9471924177 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043195 Oct 13 10:13:08.927300 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4353/8311] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:13:09.668843 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:09.669476 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:09.676343 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:09.676841 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:09.677295 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:09.678054 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:09.678551 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:09.679022 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:09.814082 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:09.822359 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-43db4ca0-54ef-404d-b544-14ce2362f7ff tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.157469 Oct 13 10:13:09.822967 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3959/8312] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:09 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:10.846938 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:10.847630 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:10.853900 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:10.854380 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:10.854867 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:10.855579 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:10.856026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:10.856447 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:10.989230 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:10.997722 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6d715293-86a4-48cb-abb7-8d454446a6ec tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.155934 Oct 13 10:13:10.998295 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4354/8313] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:10 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 13 10:13:12.019461 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:12.020093 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:12.027203 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:12.027709 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:12.028185 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:12.028902 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:12.029373 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:12.029816 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:12.160062 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:12.167755 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-2b082add-b5de-449f-93ea-abcac7762759 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.152354 Oct 13 10:13:12.168341 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3960/8314] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:12 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:13.191488 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:13.192108 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:13.200064 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:13.200544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:13.201004 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:13.201711 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:13.202160 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:13.202613 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:13.337135 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:13.344953 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-6dfa4181-3552-4f48-9bd7-444f1b2b52fd tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.157434 Oct 13 10:13:13.354787 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4355/8315] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:13 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:14.369344 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:14.369971 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:14.377257 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:14.377767 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:14.378226 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:14.378990 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:14.379495 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:14.379943 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:14.509679 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:14.517468 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-f09e23c9-7ac2-4148-baf3-27cdbcd41772 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.152840 Oct 13 10:13:14.518054 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3961/8316] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:14 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:15.205584 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "name": "network-vif-plugged", "status": "completed", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:13:15.215982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:15.216471 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:15.216913 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:15.227990 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] Creating event network-vif-plugged:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:13:15.232828 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-bb7a8358-8dcb-4294-bd64-73919cfb573a req-5800f4a4-01f1-4bac-a538-c7995286a978 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030973 Oct 13 10:13:15.233422 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4356/8317] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:13:15.540669 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:15.541296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:15.548296 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:15.548822 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:15.549289 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:15.549979 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:15.550480 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:15.550925 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:15.683027 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:15.690795 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-41b5936f-7984-4c4b-bcb6-75cc4f94cfbf tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1373 microversion: 2.1 time: 0.154681 Oct 13 10:13:15.691374 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3962/8318] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:15 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:16.715087 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:16.715920 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:16.722332 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:16.722857 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:16.723303 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:16.724006 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:16.724462 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:16.724884 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:16.862736 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:16.870622 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-84d1f5cc-90ff-4fd4-a357-5e2298d4a627 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1558 microversion: 2.1 time: 0.161176 Oct 13 10:13:16.871195 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4357/8319] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:16 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:16.892270 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:13:16.892890 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:13:16.900187 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:16.900677 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:16.901124 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:16.901821 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:16.902284 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:16.902744 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:17.035166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:13:17.042932 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-4fa74d3e-bb2a-4d3d-b0a6-2987803f5d17 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1558 microversion: 2.1 time: 0.154464 Oct 13 10:13:17.043509 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3963/8320] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:13:16 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:13:18.593872 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:13:18.599814 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=27 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:13:18.606684 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:13:18.607161 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:13:18.607587 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:13:18.611875 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=51 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:13:18.620374 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] Creating event network-changed:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:13:18.625203 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a1593aa2-7830-4ae0-804f-9007d099e11f req-bfa9b103-fd6a-411b-844b-2da098768492 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036373 Oct 13 10:13:18.625796 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4358/8321] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:21.195347 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:21.196190 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=68 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:21.197014 n-d-858384-11 devstack@n-api.service[127031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:15:21.197448 n-d-858384-11 devstack@n-api.service[127031]: Thu Oct 13 10:15:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3/action (ip 10.222.0.23) !!! Oct 13 10:15:21.204626 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1099467555"}} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:21.207090 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:21.217166 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:21.217681 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:21.218139 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:21.219024 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:21.219507 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:21.219955 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:21.427679 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-7b5c32f6-7ab7-4a0c-bfa9-c3c119c76909 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "POST /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3/action" status: 202 len: 0 microversion: 2.1 time: 0.234349 Oct 13 10:15:21.428347 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3964/8322] 10.222.0.23 () {60 vars in 1278 bytes} [Thu Oct 13 10:15:21 2022] POST /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 13 10:15:27.891252 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 10:15:27.892663 n-d-858384-11 devstack@n-api.service[127030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 13 10:15:27.893655 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:27.894443 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=1 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:27.895874 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:15:27.896101 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 10:15:27.897112 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 13 10:15:27.897248 n-d-858384-11 devstack@n-api.service[127030]: Thu Oct 13 10:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 13 10:15:27.904611 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "name": "network-vif-plugged", "status": "completed", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:27.923267 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:27.923758 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:27.924191 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:27.934825 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] Creating event network-vif-plugged:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:15:27.939831 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-5d900fb6-ca6c-49e3-8fa4-689c7e0196cf req-42feaf8f-497e-491e-bf56-986fbebe2c56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050668 Oct 13 10:15:27.940448 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4359/8323] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:39.247552 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_api:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:39.248197 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:39.248639 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:39.249192 n-d-858384-11 devstack@n-api.service[127030]: DEBUG dbcounter [-] [127030] Writing DB stats nova_cell1:SELECT=2 {{(pid=127030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:39.255216 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_api:SELECT=2 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:39.255907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG dbcounter [-] [127031] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 13 10:15:39.258277 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:39.258840 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:39.259479 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:39.260209 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:39.261045 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:39.262159 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:39.265603 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [2f0b9ac7-b326-4c24-b123-29329a7154f4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33178. Oct 13 10:15:39.266086 n-d-858384-11 devstack@n-api.service[127030]: INFO oslo.messaging._drivers.impl_rabbit [-] [babe0e58-f975-415b-9f4a-762b2284c578] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33176. Oct 13 10:15:39.296001 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 10:15:39.322318 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:39.333145 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:39.333737 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:39.334244 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:39.346602 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] Creating event network-changed:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:15:39.351711 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-85b54481-b294-4076-8384-ab1c66b843ab req-5a3c2994-a341-4b8c-b3d2-7bdedf25c684 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106164 Oct 13 10:15:39.352521 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4360/8324] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:39.377804 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e3c7ab21-078f-47f5-a517-79db471ea208 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 204 len: 0 microversion: 2.1 time: 0.134473 Oct 13 10:15:39.378399 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3965/8325] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 10:15:39 2022] DELETE /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 10:15:39.394831 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:39.396082 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:39.403434 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:39.404151 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:39.404660 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:39.405446 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:39.405982 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:39.406764 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:39.546177 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:15:39.554077 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-bdf56bb1-23f7-4261-8fda-cfa77fe20de9 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1682 microversion: 2.1 time: 0.169056 Oct 13 10:15:39.554683 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4361/8326] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:39 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:15:40.578445 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:40.579173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:40.586046 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:40.586582 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:40.587037 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:40.587743 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:40.588213 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:40.588653 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:40.882077 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:15:40.889979 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-ab1536fd-b519-4d57-b301-6e1651cee694 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1682 microversion: 2.1 time: 0.315880 Oct 13 10:15:40.890580 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3966/8327] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:40 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1682 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:15:41.813080 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cc0781-b84c-41ce-a795-22d3abbb28c3", "name": "network-vif-deleted", "tag": "81592bd4-8f92-4991-a8c4-7bd69a64392c"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:41.825555 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:41.826636 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:41.827079 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:41.839167 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] Creating event network-vif-deleted:81592bd4-8f92-4991-a8c4-7bd69a64392c for instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 on n-h2-858384-11 Oct 13 10:15:41.844826 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-6707c899-885e-4545-9150-897a81671d97 req-9ee65f15-53a9-40f1-8b84-439dd9965429 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Oct 13 10:15:41.845425 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4362/8328] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:41.913535 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:41.914305 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:41.921914 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:41.922435 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:41.922907 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:41.923627 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:41.924099 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:41.924549 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:41.959916 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:41.960419 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:41.960878 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:41.961346 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.objects.instance [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lazy-loading 'fault' on Instance uuid 98cc0781-b84c-41ce-a795-22d3abbb28c3 {{(pid=127031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:15:42.009182 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.policy [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127031) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:15:42.017283 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-c2d63902-c22d-44d2-809a-654b4e46b93f tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 200 len: 1337 microversion: 2.1 time: 0.107651 Oct 13 10:15:42.017793 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3967/8329] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:41 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:15:43.041400 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:43.042100 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: 98cc0781-b84c-41ce-a795-22d3abbb28c3] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:43.048314 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:43.048795 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:43.049226 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:43.049918 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:43.050363 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:43.050807 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:43.064256 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.wsgi [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] HTTP exception thrown: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Request method failure captured: Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: request: GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 HTTP/1.1 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Accept: application/json Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Accept-Encoding: identity Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Connection: close Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Content-Length: 0 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Content-Type: application/json Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Host: 10.222.0.23 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: Openstack-System-Scope: None Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: User-Agent: python-urllib3/1.26.12 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Auth-Token: gAAAAABjR-QTz7e8oqWlmiXgETVvrwAvW1xpnwoc4WczdqEv4jHfR21GtRd1_Q0G2pcnSGdu-ElgeHEDYfkqddo7b9GLj7tf0rNZ-KrgYY4tlV2DU3SrKWMHgCobscFyujE0HTmmotBV0NC1g42vj81L_boD3qTib6aBZEqIom0Qnro_EBZu9VI Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Id: None Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Domain-Name: None Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Identity-Status: Confirmed Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Is-Admin-Project: True Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Id: default Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Domain-Name: Default Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Id: 7873145d7630495cbbbed49058e72132 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Project-Name: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Role: member,reader Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Roles: member,reader Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7873145d7630495cbbbed49058e72132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7873145d7630495cbbbed49058e72132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7873145d7630495cbbbed49058e72132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7873145d7630495cbbbed49058e72132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Id: 7873145d7630495cbbbed49058e72132 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-Tenant-Name: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-User: tempest-TestSnapshotPattern-2135668987-project Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Id: default Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-User-Domain-Name: Default Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-User-Id: b641d70f51664d36817dd32c59a30bae Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: X-User-Name: tempest-TestSnapshotPattern-2135668987-project Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: method: > Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: exception: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: action_args: {'id': '98cc0781-b84c-41ce-a795-22d3abbb28c3'} Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:15:43.065865 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: ERROR nova.api.openstack.wsgi Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Returning 404 to user: Instance 98cc0781-b84c-41ce-a795-22d3abbb28c3 could not be found. {{(pid=127030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-88f7449c-fc3d-42cb-833d-2ed163a873ed tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3" status: 404 len: 111 microversion: 2.1 time: 0.031008 Oct 13 10:15:43.069824 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4363/8330] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:43 2022] GET /compute/v2.1/servers/98cc0781-b84c-41ce-a795-22d3abbb28c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 10:15:44.383883 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:44.384643 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:44.385864 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:44.391926 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:44.392696 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:44.393252 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:44.394094 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:44.394960 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:44.395511 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:44.396254 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:44.396894 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:44.397322 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:44.408734 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.compute.server_external_events [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] Creating event network-changed:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:15:44.413875 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [req-a8eae222-5831-4ce6-99a7-bb07ba9eef6d req-a8e6b093-4201-4b08-b16e-409707f6c306 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031618 Oct 13 10:15:44.415037 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4364/8331] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:44.425171 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Going to try to terminate instance {{(pid=127031) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 13 10:15:44.514534 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-e811c4b4-fe60-47ea-a1d7-9de73b643156 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 204 len: 0 microversion: 2.1 time: 0.133035 Oct 13 10:15:44.515813 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3968/8332] 10.222.0.23 () {58 vars in 1239 bytes} [Thu Oct 13 10:15:44 2022] DELETE /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 13 10:15:44.524626 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:44.525797 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:44.533927 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:44.534670 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:44.535261 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:44.536379 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:44.536976 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:44.537544 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:44.725772 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:15:44.734594 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-e3b85f4c-1296-46be-8f01-9aab9dcd7787 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1682 microversion: 2.1 time: 0.214419 Oct 13 10:15:44.735559 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4365/8333] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:44 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:15:45.684530 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6e8a55-4460-4f3a-a7f6-1a04a900658b", "name": "network-vif-deleted", "tag": "ef2c505d-2c85-4c1f-8746-d834a425e71b"}]} {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 13 10:15:45.698934 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:45.699456 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:45.699898 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:45.712267 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.compute.server_external_events [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] Creating event network-vif-deleted:ef2c505d-2c85-4c1f-8746-d834a425e71b for instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b on n-h1-858384-11 Oct 13 10:15:45.717346 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [req-606de4e8-a1c9-4069-91e6-64d603e9c3de req-bf34feee-5a7a-4fd1-87c7-8111c6dee078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093784 Oct 13 10:15:45.717984 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3969/8334] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Oct 13 10:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 13 10:15:45.756960 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:45.757653 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.compute.api [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127030) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:45.764468 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:45.764949 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:45.765386 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:45.766119 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:45.766602 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:45.767026 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:45.798306 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:45.798816 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:45.799248 n-d-858384-11 devstack@n-api.service[127030]: DEBUG oslo_concurrency.lockutils [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:45.799691 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.objects.instance [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lazy-loading 'fault' on Instance uuid fb6e8a55-4460-4f3a-a7f6-1a04a900658b {{(pid=127030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 13 10:15:45.840021 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.policy [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b641d70f51664d36817dd32c59a30bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7873145d7630495cbbbed49058e72132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127030) authorize /opt/stack/nova/nova/policy.py:199}} Oct 13 10:15:45.847646 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-466de63e-1b57-49db-aee5-cc4b5271c305 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 200 len: 1337 microversion: 2.1 time: 0.094552 Oct 13 10:15:45.848222 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4366/8335] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:45 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 1337 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 13 10:15:46.872413 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '>' {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:46.873158 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.compute.api [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] [instance: fb6e8a55-4460-4f3a-a7f6-1a04a900658b] Fetching instance by UUID {{(pid=127031) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 13 10:15:46.880173 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:46.880667 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:46.881121 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:46.881830 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Acquiring lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 13 10:15:46.882302 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 13 10:15:46.882768 n-d-858384-11 devstack@n-api.service[127031]: DEBUG oslo_concurrency.lockutils [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Lock "da9ed4ed-f649-4a64-9171-7dcc9de0d307" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 13 10:15:46.896504 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.wsgi [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] HTTP exception thrown: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Request method failure captured: Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: request: GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b HTTP/1.1 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Accept: application/json Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Accept-Encoding: identity Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Connection: close Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Content-Length: 0 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Content-Type: application/json Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Host: 10.222.0.23 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: Openstack-System-Scope: None Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: User-Agent: python-urllib3/1.26.12 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Auth-Token: gAAAAABjR-QTz7e8oqWlmiXgETVvrwAvW1xpnwoc4WczdqEv4jHfR21GtRd1_Q0G2pcnSGdu-ElgeHEDYfkqddo7b9GLj7tf0rNZ-KrgYY4tlV2DU3SrKWMHgCobscFyujE0HTmmotBV0NC1g42vj81L_boD3qTib6aBZEqIom0Qnro_EBZu9VI Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Id: None Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Domain-Name: None Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Identity-Status: Confirmed Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Is-Admin-Project: True Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Id: default Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Domain-Name: Default Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Id: 7873145d7630495cbbbed49058e72132 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Project-Name: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Role: member,reader Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Roles: member,reader Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7873145d7630495cbbbed49058e72132"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7873145d7630495cbbbed49058e72132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7873145d7630495cbbbed49058e72132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7873145d7630495cbbbed49058e72132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Id: 7873145d7630495cbbbed49058e72132 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-Tenant-Name: tempest-TestSnapshotPattern-2135668987 Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-User: tempest-TestSnapshotPattern-2135668987-project Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Id: default Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-User-Domain-Name: Default Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-User-Id: b641d70f51664d36817dd32c59a30bae Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: X-User-Name: tempest-TestSnapshotPattern-2135668987-project Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: method: > Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: exception: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: action_args: {'id': 'fb6e8a55-4460-4f3a-a7f6-1a04a900658b'} Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: {{(pid=127031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 13 10:15:46.898154 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: ERROR nova.api.openstack.wsgi Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: DEBUG nova.api.openstack.wsgi [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Returning 404 to user: Instance fb6e8a55-4460-4f3a-a7f6-1a04a900658b could not be found. {{(pid=127031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: INFO nova.api.openstack.requestlog [None req-23cb4694-8afd-4080-95a7-efdac8cb4a78 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b" status: 404 len: 111 microversion: 2.1 time: 0.031947 Oct 13 10:15:46.902006 n-d-858384-11 devstack@n-api.service[127031]: [pid: 127031|app: 0|req: 3970/8336] 10.222.0.23 () {58 vars in 1236 bytes} [Thu Oct 13 10:15:46 2022] GET /compute/v2.1/servers/fb6e8a55-4460-4f3a-a7f6-1a04a900658b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 13 10:15:47.054003 n-d-858384-11 devstack@n-api.service[127030]: DEBUG nova.api.openstack.wsgi [None req-f7574a82-50fa-4ed4-acc9-031f18273226 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] Calling method '.version_select at 0x7f53753ba5e0>' {{(pid=127030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 13 10:15:47.079056 n-d-858384-11 devstack@n-api.service[127030]: INFO nova.api.openstack.requestlog [None req-f7574a82-50fa-4ed4-acc9-031f18273226 tempest-TestSnapshotPattern-2135668987 tempest-TestSnapshotPattern-2135668987-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-15031804" status: 202 len: 0 microversion: 2.1 time: 0.028909 Oct 13 10:15:47.079647 n-d-858384-11 devstack@n-api.service[127030]: [pid: 127030|app: 0|req: 4367/8337] 10.222.0.23 () {58 vars in 1251 bytes} [Thu Oct 13 10:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-15031804 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)